KR20230100558A - The method of providing a moving image to guide exercise and the apparatus comprising thereof - Google Patents

Abstract

Disclosed is a method and apparatus for providing an exercise guide video. The present exercise guide video providing method includes the steps of recognizing a user's posture while an exercise guide video including repetitive motions is displayed, comparing the user's posture with a reference posture corresponding to the user's posture while included in the exercise guide video, and If the similarity between the user's posture and the reference posture for a predetermined time is less than the reference value, display of the exercise guide video is terminated.

Description

The method of providing a moving image to guide exercise and the apparatus comprising thereof}

The present disclosure relates to a method and apparatus for providing an exercise guide video.

Recently, as work-life balance, which represents a balance between work and personal life, has been attracting attention, consumption for one's own life, such as exercising after work, on weekends, or in spare time, is increasing. Users' desire to manage their health as part of work-life balance is increasing, and in order to improve the quality of life with a little time investment, various exercises such as swimming, fitness, PT (Personal Training), golf, and Pilates are provided. users are increasing.

As the number of users who exercise increases, the desire to exercise in a correct posture also increases, and accordingly, videos providing exercise guides are provided. The exercise guide image is an image in which an instructor or trainer performs an aerobic motion, a yoga motion, or a fitness exercise motion, and the user can exercise by following the instructor's motion demonstrated in the exercise guide video.

However, existing exercise guide images only guide exercise in units of time and do not selectively guide for each user.

The present disclosure provides a method and apparatus for providing an exercise guide video for each level of a user.

The present disclosure provides a method and apparatus for providing an exercise guide video based on reverse playback.

The present disclosure provides a method and apparatus for providing an exercise guide video based on a user's motion.

A method for providing an exercise guide video according to an aspect of the present invention, comprising: displaying an exercise guide video including a repetitive motion; Recognizing a user's posture while the exercise guide video is displayed; comparing the posture of the user with a reference posture corresponding to the posture of the user included in the exercise guide video; and terminating the display of the exercise guide video when the similarity between the posture of the user and the reference posture for a predetermined time is less than a reference value.

In addition, the predetermined time may be longer than a time corresponding to one set motion included in the exercise guide video.

The method may further include displaying the exercise guide video corresponding to the user's exercise speed when the similarity between the user's posture and the reference posture is greater than or equal to the reference value.

In the step of displaying the exercise guide video, if it is determined that the user's posture is ahead of the reference posture displayed in the exercise guide video by a reference section, the displayed reference posture corresponds to the user's posture. Increasing the playback speed of the video; may include.

In addition, in the displaying of the exercise guide video, if it is determined that the user's posture lags behind the reference posture displayed in the exercise guide video by a standard interval, the displayed reference posture corresponds to the user's posture. It may include; reducing the playback speed of the video.

In the step of displaying the exercise guide video, if it is determined that the user's posture lags behind the reference posture displayed in the exercise guide video by a standard interval, the exercise guide video is displayed until the displayed reference posture corresponds to the user's posture. It may include; pausing playback of the guide video.

Also, the reference section may be more than a section corresponding to a subset motion in the exercise guide video.

And, if the similarity between the posture of the user and the reference posture for more than the predetermined time is equal to or greater than the reference value, changing a body shape of a character representing the user corresponding to the similarity; and displaying the changed body shape of the character.

The method may further include generating the exercise guide video including two or more set motions based on reverse reproduction of a section of an original video including one set motion.

Meanwhile, an electronic device according to an embodiment includes a display displaying an exercise guide video including a repetitive motion; a motion sensor for recognizing a user's posture; and comparing the posture of the user with a reference posture corresponding to the posture of the user included in the exercise guide video, and displaying the exercise guide video when a similarity between the posture of the user and the reference posture for a predetermined time is less than a reference value. quit

And, it is disposed on the display and can reflect light corresponding to the posture of the user while displaying the exercise guide video. The predetermined time may be longer than a time corresponding to one set motion included in the exercise guide video.

In addition, the processor may display the exercise guide video corresponding to the user's exercise speed when the similarity between the user's posture and the reference posture is greater than or equal to the reference value.

Further, if the processor determines that the user's posture is ahead of the reference posture displayed in the exercise guide video by a reference section, the processor increases the playback speed of the exercise guide video so that the displayed reference posture corresponds to the user's posture. can make it

In addition, if it is determined that the user's posture lags behind the reference posture displayed in the exercise guide video by a standard interval, the processor reduces the playing speed of the exercise guide video so that the displayed reference posture corresponds to the user's posture. can make it

Further, if the processor determines that the user's posture lags behind the reference posture displayed in the exercise guide video by a standard interval, the processor temporarily reproduces the exercise guide video until the displayed reference posture corresponds to the user's posture. can stop

Also, the reference section may be more than a section corresponding to a subset motion in the exercise guide video.

The processor changes the body shape of a character representing the user in response to the similarity when the similarity between the posture of the user and the reference posture for the predetermined time or more is equal to or greater than the reference value, and the changed body shape of the character is set to the can be shown on the display.

In the exercise guide video according to an embodiment, the number of set motions may be adjusted.

In the exercise guide video according to an embodiment, set motions, which are repetitive motions, are provided without interruption in the video, so that the user's sense of immersion in the exercise can be enhanced.

An exercise guide video according to an embodiment is controlled by a user's exercise speed, and thus may be provided to the user more usefully.

1 is a diagram schematically illustrating an exercise equipment management system according to an embodiment.
2 is a block diagram illustrating a management server according to an exemplary embodiment.
3 is a block diagram illustrating an exercise device according to an exemplary embodiment.
4 is a block diagram illustrating a mirror display according to an exemplary embodiment.
5 is a flowchart illustrating a method of providing an exercise guide video according to an exemplary embodiment.
6 is a diagram illustrating an original video composed of one set motion according to an exemplary embodiment.
7 is a reference diagram illustrating a method of generating an exercise guide video including a plurality of set motions according to an exemplary embodiment.
8 is a reference diagram for explaining a method of generating an exercise guide video including a plurality of set motions according to another embodiment.
9 is a reference diagram for explaining a method of providing a video including a plurality of set motions as a comparative example.
10 is a diagram illustrating an original video including a plurality of set motions according to an exemplary embodiment.
11 is a reference diagram for explaining a method of providing an exercise guide video using one set section among a plurality of set sections according to an embodiment.
12 is a reference diagram for explaining a method of providing an exercise guide video using a plurality of set sections according to an embodiment.
13 is a diagram illustrating an original video including different type set operations according to an exemplary embodiment.
14 is a reference diagram explaining a method of generating an exercise guide image including repetitive exercise according to an exemplary embodiment.
15 is a reference diagram explaining a method of generating an exercise guide image including repetitive motion according to another embodiment.
16 is a flowchart illustrating a method of providing an exercise guide video based on a user's motion, according to an exemplary embodiment.
17 is a reference view illustrating a method of providing an exercise guide video when a user's posture precedes a reference posture, according to an exemplary embodiment.
18 is a reference view illustrating a method of providing an exercise guide video when a user's posture lags behind a reference posture, according to an exemplary embodiment.
19 is a reference view illustrating a method of providing an exercise guide video when a user's posture lags behind a reference posture according to another embodiment.
20 is a reference diagram illustrating a method of displaying a character indicating a user according to an exemplary embodiment.
21 is a reference diagram for explaining a method of expressing an exercise effect with a character according to an exemplary embodiment.

The terms used in the present invention have been selected from general terms that are currently widely used as much as possible while considering the functions in the present invention, but these may vary depending on the intention of a person skilled in the art or precedent, the emergence of new technologies, and the like. In addition, in a specific case, there is also a term arbitrarily selected by the applicant, and in this case, the meaning will be described in detail in the description of the invention. Therefore, the term used in the present invention should be defined based on the meaning of the term and the overall content of the present invention, not simply the name of the term.

Terms such as first and second may be used to describe various components, but the components should not be limited by the terms. Terms are used only to distinguish one component from another.

1 is a diagram schematically illustrating an exercise equipment management system 1 according to an embodiment. Referring to FIG. 1 , a system 1 may include a management server 10, an exercise device 20, a mirror display 30, a user terminal 40, and a manager terminal 50 connected through a network. In addition, the system 1 may further include a payment server and a content server associated with the management server 10 .

Networks include a Local Area Network (LAN), a Wide Area Network (WAN), a Value Added Network (VAN), a Personal Area Network (PAN), and a mobile radio communication network) or various types of wired and wireless networks such as satellite communication networks.

The management server 10 is connected to the exercise equipment 20, the mirror display 30, the user terminal 40, and the manager terminal 50 through a network to enable transmission and reception of data, and requests from the manager terminal 50. Stores the user's exercise schedule, exercise item list, etc. according to, and stores the user's exercise results from information received from the user terminal 40 or the exercise device 20, and the manager terminal 50 or the user terminal 40 ), the above-described exercise result may be provided to the manager terminal 50 or the user terminal 40 according to a request.

In addition, the management server 10 controls the exercise device 20 in the health center according to the request of the user terminal 40, or uses the exercise result received from the exercise device 20 to determine the exercise history and exercise result. It is also possible to generate corresponding calorie information and the like.

The management server 10 may be an operating server of an Internet site. The management server 10 operates a dedicated app and/or web program connected to the exercise device 20, the mirror display 30, the user terminal 40 and the manager terminal 50, etc. support functions can be performed. In addition, the management server 10 has a function of supporting an interface necessary to build an application such as an application programming interface (API) on a web/app so that an application for implementing a content platform of a digital information display can run. can also be done

The exercise device 20 may include an exercise body that is implemented as a weight training machine or a treadmill and moves according to a user's motion. Also, the exercise device 20 may provide an exercise guide to the user under the control of the management server 10 and may transmit the user's exercise result to the management server 10 . The exercise device 20 may be set in various modes under the user's manipulation or the control of the management server 10 .

The user terminal 40 is a terminal registered in the management server 10 to receive exercise management service, and accesses the management server 10, the access terminal 20, and the exercise device 20 through a wired or wireless network to provide data data. It is a terminal capable of transmitting and receiving. The user terminal 40 includes a smart phone, PC, tablet PC, laptop, smart TV, mobile phone, personal digital assistant (PDA), laptop, media player, global positioning system (GPS) device, e-book reader, digital broadcasting terminal, and navigation device. , digital cameras, wearable devices and other mobile and non-mobile computing devices and smart bands, but the present invention is not limited thereto. Here, the user terminal 40 may mean not only a terminal owned by a user receiving an exercise management service, but also an arbitrary terminal through which a registered user can log in by accessing the management server 10 .

The manager terminal 50 is a terminal registered in the management server 10 to provide exercise management services, and is a terminal capable of transmitting and receiving data by accessing the management server 10 through a wired or wireless network. The manager terminal 50 includes a smart phone, PC, tablet PC, laptop, smart TV, mobile phone, personal digital assistant (PDA), laptop, media player, global positioning system (GPS) device, e-book reader, digital broadcasting terminal, and navigation device. , digital cameras, wearable devices and other mobile or non-mobile computing devices, but the present invention is not limited thereto. Here, the administrator terminal 50 may mean a terminal owned by a person registered as an administrator in the management server 10, as well as an arbitrary terminal through which a registered administrator can log in by accessing the management server 10. .

2 is a block diagram illustrating a management server 10 according to an exemplary embodiment. Referring to FIG. 2 , the management server 10 connects external terminals such as an access terminal 20, an exercise device 20, a mirror display 30, a user terminal 40, a manager terminal 50, etc. to a network. The first communication unit 110 that communicates through, the user's exercise program, the user's exercise history, a list of health centers, a database 120 storing information on the mode of the exercise device 20, and the management server 10 A first processor ( 150) may be included. The first processor 150 may generate a user's exercise program, manage the usage status of the center, and set the mode of the exercise device 20 according to the request of the manager terminal 50 .

Although not shown in the drawing, the access terminal 20, the manager terminal 50, and the user terminal 40 may also include a communication unit, a storage unit, a user interface, and a processor.

3 is a block diagram illustrating an exercise machine 20 according to an exemplary embodiment. The exercise device 20 according to an embodiment may be an aerobic exercise device or an anaerobic exercise device. For example, the exercise device 20 may be an aerobic exercise device such as a treadmill, a bicycle, an elliptical, a stair exercise machine, or a chest. Anaerobic exercise equipment such as press, shoulder press, arm curl lat pull down peck deck fly, city draw, low pull chining dipping, leg curl, leg extension, leg press, inner space, outer space, total hip, torso back extension, updominal, etc. can

The exercise device 20 includes an exercise body 210, a sensor 220, a second communication unit 240, a first memory 250, a second user interface 260, a second output unit 270, and a second processor. (280).

The exercise body 210 is a physical exercise device that moves according to the user's motion. The exercise body 210 according to one example may add, decrease, or maintain a load according to a set exercise level. The exercise body 210 may vary according to the type of exercise device 20 .

The sensor 220 may detect movement of components included in the exercise body 210 and transmit the result to the second processor 280 . The sensor 220 may include a laser sensor 220, a motion sensor, a gyro sensor, and the like.

The second communication unit 240 may communicate with external devices such as the management server 10, the access terminal 20, other exercise devices 20, the user terminal 40, and the manager terminal 50. The second communication unit 240 includes the management server 10 and a local area network (LAN), a wide area network (WAN), a value added network (VAN), and a personal local area wireless communication (Personal Area Network). Network; PAN), mobile communication network (mobile radio communication network) or satellite communication network, etc. can communicate through various types of wired and wireless networks. And, the second communication unit 240 communicates with the access terminal 20, the user terminal 40, and the manager terminal 50 through a local area network (LAN), personal area network (PAN), and the like. It can communicate over a local area network. Thus, it is possible to prevent the exercise device 20 from being controlled by an external device other than the management server 10 . However, it is not limited thereto. In some cases, the second communication unit 240 may perform remote communication with the manager terminal 50 .

The first memory 250 may store various information used by at least one component (eg, the second processor 280 or the sensor 220) included in the exercise device 20 . The above information may include, for example, software (eg, a program) and input data or output data for commands related thereto. The first memory 250 may include a volatile first memory 250 or a non-volatile first memory 250 . As an example, the first memory 250 may include an adjustment motion range or a threshold motion range determined in advance according to user information.

The second user interface 250 may receive a command or data to be used for the exercise device 20 from an outside of the exercise device 20 (eg, a user). The second user interface 250 may include, for example, a microphone, a mouse, a keyboard, an electronic tag, or a digital pen (eg, a stylus pen). As an example, the user may input user information through the second user interface 250 . For example, the user information may include one or more of the user's name, age, gender, height, weight, and sports history.

The second output unit 270 may provide output information. Output information according to an example may be user information, user exercise information, or information for guiding a user's exercise. As an example, the second output unit 270 may include a display for displaying output information. Also, the second output unit 270 may be physically or electrically connected to the exercise body 210 . For example, the display may be installed on the frame structure of the athletic body 210 . However, the present disclosure is not limited thereto, and the display 60, including the second communication unit 230, may be connected to receive a predetermined signal from the exercise body 210 even though it is arranged to be spaced apart from the exercise body 210.

The second processor 280 may control the overall exercise device 20 and control the second communication unit 240 to communicate with external devices. The second processor 280 may, for example, execute software (eg, a program) to control at least one other component (eg, hardware or software component) connected to the second processor 280, It can perform various data processing or calculations. According to an embodiment, as at least part of data processing or calculation, the second processor 280 transfers commands or data received from other components (eg, the sensor 220 or the second communication unit 230) to the first memory. In operation 250 , a command or data stored in the volatile memory 250 may be loaded, a command or data stored in the volatile memory may be processed, and result data may be stored in a non-volatile memory of the first memory 250 .

4 is a block diagram illustrating a mirror display 30 according to an exemplary embodiment. The mirror display 30 is a device capable of providing one or more of a mirror function and a display function according to a user's needs. A film (not shown) having a polarization function is further provided on the display to reflect specific light (eg, light corresponding to the user's posture) and to reflect specific light (eg, an image output from the display). Light corresponding to) can be understood to encompass known devices capable of performing the roles of a display and a mirror at the same time by transmitting.

The mirror display 30 may include a third communication unit 310, a second memory 320, a third user interface 330, a display 340, a mirror 350, and a third processor 360.

The third communication unit 310 may communicate with external devices such as the management server 10 , the user terminal 40 , and the manager terminal 50 . The third communication unit 310 includes the management server 10 and a local area network (LAN), a wide area network (WAN), a value added network (VAN), and a personal local area wireless communication (Personal Area Network). Network; PAN), mobile communication network (mobile radio communication network) or satellite communication network, etc. can communicate through various types of wired and wireless networks. In addition, the third communication unit 310 may communicate with the user terminal 40 and the manager terminal 50 through a local area network such as a local area network (LAN) or a personal area network (PAN). there is. Thus, the mirror display 30 can be prevented from being controlled by an external device other than the management server 10 . However, it is not limited thereto. In some cases, the third communication unit 310 may perform remote communication with the manager terminal 50 .

A variety of information used by at least one component (eg, the third processor 360) included in the mirror display 30 may be stored in the second memory 320 . The above information may include, for example, software (eg, a program) and input data or output data for commands related thereto. The second memory 320 may include a volatile second memory 320 or a non-volatile second memory 320 . As an example, the second memory 320 may pre-store an original video that may be used to generate an exercise guide video.

The third user interface 250 may receive various user commands. As an example, the third user interface may receive a user command for playing an exercise guide video displayed on the mirror display 30 . The user may input an exercise event and number of sets to play the exercise guide video through the third user interface.

The display may display an exercise guide video under the control of the third processor 360 . The display may be implemented as a liquid crystal display (LCD), organic light emitting diodes (OLED), or the like, and may further include a touch screen to function as a third user interface.

Also, the mirror 350 may be disposed on at least a portion of the front surface of the display. The mirror 350 may include a film that reflects light incident from the outside and transmits light incident from the display, for example, a polarizing film.

The third processor 360 generally controls the mirror display 30 and may control the third communication unit 310 to communicate with external devices. The third processor 360 may, for example, execute software (eg, a program) to control at least one other component (eg, hardware or software component) connected to the third processor 360, It can perform various data processing or calculations. According to an embodiment, as at least part of data processing or operation, the third processor 360 transfers commands or data received from other components (eg, the third communication unit 230 or the third user interface) to the second memory. In operation 320, the second volatile memory may be loaded, the command or data stored in the volatile second memory may be processed, and the resulting data may be stored in a non-volatile second memory among the second memories. For example, the third processor 360 may store an original video including one set motion received from a server or the like in the second memory.

The original video may be divided into a plurality of sections. Specifically, the original video may be divided into a preparation section (R) indicating a preparatory motion, a finishing section (E) indicating a finishing motion, and a set section (S) that may be a repetitive motion. For example, if the original video is a video that includes a squat exercise, which is an example of a set motion, the original video has a preparation section (R) representing an action to prepare for the squat exercise, and a finishing section (E) representing an action to finish the squat exercise. ), and a set period (S) in which the squat motion can be repeated, that is, a set period (S) representing a sitting-and-rising motion.

The set section S may be divided into two sub-sections based on an inflection point, for example, a point at which the direction of motion is switched. When the set section (S) is a section representing a squat motion, the set section (S) may be divided into a first section indicating a sitting motion and a second section indicating a rising motion based on a sitting point of the squat motion. there is. When the first section representing the sitting motion is referred to as the forward section (F), the action that occurs is the backward movement of the sitting motion, and the second section representing the occurring action is the reverse section (B). Can be called.

The third processor 360 may receive and store the original video divided into a plurality of sections from an external source, for example, a server. However, it is not limited thereto. The third processor 360 may divide and store the received original video into a plurality of sections as described above. Alternatively, after storing the original video, the third processor 360 may generate an exercise guide video after dividing the original video into a plurality of sections when a request to reproduce the exercise guide video is received by a user command or the like.

The mirror display 30 may further include a detection sensor. A motion detection sensor is a device for acquiring a user's motion, and may include a vision camera, a vision sensor, an acceleration sensor, a gyro sensor, a geomagnetic sensor, an infrared sensor, and the like.

The motion detection sensor 370 may extract a region corresponding to a user's joint from the detected data and obtain coordinate data, velocity data, and the like of the corresponding joint.

In FIG. 4 , the motion detection sensor is described as one component of the mirror display, but is not limited thereto. A motion detection sensor may be a separate device. Alternatively, a camera of a user terminal may perform a function of a motion detection sensor.

5 is a flowchart illustrating a method of providing an exercise guide video according to an exemplary embodiment.

The third processor 360 may receive a play command of the exercise guide video including the number of times for the set motion from the third communication unit 310 or the third user interface 330 (S410). When the user enters within a certain distance from the mirror display 30, the mirror display 30 can change from a standby mode to an operating mode. In addition, the mirror display 30 may request an exercise item to be played on a user terminal carried by the user. The user terminal may request playback of an exercise guide image for a corresponding exercise event by transmitting the pre-stored exercise event and the number of set motions of the above-described exercise event to the mirror display 30 . Alternatively, the user may input a play command of the exercise guide video by inputting the number of times for an exercise event and a set motion through the user interface of the mirror display 30 .

The third processor 360 may generate an exercise guide video including set motions corresponding to the number of times based on reverse reproduction of a partial section of the original video (S420). The third processor 360 may generate a video corresponding to the set motion by reproducing and reverse-playing a partial section of the original video. The number of set operations included in the generated video may increase as the number of steps of reproducing and replaying a partial section increases. A detailed method of generating an exercise guide video will be described later.

The third processor 360 may display the generated exercise guide video on the display 340 (S430). The third processor 360 may display the exercise guide video on the display after completion, or may display the exercise guide video on the display at the same time as the exercise guide video is created. Generating and displaying an exercise guide video may be referred to as playing the exercise guide video.

6 is a diagram illustrating an original video composed of one set motion according to an exemplary embodiment. Referring to FIG. 6 , the original video 50 may be divided into a plurality of different sections. The original video 50 may be divided into a preparation section (R) indicating a preparation motion, a finishing section (E) indicating a finishing motion, and a set section (S) that may be a repetitive motion.

The set section (S) may be divided into a forward section (F) and a reverse section (B) based on an inflection point of the operation, that is, a point at which the direction of the operation is switched. For example, during a squat exercise, the set interval (S) representing the motion of sitting and rising is the forward interval (F) representing the motion of sitting down from the starting point of the set interval (S) to the sitting point, and the set interval (S) from the sitting point. It can be divided into a reverse section (B) representing the operation that occurs up to the end point of . The motion included in the forward section F may be opposite to the motion included in the backward section B. For example, the motion included in the forward video may be a sitting motion, whereas the motion included in the forward motion video may be a rising motion.

The time during which the forward section F is reproduced and the time during which the backward section B is reproduced may be the same, but is not limited thereto. For example, the reproduction time of the forward section F and the reproduction time of the backward section B may be within an error range of 10%.

A pose in the video at the start point of the set section (S) and a pose in the video at the end point of the set section (S) may be the same. However, it is not limited thereto. For example, the pose at the start point of the set section S and the pose at the end point of the set section S may be within an error range of 10%.

The original video 50 may be pre-stored in the second memory 320 of the mirror display 30 .

The third processor 360 may generate an exercise guide video 50a including a plurality of repeated motions, ie, a plurality of set motions, by using the original video 50 of one set motion of FIG. 5 .

7 is a reference diagram for explaining a method of generating an exercise guide video 50 including a plurality of set motions according to an exemplary embodiment.

When receiving a command to play an exercise guide video including n number of set motions from the third user interface 330 or an external device, the third processor 360 stores the original video 50 corresponding to the exercise guide video in the second memory. It can be read at (320). The third processor 360 receives the original video 50 from an external device, for example, the management server 10 or the user terminal 30, temporarily stores it in the second memory 320, and then stores the original video 50 ) can be used.

As described in FIG. 6, the original video 50 may include a plurality of sections R, F, B, and E, and the plurality of sections R, F, B, and E may be distinguished by markers or the like. . However, it is not limited thereto. If the original video 50 is not divided into a plurality of sections (R, F, B, E), the third processor 360 may divide the original video 50 into a plurality of sections using markers, etc., as described in FIG. 6 . .

The third processor 360 may generate an exercise guide image 50a including n sets of motions based on reverse playback of a partial section of the original video.

As shown in FIG. 7 , the third processor 360 may reproduce the preparation section R of the original video 50 .

When reproducing the set section S, the third processor 360 may reverse reproduce some sections of the set section S. Specifically, since the forward section F includes a sitting motion, it may include an action that occurs when the forward section F is reproduced in reverse. Thus, the third processor 360 reproduces the forward section (F) and reversely reproduces the forward section (F) at the inflection point (P ₂ ) to generate a first set section (S ₁ ) of sitting down and getting up. When the third processor 360 performs n-1 times of reverse reproduction of the forward section F after reproducing the forward section F, n-1 set sections (SE ₁ , SE ₂ ,??) are generated. can create

Further, the third processor 360 may generate an n-th set section SEn by sequentially reproducing the forward section F and the backward section B. Finally, the third processor 360 may complete creation of the exercise guide video 50a by reproducing the finishing section E.

8 is a reference diagram for explaining a method of generating an exercise guide video including a plurality of set motions according to another embodiment.

Upon receiving a request for playback of an exercise guide video including n number of set motions from the third user interface 330 or an external device, the third processor 360 performs reverse playback of some sections of the original video 50 An exercise guide image including n sets of motions may be generated.

As shown in FIG. 8 , the third processor 360 may reproduce a preparation section R of the original video 50 .

The third processor 360 may generate the first set interval SE ₁ by reproducing the forward interval F and the backward interval B.

Also, the third processor 360 may generate the second set section SE ₂ by reproducing the reverse section B after reproducing the reverse section B. For example, if the reverse section B is a video including an action that occurs, the video including a sitting motion may be reproduced by replaying the reverse section B in reverse. The third processor 360 reproduces the reverse section B and then reproduces the reverse section B n-1 times, thereby generating the set section SE ₂ ,??, SE _n n-1 times. can create

The third processor 360 may play the finishing section E to complete generation 50b of the exercise guide video.

As described above, it is possible to generate exercise guide videos 50a and 50b including a plurality of set motions based on reverse playback of some sections of the original video 50 including one set motion, so that the video is cut off. You can create an exercise guide video without this. Since the original video representing one set motion is used, even if the set motion is repeated, it is possible to provide a video in which the motion is not disturbed. If an exercise guide video including a plurality of set motions is acquired by filming, a person who repeats the set motions, for example, a trainer, may deform the trainer's posture as the set motions are repeated. However, since the number of set operations is increased by repeating playback and reverse playback of a portion of the original video, it is possible to fundamentally prevent motion from being disturbed.

In addition, since there is no need to produce and store the original video for each number of set operations, the production cost of the original video can be reduced and the storage capacity of the original video can be reduced.

Meanwhile, multiple sets of motions may be implemented by repeatedly reproducing a set section of the original video 50 representing one set motion.

9 is a reference diagram for explaining a method of providing a video including a plurality of set motions as a comparative example.

Referring to FIG. 9 , the third processor 360 may play a set section SE ₁ after reproducing a preparation section R of the original video 50 . The third processor 360 may replay the set section S repeatedly n times. That is, when the third processor 360 repeatedly reproduces the set period (S=SE ₁ ) and reaches the end point (P ₃ ) of the set period (S=SE ₁ ), the start point (P ) of the set period (S) ₁ ) to play the set section (S=SE ₂ ) again.

Repeat play is played by moving from the end point (P ₃ ) of the set section (S) to the time point (P ₁ ) of the set section (S), and even for a short period of time, video interruption may occur. And, if the pose in the video at the end point (P ₃ ) of the set section (S) and the pose in the video at the start point (P ₁ ) of the set section (S) do not match, the discontinuity of the image may be further weighted. .

The original video 50 is generally an image obtained by photographing a person's motion process, and the pose at the end point (P ₃ ) of the set section (S) and the start point (P ₁ ) of the set section (S). The poses may not match completely. Thus, it is expected that it is inevitable that a disconnection phenomenon will occur in the exercise guide video 50C generated in repeated playback. Such a disconnection phenomenon may deteriorate the user's sense of immersion in exercise.

On the other hand, according to an embodiment, when exercise guide videos 50a and 50b including a plurality of set motions are generated using inverse reproduction of some sections of the original video 50, the starting point of the set motion and the set motion As the end point of the operation is the same, there is no disconnection of the video. Thus, the user can improve the sense of immersion in the exercise while watching the image.

The original video 50 of FIG. 6 is an original video composed of one set of motions. However, it is not limited thereto. The original video may be a video including more than two sets of motions. In general, repetitive exercises may include multiple set movements. Thus, the original video may be composed of a set motion of a basic number, and the third processor 360 may generate an exercise guide video including a set motion exceeding the basic number based on reverse reproduction of a partial section of the original video. can

10 is a diagram illustrating an original video 60 including a plurality of set motions according to an exemplary embodiment. As shown in FIG. 10 , the original video 60 may include a set motion of which the basic number is two times. For example, the set section (S) of the original video 60 may include a first set section (S ₁ ) and a second set section (S ₂ ) including the same type of set motion.

In the case of generating an exercise guide video including set motions exceeding the basic number of times, the third processor 360 may increase the number of set motions by repeating reproduction and reverse reproduction of some sections of the set section S. there is.

11 is a reference diagram for explaining a method of providing an exercise guide video using one set section among a plurality of set sections according to an embodiment.

As shown in FIG. 11 , for example, the third processor 360 reproduces and reverses the forward section (F ₁ ) of the first set section (S ₁ ) among the set section (S), so that the first set section ( SE ₁ ) can be created. The third processor 360 generates n-2 set intervals by performing steps of reproducing and reverse-reproducing the forward interval F ₁ of the first set interval S ₁ among the set intervals S, n-2 times. can do.

And, the third processor 360 reproduces the first set section S1 and the second set section S2 of the original video 60 to obtain the n-1th set section SEn-1 and the n-th set section SEn- ₁ . A set section (SE _N ) may be generated.

In FIG. 11 , the set interval is increased by reproducing and reverse reproducing the forward interval F ₁ of the first set interval S ₁ , but is not limited thereto. The set period can be increased by reproducing and reverse-playing the reverse period B ₁ of the first set period S ₁ . Alternatively, the number of set operations may be increased by using reproduction and reverse reproduction of the forward section (F ₂ ) or backward section (B ₂ ) of the second set section (S ₂ ).

Alternatively, the third processor 360 may increase the set operation by reproducing and replaying a part of the first set period S and a part of the second set period S.

12 is a reference diagram for explaining a method of providing an exercise guide video 60b using a plurality of set sections according to an embodiment. The third processor 360 may increase the set intervals by reproducing and inversely reproducing a partial interval of the first set interval S ₁ and a partial interval of the second set interval S ₂ .

As shown in FIG. 12 , the third processor 360 reproduces the forward section F ₁ and the backward section B ₁ of the first set section S ₁ of the original video 60 so that the first set section ( SE ₁ ) can be created.

The third processor 360 generates the second set interval (SE ₂ ) by reproducing and backward reproducing the forward interval (F ₂ ) of the second set interval (S ₂ ), and the processor 360 generates the first set interval (S 2 ). ₁ ), the third set section SE ₃ may be generated by reproducing and reproducing the reverse section B ₁ . The processor repeats reproduction and reverse reproduction of the forward section F ₂ of the second set section S ₂ and reverse reproduction and reproduction of the reverse section B ₁ of the first set section S ₁ , thereby performing the fourth set section. It is possible to generate the n-1th set section in .

The third processor 360 may generate the nth set interval SE _n by sequentially reproducing the forward interval F ₂ and backward interval B ₂ of the second set interval S ₂ .

Since the exercise guide videos 60a and 60b are created using the original video 60 including the set motions of the basic number of times, the number of reverse playbacks or reverse playback sections can be diversified.

The original video contains one kind of set action. However, it is not limited thereto. An original video may include a plurality of different type set operations. For example, the original video may include a first-type set motion capable of repetitive motion in the right direction and a second-type set motion capable of repetitive motion in the left direction. The third processor 360 may provide an exercise guide image by using reverse playback of a partial section of the original video.

13 is a diagram illustrating an original video 70 including different type set operations according to an exemplary embodiment. Referring to FIG. 13 , an original video 70 may be divided into a plurality of sections R, S, and E. The original video 70 can be divided into a preparation section (R) representing a preparatory motion, a finishing section (E) indicating a finishing motion, and a set section (S) that can be a repetitive motion.

The set section (S) can be divided into a plurality of set sections (AS, BS) based on the point where the type of repetitive exercise is changed. For example, the set section (S) may be divided into a first type set section (AS) and a second type set section (BS) at a point where the type of repetitive exercise is changed (P ₁₃ =P ₂₁ ). For example, the lunge exercise can be divided into a right lunge exercise with the right leg behind, that is, the first type set interval (AS) and a left lunge exercise with the left leg behind, that is, the second type set interval (BS).

Each set section (AS, BS) may be divided into a forward section (AF, BF) and a reverse section (AB, BB) based on a point where the direction of operation is switched. For example, each of the right lunge movement and the left lunge movement may be divided into a forward section representing a sitting down motion and a backward section representing a rising motion.

For example, the set section (S) of the lunge exercise is the right side at the starting point (P ₁ ) of the set motion. The forward section (AF) of the first type set section (AS) representing the motion up to the point where the upper body is lowered (P ₁₂ ) at 90 degrees, the right side? At the point where it becomes 90 degrees and the upper body is lowered (P ₁₂ ), what does it do? The reverse section (AB) of the first type set section (AS) representing the motion up to the point where the upper body is raised after being stretched (P _{13 =} P ₂₁ ), the amount? What is left at the point where the upper body is raised (P ₁₃₌ P ₂₁ ) The forward section ( _BF ) of the second type set section (BS) and the left mu? What happens at the point where the upper body is lowered to 90 degrees (P ₂₂ )? It can be divided into a reverse section (BB) of the second type set section (BS) representing an operation up to the point where the upper body is raised after being opened (P ₂₃ ).

The playback time of the forward section of each type of set section and the playback time of the reverse section of the set section of the corresponding type may be the same, but, for example, the forward section and the reverse section) are played The time may be within the margin of error of 10%.

A pose in the video at a start point of each type of set section may be the same as a pose in the video at an end point of a set section of a corresponding type. However, it is not limited thereto. For example, a pose at a starting point of each type of set interval and a pose at an end point of a corresponding type of set interval may be within an error range of 10%.

The third processor 360 may generate an exercise guide video including a plurality of set motions using the original video 70 of FIG. 13 .

14 is a reference diagram for explaining a method of generating an exercise guide image 70a including repetitive exercise according to an exemplary embodiment.

When n sets of motions are requested from the third user interface 320 or an external device, the third processor 360 performs an exercise guide video including n sets of motions based on reverse playback of some sections of the original video 70 ( 70a) can be created.

As shown in FIG. 14 , the third processor 360 may reproduce the preparation section R of the original video 70 .

The third processor 360 includes a forward section (AF) of the first type set section (AS), a reverse section (AB) of the first type set section (AS), and a forward section (AF) of the second type set section (AS). ) are sequentially played, and the forward section (BF) of the second type set section (BS) is reproduced in reverse to generate the first set section (ASE ₁ , BSE ₁ ).

When the original video includes a lunge exercise, the third processor 360 reproduces the forward section (AF) of the first type set section (AS) and the reverse section (AB) of the first type set section (AS), right You can create a video of your lunge workout. Then, when the third processor 360 reversely reproduces the forward section BF of the second type set section BS after reproducing the forward section BF of the second type set section BS, the third processor ( 360) may generate a video of the left lunge exercise. That is, the forward section (BF) of the second type set section (BS) is a video in which the upper body goes down while the left knee is bent. What? Nap? This is because it can be a video in which the upper body rises as it unfolds.

The third processor 360 reversely reproduces the reverse section AB of the first type set section AS, and reverses the reverse section AB of the first type set section AS and the second type set section BS. Second set intervals ASE2 and BSE2 may be generated by reproducing the forward interval BF of the second type set interval BS in reverse after sequentially reproducing the forward interval BF.

The third processor 360 reversely reproduces the reverse section AB of the first type set section AS, and the reverse section AB of the first type set section AS and the second type set section BS After sequentially reproducing the forward section (BF), if the step of reproducing the forward section (BF) of the second type set section (BS) in reverse is performed n-2 times, the third processor 360 sets n-2 times. intervals can be created.

Then, the third processor 360 reversely reproduces the reverse section AB of the first type set section AS, and reverses the reverse section AB of the first type set section AS and the second type set section BS. ) of the forward section (BF) and the reverse section (BB) of the second type set section (BS) can be sequentially reproduced to generate the n-th set section (ASE _n , BSE _n ). Finally, the third processor 360 may complete creation of the exercise guide video 70a by reproducing the finishing section E.

A method of alternately reproducing the first type set period (AS) and the second type set period (BS) has been described in FIG. 14, but is not limited thereto. The third processor 360 generates n first-type set intervals using the first type set interval AS, and generates n second-type set intervals using the second type set interval BS. can

15 is a reference diagram explaining a method of generating an exercise guide image 70b including repetitive motions according to another embodiment.

When n sets of motions are requested from the third user interface 310 or an external device, the third processor 360 performs an exercise guide video including n sets of motions based on reverse playback of some sections of the original video 70 ( 70b) can be reproduced.

As shown in FIG. 15 , the third processor 360 may reproduce the preparation section R of the original video 70 .

After reproducing the forward section AF of the first type set section AS, the third processor 360 performs the step of reproducing the forward section AF of the first type set section AS n-1 times. By doing so, it is possible to generate n-1 first type set intervals (AS ₁ ,??). And, by sequentially reproducing the forward section (AF) of the first type set section (AS) and the reverse section (AB) of the first type set section (AS), the nth first type set section (AS _n ) is generated. can do.

Then, the third processor 360 performs the step of reproducing the forward section (BF) of the second type set section (BS) after reproducing the forward section (BF) of the second type set section (BS) in n-1 By performing n-1 times, it is possible to generate second type set intervals (BS1,??). Then, the third processor 360 sequentially reproduces the forward section BF of the second type set section BS and the backward section BB of the second type set section BS, thereby generating the nth second type set. A section (BS _n ) may be created.

Finally, the third processor 360 may complete creation of the exercise guide video 70b by reproducing the finishing section E.

In FIG. 15, it is assumed that the reverse reproduction of FIG. 7 is based on repeated generation of each type set section n times, but is not limited thereto. The reverse reproduction of FIG. 8 may be applied to the reverse reproduction of the type set section. Alternatively, the reverse reproduction of FIG. 7 and the reverse reproduction of FIG. 8 may be combined and applied.

In FIGS. 14 and 15, a method of providing an exercise guide video using an original video including two different types of set motions has been described, but is not limited thereto. Of course, it is also possible to provide an exercise guide video by using an original video including three or more different types of set motions. Also, an exercise guide video may be created using not only one set of original videos including different types of repetitive motions but also two or more basic sets of different types of repetitive motion pictures.

The generated exercise guide video may be provided on the mirror display 30 or may be provided on another device.

An exercise guide video according to an embodiment may be adjusted or ended in response to a user's motion.

16 is a flowchart illustrating a method of providing an exercise guide video based on a user's motion, according to an exemplary embodiment. Referring to FIG. 16 , the third processor 360 may display an exercise guide video on the display 340 (S610). The third processor 360 can change the mirror display 30 from a standby mode to an operating mode when a user enters within a predetermined distance from the mirror display 30 . In addition, the mirror display 30 may request an exercise item to be played on the user terminal 40 carried by the user. The user terminal 40 may request playback of an exercise guide video for a corresponding exercise event by transmitting the pre-stored exercise event and the number of set motions of the above-described exercise event to the mirror display 30 .

Alternatively, the user may input an exercise guide video display command by inputting the number of times for an exercise item and a set motion through the third user interface 330 of the mirror display 30 .

As described above, the third processor 360 generates an exercise guide video including a plurality of set motions based on reverse playback of some sections of the original video, and displays the generated exercise guide video on the display 340. can However, it is not limited thereto. Exercise guide videos for each user or each set may be pre-stored in the second memory 320 . The third processor 360 may read a pre-stored exercise guide video corresponding to a user or set according to a play request command and display it on the display 340 .

The third processor 360 may recognize the user's posture (S620). The motion detection sensor 370 detects a user's motion and transmits the result to the third processor 360 . The motion detection sensor 370 is equipment for acquiring a user's movement, and includes a vision camera, a vision sensor, an acceleration sensor, a gyro sensor, a geomagnetic sensor, and an infrared sensor. etc. The third processor 360 may recognize the user's posture using motion data received from the motion detection sensor 370 .

For example, when the motion data is image data including a user, the third processor 360 may extract feature points for recognizing a posture from the image data including the user. The feature point may be a region representing a human body. For example, the feature point may be a shoulder, a shoulder joint, an upper arm, an elbow joint, a lower arm, a wrist joint, a hand, a torso, a hip joint, an upper leg, a knee joint, a lower leg, an ankle joint, and a foot. The third processor 360 may recognize the user's posture by analyzing feature points, a connection angle (stereoscopic angle) of each feature point, and a distance (stereoscopic distance) of each feature point.

For example, the third processor 360 may recognize a 2D posture by using a deep learning learning method, a fast human pose estimation (FPD) learning method, or the like for motion data. Alternatively, the third processor 360 may recognize a 3D posture using a model-based method using a 3D body model or a model-free method estimating without a 3D model. However, it is not limited thereto. Of course, the human body posture recognition technology can be applied in various known methods.

The third processor 360 may recognize a posture (hereinafter referred to as a 'standard posture') of a target (eg, a trainer) included in an exercise guide video in a manner similar to a manner in which a user recognizes a posture. there is. However, it is not limited thereto. The third processor 360 may generate motion modeling by estimating a reference posture from an original video, and pre-store the original video and motion modeling together. Also, when displaying an exercise guide video based on an original video, the third processor 360 may extract a reference posture while transforming a motion model matched with the displayed exercise guide video. Operation modeling may be performed by the third processor 360 or may be performed by an external device such as a server.

Alternatively, if the motion detection sensor 370 is a vision camera that captures the posture of the user and the posture of the target displayed on the screen of the display 340, the third processor 360 determines the user's posture and reference from the detected image data. The posture of the user and the reference posture may be recognized by extracting the posture.

The third processor 360 may compare the user's posture with a reference posture corresponding to the user's posture included in the exercise guide video (S630). The third processor 360 may calculate a similarity between a current posture of the user at a specific time point, for example, and a reference posture corresponding to the posture of the user while being included in the exercise guide video.

Meanwhile, the user's posture recognized at a specific time point and the reference posture displayed on the display 340 may be different. For example, when the user's exercise speed is slower than the playback speed of the exercise guide video, the user's posture may lag behind the reference posture displayed on the display 340 . That is, the reference posture corresponding to the user's posture included in the exercise guide video is already displayed. The third processor 360 may compare the recognized posture of the user with a previously displayed reference posture corresponding to the posture of the user.

Alternatively, when the user's exercise speed is faster than the reproduction speed of the exercise guide video, the user's posture may precede the reference posture displayed on the display 340 . That is, the reference posture corresponding to the user's posture included in the exercise guide video may not be displayed yet. The third processor 360 may compare the recognized user's posture with the reference posture corresponding to the user's posture only when the reference posture corresponding to the user's posture is displayed on the display 340 .

The higher the similarity, the higher the coincidence rate between the user's posture and the reference posture. The third processor 360 may use angle or distance-based similarity of feature points. The third processor 360 may quantitatively calculate the degree of similarity by calculating the degree of similarity for each angle of the feature points or the distance between the feature points, assigning a weight to each degree of similarity, and then summing the points. Similarity may be calculated for all feature points, or similarity may be calculated for some important feature points in the reference posture. Since various known methods are applied to the similarity calculation method, a detailed description thereof will be omitted.

If the similarity between the user's posture and the reference posture is greater than or equal to the reference value (S640-Yes), the third processor 360 may display an exercise guide video on the display 340 corresponding to the user's exercise speed (S650).

A playback speed of the exercise guide video may be determined based on the original video. Alternatively, the playback speed of the exercise guide video may be adjusted according to a user's command. However, since the playback speed is fixed regardless of the user's exercise speed, the playback speed of the exercise guide video may be different from the user's exercise speed.

If the user is elderly or in poor physical condition, or if the user is a novice exerciser, the user's exercise speed may be slower than the playback speed of the exercise guide video. If the user exercises according to the playing speed of the exercise guide video, he or she may get injured or not be able to exercise in the correct posture. Alternatively, since the user's exercise speed slows down as the number of set motions increases, while the playback speed of the exercise guide video is constant, the user may be injured or unable to exercise in a correct posture.

The third processor 360 according to an embodiment may adjust the reproduction speed of the exercise guide video in response to the user's exercise speed.

When it is determined that the user's posture is ahead of the reference posture corresponding to the user's posture by the standard section, the third processor 360 may determine that the user's exercise speed is faster than the reproduction speed of the exercise guide video. Here, the reference interval may be a time interval corresponding to a subset operation or a set operation among set operations. For example, in the case of a squat exercise, each of a forward section and a backward section may be a time section corresponding to a subset motion, and the sum of the forward section and backward section may be a time section corresponding to the set motion. The reference interval may be preset by a user or a manager differently according to an exercise event.

The third processor 360 may specify the currently recognized user's posture based on the previously recognized user's posture. For example, the third processor 360 may determine whether the currently transplanted user's posture is the posture of the forward section or the backward section of the squat exercise based on the user's previously recognized posture. Similarly, the third processor 360 may determine the current reference posture based on the previous reference posture.

The third processor 360 may increase the playback speed of the exercise guide video so that the displayed reference posture corresponds to the recognized user's posture. The playback speed may be adjusted in proportion to the user's movement speed or may be adjusted by stepwise size change. For example, the third processor 360 increases the playing speed of the exercise guide video by 1.1 times or 1.2 times so that the displayed reference posture corresponds to the user's posture, that is, the reference posture displayed at a specific point in time matches the user's posture. It can be adjusted to one of times, 1.5 times, and 2 times.

If it is determined that the user's posture lags behind the displayed standard posture by the reference interval, the third processor 360 may determine that the user's exercise speed is slower than the playback speed of the exercise guide video. Thus, the third processor 360 may reduce the playing speed of the exercise guide video so that the displayed reference posture corresponds to the recognized user's posture, that is, the reference posture displayed at a specific point in time matches the user's posture. there is. The playback speed may be adjusted in proportion to the user's motion speed or may be adjusted by stepwise size change. For example, the third processor 360 may adjust the playback speed of the exercise guide video to one of 0.9 times, 0.8 times, and 0.5 times so that the reference posture corresponds to the user's posture.

If it is determined that the user's posture lags behind the standard posture by the reference interval, the third processor 360 may pause playback of the exercise guide video until the displayed reference posture corresponds to the user's posture. Also, if the user's posture matches the reference posture displayed in the exercise guide video, the third processor 360 may play the exercise guide video again.

It has been said that the third processor 360 determines the relationship between the user's movement speed and the reproduction speed based on the recognized user's posture and reference posture, but is not limited thereto. The third processor 360 may determine a relationship between the user's exercise speed and the play speed based on a time during which a specific user's motion is performed and a playback time at which the reference motion corresponding to the specific user's motion is displayed.

For example, the third processor 360 may profile the motion of the user from the recognized postures of the user, that is, the motion of the user, and classify the profiled motion of the user in units of subsets. Also, the third processor may compare a time required for the user to perform the subset with a playback time required for reproducing the subset section of the exercise guide video.

The third processor may determine that the movement speed of the user and the reproduction speed are the same if the difference between the operating time and the playing time is within the reference time. The third processor may determine that the movement speed of the user is slower than the playback speed when the operating time is longer than the playing time by a reference time or longer. Alternatively, the third processor may determine that the movement speed of the user is faster than the playback speed when the operating time is shorter than the playing time by a reference time or more. Here, the reference time may be a time corresponding to a subset section, and may be set by a user or a manager differently according to an exercise event. In addition, a conventional method of calculating the movement speed of the user may be applied.

If the similarity between the user's posture and the reference posture corresponding to the user's posture for a predetermined time is less than the reference value, the third processor 360 may stop displaying the exercise guide video. The predetermined time may be a time corresponding to one set operation. However, it is not limited thereto. The predetermined time may be a time corresponding to two or three set operations.

When the result of the user's motion is not received from the motion detection sensor 370 for a certain period of time, the third processor 360 may end display of the exercise guide video. If the result of the user's motion is not received from the motion detection sensor 370, the third processor 360 may determine the similarity between the user's posture and the reference posture as '0'. If the motion detection sensor 370 fails to detect the user's motion, it may mean that the user leaves the place where the user exercises.

If the user's posture, which is not the reference posture, continues for a predetermined period of time, the third processor 360 may prevent unnecessary exercise guide videos from being played by ending the display of the exercise guide videos. Thus, it is possible to prevent power waste of the exercise equipment or the mirror display 30 .

The third processor 360 may provide information related to the reproduction speed of the exercise guide video and information about the degree of similarity between the user's posture and the reference posture while providing the exercise guide video. The above information may be provided with at least one of character, graph, text, and sound.

17 to 19 are reference views illustrating a method of providing an exercise guide video according to an exemplary embodiment.

As shown in FIG. 17 , the third processor 360 may display an exercise guide video 710 on the display 340 . The user may perform the exercise while viewing the reference posture displayed in the exercise guide video. The third processor 360 may compare the user's posture with a reference posture corresponding to the user's posture, calculate a similarity between the user's posture and the reference posture, and display the result 720 on the display 340. . The user can check the accuracy of his/her own posture based on similarity.

In addition, if it is determined that the user's posture is ahead of the corresponding reference posture by the reference section, the third processor 360 may determine that the user's exercise speed is faster than the playback speed of the exercise guide video. The third processor 360 may increase the playback speed of the exercise guide video so that the displayed reference posture corresponds to the user's posture.

And, as shown in FIG. 17 , the third processor 360 may display on the display 340 a first indicator 730 notifying that the reproduction speed of the exercise guide video has increased. In addition, the third processor 360 may display a second indicator 740 on the display 340 to guide the user to slow down the exercise speed.

Alternatively, if it is determined that the user's posture lags behind the reference posture by the reference interval, the third processor 360 may determine that the user's exercise speed is slower than the reproduction speed of the exercise guide video. Also, the third processor 360 may reduce the playback speed of the exercise guide video so that the displayed reference posture corresponds to the user's posture.

And, as shown in FIG. 18 , the third processor 360 may display on the display 340 a third indicator 830 notifying that the reproduction speed of the exercise guide video has decreased. In addition, the third processor 360 may display on the display 340 a fourth indicator 840 guiding the user to increase the exercise speed.

Alternatively, as shown in FIG. 19 , if it is determined that the user's posture lags behind the corresponding reference posture by the reference interval, the third processor 360 continues the exercise guide video until the displayed reference posture corresponds to the user's posture. Playback can be paused. And, as shown in FIG. 19 , the third processor 360 may display on the display 340 a fifth indicator 930 notifying that playback of the exercise guide video is paused. When the user's posture reaches the reference posture displayed on the display 340, the third processor 360 may resume playing the exercise guide video.

At the moment when it is determined that the user's posture lags behind the corresponding reference posture by a reference section, the third processor 360 may temporarily stop playing the exercise guide video. However, it is not limited thereto. If it is determined that the user's posture lags behind the reference posture by the reference section, the third processor 360 may pause playback of the exercise guide video at the end point of the subset motion or the end point of the set motion among the exercise guide videos.

The third processor 360 may store the user's exercise speed and refer to it when playing the next exercise guide video. For example, when the user exercises faster than the playback speed whenever exercising, the third processor 360 may increase the playback speed of the exercise guide video to a preset playback speed.

It has been said that the third processor 360 may provide an indicator indicating a degree of similarity between the user's posture and the corresponding reference posture, but is not limited thereto. The third processor 360 may also provide information on effects according to the user's exercise. The third processor 360 may display the exercise effect in the body shape of a character that refers to the user, for example, an avatar.

20 and 21 are reference views illustrating a method of providing an exercise effect according to an exemplary embodiment. As shown in FIG. 20 , the third processor 360 may display a character 1010 indicating the user before playing the exercise guide video.

And, while displaying the exercise guide video, the third processor 360 compares the user's posture with a reference posture corresponding to the user's posture, and calculates a similarity between the user's posture and the reference posture. The third processor 360 may change the body shape of the character based on the calculated similarity result, and display the character 1010 whose body shape is changed on the display 340 . For example, a squat exercise has an effect of strengthening lower body muscles and reducing fat. As shown in FIG. 21 , the third processor 360 creates a character 1010 with strengthened lower body muscles and reduced fat. It can be displayed on the display 340.

So far, it has been said that the mirror display 30 generates an exercise guide video, but is not limited thereto. The exercise guide video may be created by the exercise device or a server capable of communicating with the exercise device or mirror display 30, and the exercise device or mirror display 30 may display the created exercise guide video. In addition, the exercise guide video is a general electronic device including a display, for example, a smartphone, PC, tablet PC, laptop, smart TV, mobile phone, PDA (personal digital assistant), laptop, media player, digital broadcasting terminal, It can be created in navigation devices, wearable devices and other mobile and non-mobile computing devices, and can also be created in electronic devices capable of communicating with display devices.

The method according to an embodiment of the present disclosure may be implemented in the form of program instructions that can be executed through various computer means and recorded in a computer readable medium. Computer readable media may include program instructions, data files, data structures, etc. alone or in combination. Program commands recorded on the medium may be specially designed and configured for the present disclosure, or may be known and usable to those skilled in computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic media such as floptical disks. - includes hardware devices specially configured to store and execute program instructions, such as magneto-optical media, and ROM, RAM, flash memory, and the like. Examples of program instructions include high-level language codes that can be executed by a computer using an interpreter, as well as machine language codes such as those produced by a compiler.

Some embodiments of the present disclosure may be implemented in the form of a recording medium including instructions executable by a computer, such as program modules executed by a computer. Computer readable media can be any available media that can be accessed by a computer and includes both volatile and nonvolatile media, removable and non-removable media. Also, computer readable media may include both computer storage media and communication media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Communication media typically includes computer readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave, or other transport mechanism, and includes any information delivery media. In addition, some embodiments of the present disclosure may be implemented as a computer program or computer program product including instructions executable by a computer, such as a computer program executed by a computer.

The device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-temporary storage medium' only means that it is a tangible device and does not contain signals (e.g., electromagnetic waves), and this term refers to the case where data is stored semi-permanently in the storage medium and temporary It does not discriminate if it is saved as . For example, a 'non-temporary storage medium' may include a buffer in which data is temporarily stored.

According to one embodiment, the method according to various embodiments disclosed in this document may be provided by being included in a computer program product. Computer program products may be traded between sellers and buyers as commodities. A computer program product is distributed in the form of a device-readable storage medium (eg compact disc read only memory (CD-ROM)), or through an application store or between two user devices (eg smartphones). It can be distributed (e.g., downloaded or uploaded) directly or online. In the case of online distribution, at least a part of a computer program product (eg, a downloadable app) is stored on a device-readable storage medium such as a memory of a manufacturer's server, an application store server, or a relay server. It can be temporarily stored or created temporarily.

So far, we have looked at the preferred embodiments. Those skilled in the art to which the present invention pertains will be able to understand that the present invention can be implemented in a modified form without departing from the essential characteristics of the present invention. Therefore, the disclosed embodiments should be considered from an illustrative rather than a limiting point of view. The scope of the present invention is shown in the claims rather than the foregoing description, and all differences within the equivalent scope will be construed as being included in the present invention.

1: Exercise equipment management system
10: management server
20: exercise equipment
30: mirror display
40: user terminal
50: manager terminal

Claims (19)

In the method of providing an exercise guide video,
Displaying an exercise guide video including repetitive motions;
Recognizing a user's posture while the exercise guide video is displayed;
comparing the posture of the user with a reference posture corresponding to the posture of the user included in the exercise guide video; and
and terminating display of the exercise guide video when the similarity between the user's posture and the reference posture for a predetermined time is less than a reference value. According to claim 1,
The period of time is
A method of providing an exercise guide video that is longer than a time corresponding to one set motion included in the exercise guide video. According to claim 1,
and displaying the exercise guide video corresponding to the user's exercise speed when the similarity between the user's posture and the reference posture is greater than or equal to the reference value. According to claim 3,
The step of displaying the exercise guide video,
When it is determined that the user's posture is ahead of the reference posture displayed in the exercise guide video by a reference section, increasing the playback speed of the exercise guide video so that the displayed reference posture corresponds to the user's posture; How to provide exercise guide videos. According to claim 3,
The step of displaying the exercise guide video,
If it is determined that the user's posture lags behind the reference posture displayed in the exercise guide video by a standard interval, reducing the playback speed of the exercise guide video so that the displayed reference posture corresponds to the user's posture; How to provide exercise guide videos. According to claim 3,
The step of displaying the exercise guide video,
If it is determined that the user's posture lags behind the standard posture displayed in the exercise guide video by a reference interval, pausing playback of the exercise guide video until the displayed reference posture corresponds to the user's posture; How to provide exercise guide videos. According to claim 3,
The reference interval is
A method of providing an exercise guide video having a section corresponding to a subset motion or more among the exercise guide video. According to claim 1,
changing a body shape of a character representing the user in response to the similarity when the similarity between the posture of the user and the reference posture for the predetermined time or longer is equal to or greater than the reference value; and
Displaying the changed body shape of the character; exercise guide video providing method further comprising. According to claim 1,
A method of providing an exercise guide video, further comprising generating the exercise guide video including two or more set motions based on reverse reproduction of a partial section of an original video including one set motion. A computer-readable recording medium on which a program for executing the method of any one of claims 1 to 9 is recorded on a computer. A display displaying an exercise guide video including repetitive motions;
a motion sensor for recognizing a user's posture; and
The user's posture and a reference posture corresponding to the user's posture included in the exercise guide video are compared, and if the similarity between the user's posture and the reference posture is less than a reference value for a predetermined time, the exercise guide video is displayed. An electronic device that includes; a processor that terminates. According to claim 11,
The electronic device further includes a film disposed on the display and reflecting light corresponding to the posture of the user while transmitting light corresponding to the exercise guide video. According to claim 11,
The period of time is
An electronic device that is longer than the time corresponding to one set motion included in the exercise guide video. According to claim 11,
the processor,
If the similarity between the posture of the user and the reference posture is equal to or greater than the reference value, the electronic device displays the exercise guide video corresponding to the motion speed of the user. According to claim 14,
the processor,
If it is determined that the user's posture is ahead of the displayed standard posture in the exercise guide video by a reference section, the electronic device increases the playing speed of the exercise guide video so that the displayed reference posture corresponds to the user's posture. According to claim 14,
The processor
If it is determined that the user's posture lags behind the displayed standard posture in the exercise guide video by a reference interval, the electronic device reduces the playing speed of the exercise guide video so that the displayed reference posture corresponds to the user's posture. According to claim 14,
the processor,
If it is determined that the user's posture lags behind the displayed standard posture in the exercise guide video, the electronic device pauses playback of the exercise guide video until the displayed reference posture corresponds to the user's posture. According to claim 14,
The reference interval is
An electronic device having more than a section corresponding to a subset motion in the exercise guide video. According to claim 14,
the processor,
If the similarity between the posture of the user and the reference posture for the predetermined time or longer is equal to or greater than the reference value, the electronic device changes the body shape of a character representing the user in response to the similarity and displays the changed body shape of the character on the display. .

Images