KR20230103514A - A system and method for providing fitness services in a metaverse environment - Google Patents

Abstract

The present invention implements fitness content provided in the metaverse environment through a terminal device including a 3D camera, and a fitness service providing system and method in a metaverse environment in which a user can simultaneously perform exercises and games according to the fitness content. Regarding, a terminal device including a 3D camera providing a metaverse fitness activity challenge service includes a challenge generator for generating challenge content for user participation in a metaverse environment; Avatar setting unit for collecting user avatar setting information data; an exercise posture recording unit that captures a user's movement following challenge content for user participation simulated on a display; an avatar challenge implementation unit that simulates the user motion image based on the user avatar in real time; and a challenge performance determination unit that determines whether the challenge for user participation based on the user avatar is successful.

Description

A system and method for providing fitness services in a metaverse environment}

The present invention implements fitness content provided in the metaverse environment through a terminal device including a 3D camera, and a fitness service providing system and method in a metaverse environment in which a user can simultaneously perform exercises and games according to the fitness content. it's about

Metaverse. It is a combination of ‘Universe’, which means the real world, and ‘Meta’, which means ‘processing and abstraction’, and means a three-dimensional virtual world. The metaverse world has been expressed in the word virtual reality, but now we use the word metaverse as an advanced concept. The term metaverse itself originated from Neal Stephenson's 1992 novel Snow Crash.

Metaverse is a compound word of meta, which means virtual and transcendence, and universe, which means world and space. At first glance, it feels like a completely different image from the healthcare industry, which is closely related to health in real life, but healthcare companies are continuing their efforts toward a new normal, such as chronic disease management, diagnosis through the use of AI, and online seminars.

However, these technologies capture detailed behaviors such as exercise motions and postures from people with various postures and body shapes, and analyze the user's exercise motions and postures in detail. There is a problem that there are limitations in providing customized content.

Korean registration number (KR) No. 10-0784835 (2007.12.05) Korean registration number (KR) No. 10-0986940 (2010.10.05) Korean registration number (KR) No. 10-2323492 (2021.11.02)

The present invention takes into account the above problems, and the present invention captures the user's body shape and exercise posture through a terminal including a 3D camera or an exercise device including a 3D camera, and uses the user's body shape and exercise posture as AI. By evaluating the user's exercise posture through a 3-dimensional analysis based on the exercise, correcting the user's wrong exercise method, and providing compensation according to the user's exercise ability improvement, so that the user can be interested in exercise and continue to perform it. It is to provide a fitness service providing system and method in a bus environment.

According to embodiments of the present invention, in a terminal device including a 3D camera that provides a metaverse fitness activity challenge service, a fitness service providing system in a metaverse environment includes a challenge generator for generating challenge content for user participation in a metaverse environment; Avatar setting unit for collecting user avatar setting information data; an exercise posture recording unit that captures a user's movement following challenge content for user participation simulated on a display; an avatar challenge implementation unit that simulates the motion of the user based on the user avatar in real time; and a challenge performance determination unit that determines whether the challenge for user participation based on the user avatar is successful.

In embodiments of the present invention, the challenge generator generates challenge content for user participation in a metaverse environment based on the terminal device including the 3D camera, and the challenge content for user participation in the metaverse environment includes body exercise and low-weight dumbbell workout challenge content; and home workout challenge content.

In embodiments of the present invention, the home exercise challenge content includes strength exercise challenge content including squat, lunge, standing knee-up and standing dumbbell-up exercise content utilizing an elastic resistance band; balance challenge content including tree posture, T posture, high lunge posture, and warrior posture exercise contents; and aerobic challenge content including jumping jacks and burpees tests.

In embodiments of the present invention, the avatar setting unit collects user personal information data and the user avatar setting information data in order to participate in a challenge for user participation in the metaverse environment, and the user avatar setting information data includes the A real avatar image realizing a user's 3D image captured through the 3D camera of a terminal device including a 3D camera; includes.

In embodiments of the present invention, the user avatar setting information data further includes a virtual avatar image in which the user's face is replaced with a built-in option image of any one of an animal, celebrity, or character in the user 3D image. .

In embodiments of the present invention, the exercise posture photographing unit captures the user's appearance, the user's muscles, and the user's movement in real time from the 3D camera.

In embodiments of the present invention, the avatar challenge implementation unit may include an avatar challenge implementation unit that simulates the motion of the user in real time based on the user avatar set in the avatar setting unit; and a feedback avatar challenge implementation unit that simulates the movement of the user's avatar in real time according to the information data transmitted from the challenge performance determination unit.

In embodiments of the present invention, the challenge performance determination unit, the exercise point definition unit for defining 19 exercise action points (Key points) in the three-dimensional body outline skeleton image of the user avatar; A completion determination unit for determining whether the user's posture is complete through analysis of a Recurrent Neural Network (RNN)-based Long Short Term Memory (LSTM) algorithm that takes the vector data value derived from the exercise point definition unit as an input; includes .

In the embodiments of the present invention, the movement point definition unit, from a 3D-body-tracking device (Body Tracking SDK) that inputs 19 movement key point data in the 3-dimensional body outline skeletal image of the user avatar, It defines 19 exercise action point reference lines (Key Point Line) that analyzes the body shape by connecting the position of each body shape skeleton and the exercise key point for each body shape skeleton with a line.

In embodiments of the present invention, the motion point definition unit further includes a vector digitization unit that digitizes the 19 motion action point reference lines (Key Point Lines) into three-dimensional vector values.

In the embodiments of the present invention, the completion determination unit, through the Recurrent Neural Network (RNN)-based Long Short Term Memory (LSTM) algorithm, 19 motion action point reference lines (Key Point Line) vectors of the user in a static state An evaluation criterion DB unit for generating evaluation criterion data by taking data values and exercise expert's real-time exercise motion posture vector data values as inputs.

In the embodiments of the present invention, the completion determination unit compares the evaluation reference data with 19 exercise action point reference line vector data values of the user in a dynamic state Completeness analysis unit for analyzing the completeness of the exercise posture ; is further included.

In embodiments of the present invention, the challenge performance determination unit further includes a feedback delivery unit that transmits 19 key point line vector data values of the user in the dynamic state to the avatar challenge implementation unit in real time. do.

In the method of providing a metaverse fitness activity challenge service according to another embodiment of the present invention, the method of providing a fitness service of a terminal device including a 3D camera in a metaverse environment generates challenge content for user participation in a metaverse environment doing; Collecting user avatar setting information data; photographing a user's movement following challenge content for user participation simulated on a display; simulating the movement of the user based on the user avatar in real time; and determining whether the challenge for user participation based on the user avatar is successful.

In embodiments of the present invention, the collecting of the user avatar setting information data may include collecting user personal information data and the user avatar setting information data to participate in a challenge for user participation in the metaverse environment, and the user The avatar setting information data includes a real avatar image embodying a user's 3D image captured through the 3D camera of a terminal device including a 3D camera.

In embodiments of the present invention, in the step of photographing the user's movement following the challenge content for user participation simulated on the display, the user's appearance, the user's muscles, and the user's movement are captured in real time from the 3D camera .

In embodiments of the present invention, simulating the movement of the user based on the user avatar in real time may include simulating the movement of the user based on the set user avatar in real time; and simulating a movement of the user avatar in real time according to information data fed back in the step of determining whether the challenge for user participation based on the user avatar is successful.

In embodiments of the present invention, the step of determining whether the challenge for user participation based on the user avatar is successful is defining 19 exercise key points in the 3D body outline skeletal image of the user avatar ; Determining whether the user's posture is complete through analysis of a Recurrent Neural Network (RNN)-based Long Short Term Memory (LSTM) algorithm that takes the defined vector data value as an input; includes.

According to the fitness service providing system and method of the metaverse environment as described above,

First, when using the metaverse platform of the present invention, participants can easily participate in large-scale challenges at their homes or in any place where a terminal containing a 3D camera is installed.

Second, it is possible to photograph the user's exercise posture and perform 3D AI analysis through interlocking exercise devices (smart dumbbells, balance balls, etc.) linked to a terminal including a 3D camera or exercise equipment including a 3D camera.

Third, if the non-face-to-face challenge is conducted in the form of a mini avatar, a large number of people can be applied within the display frame.

1 is a configuration diagram and schematic diagram of the present invention.
2 is a configuration diagram of an avatar challenge implementation unit 400 according to an embodiment of the present invention.
3 is a configuration diagram of a challenge performance determination unit 500 according to an embodiment of the present invention.
4 and 5 are configuration diagrams and diagrams of the movement point definition unit 510 according to an embodiment of the present invention.
6 and 7 are configuration diagrams and result charts of the completion determination unit 520 according to an embodiment of the present invention.
8 is a flow chart of the present invention.

Referring to the accompanying drawings, a fitness service providing system and method in a metaverse environment according to embodiments of the present invention will be described in detail. Since the present invention can have various changes and various forms, specific embodiments will be illustrated in the drawings and described in detail in the text. However, this is not intended to limit the present invention to a specific form disclosed, and should be understood to include all modifications, equivalents, and substitutes included in the spirit and scope of the present invention. Like reference numerals have been used for like elements throughout the description of each figure. In the accompanying drawings, the dimensions of the structures are shown enlarged than actual for clarity of the present invention, or reduced than actual in order to understand the schematic configuration.

Also, terms such as first and second may be used to describe various components, but the components should not be limited by the terms. These terms are only used for the purpose of distinguishing one component from another. For example, a first element may be termed a second element, and similarly, a second element may be termed a first element, without departing from the scope of the present invention. Meanwhile, unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by a person of ordinary skill in the art to which the present invention belongs. Terms such as those defined in commonly used dictionaries should be interpreted as having a meaning consistent with the meaning in the context of the related art, and unless explicitly defined in the present application, they should not be interpreted in an ideal or excessively formal meaning. don't

The present invention captures the user's body shape and exercise posture through a terminal including a 3D camera or an exercise device including a 3D camera, and analyzes the user's body shape and exercise posture through AI-based three-dimensional analysis. It is a technology that corrects the wrong exercise method of the user by evaluating the posture and provides compensation according to the improvement of the user's exercise ability so that the user can be interested in the exercise and continue to perform it.

1 is a configuration diagram and schematic diagram of the present invention. Referring to FIG. 1, the fitness service providing system in the metaverse environment includes a challenge generating unit 100, an avatar setting unit 200, an exercise posture recording unit 300, an avatar challenge implementation unit 400, and a challenge execution determination unit ( 500) are included.

In a terminal device including a 3D camera that provides a metaverse fitness activity challenge service, the challenge generator 100 generates challenge content for user participation in a metaverse environment. That is, to explain in more detail, the challenge generator 100 generates challenge content for user participation in a metaverse environment based on the terminal device including the 3D camera. Here, the challenge content for user participation in the metaverse environment includes bare-body exercise and low-weight dumbbell exercise challenge content; and home workout challenge content. Here, the home exercise challenge content includes strength exercise challenge content including squat, lunge, standing knee-up and standing dumbbell-up exercise content utilizing an elastic resistance band; and tree posture, T posture, high lunge posture and warrior posture balance challenge content including exercise content; and aerobic challenge content including jumping jacks and burpees tests.

In the case of the avatar setting unit 200, user avatar setting information data is collected, that is, to be described in more detail, user personal information data and the user avatar setting information to participate in the challenge for user participation in the metaverse environment Data is collected, and the user avatar setting information data includes a real avatar image that implements a user 3D image captured through the 3D camera of the terminal device including the 3D camera; or, in the user 3D image, the user A virtual avatar image in which the face of is replaced with a built-in optional image of any one of animals, celebrities, and characters; is further included. In the case of the exercise posture recording unit 300, the motion of the user following the challenge content for user participation simulated on the display is captured. That is, the user's appearance, the user's muscles, and the user's movement are captured in real time from the 3D camera, the avatar challenge implementation unit 400 simulates the user's movement based on the user avatar in real time, and the challenge execution determination unit 500 determines whether the challenge for user participation based on the user avatar is successful.

2 is a configuration diagram of an avatar challenge implementation unit 400 according to an embodiment of the present invention.

Referring to FIG. 2 , an avatar implementation unit 400a and a feedback avatar challenge implementation unit 400b are included. The avatar implementation unit 400a simulates the movement of the user in real time based on the user avatar set in the avatar setting unit 200, and the feedback avatar challenge implementation unit 400b receives the information data transmitted from the challenge execution determination unit 500 The motion of the user's avatar is simulated in real time. Therefore, it is a dataset that outputs the movement of the user avatar by applying the user's 19 body contour skeletal action points (Key Point) and motion action point reference line (Key Point Line) data analyzed in real time to the user avatar in the metaverse environment. , and the user avatar expresses the user's behavior in real time, so that various users can check the movement motion of each user avatar in the metaverse environment.

3 is a configuration diagram of a challenge performance determination unit 500 according to an embodiment of the present invention.

Referring to FIG. 3 , the challenge performance determination unit 500 includes an exercise point definition unit 510, a completion determination unit 520, and a feedback delivery unit 530. The movement point definition unit 510 defines 19 movement action points (Key points) in the 3D body outline skeletal image of the user avatar, and the completion determination unit 520 is the vector data derived from the movement point definition unit 510 It is determined whether the user's posture is complete through analysis of a Long Short Term Memory (LSTM) algorithm based on a Recurrent Neural Network (RNN) that takes a value as an input, and the feedback delivery unit 530 determines whether the user's posture in the dynamic state is 19 A motion action point reference line (Key Point Line) vector data value is transmitted to the avatar challenge implementation unit in real time.

4 and 5 are configuration diagrams and diagrams of the movement point definition unit 510 according to an embodiment of the present invention.

Referring to FIGS. 4 and 5 , the motion point definition unit 510 includes a definition unit 510a and a vector digitization unit 510b. The definition unit 510 determines the location of each body shape and skeleton and the body shape from a 3D-body-tracking device (Body Tracking SDK) that takes as input 19 key point data from the 3-dimensional body shape frame image of the user avatar. By connecting the key points for each skeleton with a line, 19 key point lines for analyzing the body shape are defined. In addition, the vector digitization unit 510b converts the 19 motion action point reference lines (Key Point Line) into 3-dimensional vector values.

6 and 7 are configuration diagrams and result charts of the completion determination unit 520 according to an embodiment of the present invention.

Referring to FIG. 6 , the completion determination unit 520 includes an evaluation criteria DB unit 520a and a completeness analysis unit 520b. The evaluation criterion DB unit 520a uses the RNN (Recurrent Neural Network)-based LSTM (Long Short Term Memory) algorithm, 19 motion action point baseline (Key Point Line) vector data values of the user in a static state and motion experts The evaluation criterion data is generated by taking the real-time exercise motion posture vector data value as input, and the completeness analysis unit 520b uses the user's 19 motion action point reference line (Key Point Line) vector data values in a dynamic state and the evaluation reference data Compare and analyze the completeness of exercise posture. Referring to FIG. 7, the evaluation of all exercises does not analyze all of the user's body outline skeletal action point (Key Point) and the user's 19 exercise action point reference lines (Key Point Line), but the part that is evaluated with emphasis according to the exercise characteristics. There is a part with a low evaluation value, and the corresponding data is continuously updated to update the evaluation reference data.

(여기서, mg: 사용자의 몸무게, k: 실시간 도출되는 사용자의 근육 이미지값, b: 사용자의 근육값의 초기기준값, K: 몸무게 및 근육양 비례상수)로 연산된다.In another embodiment of the present invention, the challenge performance determination unit 500 includes a numerical pre-processing unit 500a, a change rate measurement unit 500b, a performance completion determination unit 500c, an exercise point definition unit 500d, vector digitization It includes a unit 500e and a success determination unit 500f. The numerical preprocessing unit 500a digitizes the user's muscle image captured in real time from the exercise posture capturing unit, and the rate of change measuring unit 500b converts the user's muscle image derived as an initial value in the numerical preprocessing unit 500a. An image value is set as an initial reference value, and a change rate of the user's muscle image value is measured by comparing the user's muscle image value with the user's muscle image value derived in real time. Thereafter, if the change rate of the user's muscle image value is a positive % in the execution completion determination unit 500c, the challenge for user participation is determined to be successful, and if the change rate of the user's muscle image value is a negative %, the The challenge for user participation is judged to be a failure. Here, the rate of change of the user's muscle image value is the rate of change of the user's muscle image value =

(Here, mg: user's weight, k: user's muscle image value derived in real time, b: initial reference value of user's muscle value, K: weight and muscle mass proportional constant).

8 is a flow chart of the present invention.

Referring to FIG. 8, in the method of providing a metaverse fitness activity challenge service, the method of providing a fitness service of a terminal device including a 3D camera in a metaverse environment includes generating challenge content for user participation in a metaverse environment (S801 ); Collecting user avatar setting information data (S802); photographing a user's motion following challenge content for user participation simulated on a display (S803); simulating the movement of the user based on the user avatar in real time (S804); and determining whether the challenge for user participation based on the user avatar is successful (S805).

In an embodiment of the present invention, the step of collecting user avatar setting information data (S802) collects user personal information data and the user avatar setting information data to participate in a challenge for user participation in the metaverse environment, The user avatar setting information data includes a real avatar image embodying a user's 3D image captured through the 3D camera of a terminal device including a 3D camera.

In an embodiment of the present invention, the step of photographing the user's movement following the challenge content for user participation simulated on the display (S803) is to capture the user's appearance, the user's muscles, and the user's movement in real time from the 3D camera. do.

In an embodiment of the present invention, the step of simulating the movement of the user based on the user avatar in real time (S804) may include: simulating the movement of the user based on the set user avatar in real time; and simulating a movement of the user avatar in real time according to information data fed back in the step of determining whether the challenge for user participation based on the user avatar is successful.

In an embodiment of the present invention, the step of determining whether the challenge for user participation based on the user avatar is successful (S805) defines 19 exercise key points in the 3D body outline skeletal image of the user avatar doing; Determining whether the user's posture is complete through analysis of a Recurrent Neural Network (RNN)-based Long Short Term Memory (LSTM) algorithm that takes the defined vector data value as an input; includes.

The present invention takes into account the above problems, and the present invention captures the user's body shape and exercise posture through a terminal including a 3D camera or an exercise device including a 3D camera, and uses the user's body shape and exercise posture as AI. By evaluating the user's exercise posture through a 3-dimensional analysis based on the exercise, correcting the user's wrong exercise method, and providing compensation according to the user's exercise ability improvement, so that the user can be interested in exercise and continue to perform it. To provide a system and method for providing fitness services in a bus environment. According to the system and method for providing fitness services in a metaverse environment as described above, first, when the metaverse platform of the present invention is used, participants can easily move to their homes. Alternatively, it is possible to participate in the large-scale challenge at any place where a terminal with a 3D camera is installed. Second, it is possible to photograph the user's exercise posture and perform 3D AI analysis through interlocking exercise devices (smart dumbbells, balance balls, etc.) linked to a terminal including a 3D camera or exercise equipment including a 3D camera. Third, if the non-face-to-face challenge is conducted in the form of a mini avatar, a large number of people can be applied within the display frame.

Although the detailed description of the present invention described above has been described with reference to preferred embodiments of the present invention, those skilled in the art or those having ordinary knowledge in the art will find the spirit of the present invention described in the claims to be described later. And it will be understood that the present invention can be variously modified and changed without departing from the technical scope.

100: Challenge generator 200: Avatar setting unit
300: Exercise posture shooting department 400: Avatar challenge implementation department
400a: avatar implementation unit 400b: feedback avatar challenge implementation unit
500: Challenge performance determination unit 510: Exercise point definition unit
510a: definition unit 510b: vector digitization unit
520: Completion judgment unit 520a: Evaluation standard DB unit
520b: completeness analysis unit 530: feedback delivery unit

Claims (18)

In a terminal device including a 3D camera that provides a metaverse fitness activity challenge service,
A challenge generator for generating challenge content for user participation in the metaverse environment;
Avatar setting unit for collecting user avatar setting information data;
an exercise posture recording unit that captures a user's movement following challenge content for user participation simulated on a display;
an avatar challenge implementation unit that simulates the motion of the user based on the user avatar in real time;
A fitness service providing system in a metaverse environment, comprising: a challenge performance determination unit for determining whether the challenge for user participation based on the user avatar is successful. According to claim 1,
The challenge generator,
Based on the terminal device including the 3D camera, challenge content for user participation in the metaverse environment is created,
Challenge content for user participation in the metaverse environment,
bodyweight and low-weight dumbbell challenge content; and
Home exercise challenge content; Metaverse environment fitness service providing system comprising a. According to claim 2,
The home exercise challenge content,
Strength exercise challenge contents including exercise contents such as squats, lunges, standing knee-ups and standing dumbbell-ups using elastic resistance bands;
balance challenge content including tree posture, T posture, high lunge posture, and warrior posture exercise contents; and
Jumping jack, aerobic challenge content including a burpee test; Metaverse environment fitness service providing system comprising a. According to claim 1,
The avatar setting unit,
Collecting user personal information data and user avatar setting information data to participate in the challenge for user participation in the metaverse environment;
The user avatar setting information data,
A fitness service providing system in a metaverse environment, characterized in that it includes a real avatar image embodying a user's three-dimensional image photographed through the 3D camera of the terminal device including the 3D camera. According to claim 4,
The user avatar setting information data,
A virtual avatar image in which the user's face is replaced with a built-in option image of any one of animals, celebrities, or characters in the user's three-dimensional image; fitness service providing system in a metaverse environment, characterized in that it further comprises. According to claim 1,
The exercise posture shooting unit,
A fitness service providing system in a metaverse environment, characterized in that for real-time photographing of the user's appearance, the user's muscles and the user's movement from the 3D camera. According to claim 1,
The avatar challenge implementation unit,
an avatar implementation unit that simulates the motion of the user in real time based on the user avatar set by the avatar setting unit;
A fitness service providing system in a metaverse environment, comprising: a feedback avatar challenge implementation unit that simulates the movement of the user avatar in real time according to the information data transmitted from the challenge performance determination unit.
According to claim 1,
The challenge performance determination unit,
a motion point definition unit defining 19 motion action points (key points) in the 3-dimensional body outline skeletal image of the user avatar;
A completion determination unit for determining whether the user's posture is complete through analysis of a Recurrent Neural Network (RNN)-based Long Short Term Memory (LSTM) algorithm that takes the vector data value derived from the exercise point definition unit as an input; and A fitness service provision system in the metaverse environment. According to claim 8,
The movement point definition unit,
From the 3D-body-tracker (Body Tracking SDK) that takes as input 19 key point data from the 3-dimensional body outline skeletal image of the user avatar,
A definition unit that defines 19 exercise action point reference lines (Key Point Line) that analyzes the body shape by connecting the position of each body shape skeleton and the exercise key point for each body shape skeleton with a line. A fitness service provision system in the metaverse environment. According to claim 9,
The movement point definition unit,
A vector digitization unit that digitizes the 19 exercise action point reference lines (Key Point Line) as a three-dimensional vector value; A fitness service providing system in a metaverse environment, characterized in that it further comprises. According to claim 9,
The completion judgment unit,
Through the RNN (Recurrent Neural Network) based Long Short Term Memory (LSTM) algorithm,
Characterized by including; an evaluation criteria DB unit that generates evaluation standard data by taking as input the vector data values of the user's 19 motion action points in a static state (Key Point Line) vector data values and the motion expert's real-time motion motion posture vector data values. A fitness service provision system in the metaverse environment. According to claim 11,
The completion judgment unit,
A completeness analysis unit that analyzes the completeness of the exercise posture by comparing the 19 exercise action point reference line (Key Point Line) vector data values of the user in a dynamic state with the evaluation reference data; Fitness service delivery system. According to claim 12,
The challenge performance determination unit,
A feedback delivery unit for transmitting 19 key point line vector data values of the user in the dynamic state to the avatar challenge implementation unit in real time; Fitness service providing system in a metaverse environment, characterized in that it further comprises. In the method of providing the metaverse fitness activity challenge service,
Creating challenge content for user participation in the metaverse environment;
Collecting user avatar setting information data;
photographing a user's movement following challenge content for user participation simulated on a display;
simulating the movement of the user based on the user avatar in real time;
A fitness service providing method of a terminal device including a 3D camera in a metaverse environment, comprising: determining whether the challenge for user participation based on the user avatar is successful. According to claim 14,
The step of collecting the user avatar setting information data,
Collecting user personal information data and user avatar setting information data to participate in the challenge for user participation in the metaverse environment;
The user avatar setting information data,
A method of providing a fitness service of a terminal device including a 3D camera in a metaverse environment, characterized in that it includes; According to claim 14,
The step of photographing the user's movement following the challenge content for user participation simulated on the display,
A method of providing a fitness service of a terminal device including a 3D camera in a metaverse environment, characterized in that the user's appearance, the user's muscles, and the user's movement are photographed in real time from the 3D camera. According to claim 14,
The step of simulating the movement of the user based on the user avatar in real time,
simulating the motion of the user in real time based on the set user avatar; and
simulating in real time the movement of the user avatar according to the information data fed back in the step of determining the success of the challenge for user participation based on the user avatar; A terminal device including a 3D camera in a metaverse environment comprising: of providing fitness services. According to claim 14,
The step of determining whether the user participation challenge based on the user avatar is successful,
Defining 19 exercise action points (key points) in the 3-dimensional body outline skeletal image of the user avatar;
Determining whether the user's posture is complete through analysis of a Recurrent Neural Network (RNN)-based Long Short Term Memory (LSTM) algorithm that takes the defined vector data value as an input; A method for providing a fitness service of a terminal device including a 3D camera.

Images