KR100412932B1 - Method of displaying and evaluating motion data using in motion game apparatus - Google Patents

Abstract

The present invention relates to a method and an apparatus for displaying motion data of a motion game apparatus, and it is possible to evaluate the motion of a player following a motion of a dancer or the like in real time.

This object of the present invention can be achieved by a method comprising: a first step of calculating, from a motion data of a original actor, a reference sensor position value to be detected when a game player precisely follows motion of a original actor; A second step of calculating a camera-specific sensor position value for each camera, and a third step of setting a target region for each camera having a predetermined range around the camera-based sensor position value, and a third step of determining whether a player's sensor is detected in the target area And a visualization method for enabling a user to easily understand and follow the motion data of the original actor in a simple and easy manner. The present invention can be achieved by a method for evaluating a game motion of a motion game apparatus.

Description

TECHNICAL FIELD [0001] The present invention relates to a method and an apparatus for displaying motion data of a motion game apparatus,

The present invention relates to a method of reproducing motion data of a motion game apparatus and a method of evaluating the motion data of a motion game apparatus. More specifically, the present invention relates to a method of reproducing motion data for allowing a game player to more easily follow motion of a original actor, To a method for evaluating the same.

In recent years, a music player and a floor surface member for detecting a player's action are provided. In addition to music played on a game machine, a player's action is informed to a player through a monitor or a player's action indicator of a floor surface, There is a trend of a so-called DDR game machine following the corresponding motion.

More advanced than such a DDR game machine is a game machine in which a game sensor detects not only the game player's action but also a predetermined position in order to detect a hand extending action, and the game checks the motion of the player's hand as well as the motion.

However, the present game machines are limited to a game machine capable of sensing only the motion of a predetermined position or the movement of the player, and thus there is a problem in that it is impossible to evaluate the overall motion of the player who displays and follows the natural motion of the original actor.

SUMMARY OF THE INVENTION Accordingly, the present invention has been made to solve the above-mentioned problems, and it is an object of the present invention to provide a method of reproducing motion data so that a player can more easily follow a motion of a original actor in a motion game apparatus showing motion of a original actor do.

Another object of the present invention is to provide a motion data evaluation method capable of quickly evaluating a motion of a player who follows a motion of a original actor in real time in a motion game device showing motion of a original actor.

BRIEF DESCRIPTION OF THE DRAWINGS Fig. 1 is an external configuration diagram of a motion game apparatus according to the present invention; Fig.

2 is a block diagram of a motion game apparatus to which the present invention is applied.

3 is a flow chart illustrating a flow of processing retargeting;

FIG. 4 is a frame structure diagram for explaining an example of the structure of a video frame of a three-dimensional original actor used in the present invention; FIG.

FIGS. 5 and 6 are explanatory diagrams for explaining a method of displaying a preliminary action of the original actor motion; FIG.

Figure 7 is a flow chart illustrating the overall operation of displaying and evaluating motion using the motion frame shown in Figure 4;

8 is a flowchart for explaining a method of evaluating a motion of a player.

9 is a flow chart showing in more detail the execution flow of the present invention.

The above object of the present invention is also achieved by a motion data display method of a motion game apparatus for reproducing motion data of a original actor composed of a plurality of frames on a display device and including information on a basic frame representing a main motion of a original actor (Xf, Yf, Zf) on the screen for reproducing the continuous action of the original actor and a predetermined time (Xi, Yi, Zi) on the screen for previewing the basic frame to be reproduced later, and the continuous operation of the original actor at the reproduction position point (Xf, Yf, Zf) On the basis of continuous display (Xi, Yi, Zi) after displaying a basic frame to be displayed in the initial position point (Xi, Yi, Zi) And a third step of gradually moving the basic frame to the reproduction position point (Xf, Yf, Zf) and displaying the motion data.

The above object of the present invention is also achieved by a method for reproducing a continuous action of a original actor, which comprises information on a basic frame representing a main motion of a original actor and composed of a plurality of frames, Xf, Yf, Zf) and a predetermined time A method of reproducing motion data of a original actor on a display device having an initial position point (Xi, Yi, Zi) on a display device for previewing a basic frame to be reproduced later, ), The continuous action of the original actor is continuously displayed based on the current time t (Xi, Yi, Zi) after displaying a basic frame to be displayed on the initial position point (Xi, Yi, Zi) And a second step in which the basic frame is displayed while being gradually moved to the reproduction position point (Xf, Yf, Zf). The motion data display method of the present invention is also applicable to the motion data display method.

It is still another object of the present invention to provide an apparatus and method for reproducing a continuous motion of a original actor, which includes information on a basic frame representing a main motion of a original actor, The points (Xf, Yf, Zf) and the predetermined time (Xi, Yi, Zi) on a display device for previewing a basic frame to be reproduced later, and evaluating the motion of a player who follows the motion data of the original actor displayed on the display device, Dimensional motion data of the original actor to reflect the dimensions of the player's body and then storing the three-dimensional motion data of the retransmitted original actor, and a step of reproducing the three- At the point (Xf, Yf), continuous operation of the original actor is continuously displayed based on the current time t (Xi, Yi, Zi) after displaying a basic frame to be displayed in the initial position point (Xi, Yi, Zi) A third step in which the basic frame is displayed while being gradually moved to the reproduction position point (Xf, Yf, Zf), and three-dimensional motion data of a game player learning the same motion is extracted while following the motion of a displayed original actor A fifth step of calculating a reference sensor coordinate value of the original actor corresponding to the sensor position attached to the game player from the basic frame displayed at the playback position point Xf, Yf, Zf in the fourth and third steps, And a sixth step of comparing the three-dimensional motion data of the player with the reference sensor coordinate value. It is achieved by.

Hereinafter, the present invention will be described in detail with reference to the drawings. FIG. 1 is an external view of a motion game apparatus according to an embodiment of the present invention. The apparatus includes a display device 200 for displaying motions of a plurality of cameras 100 and actors, an input unit receiving input of a game player, and a sound device. The game player takes a motion within a certain range that the camera can detect after attaching a plurality of optical sensors (not shown in the drawings). The camera 100 can track the motion of the player using an optical sensor attached to the game player.

At this time, it is preferable that the number of optical sensors attached be attached to all possible joints. However, since the number of optical sensors increases as the number of image processing increases, an appropriate number should be selected considering processing speed and capacity. The more cameras attached, the more accurate data can be obtained, but the number of sensors is similar to the number of sensors.

2 is a block diagram of a motion game device used in the present invention. The motion game apparatus of the present invention comprises an input unit receiving a game player input, a controller, a sensor / camera, a video output device, a music DB, a character / stage DB, an audio output device, and an image memory. The control unit includes a motion selector for outputting a motion selection signal according to the output of the input unit, a motion data storage unit for storing a plurality of motion data of the original actor, a retargeting processor for retargeting the motion of the original actor, A motion estimation unit for comparing and evaluating the motion data of the game player with the retargeting original actor motion data, and a motion estimation unit for capturing the motion of the game player And a result video output unit for displaying the motion capture unit and the output of the motion evaluation unit on the video output device.

Hereinafter, the operation flow of the motion game apparatus of FIG. 2 will be described. The game player selects one of a plurality of motion data using the input unit. The motion selection unit selects one of the plurality of motion data recorded in the motion data storage unit and inputs the selected motion data to the retargeting processing unit.

The retargeting processing unit detects the size of the body by receiving the body size from the game player or through the image processing using the camera, then extracts the difference value of the physical dimensions of the game player and the original actor, And stores it in the retargeting original actor motion data storage unit. A detailed description of retargeting will be described with reference to FIG. The motion of the retargeted original actor is provided to the player through the image processing unit, the image memory, and the video output device. At this time, a basic frame for important motion to be provided in the future is provided to the game player through the frame storage unit and the sliding control unit so that the player can easily follow the motion of the original performer. The motion of the player is stored in the game self-motion data storing unit in real time. The motion evaluating unit compares and evaluates the game self motion and the retransmitting original actor motion data, and provides the result to the game player through the video output device.

Since the body size of the original actor is different from the body size of the player, this problem must be solved before analyzing the motion. The process for solving such a problem is referred to as retargeting, and Fig. 3 shows a procedure for processing retargeting.

First, body data of the original actor and body data of the player are obtained by using the input of the user or image processing through image capture from the camera. After analyzing the two data, the motion data of the cash actor is converted according to the physical dimension of the player. In general, such a transformation is performed by enlarging the three-dimensional motion data of the original actor, that is, the three-dimensional motion data of the original actor, centered on the body part as a reference for obtaining motion data (mostly based on the waist) And then the center is moved. After the center shift, motion data of the original retransmitted original actor can be obtained by performing a transformation to satisfy the constraint condition. For example, a three-dimensional motion data of a basketball player with a 2-m key is calculated by considering the physical dimensions of a 1-m-key elementary school student, A phenomenon occurs in which a part of the foot that needs to be brought into contact with the ground is floated. Therefore, the constraint of "the foot part must touch the ground" must be given, and the three-dimensional motion data of the basketball player should be converted in consideration of the constraint.

FIG. 4 is a frame structure diagram showing an example of the structure of an image frame of a three-dimensional original actor used in the present invention. Each box represents a motion frame stored in unit time intervals, and symbols on each box represent frame numbers. It can be seen that the video frame of the original actor is composed of the start and end frame and the motion frame. A motion frame is divided into a basic motion frame and a general motion frame, and a frame representing a specific motion (that is, a motion that is a key during a dance motion) among the motion frames is defined as a basic motion frame. The information about the basic motion frame may be marked (pointed) by a management program that specifies the point of time at which the motion data is generated or the motion data is stored and then a "specific posture" . The information on whether or not the basic motion frame is included can be included in a part of the motion frame indicating the motion of the original actor, or a separate file can be used.

The motion frame is generally stored in the form of a file for displaying a moving picture. A typical example of the motion frame is a BVH file. The BVH file format describes the tree structure consisting of several sensors for displaying each part of the body, and then displays the coordinate values and angles of the sensors corresponding to the respective body parts by time zone. By using the BVH file, it is possible to grasp coordinate values of each sensor by time zone.

5 and 6 are explanatory diagrams for explaining a method of displaying the preliminary action of the original actor motion. FIG. 5 (a) shows a original actor motion frame indicating a motion of a original actor, (b) is a basic motion frame showing information on a basic motion among motion frames of a original actor, And a game self-motion frame for storing the motion of the game player. it can be seen that the 10th, 17th, 19th, 21st, 25th, 27th, 28th, 31th, 37th, 38th, 40th, 42nd and 48th frames are designated as basic motion frames. The current time t is a time point at which the game player must follow the motion of the original actor, the real time motion of the original actor is provided, Is for displaying the time interval for detecting the basic motion frame. According to FIG. 5 Represents a state defined by the time at which 6 frames are displayed. According to FIG. 5, at the current time t, the 16th motion frame of the original actor is provided to the game player, (17th, 19th, and 21st frames) existing between the two frames are displayed for previewing to the player.

For example, FIG. 6 illustrates how these items are displayed through the two-dimensional display device. As shown in FIG. 6 (a), in a certain region 61 on the screen, The main motion (17th, 19th and 21st frames in Fig. 5), which is to be taken at the next moment, is sequentially displayed in real time motion So that the display is displayed while approaching the predetermined area 61 where the display is reproduced. By applying such a display method, a game player can grasp the next main operation in advance and can easily follow the motion of the original actor.

6 (a), when the height He of the player's eyes is larger than the distance Dy between the center of the display device screen and the player's sole position, the coordinates The coordinate value Yi on the Y axis on which the operation is started and the coordinate value Yf on the Y axis on the screen where the real time continuous operation is displayed must satisfy Equation (1). This is to give a stereoscopic feeling by displaying the guiding action in consideration of the eye level of the player.

Similarly, when the height He of the game player's eye is smaller than the distance Dy between the center of the display device screen and the player's sole position, the Y-axis coordinate value Yi on which the guide operation starts is displayed in real time continuous operation The coordinate value Yf on the Y-axis on the screen should satisfy Equation (2).

The directionality of the vector composed of the start point (Xi, Yi, Zi) and the end point (Xf, Yf, Zf) is determined by analyzing motion data such as BVH of the original actor including the sensor position value attached to each joint of the original actor Therefore, it is possible to display the guiding operation more realistically by displaying the guiding operation in consideration of the directionality of the vector. It is more preferable for the convenience of the player to locate the position point (Xf, Yf, Zf) on the screen where the continuous action of the original actor is displayed in the center of the screen. The starting point (Xi, Yi, Zi) It is preferable to designate the frame size appropriately in consideration of the number of frames of the preliminary operation and the horizontal size of the screen. The eye height He of the player can be easily calculated using the statistic value of the position of the eye from the key inputted by the game or the key of the game player calculated from the camera.

7 is a flow chart illustrating the overall operation of displaying and evaluating motion using the motion frame shown in FIG. The game player selects the motion data, the music DB, and the character DB by using the input unit (step s71). Next, the game player uses the body size input from the game player or the body size of the player, (Step s72). The three-dimensional image coordinate value data of the original actor is converted (retargeted) using the comparison value (step s73). In this case, in order to capture the motion of the original actor, The position and the number of the sensors attached to the body of the player are different from the positions and the number of the sensors attached to the player. Therefore, it is necessary to first match the objects to be compared in order to properly evaluate them. Therefore, the position data of the reference sensor is calculated from the original actor motion data based on the position and the number of the sensors attached to the game player (step s74)

Then, the three-dimensional motion data of the original actor is displayed in real time and the guiding operation is displayed (step s75). The motion of the original actor displayed may display the three-dimensional motion of the original actor to be retargeted It is desirable to display the original actor three-dimensional motion after being targeted. When the 3D motion of the original actor is retargeted to be retargeted, there is an advantage that the motion of the original actor can be faithfully reproduced. However, it is difficult to accurately evaluate the motion of the player and the motion of the original actor. When displaying a three-dimensional motion of a retargeted original actor, the advantage is that it can be conveniently handled in comparison with a game self-motion. That is, when displaying the motion of the player superimposed on the motion of the original actor, using the retargeted motion has an advantage that the motion difference between the motion of the original actor and the motion can be easily recognized.

The motion of the game player watching the motion of the original actor displayed is stored in units of frames in real time (step s76). At this time, it is determined whether the original actor three-dimensional motion frame displayed at time t is a basic motion frame In the case of the basic motion frame, the reference sensor position data calculated in step s74 and the game self-motion frame captured in real time are compared and evaluated (step s78). In this case, steps s76 and s77 may be alternately performed, The step s74 may be performed after the step s77. That is, after determining whether the original actor three-dimensional motion frame is the basic motion frame, the position of the sensor obtained from the motion of the player can be compared with the calculated result while calculating the reference sensor position data for the basic motion frame. If step s76 or step s74 is performed after step s77, only the motion frame of the player who follows the basic motion frame of the original actor is stored, and only the reference sensor position data for the basic frame is calculated.

After checking whether the frame is the last frame (step s79), if it is not the last frame, the step s75 is resumed. If the frame is the last frame, the final result is displayed using the comparison evaluation result (step s80)

In order to reduce the time required for the image evaluation procedure, the comparative evaluation of whether the motion of the player corresponds to the basic motion frame of the original actor should be performed in real time within a short period of time.

1. In the reference sensor position value calculation step (S81)

As described above, in order to capture the motion of the original actor, the position and the number of the sensors attached to the body of the original actor are the positions and the number of the sensors attached to the game player. . Accordingly, the three-dimensional position value of the reference sensor is calculated from the reference motion data of the original actor based on the position and the number of the sensors attached to the game player. This is defined as a reference sensor position value. For convenience of explanation, it is assumed that the reference sensor position value of the sensor 1 attached to the game player is (X1, Y1, Z1).

2. Two-dimensional coordinate value calculation step for each camera (step S82)

As described above, a plurality of cameras are used to grasp the three-dimensional position of the sensor attached to the game player. A three-dimensional image can be obtained by synthesizing two-dimensional images of a plurality of cameras thus provided. A similar procedure to a method of synthesizing a three-dimensional image in a two-dimensional image is reversed, so that a corresponding two-dimensional coordinate value of a sensor to be provided in each camera can be calculated in order to implement a three-dimensional image of the corresponding original actor. Dimensional coordinate values (X11, Y11) to be displayed on the first camera from the reference sensor position values (X1, Y1, Z1) in step S1, and two-dimensional coordinate values (X21, Y21), ..., and two-dimensional coordinate values (Xn1, Yn1) to be displayed through the nth camera.

3. Calculating the target area of each camera (step S83)

For each camera, a certain area is set from the exact position point at which the sensor should be found. For example, if the player follows the precise motion of the original actor, the exact position value of the sensor 1 recognized by the camera 1 should be (X11, Y11), but it will not be possible to take precise motion without any error. (X11 + 5, Y11 - 5), (X11 + 5, Y11 - 5), and (X11 + 5, Y11 - 5) when the constant margin is set to 5, for example, 5) and (X11-5, Y11 + 5). The area selected in this way will be referred to as a target area for convenience.

4. Checking whether or not the sensor in the target area is detected (step S84)

It is checked whether or not the image coordinates of the sensor attached to the game player are entered in the target area set in step S83 among the image data of each camera. When a method of searching the entire area of image data output from each camera and determining the position value of the sensor attached to the game player and comparing it with the sensor position value of the original performer as in the normal image processing method, A considerable time is required for the processing. Therefore, there is an advantage that the time of image processing can be considerably saved by pre-setting the target area to be detected by the sensor and checking only the predetermined target area instead of the entire area. When checking in this manner, if a sensor is found in the target area of all cameras, the player estimates that the motion accurately follows, and if not, it is easy to judge that the motion of the player differs from the motion of the original actor have. Dimensional information of the sensor to be finally used with two-dimensional detection information obtained from two or more cameras based on one sensor, i.e., after obtaining the three-dimensional position information by combining the detected two-dimensional data, A method of comparing with the three-dimensional data of the actor may be used. The algorithm for obtaining three-dimensional information from a plurality of two-dimensional information follows a general theory in the field of computer vision, and a description thereof is omitted here.

FIG. 9 is a flowchart showing the execution flow of the present invention in more detail. According to the user's selection, the user can track the whole body motion using music (s101, s102), high performance motion capture system, and character and stage (s103, s104) that can be applied when visualizing the user separately from the original actor's image Step). The original actor motion data is read from the motion capture DB of the original actor (step s105). The character image is overlaid on the original actor motion data (step s106). If the original actor image is used as it is, The data throughput can be reduced by overlaying the character image already stored in the motion coordinates of the original actor. Next, the motion data and the music data are matched (Step s107). The motion data of the original actor uses the display device, and the music is output using the sound device. (step s108). The user takes a motion according to the output data (step s109). Then, the whole body motion is captured using a plurality of cameras, the mark is identified from the image, and the motion is tracked frame by frame. s110, and s111). The two-dimensional coordinate values are extracted using the acquired image data, and the three-dimensional motion coordinate values are obtained from the extracted data (steps s113 and s114)

Next, the body dimension is compared using the original actor coordinate data and the three-dimensional coordinate value of the motion-captured learner (steps s115 and s116). When there is a difference between the actual comparison results, retargeting is performed (s117, s118 Step) The retargeting may be performed during the learner motion capture as shown in the flow shown in Fig. 9, but may be performed before the full motion capture is executed. After the retargeting, in the case of the reference frame, the original actor data is compared with the data of the learner to check whether they match or do not coincide (s119, s120). In case of coincidence, a score is given, (Step S122 to step S124). After storing the motion capture data in the user motion storage unit, it is checked whether it is the last frame. s125, step s126). If it is not the last frame, the next motion is captured. If it is the last frame, the game ends.

If the original actor motion data and the learner's motion data do not coincide with each other, a check is made as to whether or not the function of setting whether to end the game according to the number of inconsistencies is checked (step s127), and if the discrepancy is not equal to or more than the predetermined number .

INDUSTRIAL APPLICABILITY As described above, the motion game device of the present invention makes it possible to evaluate the motion of a player or a player who follows a motion of a dancer or the like in real time.

In the motion game device showing the motion of the original actor, the method of reproducing the motion data so that the game player can more easily follow the motion of the original actor is presented, thereby increasing the convenience of use. The motion game device can be practically used by quickly evaluating the motion of the player who follows the motion in real time.

Although the present invention has been shown and described with respect to specific embodiments thereof, it will be understood by those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the invention as defined by the appended claims. Anyone who can afford it will know.

Claims (9)

A motion data display method of a motion game apparatus for reproducing motion data of a original actor composed of a plurality of frames on a display device, the motion data including information about a basic frame representing a main motion of a original actor, (Xf, Yf, Zf) on the screen for reproducing the continuous action of the original actor and a predetermined time A first step of setting an initial position point (Xi, Yi, Zi) on a screen for previewing a basic frame to be reproduced later; Continuously displays the continuous operation of the original actor at the reproduction position point (Xf, Yf, Zf) on the basis of the current time t A second step of deriving a basic frame to be displayed on the initial position point Xi, Yi, Zi and displaying the basic frame on the initial position point Xi, Yi, Zi; And And a third step of progressively moving the basic frame displayed at the initial position point Xi, Yi, Zi over time to the reproduction position point Xf, Yf, Zf. Of the motion game device. (Xf, Yf, Zf), which is a predetermined position on the display device for reproducing the continuous motion of the original actor, and a reproduction position point At a predetermined time (Xi, Yi, Zi) on a display device for previewing a basic frame to be reproduced later, and reproducing motion data of the original actor on a display device, Continuously displays the continuous operation of the original actor at the reproduction position point (Xf, Yf, Zf) on the basis of the current time t And displaying the basic frame at the initial position point Xi, Yi, Zi after deriving a basic frame to be displayed at the initial position point Xi, Yi, Zi; And And a second step in which the basic frame displayed at the initial position point Xi, Yi, Zi is displayed while gradually moving to the reproduction position point Xf, Yf, Zf as time elapses Of the motion game device. 4. The method according to any one of claims 1 to 3, The image size of the basic frame displayed at the initial position point Xi, Yi, Zi is smaller than the size of the image for reproducing the continuous motion of the original actor displayed at the playback position point Xf, Yf, Zf, And the movement in the second step is an enlarged movement. The method according to claim 1, Wherein the reproduction position points Xf, Yf and Zf are set as the screen center of the display device and the initial position points Xi, Yi and Zi are along the motion of the original actor, Wherein the motion data is changed vertically with respect to a horizontal direction. (Xf, Yf, Zf), which is a predetermined position on the display device for reproducing the continuous motion of the original actor, and a reproduction position point At a predetermined time (Xi, Yi, Zi) on a display device for previewing a basic frame to be reproduced later, and evaluating the motion of a player who follows the motion data of the original actor displayed on the display device, A first step of transforming the three-dimensional motion data of the original actor by reflecting the dimensions of the player's body and storing the three-dimensional motion data of the retargeted original actor; The continuous motion of the original actor is continuously displayed on the reproduction position point (Xf, Yf, Zf) based on the current time t by using the three-dimensional motion data of the retargeted original actor A second step of deriving a basic frame to be displayed on the initial position point Xi, Yi, Zi and displaying the basic frame on the initial position point Xi, Yi, Zi; A third step in which the basic frame displayed at the initial position point Xi, Yi, Zi is displayed while gradually moving to the reproduction position point Xf, Yf, Zf as time elapses; A fourth step of extracting and storing three-dimensional motion data of a player who learns the same motion while following the motion of the displayed original actor; A fifth step of calculating a reference sensor coordinate value of the original actor corresponding to the sensor position attached to the game player from the basic frame displayed at the reproduction position point (Xf, Yf, Zf) in the third step; And a sixth step of comparing the three-dimensional motion data of the player with the reference sensor coordinate value. 6. The method of claim 5, Wherein the fourth step and the fifth step are performed regardless of the order, and the fifth step is provided between the first step and the sixth step. (Xf, Yf, Zf), which is a predetermined position on the display device for reproducing the continuous motion of the original actor, and a reproduction position point At a predetermined time (Xi, Yi, Zi) on a display device for previewing a basic frame to be reproduced later, and a motion of a player who follows motion data of the original actor displayed on the display device A method for evaluating a compound, A first step of transforming the three-dimensional motion data of the original actor by reflecting the dimensions of the player's body and storing the three-dimensional motion data of the retargeted original actor; A second step of calculating a plurality of optical sensor positions attached to the game player from three-dimensional motion data of the retargeted original performer; The continuous motion of the original actor is continuously displayed on the reproduction position point (Xf, Yf, Zf) based on the current time t by using the three-dimensional motion data of the retargeted original actor And displaying the basic frame at the initial position point Xi, Yi, Zi after deriving a basic frame to be displayed at the initial position point Xi, Yi, Zi; A fourth step in which the basic frame displayed at the initial position point Xi, Yi, Zi is displayed while gradually moving to the reproduction position point Xf, Yf, Zf as time elapses; A fifth step of extracting and storing the position of the optical sensor of the game player learning the same operation while following the motion of the original actor displayed; And And a sixth step of comparing the sensor position calculated from the basic frame displayed at the reproduction position point (Xf, Yf, Zf) in the fourth step with the sensor position of the player stored in the fifth step To evaluate the motion of the player. delete delete