WO2010143872A2

WO2010143872A2 - Motion learning system using motion capture and a three-dimensional graphical representation, and method for same

Info

Publication number: WO2010143872A2
Application number: PCT/KR2010/003676
Authority: WO
Inventors: 고영준
Original assignee: Ko Young Joon
Priority date: 2009-06-09
Filing date: 2010-06-09
Publication date: 2010-12-16
Also published as: WO2010143872A3; KR20100132322A

Abstract

The present invention relates to a motion learning system using motion capture and a three-dimensional graphical representation, and to a method for implementing same. The present invention provides a motion learning system which simultaneously outputs, through a display device, 'three-dimensional graphical motion image information' which is simultaneously rendered from one or more three-dimensional graphical cameras using a virtual character adopting motion capture and a three-dimensional graphical representation, and 'three-dimensional graphical step image information' which is rendered from a three-dimensional graphical camera directed toward the floor. The present invention enables a student to check the motion of the virtual character from one or more viewpoints and the position and direction of the foot and movement speed of the virtual character in an accurate manner, and the student can thus clearly understand and follow the motion of the teacher carried out by the virtual character. Further, as the present invention uses the three-dimensional graphical virtual character using motion capture, the student may repeatedly study the accurate motion of any desired part using a remote control.

Description

Motion Learning System and Method Using Motion Capture and 3D Graphics

The present invention relates to a motion learning system for observing motion image information of a body generated at one or more viewpoints and motion image information of a foot generated at one viewpoint using motion capture and three-dimensional graphic technology. will be.

Conventional motion learning system using image information displays motions of a motion expert and a virtual character implemented through motion capture technology on one screen, and the user learns motions by moving his body accordingly. It was the way.

In particular, the step information to help the understanding and learning of the motion is provided in a simple manner of transmitting a plane image indicating the position of the foot through the dance textbook, as shown in Figure 2, it was difficult to deliver accurate information with low understanding.

In the motion training media and programs according to the prior art, the user is primarily provided with image information of a short time point so that the user can learn according to the motion. However, in this method, it is possible to accurately observe the motion of a person in a three-dimensional space. It lacks the ability to continuously visualize information about the exact movements of the foot, particularly important in motion learning.

According to the present invention, by applying the three-dimensional motion information obtained through the motion capture to the virtual character to render 'three-dimensional graphics motion image information' from one or more viewpoints and at the same time 'three-dimensional graphics step image information' Because it renders and outputs, it is faster and more accurate to understand motions than existing systems that deliver images at a single point of view, so that difficult motions can be learned more effectively. For example, in the case of dance, the movement of the foot is continuously observed through '3D graphic step image information' while the speed, direction and position are continuously observed. Since this process can be confirmed in real time, it is possible to identify and learn complex dance movements accurately and effectively in a shorter time.

'3D graphic step image information' of the present invention refers to a 3D graphic image using a motion capture that can continuously check the area corresponding to the foot or the sole that was not represented by the existing image information, and the existing media Unlike other parts of the body, which are not visible because they are not covered by other parts of the body, it is effective for the delivery of visual information about the movement of a person's foot, and the user can view the 3D graphic motion image information at the same time. By understanding the movement of the foot, you can be provided with a motion learning environment that can check the motion of the body.

'3D graphic motion image information' of the present invention refers to a 3D graphic image rendered from one or more 3D cameras facing a virtual character to which predetermined 3D motion data is applied, and the 3D graphic motion image information is a 3D camera. When output through one or more display devices installed in the direction corresponding to the user can continuously view the operation image corresponding to the viewpoint from the display located in the direction of the line of sight.

For example, in the case of a rotating motion, the image recorded at one viewpoint should turn the head to the display direction in order to see the motion image. According to the present invention, the motion image of the corresponding viewpoint is displayed on a plurality of displays during the rotation. This real-time output is very quick and effective to confirm the operation of the case.

In addition, according to the present invention, since a plurality of displays can be controlled at the same time through the remote control device effective learning in a short time by learning the three-dimensional motion information through the interval repeat or low speed playback until the learning of the operation is made There is.

According to the method of the present motion learning system, the user can confirm the motion of the virtual character at the appropriate time and the position and direction of the foot accurately, so that the human motion can be accurately understood and followed. In fact, in case of simple operation, the motion can be effectively followed only by '3D graphic step image information' using motion capture, and the operation of considerable difficulty is possible even when outputting a sufficient number of '3D graphic motion image information' to multiple displays. To learn for yourself. In addition, since the 3D graphic character is output in real time, the effect is greater when the desired part is repeatedly checked and learned using the remote controller.

1: Diagram of dance learning system using graphics

2: existing step information

3: 3D graphic step image information

4: Example 1 of the motion learning system

5: Example 2 of the motion learning system

6: Example 3 of a motion learning system

DESCRIPTION OF THE PREFERRED EMBODIMENTS Preferred embodiments of systems and methods according to the present invention are described below with reference to the accompanying drawings.

1 is a block diagram illustrating a motion learning system according to the spirit of the present invention.

Referring to FIG. 1, the present invention relates to a motion learning system using motion capture and 3D graphics and a method of implementing the same. An operation database unit 102 stores 3D motion data generated by motion capturing a predetermined human motion. ), A sound source database unit 101 for storing a sound source corresponding to the motion data, an motion information database unit 103 for storing data describing the motion data, and one installed toward the virtual character to which the 3D motion data is applied. The motion image information rendering unit 111 generating one or more motion images from the 3D graphics camera, the 3D motion data, or a part corresponding to the foot of the cyber character to which the 3D motion data is applied, is not covered by other body parts. One or more tertiary via one or more three-dimensional graphics cameras to allow continuous viewing Step image information rendering unit 112 for rendering the original graphic step image information, operation information display unit 113 for outputting a description of the operation being played, and sound source playback unit 120 for outputting a sound source corresponding to the operation being played from the database. ), The image display unit 140 for simultaneously outputting the images transmitted from the rendering unit through one or more display devices, the reproduction, stop, repeat, interval repeat, speed control, screen of the plurality of rendering units and the sound source playback unit It is configured to include a remote control unit 130 to control the remote control at the same time.

In the present invention, the existing step information used in the dance book as shown in FIG. 2 is utilized to make a three-dimensional graphic step image information by applying motion capture and three-dimensional graphics technology. This type of step information cannot convey the feeling of operation because there is no information about the position or direction of successive step. Therefore, in order to utilize the existing step information, the present invention uses the rendered 3D step image information by applying real-time motion capture and 3D graphic technology to the virtual character as shown in FIG. 3. The 3D step image information can accurately transmit the movement of the foot because the image of the foot or the sole portion is continuously displayed using a virtual character applied with motion capture and 3D graphics.

4 is a first preferred embodiment of such a motion learning system. Using motion capture and 3D graphics technology, as shown in FIG. 4, 3D graphic motion image information 601 rendered at one viewpoint and 3D graphic step image information rendered from a camera facing the bottom surface 602. ) Can be confirmed through one display apparatus 600.

5 is a second preferred embodiment of a motion learning system. The three-dimensional graphic motion image information 601 rendered at one viewpoint and the three-dimensional graphic step image information 611 rendered from the camera facing the bottom surface may be confirmed through the two

display apparatuses

600 and 610.

6 is a third preferred embodiment of a motion learning system. The three-dimensional graphic

motion image information

601 and 701 rendered at two viewpoints can be checked simultaneously through the two

display devices

600 and 700, and the three-dimensional graphic step image information 611 rendered from the camera facing the bottom surface is one. The display device 610 can be checked at the same time.

The user can understand and learn the motion of a complex person by understanding the motion of a person through the three-dimensional graphic step image while at the same time understanding the motion of the person through a separate three-dimensional graphic step image. In addition, the operation may be repeatedly observed through a plurality of image information through a remote control device.

In the present invention, the left foot and the right foot of the 3D graphic step image information can be identified by color, shape, symbol, etc., and when the foot touches the floor, the color or brightness of the touched part is changed, and the contact duration time is reached. By identifying the, the user can effectively understand and learn the foot motion through the 3D graphic step image.

The present invention can be configured on-offline, it is preferable to provide a motion capture data of the expert to provide offline or service as content on-line. In addition, it is desirable to have a remote control and the like on-line and off-line so that the user can freely search for a desired operation.

Since the present invention is transmitted through a three-dimensional image, at least one display is required. For this purpose, it is preferable to output two images on one monitor or to output images on two or more monitors. It works in the form. It is possible to operate by outputting 'three-dimensional graphic motion images' at various points of time using a larger number of displays offline.

The system of the present invention provides a method of training a movement of ballet, dance, gymnastics, etc. through online and offline without incurring a high cost by pioneering a new area in the educational contents market.

Claims

(a) a motion database unit for storing three-dimensional motion data generated by motion capturing a motion of a predetermined person;

(b) a sound source information database unit for storing sound source information corresponding to the operation data;

(c) a motion image information rendering unit configured to render motion image information of the virtual character in real time through at least one 3D graphic camera installed in an arbitrary direction toward the virtual character to which the 3D motion data of (a) is applied;

(d) a step image information rendering unit configured to render in real time three-dimensional graphic step image information capable of continuously observing only a part corresponding to the foot or the sole of the virtual character of (c) through a three-dimensional graphic camera facing the floor;

(e) an image display unit which simultaneously outputs the 3D graphic motion image information of (b) and the 3D graphic step image information of (c) in real time through one or more display devices; and

(f) an operation learning system including a sound source reproducing unit which displays the image information of (e) and simultaneously receives the corresponding sound source from the sound source information database and outputs it in real time;
The method of claim 1,

And a remote control device for remotely controlling the reproduction, stop, pause, repetition, section repetition, speed control, and screen switching of the image information of the image information and sound source information.
The method of claim 1,

And a motion information database for storing data describing the 3D motion data, and a motion information display for outputting a description of the motion being reproduced.
The method of claim 1,

The 3D graphic step image information is a motion learning system, characterized in that the left and right feet can be identified by color, shape, symbols, etc.
The method of claim 1,

The 3D graphic step image information is a motion learning system, characterized in that when the foot touches the floor, the color or brightness of the touched part is changed to identify the touched part and the contact duration.
(a) motion capturing motions of a predetermined person to generate three-dimensional motion data;

(b) real-time rendering the 3D graphic motion image information of the virtual character through at least one 3D graphic camera installed in an arbitrary direction toward the virtual character to which the 3D motion data of step (a) is applied;

(c) real-time rendering three-dimensional graphic step image information capable of continuously observing only a part corresponding to the foot or the sole of the virtual character of step (b) through a three-dimensional graphics camera facing the floor;

(d) reproducing sound source information corresponding to the motion data in real time; And

(e) simultaneously outputting three-dimensional graphic motion image information of (b), three-dimensional graphic step image information of (c) and sound source information of (d) in real time through one or more display devices and sound devices;

Action learning method comprising a.
The method of claim 6,

And remotely controlling playback, stop, pause, repetition, section repeating, speed control, and screen switching of the image information of the image information and sound source information.
The method of claim 6,

The motion learning system includes a motion description step of displaying a description of the motion.
The method of claim 6,

The three-dimensional graphic step image information is a motion learning method characterized in that the left foot and the right foot can be identified by color, shape, symbols and the like.
The method of claim 6,

Wherein the three-dimensional graphic step image information is a motion learning method characterized in that when the foot touches the floor to change the color or brightness of the touched area to identify the contact and the contact duration.