KR20150025462A - Method and apparatus for modeling interactive character - Google Patents

Abstract

The present invention relates to a method and an apparatus for modeling an interactive character. A real-time movement of two characters are generated by receiving movement data from two motion captured characters, mapping the movement data into an inverted pendulum model so that a spatial relationship of the two characters are maintained, obtaining a reference path for controlling the movement of the two characters from the movement data and the inverted pendulum model, transferring the reference path to a movement of the two characters by taking the state of the inverted pendulum model into consideration and tracking the transferred movement.

Description

METHOD AND APPARATUS FOR MODELING INTERACTIVE CHARACTERS Field of the Invention < RTI ID = 0.0 >

In particular, the present invention relates to a technique for modeling a character, and more particularly, to a technique for modeling a character, in particular, a method of mapping a motion data input to maintain a spatial relationship between two characters to an inverted pendulum model, acquiring a reference path from the inverted pendulum model, To a method and apparatus for modeling a character.

As the game industry develops and game hardware and graphics engines evolve, most of the current game graphics are being produced in 3D. This is because consumer demands demand game contents that can give more realism. PS3 and XBOX360 have been developed to enjoy 3D games output at 1080P in full HD era, and GPU (Graphics Procession Unit) is developing based on 3D processing speed. The 3D-oriented development of game graphics hardware has a common goal of creating more realistic and brilliant effects.

In addition, there is a growing demand for realism in the field of 3D games and animation in keeping with these developments. Therefore, it is necessary to study various technologies that satisfy this. Currently, motion capture technology is used in medicine, engineering, etc., and it is widely used in entertainment fields such as movies and games. In particular, motion capture has been utilized so that it can be used in movies and enjoy dramatic and realistic games in games.

On the other hand, the prior art cited below introduces a technique for generating a game character animation using a motion capture system. Although there are some differences according to the motion capture device and the used software, the general work process is performed in order of modeling the character, acquiring the motion capture data, editing and post-processing the motion data, and connecting the motion data to the character model. However, in the conventional motion capture system, when a plurality of characters are handled, the operation is unnatural because the relation between the characters is not taken into account, and an external stimulus or an immediate response to a user's input signal .

From such a viewpoint, it can be seen that a technical means for generating a motion of a plurality of characters in consideration of a spatial relation between a physical rule and a character is necessary to model a plurality of characters through motion capture.

 Game Character Animation Using Motion Capture System, Yi-Hee Lee, Journal of the Institute of Information Scientists and Engineers, Vol.24 No.21, 2006.2

Accordingly, a first object of the present invention is to provide a method of generating an action of a plurality of characters in consideration of a physical relationship between a physical rule and a character.

A second problem to be solved by the present invention is to provide a device capable of generating an action of a plurality of characters in consideration of a physical relationship between a physical rule and a character.

In order to accomplish the first object of the present invention, there is provided a method of operating a mobile terminal, comprising the steps of: receiving motion data of two characters captured with motion capture; Mapping the operation data to an inverted pendulum model so that the spatial relationship of the two characters is maintained; Obtaining a reference path for controlling the operation of the two characters from the operation data and the inverted pendulum model; Translating the reference path into motion of the two characters in consideration of the state of the inverted pendulum model; And generating a real-time motion of the two characters by tracking the transitional movement. The present invention also provides a method of modeling a character.

According to an embodiment of the present invention, an inverted pendulum model for each of the two characters is resiliently coupled and mapped so as to maintain a predetermined distance, thereby maintaining a spatial relationship between the two characters It can be a way to model a character.

The obtaining of the reference path may include obtaining a control parameter including direction components of the inverse pendulum model for the two characters; Obtaining a path parameter for moving the inverted pendulum model from the control parameter in the same pattern as the operation data; And obtaining the reference path based on the path parameter.

According to another embodiment of the present invention, the control parameter designates a direction in which the other party is viewed as a facing vector, and a direction in which the other party is to be avoided is designated as an avoiding vector, And is obtained from a coefficient of the avoiding vector.

According to another embodiment of the present invention, the step of acquiring the path parameter includes: setting a difference between the motion data of the two motion-captured characters and the inverted pendulum model as an objective function; And obtaining the path parameter from a value derived based on the objective function.

According to another embodiment of the present invention, the step of transitioning the reference path to motion may be a method of modeling the character including the step of deforming the reference path to correspond to the center of gravity of the inverse pendulum model.

 According to another embodiment of the present invention, the step of generating the real-time motion may comprise the steps of: tracking joint angles for the two characters, controlling the joints through the tracking, As shown in FIG.

In order to accomplish the second object of the present invention, there is provided an apparatus comprising: an input unit for receiving motion data of two motion-captured characters; Mapping the operation data to an inverted pendulum model so as to maintain a spatial relationship between the two characters, obtaining a reference path capable of controlling operations of the two characters from the operation data and the inverted pendulum model, A processing unit for shifting the reference path to correspond to the center of gravity of the inverted pendulum model in consideration of the state; And a generation unit for generating a real-time motion of the two characters by tracking joint angles of the two characters with respect to the transitioned motion, wherein the processing unit is configured to generate a control parameter including a direction component of the inverse pendulum model for the two characters Obtains a path parameter for moving the inverted pendulum model from the control parameter in the same pattern as the operation data, and obtains the reference path based on the path parameter. do.

According to an embodiment of the present invention, the processing unit sets the difference between the motion data of the two motion-captured characters and the inverted pendulum model as an objective function, and obtains the path parameter from a value derived based on the objective function The character modeling apparatus may be a character modeling apparatus.

It is also possible that the control parameter specifies the direction in which the other party is viewed by the front vector and the direction in which the other party is to be avoided by the avoidance vector so as to obtain the control parameter from the coefficients of the front vector and the avoiding vector And a character modeling device.

According to the present invention, the motion capture data for two characters is mapped to an inverted pendulum model, the reference path is obtained from the motion capture data and the inverted pendulum model, and the reference path is defined as the movement of the two characters By transitioning, it is possible to track the movement and generate the actions of two interacting characters. Further, by obtaining the control parameters including the direction components for the two characters, obtaining the path parameters from the control parameters, and obtaining the reference paths based on the path parameters, the operations of the two characters interacting in consideration of the reference path Can be generated.

1 is a flow chart illustrating a method for generating an action of two interacting characters in accordance with an embodiment of the present invention.
2 is a flow chart illustrating a method for obtaining a reference path in accordance with another embodiment of the present invention.
3 is a diagram showing control parameters of an inverted pendulum model according to another embodiment of the present invention.
4 is a diagram illustrating a process of obtaining path parameters from path data and an inverted pendulum model according to another embodiment of the present invention.
5 is a view showing reference paths obtained based on path parameters according to another embodiment of the present invention.
FIG. 6 is a diagram illustrating a process of an action plan for creating an action of two interacting characters according to another embodiment of the present invention.
FIG. 7 is a detailed view illustrating a process of kinematic mapping for generating an operation of two interacting characters according to another embodiment of the present invention.
8 is a detailed view illustrating a process of analyzing an operation according to another embodiment of the present invention.
9 is a detailed view illustrating a process of generating an operation according to another embodiment of the present invention.
FIG. 10 is a block diagram illustrating a character modeling apparatus for generating an action of two interacting characters according to an embodiment of the present invention.

Prior to describing the embodiments of the present invention, after investigating the problems that arise when generating the operations of a plurality of characters in real time using the existing model capture, the embodiments of the present invention This section provides a general introduction to the technical means that

The conventional method of generating motion of two characters using motion capture is a general method in which the motion of each character is cut into small unit operations and the motion is generated by connecting the cut motion. Herein, the sub-unit operations can be divided into steps of kicking, stepping, kicking, kicking, and returning to the place, for example. However, in the case of creating an action for two characters, it is necessary to create an action by considering not only one character but also the action of the other character. Therefore, the variation from one unit operation to another unit operation does not vary, and it tends to repeat the same pattern operation, so that it is difficult to generate various operations. In addition, if two operations in a non-identical state are arbitrarily given in order to vary the variation from one unit operation to another, the operations of the character appear unnatural by generating physically impossible operations. In addition, in terms of the reaction rate, if there is currently selected unit operation being performed, it will not be possible to immediately react to another external stimulus or user's input signal until the unit operation is completed.

In the case of the character animation using the existing physical model, the relation between the respective characters is not considered, even if the character is handled. In other words, there is no technical means for generating the motion of the two characters considering the spatial relation between the physical laws and the characters of the two characters. In addition, existing researches that use character modeling and motion capture simultaneously have been dealing with low degrees of freedom (DOF), such as walking and running, Modeling was not considered.

Accordingly, the present invention proposes a technical means for generating an operation of a plurality of characters from the motion-captured motion data in consideration of a spatial relation between a physical rule and a character.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. In the following description and the accompanying drawings, detailed description of well-known functions or constructions that may obscure the subject matter of the present invention will be omitted. It should be noted that the same constituent elements are denoted by the same reference numerals as possible throughout the drawings.

FIG. 1 is a flow chart illustrating a method of generating an action of two interacting characters according to an embodiment of the present invention, and may be performed by a character modeling apparatus including at least one processor.

In operation S110, the motion data of the two characters captured by motion capture is input.

More specifically, motion data derived from the motion capturing is received by capturing an operation of a character who wants to generate an motion in real time through a motion capture system.

Here, the motion capture methods used to capture real-time motion include acoustic, mechanical, magnetic, and optical. Factors that distinguish each technique of motion capture include the accuracy of the data, the sampling rate, the degree of freedom of motion allowed to the actor, the number of sampling points, and the number of actors capable of capturing simultaneously motion capture .

The acoustic motion capture is a process of attaching equipment consisting of an ultrasonic wave generating device and three receiving devices to each joint of a performer and then measuring the time taken for the ultrasonic waves generated in each device to be received by the receiving device, The speed is used to calculate the distance from the generator to the receiver. Here, the positions on the three-dimensional space of each transmission apparatus can be obtained by using the values calculated by the three reception apparatuses.

Mechanic motion capture is a composite of a potentiometer and a slider to measure the motion of the actor's joints. The mechanical motion capture system is an absolute measurement device that is not affected by magnetic fields or unwanted reflections. Therefore, there is an advantage that the initial set-up (calibration) process is hardly required and operation data can be obtained with a very high sampling frequency. However, this system can not produce the natural action of the actor, because it requires attaching a very burdensome machine to the actor's body, and the accuracy of the motion data varies depending on how precisely the machine is positioned in each joint of the actor May have disadvantages. Therefore, the mechanical motion capturing can be used together with a key frame method and an operation control method, which are known animation production techniques, and can be used to generate a key frame or a step operation.

In the magnetic motion capture, a sensor capable of measuring a magnetic field is attached to each joint of the actor, and when the actor moves near the magnetic field generator, And calculating the motion. Here, each of the sensors, the magnetic field generator, and the main body are connected by a cable. The magnetic motion capture is advantageous in that it is inexpensive, easy to operate, and requires no facility investment other than the equipment itself. In addition, unnecessary investment is not required because the necessary number of sensors are purchased and used. On the other hand, in the case of the magnetic motion capture system, the biggest drawback is a problem due to a large number of cables connected to the sensor body when attaching the sensor to the actor's body. The cables limit the actor's motion and make it impossible to express complex and fast movements naturally. Some companies have developed and marketed wireless magnetic motion capture systems that do not require a cable, but they also have the disadvantage of having to attach a transmitter to the performer's body. Therefore, the magnetic motion capture is suitable for capturing a simple operation or the like.

The optical motion capture locates motion in three-dimensional space using light, camera, and reflex dots. That is, the optical motion capture installs cameras that read information from a capture sensor attached to the body of the actor, and when the capture sensors provide a two-dimensional position, the motion capture software calculates 3D data. Unlike the magnetic motion capturing, the optical motion capturing is advantageous not only because it is not affected by the metal, but because there is no restriction on the motion, it is convenient when two or more people are acting, It is also useful for capturing. Also, since the size of the marker attached to the actor is small, it is not connected to the cable, and the number is not limited, the actor can freely move while performing the motion, and even the minute description of the motion can be made possible. The optical motion capture is capable of capturing in a wide range as compared with the acoustic, mechanical, and magnetic motion capturing, and is also high in terms of capture accuracy. On the other hand, the optical motion capture may cause the motion data to be missed when the sensors are blocked from being tracked by the cameras. It is impossible to obtain the three-dimensional coordinates when the operation data is missed, and when it is impossible to obtain the three-dimensional coordinates, a large number of post-processing steps are required, so that the real-time processing becomes impossible or complicates the motion capturing process. This can be a factor in performance degradation.

In the step of receiving the motion data of the two characters captured in step S110, the method used for the motion capture is not limited to one of the methods of the acoustic, mechanical, magnetic, and optical motion capturing methods, , Mechanical, magnetic, and optical motion capture methods.

The operation data is mapped to an inverted pendulum model so that the spatial relationship between the two characters is maintained in step S120.

More specifically, the operation data input in operation S110 are resiliently coupled and mapped so that the inverted pendulum models for the two characters maintain a predetermined distance, thereby maintaining the spatial relationship between the two characters.

Here, the inverse pendulum model obtains a center of mass (COM) representing a total mass center corresponding to the total mass of the character, and simplifies the gait kinematical expression as an equation of motion for the point mass using the center of gravity . By using the inverted pendulum model, an operation of a character or a robot can be generated, and the inverted pendulum model can maintain a balance even if there is an obstructing action in the vicinity. The characteristic that can maintain the above balance is similar to a state in which a person maintains a balance, and can be used for walking or running and centering action by expressing a walking or running motion of a character or a robot using the inverted pendulum model. However, the conventional inverted pendulum model is generally used for simple motion such as walking behavior, and the center of gravity and zero movement point (ZMP) are used for mapping the character's motion to the inverted pendulum model. However, when the ZMP is used, there is a disadvantage in that it is not possible to define the behavior of the character unless the two feet of the character are attached to the ground. Accordingly, in the present invention, when the motion-captured motion data is mapped to the inverted pendulum model, the center of gravity and the momentum are used without using the existing center of gravity and the ZMP, It is possible to define the movement of the character even in a situation where the player is away from the player. In addition, by generating an inverse pendulum model using the center of gravity and the ZMP, various operations can be generated in which the two characters interact with each other, and various patterns of operations can be generated such that the two characters do not violate the physical laws .

In step S130, a reference path capable of controlling the operations of the two characters is obtained from the operation data and the inverted pendulum model.

More specifically, the reference path of the two characters is obtained from the operation data input in step S110 and the inverted pendulum model generated in step S120, and obtaining the reference path will be described with reference to FIG.

2 is a flow chart illustrating a method for obtaining a reference path in accordance with another embodiment of the present invention.

In step S210, a control parameter including the direction component of the inverse pendulum model for the two characters is obtained. Here, the control parameters are described below with reference to FIG.

3 is a diagram showing control parameters of an inverted pendulum model according to another embodiment of the present invention.

이고, 제 1 역진자 모델(31)이 제 2 역진자 모델(32)을 회피하는 회피백터(34)가

이고, 제 2 역진자 모델(32)이 제 1 역진자 모델(31)을 바라보는 정면백터(33)가

이고, 제 2 역진자 모델(32)이 제 1 역진자 모델(31)을 회피하는 회피백터(34)가

이고, normalize가 백터에 대한 정규화이고,

이 제 1 역진자 모델(31)의 무게중심이고,

이 제 2 역진자 모델(32)의 무게중심이고,

는 Y축를 표현한 유닛 백터로서 바닥으로부터 수직 성분 백터일때, 지역 좌표(Local coordinate)는 다음과 같이 표현할 수 있다.More specifically, when it is assumed that the inverse pendulum models of the two characters face each other, the direction of looking at the other is designated as a facing vector 33, and the direction of avoiding the other is designated as avoiding vector vector (34), the control parameter can be obtained from the coefficients of the front vector and the avoidance vector. Here, the front inverters 33, in which the first inverted pendulum model 31 looks at the second inverted pendulum model 32,

, And the avoidance vector 34 in which the first inverted pendulum model 31 avoids the second inverted pendulum model 32

And the second inverted pendulum model 32 has a front vector 33 that looks at the first inverted pendulum model 31

And the avoidance vector 34 avoiding the first inverted pendulum model 31 of the second inverted pendulum model 32

Normalize is the normalization for the vector,

The center of gravity of the first inverted pendulum model 31,

The center of gravity of the second inverted pendulum model 32,

Is a unit vector representing the Y-axis and is a vertical component vector from the bottom, the local coordinate can be expressed as follows.

가 제 1 역진자 모델(31)의 속도이고,

가 제 2 역진자 모델(32)의 속도이고,

,

이 제 1 역진자 모델(31)의 방향 파라미터이고,

,

이제 2 역진자 모델(32)의 방향 파라미터일 때, 제 1 역진자 모델(31)과 제 2 역진자 모델(32)에 대한 속도를 구하는 것은 다음과 같이 표현할 수 있다.Also,

Is the velocity of the first inverted pendulum model 31,

Is the velocity of the second inverted pendulum model 32,

,

Is an orientation parameter of the first inverted pendulum model 31,

,

Now, when the direction parameter of the second inverted pendulum model 32 is obtained, the velocity for the first inverted pendulum model 31 and the second inverted pendulum model 32 can be expressed as follows.

Returning now to FIG. 2, step S210 and subsequent steps will be described.

In step S220, a path parameter for moving the inverted pendulum model in the same pattern as the motion-captured motion data is obtained from the control parameter in step S210. The process of obtaining the path parameter in the reverse direction will be described with reference to FIG.

4 is a diagram illustrating a process of obtaining path parameters from path data and an inverted pendulum model according to another embodiment of the present invention.

More specifically, the path parameter may be obtained through a spatial relation model to move the inverted pendulum model in the same pattern as the motion-captured motion data. Here, the spatial relationship model can express the motion of the inverted pendulum model, express the relationship between the inverted pendulum models, express the balance of the character pose, and express the change of the foot step with respect to the character.

가 제 1 캐릭터(43)에 대한 무게중심이고,

가 제 2 캐릭터(44)에 대한 무게중심이고,

가 제 1 역진자 모델(31)의 무게중심이고,

가 제 2 역진자 모델(32)의 무게중심이고,

가

이고,

가

이고,

는 제 1 캐릭터가 제 2 캐릭터를 바라보는 성분에 수직한 방향으로의 속도, 즉 두 캐릭터 사이의 각속도를 의미하고, 이 각속도는

로 회피방향의 속도와 제 2 캐릭터와의 거리를 사용하여 계산되고,

는 제 1 역진자가 제 2 역진자를 바라보는 성분에 수직한 방향으로의 속도, 즉 두 캐릭터 사이의 각속도를 의미하고,

로 회피방향의 속도와 제 2 역진자와의 거리를 사용하여 계산되고,

를 1이라 가정하고,

가

이고,

가

일 때, 모션캡쳐된 동작데이터와 동일한 패턴으로 상기 역진자 모델이 움직이도록 하기 위한 공간관계모델은 다음과 같이 표현할 수 있다.Also,

Is the center of gravity for the first character 43,

Is the center of gravity for the second character 44,

Is the center of gravity of the first inverted pendulum model 31,

Is the center of gravity of the second inverted pendulum model 32,

end

ego,

end

ego,

Means the speed in the direction perpendicular to the component in which the first character looks at the second character, that is, the angular velocity between the two characters ,

Is calculated using the velocity in the avoidance direction and the distance between the first character and the second character,

Denotes a velocity in a direction perpendicular to a component of which the first inverse looks at the second inverse, i.e., an angular velocity between two characters,

Is calculated using the velocity in the avoidance direction and the distance from the second inverted pendulum,

Lt; RTI ID = 0.0 > 1,

end

ego,

end

The spatial relationship model for moving the inverted pendulum model in the same pattern as the motion-captured motion data can be expressed as follows.

Now return to FIG. 2 again to explain step S220 and subsequent steps.

In step S230, based on the path parameters acquired in step S220, a reference path capable of controlling the operations of the two characters is obtained. Here, obtaining the reference path will be described with reference to FIG.

5 is a view showing reference paths obtained based on path parameters according to another embodiment of the present invention.

More specifically, the difference between the motion data of the two motion-captured characters and the inverted pendulum model may be set as an objective function, and the reference path may be obtained from a value derived based on the objective function. Wherein the objective function is to obtain the control parameter to be applied to the inverted pendulum model such that the path through which the center of gravity of the inverted pendulum model moves is similar to the path of the center of gravity of the operation data obtained from the motion capture, . In order to accomplish the above object, a total of four dimension parameters, which are target velocities of the inverse direction and the avoidance direction, of the inverted pendulum model for the two characters are changed, and a parameter which varies with time most suitable for the control parameter is found Thus, the reference path can be obtained and can be expressed as follows.

Here, project denotes projection on the y-axis, and argmin may be to find a target velocity that minimizes the error value resulting from the objective function.

Returning now to FIG. 1, step S130 and subsequent steps will be described.

In step S140, the reference path is translated into the motion of the two characters in consideration of the state of the inverted pendulum model. Here, the transition of the reference path to the motion of the two characters will be described with reference to FIG.

FIG. 6 is a diagram illustrating a process of an action plan for creating an action of two interacting characters according to another embodiment of the present invention.

More specifically, it is possible to obtain a reference path that allows the inverted pendulum model to interact and operate based on the state of the inverted pendulum model mapped based on the motion-captured motion data. Now, the path of the two characters interacting through the kinematic mapping of the reference path can be obtained. Here, the kinematic mapping will be described with reference to FIG.

FIG. 7 is a detailed view illustrating a process of kinematic mapping for generating an operation of two interacting characters according to another embodiment of the present invention.

More specifically, stepping estimation can estimate the footing position. When the foot of the character with respect to the motion data acquired from the motion capture data for estimating the footing position does not move when the foot of the character touches the ground, the relative position with respect to the inverted pendulum model Can be obtained. The obtained foot position can be rotated in accordance with the position and direction of the generated inverted pendulum model, thereby generating a footing position in a new operation. Thereafter, in order to generate a continuous foot position, the position of the next foot is compared with the position of the previous foot, taking into consideration the position where the next foot is next, can do. However, if the length of the motion generated at the time of motion generation is not long enough to allow the next footing position to be reached, the position of the next foot may not be extracted. Further, if the length of the operation data generated for extracting the position of the next foot is increased, the reaction speed of the operation, which is the posture deformation speed due to the interaction with the other party, may be delayed. In order to solve the above problem, the position of the next foot can be estimated by storing the foot position currently extracted in the motion analysis step and the time that is next to the foot, and further moving the inverse pendulum model by that time. The inverse kinematics of the lower body can be released to match the position of the foot produced by the estimation, and the position of the leg joint can be obtained according to the position of the foot.

Returning now to FIG. 1, step S140 and subsequent steps will be described.

In step S150, the real-time motion of the two characters is generated by tracking the moved motion in step S140.

More specifically, the joint angles for the two characters can be tracked, and the joints can be controlled through the tracking to generate real-time motion for the two characters.

In addition, FIG. 1 can be roughly divided into a step of analyzing an operation and a step of generating an operation, and in the step of analyzing the operation, an operation captured using motion of two persons from a motion capture device is referred to as a physical model proposed by the present invention Thereby creating a coupled inverted pendulum path generator. The operation generating step may be a step of reconstructing the motion of the character according to the inverted pendulum path when the path of the inverted pendulum models is generated in real time from the coupled path generator. Hereinafter, the step of analyzing the operation will be described in detail with reference to FIG.

8 is a detailed view illustrating a process of analyzing an operation according to another embodiment of the present invention. Here, the coupled inverted pendulum path generator may correspond to steps S110 to S120 in FIG.

More specifically, the motion analysis step can acquire the motion paths of two persons using the motion capture device. The obtained two-person capturing operation can be mapped to the inverted pendulum model through analysis as a function of the center of gravity and the movement path of the momentum. Here, since the part to be further considered deals with the operation of the two persons, the movement path of the two persons analyzed should maintain the spatial relationship between the two persons. Therefore, a process of coupling the inverted pendulum model to maintain the spatial relationship between the two persons may be required.

The inverse pendulum model can use two major vector components. The first is the vector in the direction of looking at the other, the second is the vector in the direction of not facing the other side, and the vectors can be defined as front vector and avoid vector. The front vector and the avoidance vector have only directional components as a unit vector, and the coefficients of the front vector and the avoidance vector are control parameters of the coupled inverted pendulum model, so that the operation pattern of the inverted pendulum model can be determined. Wherein the parameter derives the value of the optimization problem by setting the captured motion and the inverse pendulum model as the objective function as the difference between the center of gravity and the momentum and sets a parameter for moving the inverse pendulum model in the same pattern as the capture motion Can be found. A module for generating a path of the coupled inverted pendulum model in real time through a process of finding a parameter for moving the inverted pendulum model in the same pattern as the capturing operation can be made, Path generator. As a result, an inverted pendulum path that is a reference of the motion of the character to be controlled can be generated through the motion analysis step.

The operation generating step will be described below with reference to FIG.

9 is a detailed view illustrating a process of generating an action according to another embodiment of the present invention. The action of the character is adjusted in consideration of the path generated from the coupled inverted pendulum path generator and the state of the current inverted pendulum model , And performing the character animation by tracking the operation.

More specifically, the captured motion data can be used to create a motion graph for two character behaviors. The motion graph may generate an operation in real time, and the generated operation may be transferred according to the center of gravity of the inverted pendulum model obtained through the operation analysis step. Here, it is important to maintain balance so that the character does not collapse, and it is necessary to adjust the position of the character's foot in order to maintain balance. At this time, the above-mentioned situation refers to a value at which the body of the character is inclined, and the degree to which the character's body is inclined can be known by measuring the inclined value of the inverted pendulum model. In addition, the footprint of the character can be obtained from the motion capture data, and the IK of the character can be solved according to the obtained footprint to generate the lower body motion of the character. Now, if the center of gravity of the motion generated in the motion graph is allocated to the center of gravity of the inverse pendulum model, the motion of the character and the angle of the joint according to the motion can be obtained. By tracking the joint angles and controlling the joints, it is possible to generate the operations of two characters interacting in real time.

FIG. 10 is a block diagram showing a character modeling apparatus for generating an operation of two characters interacting with each other according to an embodiment of the present invention. The character modeling apparatus 50 includes the character modeling apparatus 50 shown in FIGS. 1 to 9 And includes corresponding configurations. Therefore, in order to avoid duplication of explanation, the function is outlined mainly in the hardware device.

The input unit 51 receives the motion data of the two motion-captured characters.

The processing unit 52 maps the operation data to an inverted pendulum model so as to maintain a spatial relationship between the two characters, obtains a reference path capable of controlling operations of the two characters from the operation data and the inverted pendulum model, The reference path is shifted to correspond to the center of gravity of the inverted pendulum model in consideration of the state of the inverted pendulum model.

The generation unit 53 generates the real-time motion of the two characters by tracking the joint angles of the two characters with respect to the transferred motion.

The processing unit 52 obtains control parameters including the direction components of the inverse pendulum model for the two characters and generates a path parameter for moving the inverse pendulum model from the control parameters in the same pattern as the operation data And acquires the reference path based on the path parameter. Here, the control parameter specifies the direction in which the other party is viewed by the front vector and the direction in which the other party is to be avoided by the avoidance vector, thereby obtaining the control parameter from the coefficients of the front vector and the avoidance vector.

In addition, the processing unit 52 sets the difference between the motion data of the two motion-captured characters and the inverse pendulum model as an objective function, and obtains the path parameter from the value derived based on the objective function.

According to the embodiments of the present invention described above, the motion capture data for the two characters is mapped to the inverted pendulum model, the reference path is obtained from the motion capture data and the inverted pendulum model, To two character movements, it is possible to track the movements and generate the actions of the two characters interacting with each other. In addition, it is possible to generate two characters having a high degree of freedom in consideration of the physical laws, to generate a new operation in addition to the captured operation, to have excellent operation reaction speed, and to have high quality of generated operation.

Meanwhile, the embodiments of the present invention can be embodied as computer readable codes on a computer readable recording medium. A computer-readable recording medium includes all kinds of recording apparatuses in which data that can be read by a computer system is stored.

Examples of the computer-readable recording medium include a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device and the like, and also a carrier wave (for example, transmission via the Internet) . In addition, the computer-readable recording medium may be distributed over network-connected computer systems so that computer readable codes can be stored and executed in a distributed manner. In addition, functional programs, codes, and code segments for implementing the present invention can be easily deduced by programmers skilled in the art to which the present invention belongs.

The present invention has been described above with reference to various embodiments. It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. Therefore, the disclosed embodiments should be considered in an illustrative rather than a restrictive sense. The scope of the present invention is defined by the appended claims rather than by the foregoing description, and all differences within the scope of equivalents thereof should be construed as being included in the present invention.

31: First Inverted Pendulum Model
32: Second Inverse Pendulum Model
43: First character
44: Second character
50: Character modeling device
51: Input unit
52:
53: Generator

Claims (10)

The method comprising the steps of: receiving motion data of two characters that are motion-captured;
Mapping the operation data to an inverted pendulum model so that the spatial relationship of the two characters is maintained;
Obtaining a reference path for controlling the operation of the two characters from the operation data and the inverted pendulum model;
Translating the reference path into motion of the two characters in consideration of the state of the inverted pendulum model; And
And generating real-time motion of the two characters by tracking the transitional movement. ≪ Desc / Clms Page number 19 > The method according to claim 1,
Wherein the inverse pendulum models of the two characters are coupled in a resilient manner so as to maintain a predetermined distance so that the spatial relationship of the two characters is maintained. The method according to claim 1,
Wherein the step of acquiring the reference path comprises:
Obtaining a control parameter including direction components of the inverse pendulum model for the two characters;
Obtaining a path parameter for moving the inverted pendulum model from the control parameter in the same pattern as the operation data; And
And obtaining the reference path based on the path parameter. The method of claim 3,
Wherein the control parameter comprises:
Wherein the direction vector is obtained from a coefficient of the front vector and the avoidance vector by designating a direction in which the other party is viewed as a facing vector and a direction in which the other party is avoided as an avoiding vector, How to model a character. The method of claim 3,
Wherein obtaining the path parameter comprises:
Setting a difference between the motion data of the two motion-captured characters and the inverted pendulum model as an objective function; And
And obtaining the path parameter from a value derived based on the objective function. The method according to claim 1,
Wherein transitioning the reference path to motion comprises:
And modifying the reference path to correspond to the center of gravity of the inverted pendulum model. The method according to claim 1,
Wherein the generating the real-
Tracking joint angles for the two characters, and controlling the joints by tracing to generate a real-time motion for the two characters. An input unit for receiving motion data of two motion-captured characters;
Mapping the operation data to an inverted pendulum model so as to maintain a spatial relationship between the two characters, obtaining a reference path capable of controlling operations of the two characters from the operation data and the inverted pendulum model, A processing unit for shifting the reference path to correspond to the center of gravity of the inverted pendulum model in consideration of the state; And
And a generation unit for generating a real-time motion of the two characters by tracking joint angles of the two characters with respect to the transitional movement,
Wherein the processing unit obtains a control parameter including direction components of the inverse pendulum model for the two characters and obtains a path parameter for moving the inverse pendulum model from the control parameter in the same pattern as the operation data, And obtains the reference path based on the path parameter. 9. The method of claim 8,
Wherein,
And sets the difference between the motion data of the two motion-captured characters and the inverted pendulum model as an objective function, and obtains the path parameter from a value derived based on the objective function. 9. The method of claim 8,
Wherein the control parameter comprises:
Wherein the control parameter can be obtained from a coefficient of the front vector and the avoidance vector by designating the direction in which the other party is viewed as a front vector and the direction in which the other party is to be avoided as the avoidance vector.

Images