KR101686028B1 - Method and apparatus for character motion retargeting to rig-space - Google Patents

Method and apparatus for character motion retargeting to rig-space Download PDF

Info

Publication number
KR101686028B1
KR101686028B1 KR1020150055169A KR20150055169A KR101686028B1 KR 101686028 B1 KR101686028 B1 KR 101686028B1 KR 1020150055169 A KR1020150055169 A KR 1020150055169A KR 20150055169 A KR20150055169 A KR 20150055169A KR 101686028 B1 KR101686028 B1 KR 101686028B1
Authority
KR
South Korea
Prior art keywords
joint
parameter
space
rigging
value
Prior art date
Application number
KR1020150055169A
Other languages
Korean (ko)
Other versions
KR20160124493A (en
Inventor
노준용
송재원
Original Assignee
한국과학기술원
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 한국과학기술원 filed Critical 한국과학기술원
Priority to KR1020150055169A priority Critical patent/KR101686028B1/en
Publication of KR20160124493A publication Critical patent/KR20160124493A/en
Application granted granted Critical
Publication of KR101686028B1 publication Critical patent/KR101686028B1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00Animation
    • G06T13/203D [Three Dimensional] animation
    • G06T13/403D [Three Dimensional] animation of characters, e.g. humans, animals or virtual beings

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Processing Or Creating Images (AREA)

Abstract

In the present invention, in the present invention, the original motion is retargeted to a complicated and diverse character rig at a level that can be used in actual production, thereby providing a league space in which the animator can utilize the existing familiar league parameters for correcting or reusing motion. A method and apparatus for character motion retargeting,
The method of character motion retargeting into a league space includes: acquiring a joint space parameter by retargeting a source motion composed of a plurality of joint position measurement values to a joint space of a target character; Calculating a rigging space parameter from the joint value spatial parameter through a nonlinear optimization function; And an arithmetic operation unit for performing an operation of inversely calculating the joint space spatial parameter from the rigging space parameter and then comparing the joint space spatial parameter with the joint space spatial parameter and performing a rigging operation in which an error between the arithmetically operated joint spatial spatial parameter and the joint spatial spatial parameter is minimized And selecting the spatial parameters to optimize the rigging spatial parameters.

Description

TECHNICAL FIELD The present invention relates to a method and apparatus for character motion retargeting into a league space,

The present invention relates to a method of character motion retargeting in 3D computer animation. Even if a target character has a complicated rigging level that is used in an existing animation pipeline, the present invention can be applied to retargeting motion in a rig- And more particularly to a method and apparatus for character motion retargeting into a stable and new league space.

The character motion of traditional 3D computer animation is produced by the key framing technique of the animator, and the key framing technique is still one of the most representative methods of producing character animation in the movie and animation industry so far. In order to produce such a keyframing animation, animators mostly work with carefully crafted character rigs.

Character leagues are intuitive and familiar controllers that are created to make animators more comfortable to manipulate character's joint motion and natural body deformations for animation production. Animators can use these controllers to manipulate character joints and deformers' parameters, making them useful for creating new key framing animations or modifying already created animations.

The keyframing method relies heavily on the capabilities of the animator and has the disadvantage of time and expense, which is why motion capture and retargeting technologies are becoming more and more popular.

In general terms, motion re-targeting refers to the process of minimizing the error value of motion-captured original motion to different target characters. In the case of body motion re-targeting, it minimizes the joint error of the original and target joints .

Motion capture and retargeting technologies are now becoming very important in real game, film and animation production, along with traditional keyframing techniques, due to the many inventions and technology developments over the years.

It is very rare to use captured motion when using motion-captured data in real production, and in most cases the animator goes through the process of editing the motion according to its intended use.

In this process, the animator can change the timing of the motion or add more exaggerated expressions, such as making the foot of the character not slip on the ground or making the character's body part dig itself, Editing operation is performed. Various editing techniques have been proposed to edit such motion more easily and intuitively, or inventions have been made to automatically modify or create motion based on physical laws. However, in order to be applied to the actual production pipeline, Animators who are familiar with the keyframing method are not suitable for use. In addition, in order to modify the body motion that is retargeted to the joint of the target character in the conventional manner, the animation value of the character must be directly modified by the animator, which is inconvenient and unintuitive. Because of this, animators prefer to edit in a familiar way, character rigs, where they are working with keyframing animations as they edit their retargeted motion.

To solve the requirements of these animators, the latest commercial CG software such as "Autodesk Maya2013 HumanIK" provides the function of performing body motion re-targeting in the character league recently. However, in the case of these commercial programs, the correlation between each joint and the character rigging space parameter associated with each joint must be specified, and the method is limited to a very simple point constraint, an orient constraint, and the like There is a limit to apply to various complex real production stage character leagues.

In order to solve the above problems, in the present invention, the original motion is retargeted to a complicated and various character league which is used in actual production, so that the animator can modify or reuse the existing familiar league parameters And to provide a method and apparatus for character motion retargeting into a league space that can be utilized.

In addition, by proposing a nonlinear optimization technique for finding the character rigging space parameter of the target character that minimizes the error value with the original motion, the character motion retargeting into the league space enables efficient retargeting while preserving the original motion as much as possible Method, and apparatus.

It is another object of the present invention to provide a method and apparatus for character motion retargeting into a league space that maximizes the accuracy and efficiency of a retargeting operation by appropriately grouping each body part and then performing optimization individually.

The objects of the present invention are not limited to the above-mentioned objects, and other objects not mentioned can be clearly understood by those skilled in the art from the following description.

According to an embodiment of the present invention, there is provided a method for solving the above problems, comprising the steps of: acquiring a joint space spatial parameter by retargeting a source motion composed of a plurality of joint position measurement values to a joint space of a target character; Calculating a rigging space parameter from the joint value spatial parameter through a nonlinear optimization function; And an arithmetic operation unit for performing an operation of inversely calculating the joint space spatial parameter from the rigging space parameter and then comparing the joint space spatial parameter with the joint space spatial parameter and performing a rigging operation in which an error between the arithmetically operated joint spatial spatial parameter and the joint spatial spatial parameter is minimized And selecting the spatial parameters to optimize the rigging space parameter.

Wherein the step of calculating the rigging space parameter comprises:

Figure 112015038100675-pat00001
Quot ;, the c is a rigging space parameter, the R n is an n-dimensional rigging space parameter c, the J is a joint space parameter, the J t Is a joint space spatial parameter inversely calculated by an n-dimensional rigging space parameter c.

The step of optimizing the rigging space parameter is characterized by grouping a plurality of joints of the target character by body parts and performing an optimization operation of the rigging space parameter on a group basis.

In the step of optimizing the rigging space parameter, when there are a plurality of rigging space parameters participating in one joint value, the number of joints involved in each of the rigging space parameters is additionally confirmed, and then the rigging space parameter In order from the beginning.

Wherein optimizing the rigging space parameter comprises:

Figure 112015038100675-pat00002
&Quot;, wherein j is an individual joint value belonging to the joint space parameter, and j t is an arbitrary joint value belonging to the joint space parameter, And is an individual joint value belonging to the calculated joint space spatial parameter.

The step of optimizing the rigging space parameter may be performed by optimizing the rigging space parameter after changing weights assigned to the plurality of joints according to predetermined skeleton structure information.

Wherein optimizing the rigging space parameter comprises:

Figure 112015038100675-pat00003
,
Figure 112015038100675-pat00004
&Quot;, wherein j is an individual joint value belonging to the joint space parameter, and j t is an inverse calculated by the rigging space parameter. ≪ RTI ID = 0.0 > (J) is a hierarchical function for the joint value j, and w j is a weight for the joint value j.

Wherein optimizing the rigging space parameter comprises:

Figure 112015038100675-pat00005
Calculating an error between the inversely calculated joint space spatial parameter and the joint space spatial parameter according to an equation of "
Figure 112015038100675-pat00006
Calculating a user-defined constraint value according to an equation of "
Figure 112015038100675-pat00007
"And"
Figure 112015038100675-pat00008
"And optimizing the rigging space parameter based on the inversely-calculated joint space value parameter, wherein J is a joint value < RTI ID = 0.0 > J is an individual joint value belonging to the joint space parameter J, j t is an individual joint value belonging to the joint space parameter which is inversely calculated by the rigging space parameter, c is a rigging space parameter, C user is a set of rigging space parameters given as a user-defined constraint, t i (J) is a value of the joint space parameter J of the i-th frame, R n is an n-dimensional rigging space parameter c, and? is a user-defined coefficient.

Wherein optimizing the rigging space parameter comprises:

Figure 112015038100675-pat00009
,
Figure 112015038100675-pat00010
Calculating an error between the inversely calculated joint space spatial parameter and the joint space spatial parameter according to an equation of "
Figure 112015038100675-pat00011
Calculating a user-defined constraint value according to an equation of "
Figure 112015038100675-pat00012
"And"
Figure 112015038100675-pat00013
"And optimizing the rigging space parameter based on the inversely-calculated joint space value parameter, wherein J is a joint value < RTI ID = 0.0 > Wherein j is an individual joint value belonging to the joint space parameter J, j t is an individual joint value belonging to the joint space parameter that is inversely calculated by the rigging space parameter, h (j) j is a layer function for j, w j is a weight for joint value j, c is a rigging space parameter, C user is a set of rigging space parameters given as a user-defined constraint, t i (J) And R n is an n-dimensional rigging space parameter c, and α, β, and γ are user-defined coefficients.

According to another aspect of the present invention, there is provided a motion estimation method for estimating a joint motion of a target character based on a motion of a target character, A targeting unit; A rigging space parameter calculator for calculating a rigging space parameter from the joint space spatial parameter through a nonlinear optimization function; And an arithmetic operation unit for performing an operation of inversely calculating the joint space spatial parameter from the rigging space parameter and then comparing the joint space spatial parameter with the joint space spatial parameter and performing a rigging operation in which an error between the arithmetically operated joint spatial spatial parameter and the joint spatial spatial parameter is minimized And a rigging space parameter optimizer for optimizing the rigging space parameter by selecting a spatial parameter.

The present invention analyzes the correlation between the rigging space of different characters rigged in various and complex ways and the joint joint space of the character (Joint Parameter Space), and performs a nonlinear We propose an optimization technique. This allows the animator to use the same rigging parameters as the existing keyframing operations when modifying the original motion obtained by motion capture, etc., so that the motion can be modified intuitively, quickly and easily.

In addition, after observing the way the animator would like to work, the process is reflected in the optimization process so that the animator can produce retouching results that are very easy to modify.

FIG. 1 is a diagram for explaining a method of character motion retargeting into a league space according to an embodiment of the present invention. Referring to FIG.
FIG. 2 is a view for explaining the operation principle of a character motion retargeting method to a league space according to an embodiment of the present invention.
FIG. 3 is a view for explaining an example of spectator grouping according to a method of character motion retargeting into a league space according to an embodiment of the present invention.
Fig. 4 is a diagram showing the result of calculating the joint space parameter that varies depending on the number of rigging space parameter usage.
FIG. 5 is a view for explaining the principle of assigning priority to each of the rigging space parameters according to an embodiment of the present invention.
FIG. 6 is a view for explaining a method of optimizing a league parameter according to a joint hierarchical structure according to an embodiment of the present invention.
FIG. 7 illustrates a method of optimizing a league parameter according to a user-defined constraint value and a time axis constraint for supporting manual operation of an animator according to an exemplary embodiment of the present invention.
FIG. 8 is a diagram for explaining the effect of the method of character motion retargeting into a league space according to an embodiment of the present invention.
9 is a diagram for explaining a character motion retargeting apparatus into a league space according to an embodiment of the present invention.

BRIEF DESCRIPTION OF THE DRAWINGS The above and other objects, features and advantages of the present invention will be more apparent from the following detailed description taken in conjunction with the accompanying drawings, in which: FIG. In the following description of the present invention, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear.

The following terms are defined in consideration of the functions of the present invention, and these may be changed according to the intention of the user, the operator, or the like.

The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. These embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art to which the present invention pertains. Only. Therefore, the definition should be based on the contents throughout this specification.

FIG. 1 is a diagram for explaining a method of character motion retargeting into a league space according to an embodiment of the present invention. Referring to FIG.

Referring to FIG. 1, the character motion retargeting method of the present invention includes a step (S10) of acquiring a joint space spatial parameter by retargeting a source motion composed of a plurality of joint position measurement values to a joint space of a target character, Calculating (S20) a rigging space parameter from the joint space value parameter using a nonlinear optimization function, and performing an operation of inversely calculating the joint space value parameter from the rigging space parameter and then comparing the joint value space parameter with the joint value space parameter , Optimizing the rigging space parameter by selecting a rigging space parameter that minimizes an error between the inversely-calculated joint space spatial parameter and the joint space spatial parameter (S30), and the like.

As described above, in the present invention, when the motion-captured original motion is input, the original motion is retargeted to the joint space of the target character before the original motion is retargeted to the league space of the target character as shown in FIG. 2, The rigging space value of the target character that satisfies the joint value of the target character is obtained through the nonlinear optimization. As a result, the present invention allows the animator to modify the motion capture animation by using the character league which has been performing the key framing animation operation instead of the character joint structure.

First, step S10 of acquiring the joint space spatial parameter will be described in more detail as follows.

In the present invention, the original motion re-targeting is performed in an offline manner. This is because the application field of the present invention is motion editing performed offline, not in a real-time application, so that an optimization operation is performed in units of motion data, not every hour Thereby enabling more accurate motion re-targeting.

Then, as in Equation (1), it is assumed that the source motion is M source and the target character motion is M target , and then the error of the objective function r with respect to the unit time t is minimized. So as to acquire the joint values of the target character.

Figure 112015038100675-pat00014

Next, the step S20 of calculating the rigging space parameter will be described in more detail as follows.

The character motion can be described by the rotation value and the position value of each joint of the character changing every time. That is, in the case of a character having N joints, if it is assumed that the rotation value and the position value for one joint are represented by a vector j, the character motion is represented by N jj joint values, The space can be defined as the joint parameter space of the character.

In general, the motion re-targeting is performed with the joint value space of the target character in the joint value space of the original character. In the present invention, however, the motion re-targeting is replaced with various parameters of the target character's league rather than the joint value. The character league space parameter refers to values directly handled by the animator. In the present invention, a set of these values is defined as a rig-space parameter.

If the rigging space parameter is c in the character rig and the joint space value parameter is J, the character rig can be expressed in the form of a function according to Equation (2) below. On the other hand, , It can be seen that the target character rigging space parameter can be found from the joint value spatial parameter of the target character.

Figure 112015038100675-pat00015

In step S2 of the present invention, the inverse function g (x) of Equation (2) is used to infer the target character rigging space parameter from the joint space spatial parameter of the target character as in Equation (3).

Figure 112015038100675-pat00016

However, it is quite difficult to express the function g (x) explicitly in a variety of complex and production-level character rigs. In one character rig, the rigging space parameter c and the joint space parameter J are connected in a very wide variety of ways. For example, it can include a wide variety of methods ranging from simple position constraint or rotational constraint to inverse kinematics, or even to a designator of a character league.

Therefore, expressing the function g (x) explicitly for the purpose of retagging the rigging space requires knowing the correlation between all the rigging space parameters and the joint space parameter, which are close to the hundreds, And therefore it is very difficult. Moreover, since each character rig is different, it is very inefficient to make this separate function g (x) for every character.

Accordingly, in the present invention, the problem is defined as a data optimization problem so that the rigging space parameter can be calculated from the joint value space parameter regardless of the character rig method. As a result, the nonlinear optimization The function can be briefly expressed as Equation (4) below.

Figure 112015038100675-pat00017

Here, c is a rigging space parameter, R n is an n-dimensional rigging space parameter c, J is a joint value space parameter, and J t is a joint space spatial parameter inversely calculated by an n-dimensional rigging space parameter c. That is, the nonlinear optimization function g (J) is a function that optimizes the rigging space parameter c that satisfies the joint space parameter J as much as possible.

However, it is inefficient to optimize all the joint space parameters and the rigging space parameters at the same time according to the nonlinear optimization function g (J). This is because certain rigging space parameters may not affect a particular joint. In this case, it is effective to include only rigging space parameters related to the corresponding joints in the optimization operation. Also, when all the joint space parameters and the rigging space parameters of a character are optimized at once, the nonlinearity of each parameter becomes larger as the character rigging method becomes more complicated, making it difficult for the optimization algorithm to converge.

In the present invention, step (S30) of optimizing the rigging space parameter is additionally performed. Step S30 further includes step S31 of properly dividing and grouping each part of the body of the target character, optimization step S32 ), And the like.

In the grouping step of step S31, in order to reduce the nonlinearity of complicated rigging, in the present invention, each part of the body of the target character is appropriately divided and grouped, and the optimization operation is performed in units of groups, To be performed.

The basic assumption of joint grouping is that not all rigging space parameters are involved in all joints. Rigging space parameters that move ankle joints are likely to have no effect on wrist joints. Therefore, it is effective to optimize only the rigging space parameters involved in a specific joint space parameter. For this, the set function G is defined as Equation (5) below before performing the optimization operation.

Figure 112015038100675-pat00018

That is, the set function G means a set of all the rigging space parameters c involved in the change of the specific joint value j.

Thus, the rigging space parameters to be optimized for each joint are defined, and it is further determined in what order and method the optimization should be performed. As described above, optimizing all the joints at once is highly likely because the number of rigging space parameters is large and the character rigging method is complicated. On the other hand, it is also inefficient to optimize all the joints separately, because character joints generally have a hierarchical structure, so if there is some error in the upper joints, the errors are accumulated in the end joints, Because.

Accordingly, in the present invention, joints are grouped according to a certain standard, and then optimization is performed, thereby making it possible to perform the most accurate optimization operation within the group and at the same time to improve the efficiency of calculation. For example, as shown in FIG. 3, in the case of a bipedal character, the joint group can be roughly divided into six groups such as a head group, a left arm group, a right arm group, a left leg group, a right leg group, and a torso group. Basically, optimize the arms and legs of the body based on the branches of the joints, and optimize the hands and feet in case of relatively complicated rigging. This criterion is more empirical due to repeated experiments and measurement of results. However, considering the rigging process of a general bipedal character and taking into account the principle of operation of the joints of each body part, the optimization algorithm converges more easily This is a reasonable classification that can be done.

When the grouping step of step S31 is completed, the optimization step for the rigging space parameter of step S32 can be performed on a group basis. In the present invention, the optimizing step for the rigging space parameter is performed by a method of optimizing a league parameter, A method of optimizing a league parameter according to a joint hierarchical structure, and a method of optimizing a league parameter according to a user-defined constraint value and a time axis constraint.

First, a description will be given of a method of optimizing a league parameter according to an animator operation method, which is an optimization method of a first league parameter.

Even if joint grouping is performed through step S31, another problem is that there may be two or more rigging space parameters c that produce one joint parameter J.

4 (a) and 4 (b) have the same joint parameters, but as shown in FIG. 4 (a), a user named Grab (B) can be calculated using the Forward Kinematics (FK) parameters at each finger, using one rigging space parameter arbitrarily specified.

As a result of observing the work process of a skilled professional animator with more than five years of experience, animators prefer to use rigging parameters to create a larger posture, and then use rigging space parameters to create a smaller, more detailed posture I have learned that it works in a sequential way. For example, when constructing the posture shown in FIG. 4, the left method using one parameter called Grab was preferred to the right method using a plurality of FK parameters. This order is much more efficient in the process of creating and editing motion by using as few controllers as possible. When making a full body pose of a character, the animator first makes the overall position or posture of the character roughly through the highest top joint, and then the posture of the arm or leg, and then the specific posture I have worked mainly in the way of making.

Accordingly, in the present invention, when more than two rigging space parameters involved in one joint parameter exist, the rigging space parameter that relatively changes the joint space is preferentially optimized based on the operation method of the animator.

The set of rigging space parameters {c 1 , c 2 , ..., k) involved in a particular joint j through function G in equation (5) , c n } can be obtained. Here, in order to optimize the c with a higher weight first, as shown in FIG. 5, the number of joints involved in each c is measured, and priority is given to each of the rigging space parameters based on the number of joints. And optimize the rigid space parameter c, which has the highest number of joints, in the order of higher priority, so that it can be optimized as the animator works.

The optimization function of the rigging space parameter basically compares the error between the joint value J, which is a retargeted result, and the joint value J t, which is made of the rigging space parameter, as shown in Equation (4). At this time, the joint value is represented by N 4x4 transform matrix when there are N joints, so that both movement value and rotation value of joint can be compared. In order to calculate this joint value error, Equation (6) below can be utilized.

Figure 112015038100675-pat00019

In this case, j denotes an individual joint value belonging to a joint space parameter, j t denotes an individual joint value belonging to the joint space parameter which is inversely calculated by the rigging space parameter, and a sum The joint space value error E joint to be determined can be determined.

Next, a method of optimizing a league parameter according to a joint hierarchical structure, which is a method of optimizing a second league parameter, will be described.

When comparing the error values of the joints using Equation (6), unintentional errors may occur as shown in FIG. 6 when the errors are measured by comparing the joints equally.

FIG. 6 (a) is a phenomenon in which an optimization operation is performed by minimizing an error in an unintended manner when the same weight is given to all the joints . Therefore, when calculating the inter-articular error, it is more improved to perform the optimization so as to find a more accurate value from the upper joints by giving a higher weight to the higher-order joint in the skeletal structure, as shown in FIG. 6 (b) .

For this purpose, Equation (6) is modified as shown in Equation (7) and the rigging space parameters are optimized after different weights assigned to the plurality of joints according to predetermined skeleton structure information.

Figure 112015038100675-pat00020

At this time, the function h (j) is a hierarchical function of joint j. In the case of the uppermost joint, it has a value of 1, and as it goes down to the lower joints, the value increases by 1. The weight w j for the joint j is a fractional function having the denominator h as a function. As a result, the higher the weight of the joint, the higher the weight is.

In this way, the animator automatically retargetes to the rigging space according to the general work pattern of the animator, but the animator may arbitrarily designate the league to the league space according to the specific tendency of the specific animator or the special case of some character.

That is, in the present invention, a third method for optimizing a league parameter, a user-defined constraint value for supporting the manual operation of the animator, and a league parameter optimization method based on a time axis constraint will be further proposed.

In the case of FIG. 4 described above, it is generally preferable to work with a smaller number of rigging space parameters, but if the animator wants to work with only the FK controller, will be. The user defined constraint value for this can be calculated by the following equation (8).

Figure 112015038100675-pat00021

Where C user is a set of league parameters given as a user defined constraint and 1 if the particular league parameter c is one of the league parameters given as a user defined constraint and 0 otherwise.

Since the optimization process is performed every animation frame, if the rigging space parameter is optimized in a manner significantly different from the immediately preceding frame, the whole operation may be unnatural, or a situation difficult to edit may occur.

The animation graph of FIG. 7 shows such an example. As shown in FIG. 7, in the case of the league parameter that takes the rotation value of the joint, there are several league parameters that produce the same joint value, and this situation occurs.

Therefore, in the present invention, when the optimization operation is performed, the motion graph instantaneously jumps out by adding a time-axis constraint so that a value far from the rigging space parameter of the immediately preceding frame does not appear. This time base constraint can be expressed as E time in the objective function as shown in Equation 9 below.

Figure 112015038100675-pat00022

In this case, t i (J) denotes the value of the joint parameter J of the i-th frame. As shown in Equation (9), 0 is calculated as 0 in the first frame, and is optimized in such a manner as to minimize the difference in joint parameter with the existing frame. Finally, by summing up the error values of the respective terms and summing them in the whole frame, Equation 3, which is the optimization function described above, can be modified to Equation 10 below.

Figure 112015038100675-pat00023

At this time, E joint can be calculated according to Equation 6 or 7, and the error value of each term is normalized from 0 to 1 by finding the maximum and minimum values in the entire motion. The coefficients α, β and γ of each term are user-defined coefficients that can be defined by the user, and are most preferably 1.0, 10.0, and 1.0, respectively.

FIG. 8 is a diagram for explaining the effect of the method of character motion retargeting into a league space according to an embodiment of the present invention.

In order to give a skilled animator body motion that is retargeted, to modify the animation by giving a certain goal, it is possible to directly modify the data of the joint value when there is data in a conventional retargeting manner, We tested how to use the parameters of the rigging space.

Table 1 is an evaluation table of comparison between the existing method and the working efficiency according to the present invention, and the working time will vary depending on the skill level of the animator. However, the method of rectifying using the league after retargeting into the rigging space is twice as large It is possible to reduce the editing time by 10 times or more. At this time, the target character is a level character used for actual animation production as shown in FIG. 8, and has 112 joints and 183 league parameters.

Joint J League p frame Conventional Invention 112 183 120 135min 13min

This is different depending on the nature of the motion. In the case of a motion in which a character fixes a specific part of the body as shown in FIG. 8, for example, a motion is made such as fixing a hand to a specific part and moving another body part, Although it is very difficult to directly modify the joint parameters to generate motion, it can be seen that the same motion can be created much more easily using the inverse kinematic rigging parameters of the present invention.

9 is a diagram for explaining a character motion retargeting apparatus into a league space according to an embodiment of the present invention.

Referring to FIG. 9, the character motion retargeting apparatus 10 of the present invention includes a motion motion estimating apparatus 10 for estimating a motion motion of a target character, A rigging space parameter calculating unit (12) for calculating a rigging space parameter from the joint space value parameter through a nonlinear optimization function, and a joint space parameter calculating unit (12) for calculating the joint space parameter from the rigging space parameter, A rigging space parameter optimizing unit for optimizing the rigging space parameter by selecting a rigging space parameter that minimizes an error between the inversely calculated joint space spatial parameter and the joint space spatial parameter, (13), and the like.

The character motion retargeting apparatus 10 includes a communication unit 20 for supporting data communication with an external device and a user interface 30 including various data input and output devices such as a keyboard, a touch screen, a mouse, and a monitor And may be implemented as one independent hardware device.

In addition, if necessary, the character motion retargeting apparatus 10 may be embodied as a computer or an embedded device embedded in a server, and the character motion retargeting apparatus 10 may be operated in a manner interlocked with an operating system or a program installed in the computer or the server Of course, it can be of course.

The computer-readable recording medium on which the program commands are recorded may be a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, Media storage devices.

The computer-readable recording medium on which the above-described program is recorded may be distributed to a computer apparatus connected via a network so that computer-readable codes can be stored and executed in a distributed manner. In this case, one or more of the plurality of distributed computers may execute some of the functions presented above and send the results of the execution to one or more of the other distributed computers, The computer may also perform some of the functions described above and provide the results to other distributed computers as well.

The computer for reading the recording medium on which the application for executing the character motion retargeting method and the apparatus for moving the character into the league space according to each embodiment of the present invention can be read includes not only general PCs such as general desktops and laptops, A mobile terminal such as a smart phone, a tablet PC, a personal digital assistant (PDA), and a mobile communication terminal. In addition, it should be interpreted as all devices capable of computing.

While the present invention has been described in connection with what is presently considered to be the most practical and preferred embodiments, it is to be understood that the invention is not limited to the disclosed embodiments. That is, within the scope of the present invention, all of the components may be selectively coupled to one or more of them. In addition, although all of the components may be implemented as one independent hardware, some or all of the components may be selectively combined to perform a part or all of the functions in one or a plurality of hardware. As shown in FIG. The codes and code segments constituting the computer program may be easily deduced by those skilled in the art. Such a computer program can be stored in a computer-readable storage medium, readable and executed by a computer, thereby realizing an embodiment of the present invention. As a storage medium of the computer program, a magnetic recording medium, an optical recording medium, or the like can be included.

It is also to be understood that the terms such as " comprises, "" comprising," or "having ", as used herein, mean that a component can be implanted unless specifically stated to the contrary. But should be construed as including other elements. All terms, including technical and scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs, unless otherwise defined. Commonly used terms, such as predefined terms, should be interpreted to be consistent with the contextual meanings of the related art, and are not to be construed as ideal or overly formal, unless expressly defined to the contrary.

The foregoing description is merely illustrative of the technical idea of the present invention, and various changes and modifications may be made by those skilled in the art without departing from the essential characteristics of the present invention. Therefore, the embodiments disclosed in the present invention are intended to illustrate rather than limit the scope of the present invention, and the scope of the technical idea of the present invention is not limited by these embodiments. The scope of protection of the present invention should be construed according to the following claims, and all technical ideas within the scope of equivalents should be construed as falling within the scope of the present invention.

Claims (11)

Acquiring a joint space spatial parameter of a target character by retargeting a source motion composed of a plurality of joint position measurement values to a joint space space of a target character;
Calculating a rigging space parameter of the target character from the joint value space parameter through a nonlinear optimization function; And
Calculating a rigging space parameter by inversely calculating the joint space parameter from the rigging space parameter, and comparing the joint space parameter with the joint space parameter, calculating a rigging space having a minimum error between the inversely calculated joint space parameter and the joint space parameter, And optimizing the rigging space parameter by selecting a parameter. ≪ Desc / Clms Page number 19 >
The method of claim 1, wherein calculating the rigging space parameter comprises:
"
Figure 112015038100675-pat00024
Quot ;, the c is a rigging space parameter, the R n is an n-dimensional rigging space parameter c, the J is a joint space parameter, the J t Is a joint space spatial parameter inversely calculated by an n-dimensional rigging space parameter (c).
2. The method of claim 1, wherein optimizing the rigging space parameter comprises:
Wherein a plurality of joints of the target character are grouped by body parts and an optimization operation of the rigging space parameter is performed in units of groups.
2. The method of claim 1, wherein optimizing the rigging space parameter comprises:
When there are a plurality of rigging space parameters involved in one joint value, the number of joints involved in each of the rigging space parameters is additionally confirmed, and then sequentially optimized from the rigging space parameter having a large number of involved joints To a league space.
5. The method of claim 4, wherein optimizing the rigging space parameter comprises:
"
Figure 112015038100675-pat00025
&Quot;, wherein j is an individual joint value belonging to the joint space parameter, and j t is an arbitrary joint value belonging to the joint space parameter, And a joint joint value belonging to the calculated joint space value parameter.
2. The method of claim 1, wherein optimizing the rigging space parameter comprises:
And optimizing the rigging space parameter after changing a weight value assigned to each of the plurality of joints according to predetermined skeleton structure information.
7. The method of claim 6, wherein optimizing the rigging space parameter comprises:
"
Figure 112015038100675-pat00026
,
Figure 112015038100675-pat00027
&Quot;, wherein j is an individual joint value belonging to the joint space parameter, and j t is an inverse calculated by the rigging space parameter. ≪ RTI ID = 0.0 > (J) is a hierarchical function for the joint value j, and w j is a weight for the joint value j. The character motion retargeting method according to claim 1, .
2. The method of claim 1, wherein optimizing the rigging space parameter comprises:
"
Figure 112015038100675-pat00028
Calculating an error between the inversely calculated joint space spatial parameter and the joint space spatial parameter according to the following equation:
"
Figure 112015038100675-pat00029
Calculating a user-defined constraint value according to the following equation;
"
Figure 112015038100675-pat00030
Calculating a time constraint value according to an equation of "
"
Figure 112015038100675-pat00031
&Quot;, and optimizing the rigging space parameter based on the inversely-calculated joint space value parameter,
Wherein J is a separate joint value that is part of a joint value spatial parameters calculated station by the joint value spatial parameter, wherein j is an individual joint value belonging to the joint value of the spatial parameters J, where j t is rigging spatial parameter, wherein c is rigging spatial parameters, the c user has a set of rigging spatial parameters given by the user-defined constraints, the t i (J) is the i-th frame articulated value place value of the parameter J of the R n is rigging spatial parameters of the n-dimensional c, Wherein the alpha, beta and gamma are user-defined coefficients.
2. The method of claim 1, wherein optimizing the rigging space parameter comprises:
"
Figure 112015038100675-pat00032
,
Figure 112015038100675-pat00033
Calculating an error between the inversely calculated joint space spatial parameter and the joint space spatial parameter according to the following equation:
"
Figure 112015038100675-pat00034
Calculating a user-defined constraint value according to the following equation;
"
Figure 112015038100675-pat00035
Calculating a time constraint value according to an equation of "
"
Figure 112015038100675-pat00036
&Quot;, and optimizing the rigging space parameter based on the inversely-calculated joint space value parameter,
Wherein J is a separate joint value that is part of a joint value spatial parameters calculated station by the joint value spatial parameter, wherein j is an individual joint value belonging to the joint value of the spatial parameters J, where j t is rigging spatial parameter, wherein the h ( j is a hierarchical function for the joint value j, w j is a weight for the joint value j, c is a rigging space parameter, C user is a set of rigging space parameters given as a user-defined constraint, t i (J ) Is a value of a joint space parameter J of an i-th frame, R n is an n-dimensional rigging space parameter c, and α, β and γ are user-defined coefficients. .
A computer-readable recording medium having recorded thereon a program for executing a character motion retargeting method in a league space according to any one of claims 1 to 9. A source motion retargeting unit for retargeting a source motion composed of a plurality of joint position measurement values to a joint space of a target character to acquire joint space spatial parameters of the target character;
A rigging space parameter calculator for calculating a rigging space parameter of a target character from the joint space spatial parameter through a nonlinear optimization function; And
Calculating a rigging space parameter by inversely calculating the joint space parameter from the rigging space parameter, and comparing the joint space parameter with the joint space parameter, calculating a rigging space having a minimum error between the inversely calculated joint space parameter and the joint space parameter, And a rigging space parameter optimizing unit that optimizes the rigging space parameter by selecting a parameter.
KR1020150055169A 2015-04-20 2015-04-20 Method and apparatus for character motion retargeting to rig-space KR101686028B1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020150055169A KR101686028B1 (en) 2015-04-20 2015-04-20 Method and apparatus for character motion retargeting to rig-space

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020150055169A KR101686028B1 (en) 2015-04-20 2015-04-20 Method and apparatus for character motion retargeting to rig-space

Publications (2)

Publication Number Publication Date
KR20160124493A KR20160124493A (en) 2016-10-28
KR101686028B1 true KR101686028B1 (en) 2016-12-13

Family

ID=57244633

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020150055169A KR101686028B1 (en) 2015-04-20 2015-04-20 Method and apparatus for character motion retargeting to rig-space

Country Status (1)

Country Link
KR (1) KR101686028B1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20200056764A (en) 2018-11-15 2020-05-25 주식회사 스튜디오매크로그래프 Method for automatically set up joints to create facial animation of 3d face model and computer program
KR102449987B1 (en) 2021-11-22 2022-10-04 스튜디오이온 주식회사 Method for automatically setup joints to create facial animation of 3d face model and computer program thereof

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101998059B1 (en) * 2017-08-31 2019-07-09 한국과학기술원 Motion retargeting method for character animation and apparatus thereof
KR102560754B1 (en) * 2018-08-21 2023-07-28 주식회사 엔씨소프트 Apparatus and method for motion retargeting
KR102577577B1 (en) * 2021-11-30 2023-09-12 주식회사 프락시스스튜디오 디오리지널 Method to transfer the animation motion source of the 3d character

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101102778B1 (en) * 2010-04-22 2012-01-05 한국과학기술원 Method and apparatus for transferring character rigs from source model to target model

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
Martin Poirier ET AL., Rig Retargeting for 3D Animation, GI'09 PROCEEDINGS OF GRAPHICS INTERFACE 2009, 2009.05.25., 103-110P*

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20200056764A (en) 2018-11-15 2020-05-25 주식회사 스튜디오매크로그래프 Method for automatically set up joints to create facial animation of 3d face model and computer program
KR102449987B1 (en) 2021-11-22 2022-10-04 스튜디오이온 주식회사 Method for automatically setup joints to create facial animation of 3d face model and computer program thereof

Also Published As

Publication number Publication date
KR20160124493A (en) 2016-10-28

Similar Documents

Publication Publication Date Title
KR101686028B1 (en) Method and apparatus for character motion retargeting to rig-space
KR101998059B1 (en) Motion retargeting method for character animation and apparatus thereof
Ye et al. Synthesis of detailed hand manipulations using contact sampling
US10748325B2 (en) System and method for automatic rigging of three dimensional characters for facial animation
Seol et al. Artist friendly facial animation retargeting
JP2018532216A (en) Image regularization and retargeting system
WO2022143178A1 (en) Motion retargeting method and apparatus, electronic device, and storage medium
US8736616B2 (en) Combining multi-sensory inputs for digital animation
US8379029B2 (en) Looping motion space registration for real-time character animation
Choi et al. SketchiMo: sketch-based motion editing for articulated characters
JP5686538B2 (en) Assembly sequence generation system, program and method
KR101261737B1 (en) Retargeting method for characteristic facial and recording medium for the same
KR20140142679A (en) Designing a 3d modeled object with 2d views
KR20180097949A (en) The estimation and refinement of pose of joints in human picture using cascade stages of multiple convolutional neural networks
US20090251462A1 (en) System and method for mesh distance based geometry deformation
Tonneau et al. Character contact re‐positioning under large environment deformation
JP7251003B2 (en) Face mesh deformation with fine wrinkles
US10032304B1 (en) Automatic creation of temporary rigid relationships between moving parts in motion simulation
US20240037826A9 (en) Image Regularization and Retargeting System
US20180329503A1 (en) Sensor system for collecting gestural data in two-dimensional animation
Song et al. Sparse rig parameter optimization for character animation
Yonemoto A sketch-based skeletal figure animation tool for novice users
JP6753282B2 (en) Assembly work robot motion generation method, motion generation program, and motion generation device
JP2014215678A (en) Motion data segment determination device, motion data segment determination method, and computer program
CN115908664B (en) Animation generation method and device for man-machine interaction, computer equipment and storage medium

Legal Events

Date Code Title Description
A201 Request for examination
E902 Notification of reason for refusal
E701 Decision to grant or registration of patent right
GRNT Written decision to grant
FPAY Annual fee payment

Payment date: 20191126

Year of fee payment: 4