WO2022143178A1 - Procédé et appareil de reciblage de mouvement, dispositif électronique, et support d'enregistrement - Google Patents

Procédé et appareil de reciblage de mouvement, dispositif électronique, et support d'enregistrement Download PDF

Info

Publication number
WO2022143178A1
WO2022143178A1 PCT/CN2021/138407 CN2021138407W WO2022143178A1 WO 2022143178 A1 WO2022143178 A1 WO 2022143178A1 CN 2021138407 W CN2021138407 W CN 2021138407W WO 2022143178 A1 WO2022143178 A1 WO 2022143178A1
Authority
WO
WIPO (PCT)
Prior art keywords
bone
constraint
source
target
point
Prior art date
Application number
PCT/CN2021/138407
Other languages
English (en)
Chinese (zh)
Inventor
朱曈晖
柴金祥
Original Assignee
魔珐(上海)信息科技有限公司
上海墨舞科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 魔珐(上海)信息科技有限公司, 上海墨舞科技有限公司 filed Critical 魔珐(上海)信息科技有限公司
Publication of WO2022143178A1 publication Critical patent/WO2022143178A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00—Animation
    • G06T13/20—3D [Three Dimensional] animation
    • G06T13/40—3D [Three Dimensional] animation of characters, e.g. humans, animals or virtual beings

Definitions

  • the present disclosure relates to the field of computer technologies, and in particular, to a motion redirection method, apparatus, electronic device, and storage medium.
  • motion capture is usually used in the current animation production. Motion capture can accurately restore the movements of the actors themselves. What is needed is character animation, and the characters may be of various types, such as real people, or two-dimensional characters, or even animals. Therefore, it is necessary to apply redirection technology to convert the actions of the actors into the corresponding character actions.
  • the redirection technology is relatively simple. Usually, only the bone rotation data of the actor's captured action is migrated. As a result, the redirected action will appear jittery or the overall action will be stiff and unnatural, etc. phenomenon, the action semantics has changed or the relevant motion constraint information is not satisfied, which leads to a lot of time for manual repair in the later stage.
  • the present disclosure proposes a motion redirection method, apparatus, electronic device, and storage medium.
  • a motion redirection method comprising:
  • the constraint point including the skin point
  • the second bone pose of the target bone that satisfies the second constraint condition is obtained, wherein the first position is to map the first bone pose to the The target bone, the obtained position of the constraint point of the target bone; the second position is based on the correspondence between the constraint point of the source bone and the constraint point of the target bone, the constraint point of the source bone and the posture of the first bone , the determined position of the constraint point of the target bone.
  • the method further includes: building one or more virtual bones between the source bone and the target bone;
  • a second bone pose satisfying the second constraint condition is obtained; wherein the third position is the position of the constraint point of the target bone under the third bone pose.
  • the second constraint condition includes: the position of the constraint point of the target bone under the second bone pose is the same as the second position.
  • the position of the constraint point of the target bone under the second bone posture is based on the weight information of the constraint point of the target bone, the constraint point of the target bone in the second bone posture is in the target bone
  • the local coordinates on and the transformation matrix from the local coordinate system of the target bone to the world coordinate system are determined.
  • the method further includes: processing the second bone pose sequence of the target bone, the motion sequence of the constraint point of the source bone, and the constraint point of the target bone of the current frame by using the prediction model, to obtain The constraint point of the target bone in the next frame; wherein, the motion sequence of the constraint point of the source bone is determined by the positions of different constraint points of the source bone.
  • the constraint points further include: mesh points and/or skeleton points.
  • the building one or more virtual bones between the source bone and the target bone includes:
  • the target bone and one or more preset reference poses obtain one or more reference poses of the source bone and one or more reference poses of the target bone;
  • one or more virtual bones are built between the same reference pose of the source bone and the target bone.
  • the reference posture includes at least: a T-pose.
  • the constraint point of the source bone is determined according to the self constraint of the source bone and/or the environment constraint associated with the source bone.
  • a motion redirection device comprising:
  • an acquisition module for acquiring the first bone pose of the source bone and constraint points of the source bone, the constraint points include skin points; a first constraint condition building module for acquiring the first bone pose and the constraints of the source bone point to construct the first constraint condition; the second constraint condition building module is used to obtain the second constraint condition according to the corresponding relationship between the constraint point of the source bone and the constraint point of the target bone and the first constraint condition; motion A redirection module, configured to obtain a second bone pose of the target bone that satisfies the second constraint condition according to the first position and the second position, wherein the first position is to convert the target bone without the second constraint condition
  • the first bone pose is mapped to the target bone, and the obtained position of the constraint point of the target bone; the second position is based on the corresponding relationship between the constraint point of the source bone and the constraint point of the target bone, the constraint point of the source bone and
  • the first bone pose is the determined position of the constraint point of the target bone.
  • an electronic device comprising: a processor; a memory for storing instructions executable by the processor; wherein the processor is configured to perform the above method.
  • a non-volatile computer-readable storage medium having computer program instructions stored thereon, wherein the computer program instructions, when executed by a processor, implement the above-described method.
  • the first bone pose of the source bone and the constraint point of the source bone are obtained, where the constraint point includes a skin point; the first constraint condition is constructed according to the first bone pose and the constraint point of the source bone ; According to the corresponding relationship between the constraint point of the source bone and the constraint point of the target bone, and the first constraint condition, the second constraint condition is obtained; According to the first position and the second position, the second constraint condition is obtained.
  • the second bone pose of the target bone wherein the first position is the constraint point position of the target bone obtained by mapping the first bone pose to the target bone when there is no second constraint condition;
  • the second position is the position of the constraint point of the target bone determined according to the corresponding relationship between the constraint point of the source bone and the constraint point of the target bone, the constraint point of the source bone and the posture of the first bone.
  • FIG. 1 shows a flowchart of a motion redirection method according to an embodiment of the present disclosure
  • FIG. 2 shows a flowchart of a motion redirection method according to an embodiment of the present disclosure
  • FIG. 3 shows a schematic diagram of constructing a virtual skeleton according to an embodiment of the present disclosure
  • FIG. 4 shows a structural diagram of a motion redirection device according to an embodiment of the present disclosure
  • FIG. 5 shows a block diagram of an electronic device according to an embodiment of the present disclosure.
  • FIG. 1 shows a flowchart of a motion redirection method according to an embodiment of the present disclosure. As shown in Figure 1, the method may include:
  • Step 101 Obtain the first bone pose of the source bone and the constraint points of the source bone; wherein, the constraint points include skin points.
  • Source bones and target bones can be in the form of 3D files, such as FBX files (AutoDesk common format), asf format (CMU standard format), mskel (Xmov standard format).
  • the first bone pose of the source bone can be the action pose of the captured actor, or the action pose of the bone drawn by the animator, etc.; the first bone pose can be determined by the rotation angle ( Euler angles, quaternions, etc.), translation distance and other data are represented, where the animation data of the source bones can be standard animation format files, such as amc (CMU standard format), FBX or sps (Xmov standard format) .
  • the animation data of the source bone is transferred to the desired target bone, and a semantic association configuration can be made between the source bone and the target bone in advance, so as to correspond to different naming conventions, for example, the source bone
  • the root bone in the target bone is called root
  • the root bone in the target bone is called Bip001.
  • the naming standards of two different companies are corresponding to the root bone.
  • the semantics are the same (for example, the bone The function of the same) is associated with other bones, so as to define the corresponding relationship between the source bone and the target bone.
  • the same number of key bones can be selected from the source bone and the target bone, and these key bones can be selected.
  • the bones are mapped to define the corresponding relationship between the source bone and the target bone.
  • the constraint points may include the constraint points of the target bone and the constraint points of the source bone, which represent the points that constrain the posture of the target bone during the motion redirection process.
  • the constraint points may include: skin points, bone points, meshes at least one of the points.
  • the skin point refers to the point attached to the skin surface of the target bone or the source bone
  • the bone point refers to the point on the target bone or the source bone
  • the mesh point refers to the point on other objects in the space where the target bone or the source bone is located. .
  • the data of the skinning points can come from the human database of the motion capture system or the database of other sources; the skinning points of the source bones are associated with each root bone in the source bones, and the skinning points of the target bones are related to each Root bones are associated.
  • a semantic association configuration may be made in advance between the constraint points of the source bone and the constraint points of the target bone, so as to define the corresponding relationship between the constraint points of the source bone and the constraint points of the target bone. For example, take the bone point of the thumb fingertip in the source bone as the constraint point of the source bone, take the bone point of the thumb fingertip in the target bone as the constraint point of the target bone, and associate the two bone points to define the thumb in the source bone. The correspondence between the bone points of the fingertip and the bone points of the thumb fingertip in the target bone.
  • the skin point of the toe in the source bone is used as the constraint point of the source bone
  • the skin point of the toe in the target bone is used as the constraint point of the target bone
  • the two skin points are associated to define the toe in the source bone. The correspondence between the skin point of , and the skin point of the toe in the target bone.
  • the constraint point of the source bone may be determined according to the self constraint of the source bone and/or the environment constraint associated with the source bone.
  • the self-constraint of the source skeleton refers to the constraint from the source skeleton itself
  • the environment constraint refers to the constraint from the external environment generated by the interaction between the source skeleton and the external environment.
  • the three-dimensional motion of the actor cannot be directly mapped to the virtual character.
  • the various semantic information of the tensor constrains the mapping process; according to whether the semantic information originates from the role itself or from the role and the external environment, it can be divided into self constraints and environmental constraints. For example, in the process of motion redirection, a hand-length People can touch their toes without bending their knees, while people with short hands need to bend their knees when they touch their toes. This is equivalent to two gestures obtained under the same semantic information. When people touch their toes with their hands, they are a kind of self.
  • Constraints at this time, the skin points and/or bone points on the hands, knees, and toes of the source bone can be taken as the constraint points of the source bone; for another example, a tall person can touch it without jumping The basket, and short people need to jump to touch it. This is equivalent to two gestures obtained under the same semantic information.
  • a person touches the basket it is an environmental constraint.
  • the hand of the source bone can be obtained.
  • skin and/or bone points on feet, etc., and mesh points on the basket as constraint points for the source bone.
  • a part of all skin points, bone points, and mesh points in the source and target bones can be selected as the Key information points, and then select appropriate points from the key information points of the source bone as the constraint points of the source bone according to their own constraints or environmental constraints.
  • Constraint points; among them, key information points may include key skin points, key bone points, and key mesh points.
  • a number of skin points can be selected from all the skin points of the source bone as the key skin points of the source bone, and at the same time, selected from all the skin points of the target bone and
  • the skin point corresponding to the position of the key skin point of the source bone is used as the key skin point of the target bone.
  • the skin point at the end of the hand, foot, head, knee and other parts can be selected as the key skin point skin point.
  • the number of key skinning points of the source bone selected above is the same as the number of key skinning points of the selected target bone. The correspondence between the key skin points of the source bone and the key skin points of the target bone.
  • the key skinning points of the above-mentioned one or more source bones can be used as the constraint points of the source bone.
  • the key skinning points of the source bone and the target Correspondence between the key skinning points of the bones correspondingly, the key skinning points of one or more target bones can be used as the constraint points of the target bone; since each constraint point of the source bone and each constraint point of the target bone there is a corresponding relationship, and through the corresponding relationship between the constraint points and different constraint points determined according to the source bone's own constraints and/or environmental constraints associated with the source bone, different effects can be produced in different animations.
  • the key skin points of the hand of the source bone and the key skin points of the knee can be used as the constraint points of the source bone, and correspondingly, the The key skin points of the hand of the target bone and the key skin points of the knee are used as the constraint points of the target bone.
  • Step 102 construct a first constraint condition according to the posture of the first bone and the constraint point of the source bone.
  • a first constraint condition is constructed according to the constraint points of the source bone selected in the above step 101; the first constraint condition represents the relative positions of different constraint points in the source bone under the first bone pose The position constraints for each constraint point obtained by the relationship.
  • the first constraint condition including skin information can be constructed under the condition that the above self-constraint, the above-mentioned environmental constraint exists, or both the above-mentioned self-constraint and the environmental constraint exist.
  • the first bone pose of the source bone is the action pose of hand touching the knee
  • the key skin points of the hand of the source bone and the key skin points of the knee can be used as the key skin points of the source bone.
  • Constraint point in the gesture of hand touching the knee, the first constraint condition constructed is that the position of the key skin point of the hand of the source bone is the same as the position of the key skin point of the knee of the source bone.
  • Step 103 Obtain a second constraint condition according to the correspondence between the constraint point of the source bone and the constraint point of the target bone and the first constraint condition.
  • the second constraint condition containing the skin information can be constructed under the condition that the above-mentioned self-constraint, the above-mentioned environment constraint exists, or both the above-mentioned self-constraint and the environment-constraint exist.
  • the key skin points of the hand of the source bone and the key skin points of the knee are used as the constraint points of the source bone
  • the key skin points of the hand and the knee of the target bone are is the constraint point of the target bone
  • the first constraint condition is that the position of the key skin point of the hand of the source bone is the same as the position of the key skin point of the knee of the source bone, according to the constraint point of the source bone and the constraint of the target bone
  • the position of the key skin point of the target bone's hand and the position of the key skin point of the target bone's knee should be constrained as follows: the hand of the target bone
  • the position of the key skin point of the target bone is the same as that of the knee of the target bone, that is, the second constraint condition is that the position of the key skin point of the target bone's hand is the same as that of the knee of the target bone.
  • Step 104 According to the first position and the second position, obtain the second bone pose of the target bone that satisfies the second constraint condition; wherein, the first position is the position of the first bone when there is no second constraint condition.
  • the pose is mapped to the target bone, and the obtained position of the constraint point of the target bone; the second position is based on the correspondence between the constraint point of the source bone and the constraint point of the target bone, the constraint point of the source bone, and the first A bone pose, the determined position of the constraint point of the target bone.
  • the first bone posture is mapped to the target bone, and the position of the constraint point under the bone posture of the target bone at this time is the first position; the first position and the target bone constraint point There may be differences in the target position (ie, the second position) to be reached, and the skeleton pose of the target bone at this time is constrained by the second constraint condition, so as to obtain a second skeleton pose that satisfies the second constraint condition.
  • the final animation needs to be added with skinning effects.
  • bone data for motion redirection will cause jitter and overall motion stiffness and unnaturalness.
  • a A fat person and a thin person may have exactly the same bones, that is, the source bone is exactly the same as the target bone, but the skinning information of the two is different.
  • the fat person directly touches the head
  • the final output animation may show that the skinny person is not touching his head; therefore, additional information is needed to assist the skeletal animation to handle the above-mentioned skinning encountered in redirection question.
  • the constraint point of the target bone includes the skin point of the target bone.
  • the animation data of the existing source bones can be transferred to completely different target bones, which increases the reuse of data and further improves the efficiency of animation production.
  • the second bone pose of the target bone is the action pose of the virtual character that satisfies the second constraint condition obtained by reorienting the first bone pose of the source bone, and the second bone pose can be included in the animation data of the target bone.
  • the rotation angle, translation distance and other data are represented.
  • the animation data of the target bone is the animation data of the target bone obtained by the animation data of the source bone through motion redirection, and the style of the animation data of the target bone can be the same as the animation data of the source bone. style is consistent or similar.
  • the animation data of the target bone can be a standard format file of animation, such as amc (CMU standard format), FBX or sps (Xmov standard format).
  • the second constraint condition may include: the position of the constraint point of the target bone under the second bone pose is the same as the second position.
  • the position of the constraint point of the target bone in the second bone posture can be based on the weight information of the constraint point of the target bone, the local coordinates of the constraint point of the target bone on the target bone in the second bone posture, and the local coordinate system of the target bone to The transformation matrix of the world coordinate system is determined.
  • the position of the key skin point in the second bone pose can be determined, and the following formula (1) can be used to determine the source bone or a certain point of the target bone.
  • the position of a constraint point under a certain bone pose for example, the following formula (1) can be used to determine the position of a certain constraint point of the target bone under the second bone pose;
  • S(q) represents the position of the constraint point (key skin point) of the target bone when the second bone pose of the target bone is q
  • n represents the constraint point (key skin point) contained in the target bone and the target bone.
  • the number of bones associated with the skin point), h is the serial number of the associated bone
  • W h represents the weight of the constraint point (key skin point) of the target bone controlled by the bone h
  • L h represents the pose of the second bone
  • M h represents the transformation matrix from the local coordinate system of the hth bone to the world coordinate system.
  • the constraint points of the target bone include the key skin points of the hand and the key skin points of the knee of the target bone, and the key skin points of the hand.
  • the key skin points of the point and knee are controlled by multiple bones in the target bone. According to the control weights of these root bones, the key skin points of the hand, and the local coordinates of the key skin points of the knee on each bone and each
  • the transformation matrix from the local coordinate system of the root bone to the world coordinate system can obtain the key skin points of the hand and knee of the target bone when the second bone pose of the target bone is q in the world coordinate system. Location.
  • the second position of the constraint point of the target bone is the constraint point of the target bone determined according to the preset correspondence between the constraint point of the source bone and the constraint point of the target bone, the constraint point of the source bone, and the posture of the first bone Location. Since there is a correspondence between the constraint point of the target bone and the constraint point of the source bone, in the process of transferring the animation data of the source bone to the target bone, the position of the constraint point of the source bone under the first bone pose is determined by the corresponding relationship. The relationship can be mapped to obtain the second position of the constraint point of the target bone, and the second position is the target position expected to be reached by the constraint point of the target bone in the process of motion redirection.
  • the constraint points of the target bone include the key skin points of the hand and the key skin points of the knee of the target bone.
  • the position of the key skin point of the hand and the key skin point of the knee combined with the corresponding relationship between the constraint point of the target bone and the constraint point of the source bone, can know the second position of the key skin point of the target bone, that is The expected target position of the key skin points of the knee of the target bone and the expected target position of the key skin points of the hand.
  • the constraint function can be determined according to the position and the second position of the constraint point of the target bone in the second bone pose, and the second constraint condition is expressed as the minimum value of the constraint function. It can be understood that the value of the constraint function is The smallest can indicate that the position of the constraint point of the target bone under the second bone pose is the same as the second position; through the constraint condition, the bone posture of the target bone in the process of motion redirection is constrained, so that the second constraint condition is satisfied.
  • the second bone pose of the target bone Exemplarily, as shown in the following formula (2),
  • S(q) represents the position of the jth constraint point of the target bone when the second bone pose of the target bone is q, where the constraint point includes the key skin point, and m represents the constraint point of the target bone (the key mask).
  • the number of skin points) c j represents the second position of the jth constraint point (key skin point) of the target bone.
  • the skeleton data not only the skeleton data but also the skin information is used effectively to establish the constraint conditions, so as to carry out more perfect constraints on the motion redirection process.
  • constraint information is missing.
  • the skeleton data has only two bones to control the foot, but the skeleton data cannot know the effect of the skinning, and the feet are often uneven.
  • key skin points such as hands and feet can be used as constraint points, and a first constraint condition and a second constraint condition can be constructed, and then the first position and the second position of the constraint point of the target bone can be used to satisfy the The second bone pose of the target bone of the second constraint condition, the positions of key skin points such as hands and feet under the second bone pose of the target bone and the corresponding key skin points under the first bone pose of the source bone
  • the positions of the points correspond to each other, so that the action of the virtual character can be expressed more realistically and naturally through the second skeletal pose.
  • q represents the second bone pose of the target bone
  • q ⁇ represents the bone pose of the target bone obtained without constraints (that is, directly transfer the animation data of the source bone without constraints to obtain the target bone)
  • FK ( q) Represents the coordinate information of the constraint point (bone point) when the second bone pose of the target bone is q, wherein the constraint point includes the bone point
  • c i represents the ith joint point (bone point) of the target bone corresponding to the need to reach
  • k represents the number of joint points (bone points) in the target bone.
  • the above formula (2) can be combined with the above formula (3) to obtain a more comprehensive optimization formula, so as to optimize the skeletal posture of the target bone during the motion redirection process, and the optimization formula is shown in the following formula (4) :
  • q represents the second bone pose of the target bone
  • q ⁇ represents the bone pose of the target bone obtained without constraints
  • FK(q) represents the constraint point when the second bone pose of the target bone is q (the key Bone point) information
  • c i represents the specified position corresponding to the ith joint point (key bone point) of the target bone that needs to be reached
  • k represents the number of joint points (key bone points) in the target bone
  • m represents the target bone
  • w 1 , w 2 , and w 3 are all weight coefficients.
  • FK(q) can express the coordinate information of the constraint point (key bone point) of the target bone
  • S(q) can express the constraint point (key skin point) information of the target bone
  • c i and c j respectively represent the pair of bone information
  • the position constraints and the position constraints of the skin information, and the specific values of the weight coefficients w 1 , w 2 , and w 3 can be adjusted according to actual needs, so that in the process of motion redirection, the valid information is no longer only the rotation of the bones.
  • the position of the skin point becomes an important additional constraint; at the same time, the use of bone motion information and skin information for constraints can effectively avoid the jitter that may occur in motion redirection and the stiffness and unnaturalness of the overall action; At the same time, the animation production efficiency is improved.
  • the method further includes: processing the second bone pose sequence of the target bone, the motion sequence of the constraint point of the source bone, and the constraint point of the target bone of the current frame by using the prediction model, to obtain The constraint point of the target bone in the next frame; wherein, the motion sequence of the constraint point of the source bone is determined by the positions of different constraint points of the source bone.
  • the motion sequence of the constraint points of the source bone consists of the position of the key skin point of the source bone and the position of the key mesh point, or the position of the key skin point of the source bone and the position of the key bone point, or the position of the key skin point of the source bone and the position of the key bone point.
  • the position of the key skin point is determined with the position of other key skin points.
  • key mesh points may include: the ground on which people walk, tables and chairs that people touch, horizontal bars, etc.
  • other key skin points may include: key skin points of bones of other characters associated with the source bone skin point.
  • the prediction model uses the second pose sequence of the target bone, the motion sequence of the constraint point of the source bone, and the position of the constraint point of the target bone in the current frame as input, and uses the constraint point of the target bone in the next frame as the prediction result. Train, and train an algorithmic model that reaches convergence.
  • the second bone pose sequence of the target bone is a sequence composed of the second bone poses of the target bone obtained through motion redirection within a certain time window; the motion sequence of the constraint points of the source bone is the source corresponding to each first bone pose of the source bone.
  • the constraint points of the source bones are related to the positions of key grid points, key bone points or other key skin points in the above motion sequence.
  • the position of the point or other key skin point can determine the constraint point of the source bone.
  • the key information point is determined as The constraint points of the source bone, thereby determining the motion sequence of the constraint points of the source bone.
  • a piece of animation data of the source bone includes 50 frames
  • the second bone pose sequence of the target bone may include the second bone pose of the target bone obtained after the animation data of the source bone in the first 30 frames of motion redirection, and the constraints of the source bone.
  • the motion sequence of points can include the constraint points of the source bone in the first bone pose of the source bone in 50 frames, through the second bone pose of the target bone in the 30 frames, the constraint points of the source bone in the 50 frames, and the target bone in the 30th frame. to determine the constraint point of the target bone in the current 31st frame of data; for example, as shown in the following formula (5):
  • F is the trained neural network prediction model
  • c ⁇ represents the constraint point of the target bone in the current frame
  • c * represents the constraint point of the target bone in the previous frame
  • a motion sequence representing the constraint points of the source bone.
  • the distance judgment is: look at the source and target bones in the space and space objects (objects with interaction) As a whole, the distance between them will become the basis for constraint determination, that is, not only the target bone of a single virtual character is considered, but the redirection space where the entire target bone is located is regarded as a whole.
  • a section of the source bone that runs first, then grabs the horizontal bar to do pull-ups and then falls is transferred to the target bone.
  • the running is the constraint between the footsteps and the ground.
  • the hand and the horizontal bar are constrained, and finally, when the body falls, it returns to the constraint between the footsteps and the ground.
  • the ground and the horizontal bar are used as environmental factors, and the ground is used in the process of motion redirection.
  • the key information points include the key skin points of the hands and feet, and the key mesh points on the ground and the horizontal bar that are in contact with the key skin points on the source bone , the constraint points of the source bones are related to these key information points; according to this whole, that is, the key mesh points on the ground, the key mesh points of the horizontal bar, the key skin points of the hands, and the key skin points of the feet, Therefore, the motion sequence of the constraint points of the source bones can be known, that is, the key skin points of the feet first contact the key mesh points on the ground, then the key skin points of the hand contact the key mesh points of the horizontal bar, and finally return.
  • the key skin points to the feet are in contact with the key grid points on the ground; assuming that a part of the motion redirection has been completed for the entire action, the second bone pose sequence of the target bone is obtained, according to the constraint point of the source bone.
  • the motion sequence, the second skeleton pose sequence of the target skeleton, and the constraint point of the target skeleton of the current frame, the constraint point of the target skeleton of the next frame can be obtained through the above formula (5);
  • the second constraint condition includes skin information and environment information, through the second constraint condition
  • the second bone pose of the target bone is constrained in real time during the motion redirection process, so that the position of the constraint point of the target bone under the optimized second bone pose of the target bone is the same as the second position.
  • the valid information is no longer only the motion information such as the rotation angle of the bones, and the key skin points and key grid points become an important additional constraint; at the same time, the bone motion information and skin information are used to constrain , effectively avoid the jitter that may occur in motion redirection and the stiffness and unnaturalness of the overall action; at the same time, it improves the efficiency of animation production.
  • FIG. 2 shows a flowchart of a motion redirection method according to an embodiment of the present disclosure. As shown in Figure 2, the method may include:
  • Step 200 between the source bone and the target bone, build one or more virtual bones
  • the difference in the number of bones makes it impossible to transfer the spatial rotation data of the joints one-to-one between the source bone and the target bone.
  • the axis of the bone refers to the local coordinate system of each bone.
  • the difference in the axial direction causes the joint between the source bone and the target bone to directly transmit spatial rotation data.
  • the difference in length leads to errors in transferring animation data from the source bone to the target bone (eg foot sliding, etc.).
  • FIG. 3 shows a schematic diagram of constructing a virtual bone according to an embodiment of the present disclosure.
  • the length of each bone in the virtual bone is related to the corresponding source bone
  • the length of each bone in the virtual bone is the same, and the axial direction of each bone in the virtual bone is the same as the axial direction of each bone in the corresponding target bone.
  • the number of virtual bones can be multiple, and multiple virtual bones are used to bridge the source bone and the target bone, so as to achieve a smooth transition from the source bone to the target bone, and further optimize the effect of eliminating axial differences.
  • the number of virtual bones may be different from the source bones and the target bones, and the number of virtual bones may be the same as the number of bones selected in the above-mentioned predefined correspondence between the source bones and the target bones, for example, the source bones and the target bones
  • Each of the bones has 100 bones.
  • 10 bones are selected as key bones for correspondence, and 10 virtual bones are calculated through 100 root bones and 100 target bones and their corresponding relationships; for example, the source bones have 100 The root bone and the target bone have 10 bones.
  • 10 bones are selected as key bones for correspondence, and 10 virtual bones are calculated through 100 root bones and 10 target bones and their corresponding relationships. Therefore, the above-mentioned influence of the difference in the number of bones on the motion redirection is effectively solved, and the operation efficiency is improved.
  • this step may include: obtaining one or more reference poses of the source skeleton and one of the target skeletons according to the source skeleton, the target skeleton and one or more preset reference poses or multiple reference poses; according to the preset correspondence between the source bones and the target bones, one or more virtual bones are built between the same reference poses of the source bones and the target bones.
  • the virtual bone is constructed by adding Multiple reference poses are used, and the multi-frame reference pose is used to define the style relationship between the source bone and the target bone, so as to control the final animation style of the character.
  • one or more virtual bones corresponding to the reference poses are obtained, so as to use the virtual bones to The style transitions from the source bone to the target bone.
  • the reference pose is standing
  • the source bone is a normal standing style
  • the target bone is expected to be in a hunchbacked standing style
  • the corresponding relationship between the source bone and the target bone is used to make the normal standing source
  • a virtual skeleton of the standing posture is built between the skeleton and the target bone of hunchbacked standing.
  • the style of the virtual skeleton's standing posture is the transition from the normal standing style to the hunchbacked standing style, so that the virtual bone is used to transition the normal standing style of the source bone to the hunchbacked standing style.
  • the hunchback standing style of the target skeleton is the transition from the normal standing style to the hunchbacked standing style, so that the virtual bone is used to transition the normal standing style of the source bone to the hunchbacked standing style.
  • the reference pose includes: a T-pose.
  • the basic reference pose is a T-pose (T-pose), that is, a standing posture with both hands raised.
  • T-pose T-pose
  • the T-pose according to the corresponding relationship between the source bone and the target bone, and the T-pose presented by the source bone and the T-pose presented by the target bone.
  • T-pose virtual bone is built, and the T-pose of the virtual bone bridges the source bone and the target bone. The stylistic form when standing between hands raised.
  • the reference posture further includes at least one posture of squatting, taking a step, akimbo, bending over, and raising both hands.
  • the above-mentioned T-pose virtual bone is constructed by using the source bone and target bone, as well as the corresponding relationship between the source bone and the target bone.
  • the T-pose virtual bone is used as the basic virtual bone, which basically bridges the axial difference between the source bone and the target bone. .
  • other reference poses are added to meet different style requirements.
  • the reference postures may also include other 5 different reference postures: squatting posture, stepping posture, akimbo posture, bending posture, and raising hands posture.
  • a virtual skeleton of the reference pose is built, so as to use the virtual skeleton to transition the style of the source skeleton under the reference pose to the style of the target skeleton under the reference pose.
  • the preset reference pose has a T- pose, and other reference poses can be added according to different animation production requirements, and the number of reference poses is not limited in this embodiment of the present disclosure.
  • Step 201 Acquire the first bone pose of the source bone and the constraint points of the source bone, wherein the constraint points include skin points.
  • This step is the same as step 101 in the above-mentioned FIG. 1 , and will not be repeated here.
  • Step 202 constructing a first constraint condition according to the posture of the first bone and the constraint points of the source bone.
  • This step is the same as step 102 in the above-mentioned FIG. 1 , and will not be repeated here.
  • Step 203 Obtain a second constraint condition according to the correspondence between the constraint point of the source bone and the constraint point of the target bone and the first constraint condition.
  • This step is the same as step 103 in the above-mentioned FIG. 1 , and will not be repeated here.
  • Step 204 Obtain a third bone pose of the target bone according to the first bone pose and the virtual bone.
  • one or more virtual bones are obtained, and then one or more virtual bones are fused to obtain the third bone pose of the target bone, so that the style of the source bone can be combined Mapped to the target bone; the pose of the third bone is the pose of the target bone obtained without constraints.
  • the third bone pose of the target bone is obtained through fusion calculation.
  • Step 205 According to the third position and the second position, obtain a second bone pose that satisfies the second constraint condition; wherein, the third position is the constraint point of the target bone under the third bone pose. position; the second position is the position of the constraint point of the target bone determined according to the correspondence between the constraint point of the source bone and the constraint point of the target bone, the position of the constraint point of the source bone, and the posture of the first bone.
  • the position of the constraint point of the target bone under the posture of the third bone may be different from the target position that the constraint point of the target bone needs to reach (that is, the second position).
  • a second constraint is added to constrain the bone pose of the target bone, so as to obtain a more vivid and realistic second bone pose of the target bone, making the motion redirection action more accurate.
  • the animation data of the source bone is transferred to the target bone through one or more virtual bones constructed above, that is, the first bone pose of the source bone is mapped to the third bone pose of the target bone through the virtual bone;
  • the virtual bone eliminates the quantitative and axial differences between the source bone and the target bone, thus ensuring that the animation data can be effectively transferred from the source bone to the target bone;
  • the reference pose of the source skeleton and the target skeleton's different pose styles are also converted through the virtual skeleton.
  • the third bone pose of the target bone obtained during the motion redirection process is constrained by the second constraint condition in FIG. 1, so as to obtain the second bone pose of the target bone.
  • the skin information is effectively used to carry out Constraints can more effectively avoid the jitter that may occur in motion redirection and the stiffness and unnaturalness of the overall movement, which further improves the efficiency of animation production and avoids a lot of manual work.
  • the constraint points include skin points; according to the first bone pose and the constraint points of the source bone, a first Constraint condition; according to the corresponding relationship between the constraint point of the source bone and the constraint point of the target bone, and the first constraint condition, the second constraint condition is obtained; according to the first position and the second position, the second constraint condition is obtained.
  • the second bone pose of the target bone with the constraint condition wherein the first position is the position of the constraint point of the target bone obtained by mapping the first bone pose to the target bone without the second constraint condition;
  • the second position is the position of the constraint point of the target bone determined according to the corresponding relationship between the constraint point of the source bone and the constraint point of the target bone, the constraint point of the source bone and the posture of the first bone.
  • FIG. 4 shows a structural diagram of a motion redirection apparatus according to an embodiment of the present disclosure.
  • the apparatus includes: an acquisition module 301 for acquiring a first bone pose of a source bone and constraints of the source bone point, the constraint points include skin points; the first constraint construction module 302 is used to construct the first constraint according to the first bone pose and the constraint points of the source bone; the second constraint construction module 303 is used to construct the first constraint to obtain the second constraint condition according to the corresponding relationship between the constraint point of the source bone and the constraint point of the target bone and the first constraint condition; the motion redirection module 304 is used for, according to the first position and the second position, obtaining the second bone pose of the target bone that satisfies the second constraint condition, wherein the first position is the target bone obtained by mapping the first bone pose to the target bone when there is no second constraint condition The second position is the constraint point of the target bone determined according to the corresponding relationship between the constraint point of the
  • the apparatus further includes: a virtual bone building module, configured to: build one or more virtual bones between the source bone and the target bone; according to the first bone posture and the virtual bone to obtain the third bone posture of the target bone; according to the third position and the second position, obtain the second bone posture that satisfies the second constraint condition; wherein, the third position is the target The position of the constraint point of the bone in the third bone pose.
  • a virtual bone building module configured to: build one or more virtual bones between the source bone and the target bone; according to the first bone posture and the virtual bone to obtain the third bone posture of the target bone; according to the third position and the second position, obtain the second bone posture that satisfies the second constraint condition; wherein, the third position is the target The position of the constraint point of the bone in the third bone pose.
  • the second constraint condition includes: the position of the constraint point of the target bone under the second bone pose is the same as the second position.
  • the position of the constraint point of the target bone under the second bone posture is based on the weight information of the constraint point of the target bone, the constraint point of the target bone in the second bone posture is in the target bone
  • the local coordinates on and the transformation matrix from the local coordinate system of the target bone to the world coordinate system are determined.
  • the apparatus further includes: a constraint point position prediction module, configured to predict the second bone pose sequence of the target bone, the motion sequence of the constraint point of the source bone, and the target of the current frame by using the prediction model
  • the constraint points of the bones are processed to obtain the constraint points of the target bone in the next frame; wherein, the motion sequence of the constraint points of the source bone is determined by the positions of different constraint points of the source bone.
  • the constraint points further include: mesh points and/or skeleton points.
  • the virtual skeleton building module is further configured to: obtain one or more references of the source skeleton according to the source skeleton, the target skeleton and one or more preset reference poses The pose and one or more reference poses of the target bone; according to the preset correspondence between the source bone and the target bone, one or more virtual bones are built between the same reference pose of the source bone and the target bone.
  • the reference posture includes at least: a T-pose.
  • the constraint point of the source bone is determined according to the self constraint of the source bone and/or the environment constraint associated with the source bone.
  • the constraint points include skin points; according to the first bone pose and the constraint points of the source bone, a first Constraint condition; according to the corresponding relationship between the constraint point of the source bone and the constraint point of the target bone, and the first constraint condition, the second constraint condition is obtained; according to the first position and the second position, the second constraint condition is obtained.
  • the second bone pose of the target bone with the constraint condition wherein the first position is the position of the constraint point of the target bone obtained by mapping the first bone pose to the target bone without the second constraint condition;
  • the second position is the position of the constraint point of the target bone determined according to the corresponding relationship between the constraint point of the source bone and the constraint point of the target bone, the constraint point of the source bone and the posture of the first bone.
  • an electronic device comprising: a processor; a memory for storing instructions executable by the processor; wherein the processor is configured to perform the above method.
  • a non-volatile computer-readable storage medium having computer program instructions stored thereon, wherein the computer program instructions, when executed by a processor, implement the above-described method.
  • FIG. 5 shows a block diagram of an electronic device 1900 according to an embodiment of the present disclosure.
  • the electronic device 1900 may be provided as a server.
  • electronic device 1900 includes processing component 1922, which further includes one or more processors, and a memory resource represented by memory 1932 for storing instructions executable by processing component 1922, such as applications.
  • An application program stored in memory 1932 may include one or more modules, each corresponding to a set of instructions.
  • the processing component 1922 is configured to execute instructions to perform the above-described methods.
  • the electronic device 1900 may also include a power supply assembly 1926 configured to perform power management of the electronic device 1900, a wired or wireless network interface 1950 configured to connect the electronic device 1900 to a network, and an input output (I/O) interface 1958 .
  • Electronic device 1900 may operate based on an operating system stored in memory 1932, such as Windows ServerTM, Mac OS XTM, UnixTM, LinuxTM, FreeBSDTM or the like.
  • a non-volatile computer-readable storage medium such as memory 1932 comprising computer program instructions executable by processing component 1922 of electronic device 1900 to perform the above-described method.
  • the present disclosure may be a system, method and/or computer program product.
  • the computer program product may include a computer-readable storage medium having computer-readable program instructions loaded thereon for causing a processor to implement various aspects of the present disclosure.
  • a computer-readable storage medium may be a tangible device that can hold and store instructions for use by the instruction execution device.
  • the computer-readable storage medium may be, for example, but not limited to, an electrical storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing.
  • Non-exhaustive list of computer readable storage media include: portable computer disks, hard disks, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM) or flash memory), static random access memory (SRAM), portable compact disk read only memory (CD-ROM), digital versatile disk (DVD), memory sticks, floppy disks, mechanically coded devices, such as printers with instructions stored thereon Hole cards or raised structures in grooves, and any suitable combination of the above.
  • RAM random access memory
  • ROM read only memory
  • EPROM erasable programmable read only memory
  • flash memory static random access memory
  • SRAM static random access memory
  • CD-ROM compact disk read only memory
  • DVD digital versatile disk
  • memory sticks floppy disks
  • mechanically coded devices such as printers with instructions stored thereon Hole cards or raised structures in grooves, and any suitable combination of the above.
  • Computer-readable storage media are not to be construed as transient signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (eg, light pulses through fiber optic cables), or through electrical wires transmitted electrical signals.
  • the computer readable program instructions described herein may be downloaded to various computing/processing devices from a computer readable storage medium, or to an external computer or external storage device over a network such as the Internet, a local area network, a wide area network, and/or a wireless network.
  • the network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers, and/or edge servers.
  • a network adapter card or network interface in each computing/processing device receives computer-readable program instructions from a network and forwards the computer-readable program instructions for storage in a computer-readable storage medium in each computing/processing device .
  • Computer program instructions for carrying out operations of the present disclosure may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state setting data, or instructions in one or more programming languages.
  • Source or object code written in any combination, including object-oriented programming languages, such as Smalltalk, C++, etc., and conventional procedural programming languages, such as the "C" language or similar programming languages.
  • the computer readable program instructions may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer, or entirely on the remote computer or server implement.
  • the remote computer may be connected to the user's computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (eg, using an Internet service provider through the Internet connect).
  • LAN local area network
  • WAN wide area network
  • custom electronic circuits such as programmable logic circuits, field programmable gate arrays (FPGAs), or programmable logic arrays (PLAs) can be personalized by utilizing state information of computer readable program instructions.
  • Computer readable program instructions are executed to implement various aspects of the present disclosure.
  • These computer readable program instructions may be provided to a processor of a general purpose computer, special purpose computer or other programmable data processing apparatus to produce a machine that causes the instructions when executed by the processor of the computer or other programmable data processing apparatus , resulting in means for implementing the functions/acts specified in one or more blocks of the flowchart and/or block diagrams.
  • These computer readable program instructions can also be stored in a computer readable storage medium, these instructions cause a computer, programmable data processing apparatus and/or other equipment to operate in a specific manner, so that the computer readable medium on which the instructions are stored includes An article of manufacture comprising instructions for implementing various aspects of the functions/acts specified in one or more blocks of the flowchart and/or block diagrams.
  • Computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other equipment to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other equipment to produce a computer-implemented process , thereby causing instructions executing on a computer, other programmable data processing apparatus, or other device to implement the functions/acts specified in one or more blocks of the flowcharts and/or block diagrams.
  • each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which comprises one or more functions for implementing the specified logical function(s) executable instructions.
  • the functions noted in the blocks may occur out of the order noted in the figures. For example, two blocks in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved.
  • each block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations can be implemented in dedicated hardware-based systems that perform the specified functions or actions , or can be implemented in a combination of dedicated hardware and computer instructions.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Processing Or Creating Images (AREA)

Abstract

La présente divulgation concerne un procédé et un appareil de reciblage de mouvement, un dispositif électronique, et un support d'enregistrement. Le procédé consiste à : acquérir une première posture osseuse et un point de contrainte d'un os source, le point de contrainte comprenant un point cutané ; élaborer une première condition de contrainte selon la première posture osseuse et le point de contrainte de l'os source ; obtenir une seconde condition de contrainte selon une correspondance entre le point de contrainte de l'os source et un point de contrainte d'un os cible, et la première condition de contrainte ; et obtenir, selon une première position et une seconde position, une seconde posture osseuse de l'os cible satisfaisant à la seconde condition de contrainte, la première position étant une position de point de contrainte de l'os cible obtenue par mise en correspondance de la première posture osseuse avec l'os cible en l'absence de seconde condition de contrainte, et la seconde position étant une position de point de contrainte de l'os cible déterminée selon la correspondance, le point de contrainte de l'os source et la première posture osseuse. Dans la présente divulgation, des contraintes cutanées sont ajoutées au reciblage de mouvement, de façon à éviter des phénomènes tels que la gigue de mouvement, la rigidité et le caractère non naturel, et à améliorer l'efficacité de production d'animation.
PCT/CN2021/138407 2020-12-31 2021-12-15 Procédé et appareil de reciblage de mouvement, dispositif électronique, et support d'enregistrement WO2022143178A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202011631904.6A CN112634419B (zh) 2020-12-31 2020-12-31 一种运动重定向方法、装置、电子设备及存储介质
CN202011631904.6 2020-12-31

Publications (1)

Publication Number Publication Date
WO2022143178A1 true WO2022143178A1 (fr) 2022-07-07

Family

ID=75289826

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/138407 WO2022143178A1 (fr) 2020-12-31 2021-12-15 Procédé et appareil de reciblage de mouvement, dispositif électronique, et support d'enregistrement

Country Status (2)

Country Link
CN (1) CN112634419B (fr)
WO (1) WO2022143178A1 (fr)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115713582A (zh) * 2022-12-02 2023-02-24 北京百度网讯科技有限公司 虚拟形象生成方法、装置、电子设备和介质
CN116152404A (zh) * 2023-04-19 2023-05-23 苏州浪潮智能科技有限公司 动画重定向方法、装置、计算机设备及存储介质

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112634419B (zh) * 2020-12-31 2022-03-25 魔珐(上海)信息科技有限公司 一种运动重定向方法、装置、电子设备及存储介质
CN113313794B (zh) * 2021-05-19 2022-11-08 深圳市慧鲤科技有限公司 动画迁移方法和装置、设备及存储介质
CN113298917A (zh) * 2021-05-28 2021-08-24 上海曼恒数字技术股份有限公司 一种人形动画复用方法及系统
CN113610949B (zh) * 2021-08-25 2023-06-16 腾讯科技（深圳）有限公司 虚拟手臂骨骼的蒙皮方法、装置、设备以及存储介质
CN115018959A (zh) * 2022-05-13 2022-09-06 阿里巴巴（中国）有限公司 三维虚拟模型的驱动处理方法、装置、设备和存储介质
CN116385666B (zh) * 2023-06-02 2024-02-27 杭州倚澜科技有限公司 基于反馈式循环神经网络的人体模型重定向方法及装置

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2009140261A1 (fr) * 2008-05-13 2009-11-19 The Board Of Trustees Of The Leland Stanford Junior University Systèmes, procédés et dispositifs pour une capture de mouvement à l'aide d'une imagerie vidéo
CN111292402A (zh) * 2020-02-13 2020-06-16 腾讯科技（深圳）有限公司 数据处理的方法、装置、设备及计算机可读存储介质
CN111402372A (zh) * 2020-03-24 2020-07-10 网易（杭州）网络有限公司 游戏中虚拟角色的动作模拟方法、装置和电子设备
CN112634419A (zh) * 2020-12-31 2021-04-09 魔珐(上海)信息科技有限公司 一种运动重定向方法、装置、电子设备及存储介质

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9058065B2 (en) * 2010-10-22 2015-06-16 Custom Device Technologies, Llc Hand-held orthopedic electronic interface device and method of manufacture
CN102708582B (zh) * 2012-05-08 2014-03-12 电子科技大学 一种面向异构拓扑的角色运动重定向方法
CN102945561B (zh) * 2012-10-16 2015-11-18 北京航空航天大学 一种计算机骨骼动画中基于运动捕获数据的运动合成与编辑方法
CN106780766B (zh) * 2016-11-24 2019-02-05 腾讯科技（深圳）有限公司 匹配实现方法及相关装置
CN107833271B (zh) * 2017-09-30 2020-04-07 中国科学院自动化研究所 一种基于Kinect的骨骼重定向方法及装置
CN111080755B (zh) * 2019-12-31 2023-11-14 上海米哈游天命科技有限公司 一种运动解算方法、装置、存储介质及电子设备
CN111724459B (zh) * 2020-06-22 2024-04-12 合肥工业大学 一种面向异构人体骨骼的运动重定向的方法及系统
CN111899317A (zh) * 2020-08-07 2020-11-06 北京中科深智科技有限公司 一种基于神经网络的运动数据重定向方法

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2009140261A1 (fr) * 2008-05-13 2009-11-19 The Board Of Trustees Of The Leland Stanford Junior University Systèmes, procédés et dispositifs pour une capture de mouvement à l'aide d'une imagerie vidéo
CN111292402A (zh) * 2020-02-13 2020-06-16 腾讯科技（深圳）有限公司 数据处理的方法、装置、设备及计算机可读存储介质
CN111402372A (zh) * 2020-03-24 2020-07-10 网易（杭州）网络有限公司 游戏中虚拟角色的动作模拟方法、装置和电子设备
CN112634419A (zh) * 2020-12-31 2021-04-09 魔珐(上海)信息科技有限公司 一种运动重定向方法、装置、电子设备及存储介质

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115713582A (zh) * 2022-12-02 2023-02-24 北京百度网讯科技有限公司 虚拟形象生成方法、装置、电子设备和介质
CN115713582B (zh) * 2022-12-02 2023-10-27 北京百度网讯科技有限公司 虚拟形象生成方法、装置、电子设备和介质
CN116152404A (zh) * 2023-04-19 2023-05-23 苏州浪潮智能科技有限公司 动画重定向方法、装置、计算机设备及存储介质

Also Published As

Publication number Publication date
CN112634419B (zh) 2022-03-25
CN112634419A (zh) 2021-04-09

Similar Documents

Publication Publication Date Title
WO2022143178A1 (fr) Procédé et appareil de reciblage de mouvement, dispositif électronique, et support d'enregistrement
CN112819971B (zh) 虚拟形象的生成方法、装置、设备和介质
Seol et al. Creature features: online motion puppetry for non-human characters
CN112509099B (zh) 虚拟形象驱动方法、装置、设备和存储介质
Chen et al. KinÊtre: animating the world with the human body
EP3454302B1 (fr) Approximation de déformation de maillage pour des plates-formes de caractères
US9378589B2 (en) Apparatus and method for generating digital clone
US11195318B2 (en) Rapid avatar capture and simulation using commodity depth sensors
KR20220025023A (ko) 애니메이션 처리 방법 및 장치, 컴퓨터 저장 매체 그리고 전자 디바이스
US9947124B2 (en) Motion control of active deformable objects
CN111223171A (zh) 图像处理方法、装置、电子设备及存储介质
CN112330805A (zh) 人脸3d模型生成方法、装置、设备及可读存储介质
Feng et al. Fast, automatic character animation pipelines
WO2023216646A1 (fr) Procédé et appareil de traitement de pilotage pour modèle virtuel tridimensionnel, dispositif et support de stockage
Pantuwong et al. A novel template‐based automatic rigging algorithm for articulated‐character animation
CN116206370A (zh) 驱动信息生成、驱动方法、装置、电子设备以及存储介质
CN111599002A (zh) 用于生成图像的方法和装置
CN111369647A (zh) 信息处理方法及装置、计算机存储介质、电子设备
US7057618B2 (en) Patch picking methods and apparatus
CN112509098B (zh) 动画形象生成方法、装置及电子设备
US10282883B2 (en) Hierarchy-based character rigging
US10319133B1 (en) Posing animation hierarchies with dynamic posing roots
Razzaq et al. Automatic conversion of human mesh into skeleton animation by using kinect motion
CN116524081A (zh) 虚拟现实画面调整方法、装置、设备及介质
US8786611B1 (en) Sliding skin deformer

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21913919

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21913919

Country of ref document: EP

Kind code of ref document: A1

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 20.11.2023)