WO2023207477A1

WO2023207477A1 - Animation data repair method and apparatus, device, storage medium, and program product

Info

Publication number: WO2023207477A1
Application number: PCT/CN2023/084373
Authority: WO
Inventors: 许广龙; 李志豪
Original assignee: 腾讯科技（深圳）有限公司
Priority date: 2022-04-27
Filing date: 2023-03-28
Publication date: 2023-11-02
Also published as: CN117011498A

Abstract

An animation data repair method and apparatus, a device, a storage medium and a program product, relating to the technical field of data processing. The method comprises: acquiring animation data to be repaired obtained by redirection of motion capture data (201); creating colliders for at least one object in the animation data to be repaired, so as to obtain a collider set respectively corresponding to the at least one object (202); respectively performing, on the basis of the collider set respectively corresponding to the at least one object, collision detection on objects in multiple frames of animation data, so as to obtain at least one key frame data group (203); obtaining, on the basis of the at least one key frame data group, at least one repaired data segment (204); and superimposing the at least one repaired data segment with the animation data to be repaired, so as to obtain repaired animation data (205). The present application realizes automatic acquisition of a key frame data group (i.e., an interpolation process), improves animation data repair efficiency.

Description

Animation data repair method, device, equipment, storage medium and program product

This application claims priority to the Chinese patent application with application number 202210454407.6 and the invention name "Animation Data Repair Method, Device, Equipment, Storage Media and Program Products" submitted on April 27, 2022, the entire content of which is incorporated by reference. in this application.

Technical field

The embodiments of the present application relate to the field of data processing technology, and in particular to an animation data repair method, device, equipment, storage medium and program product.

Background technique

Currently, animation can be produced based on the motion capture data obtained through motion capture. However, since the height ratio of the motion capture object is inconsistent with the height ratio of the animated character, there are often interspersed phenomena in the animation data obtained by redirection, for example, the limbs of animated characters are interspersed, and the limbs of animated characters and objects in the animation Interspersed between etc.

In related technologies, animators use manual repair methods to detect frame-by-frame based on reference videos (such as videos corresponding to motion capture data) or the needs of action directors to discover animation data segments with interspersed phenomena, and then target these animation data segments Perform interspersed repair to obtain the repaired animation data. However, this process usually requires a lot of manpower and time, and often requires waiting for hours or even days to obtain animation data ranging from tens of seconds to minutes. The repair efficiency of animation data is not high.

Contents of the invention

Embodiments of the present application provide an animation data repair method, device, equipment, storage medium and program product, which can improve animation data repair efficiency. The technical solution may include the following content.

According to one aspect of the embodiments of the present application, a method for repairing animation data is provided. The method includes:

Obtain animation data to be repaired, where the animation data to be repaired includes multi-frame animation data obtained by redirecting motion capture data;

Create a collision body for at least one object in the animation data to be repaired, and obtain a collection of collision bodies corresponding to the at least one object, and the collection of collision bodies includes at least one collision body;

Based on the set of colliders respectively corresponding to the at least one object, collision detection is performed on the objects in the multi-frame animation data to obtain at least one key frame data group, each of the key frame data groups corresponding to an interleaving process;

Based on the at least one key frame data group, at least one repaired data segment is obtained, where the repaired data segment refers to the data segment that is repaired by the interleaving process;

According to the time periods corresponding to the at least one repair data segment, the at least one repair data segment and the animation data to be repaired are superimposed to obtain repair animation data.

According to one aspect of the embodiment of the present application, an animation data repair device is provided, and the device includes:

An animation data acquisition module, used to acquire animation data to be repaired, where the animation data to be repaired includes multi-frame animation data obtained by redirecting motion capture data;

A collision body creation module, configured to create a collision body for at least one object in the animation data to be repaired, and obtain a collection of collision bodies corresponding to the at least one object, and the collection of collision bodies includes at least one collision body;

A key frame acquisition module, configured to perform collision detection on the objects in the multi-frame animation data based on the set of colliders respectively corresponding to the at least one object, and obtain at least one key frame data group, each of the key frame data The group corresponds to an interspersed process;

A repair fragment acquisition module, configured to obtain at least one repair data fragment based on the at least one key frame data group, where the repair data fragment refers to the data fragment after the interleaving process is repaired;

An animation data repair module is configured to superimpose the at least one repair data segment and the animation data to be repaired according to the time periods corresponding to the at least one repair data segment to obtain repair animation data.

According to an aspect of an embodiment of the present application, a computer device is provided. The computer device includes a processor and a memory. A computer program is stored in the memory. The computer program is loaded and executed by the processor to implement the above. Animation data repair method.

According to one aspect of the embodiments of the present application, a computer-readable storage medium is provided. A computer program is stored in the readable storage medium, and the computer program is loaded and executed by a processor to implement the above animation data repair method.

According to one aspect of an embodiment of the present application, a computer program product is provided. The computer program product includes a computer program, and the computer program is stored in a computer-readable storage medium. The processor of the computer device reads the computer program from the computer-readable storage medium, and the processor executes the computer program, so that the computer device performs the above animation data repair method.

The technical solutions provided by the embodiments of this application may include the following beneficial effects:

By creating a collision body for at least one object in the animation data to be repaired, and then obtaining the collision body based on the creation, collision detection is performed on the multi-frame animation data corresponding to the animation data to be repaired, and the key frame data group is obtained, realizing the automatic acquisition of the interleaving process. , Compared with the related art in which the interleaving process is obtained through manual frame-by-frame detection, the technical solution provided by the embodiment of the present application can improve the acquisition efficiency of the interleaving process, thereby improving the repair efficiency of animation data.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments will be briefly introduced below. Obviously, the drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, other drawings can also be obtained based on these drawings without exerting creative efforts.

Figure 1 is a schematic diagram of a solution implementation environment provided by an embodiment of the present application;

Figure 2 is a flow chart of an animation data repair method provided by an embodiment of the present application;

Figure 3 is a schematic diagram of a collision body creation method provided by an embodiment of the present application;

Figure 4 is a flow chart of a method for obtaining a key frame data group provided by an embodiment of the present application;

Figure 5 is a schematic diagram of interspersed repair under the interaction between animated characters and the ground provided by an embodiment of the present application;

Figure 6 is a schematic diagram of interspersed repair under interaction between animated characters provided by an embodiment of the present application;

Figure 7 is a schematic diagram of the creation of a collision body under the interaction between animated characters provided by an embodiment of the present application;

Figure 8 is a schematic diagram of the creation of a collision body under the interaction between animated characters and props provided by an embodiment of the present application;

Figure 9 is a schematic diagram of collision detection under a surrounding ball provided by an embodiment of the present application;

Figure 10 is a block diagram of an animation data repair device provided by an embodiment of the present application;

Figure 11 is a block diagram of an animation data repair device provided by another embodiment of the present application;

Figure 12 is a block diagram of a computer device provided by an embodiment of the present application.

Detailed ways

In order to make the purpose, technical solutions and advantages of the present application clearer, the embodiments of the present application will be further described in detail below with reference to the accompanying drawings.

Before introducing the embodiments of this application, some terms involved in this application are first defined and explained.

1. Motion Capture (Mocap): The process of recording motion data of motion capture objects (such as human bodies, animals, and other moving objects) with the help of cameras or inertial devices.

2. Retargeting: A computer graphics term that specifically refers to the process of mapping motion capture data obtained through motion capture from motion capture objects to animated characters (or robots, game characters, etc.).

3. Collision Detection: A computer graphics term, specifically referring to the process of determining whether two objects intersect in a computer.

4. Polygon mesh (Mesh): A term in computer graphics, specifically referring to a geometric model composed of a series of polygons (such as Geometric models of human bodies, animals, objects, etc.), which contain geometric information such as grid points, grid edges, and grid surfaces.

5. Skeleton: Computer graphics term. If an object in the geometric model affects a series of grid points of the polygon mesh and can cause the series of grid points to follow the movement or deformation of the object, the object is Call it a skeleton. A sequence of bones can form a bone hierarchy.

6. Bounding Ball: A computer graphics term that defines a ball with the smallest radius such that all grid points corresponding to a Mesh are inside the ball, then the ball is called the bounding ball of the Mesh.

7. FK (Forward Kinematic): Based on the bone hierarchy, first calculate the rotation position of the parent bone, then calculate the position and rotation of the next-level bone, and calculate downward step by step until the end child bone is calculated. .

8. IK (Inverse Kinematic): The process of reversely solving the position and rotation of the parent bone based on the rotation and position of the child bone.

Please refer to Figure 1, which shows a schematic diagram of a solution implementation environment provided by an embodiment of the present application. The implementation environment of this solution can realize the architecture of animation data repair system. The implementation environment may include: a terminal 10 and a server 20 .

The terminal 10 may be an electronic device such as a mobile phone, a tablet computer, a PC (Personal Computer), a wearable device, an intelligent robot, a camera, an inertial device, and the like. The terminal 10 can be used to obtain motion capture data, and provide the motion capture data to the server 20, so that the motion capture data can be converted, repaired, and other processes through the server 20 to obtain animation data. In some embodiments, a client running a target application can be installed in the terminal 10. The client of the target application can be used to convert, repair, and other processing on the motion capture data to obtain animation data. The above target applications may be animation production applications, animation restoration applications, video production applications, game production applications, entertainment interactive applications, simulation applications, simulation learning applications, etc. The embodiments of the present application do not limit this.

The server 20 can be used to convert, repair, and other processing on the motion capture data to obtain animation data. Optionally, the server 20 may also be used to provide background services for clients of target applications in the terminal 10 . For example, the server 20 may be a backend server for clients of the target application. The server 20 may be an independent physical server, a server cluster or a distributed system composed of multiple physical servers, or a cloud server that provides cloud computing services.

The terminal 10 and the server 20 can communicate through the network 30. The network can be a wired network or a wireless network.

In the method provided by the embodiments of the present application, the execution subject of each step may be a computer device. A computer device can be any electronic device capable of storing and processing data. For example, the computer device may be the server 20 in FIG. 1 , the terminal device 10 in FIG. 1 , or another device other than the terminal device 10 and the server 20 .

The technical solutions provided by the embodiments of this application are applicable to any scene that requires animation data repair, such as virtual object fitting scenes (such as virtual people, virtual animals, etc.), game production scenes (such as action settings of game characters), and video production scenes. , animation data repair scenes, etc. The technical solution provided by the embodiments of the present application can improve the repair efficiency of animation data.

For example, referring to Figure 1, the terminal 10 sends the collected motion capture data to the server 20. The server 20 redirects the motion capture data to obtain the animation data to be repaired. The server 20 performs a collision on at least one object in the animation data to be repaired. Create, then perform collision detection based on the created collision body, automatically obtain key frame data (used to characterize the interleaving process), then automatically obtain repair data fragments based on key frame data (i.e., data fragments that are repaired during the interleaving process), and finally based on repair The data fragment automatically repairs the animation data to be repaired and obtains the repaired animation data.

The animation data repair method provided by the embodiment of the present application will be introduced in detail below.

Please refer to Figure 2, which shows a flow chart of an animation data repair method provided by an embodiment of the present application. The execution subject of each step of the method can be the terminal 10 or the server 20 in the solution implementation environment shown in Figure 1. In the following method embodiments, for convenience of description, only the execution subject of each step is a "computer device" for introduction and explanation. The method may include at least one of the following steps (201-205).

Step 201: Obtain animation data to be repaired. The animation data to be repaired includes multi-frame animation data obtained by redirecting motion capture data.

Among them, the motion capture data refers to the data obtained by capturing the motion of the motion capture object. For example, through a motion capture device (such as cameras, inertial devices, etc.), capture motion data of motion capture objects (such as standing, walking, running, interaction, etc. motion data) to obtain motion capture data. Optionally, the frame rate of motion capture data can be set according to actual usage requirements, such as 25Hz, 30Hz, etc. The embodiments of the present application do not limit the specific type of the motion capture device, and do not limit the motion capture frequency of the motion capture device.

Motion capture object: An object whose movements change and whose movements are captured. The motion capture objects in the embodiments of the present application are not limited to objects in the real world, but can also be objects in the virtual world. In the embodiments of the present application, the environment in which the objects are located is not limited. Optionally, when the motion capture object is an object in the real world, the specific type of the motion capture object includes but is not limited to real people, real animals, real robots and other objects that can produce motion activities. Optionally, when the motion capture object is an object in the virtual world, the specific type of the motion capture object includes but is not limited to virtual characters, virtual animals, virtual animation personnel and other objects that can generate motion activities. In the embodiment of the present application, for motion capture The specific object type of the object is not limited. Of course, in the following embodiments, only the motion capture object being a motion capture actor is used as an example for explanation. For other types of motion capture objects, refer to the motion capture actor.

Redirect object: Another object with the same actions as the mocap object. The redirected object in the embodiment of the present application is not limited to objects in the real world, but may also be objects in the virtual world. Taking the redirection object as a real robot in the real world as an example, control parameters can be generated based on the motion capture data of the above motion capture actor, thereby controlling the real robot to produce the same actions as the motion capture actor. However, the embodiments of the present application are mainly explained on the assumption that the redirection object is a virtual object in the virtual world. Of course, those skilled in the art should know that the redirection object is not limited to virtual objects in the virtual world. In the embodiment of this application, animation data refers to the data obtained by redirecting the actions of the motion capture object in the motion capture data to the redirection object in the animation data. The animation data of different frames correspond to the actions at different times. . Optionally, at the first moment, the motion capture object generates action A, then according to the motion capture data of the motion capture object, the animation data of the redirected object in the Nth frame of the animation is determined, where the animation data indicates that the redirected object is in Perform action A. In some embodiments, the animation data includes, but is not limited to, position data and motion data of the redirected object in each frame of the animation. Among them, motion capture objects can include people, animals, plants, objects, etc. Retargeting objects refer to objects in animation data that need to fit the actions of motion capture objects, such as virtual people, virtual animals, animated characters, game characters, objects Models, etc., are not limited in the embodiments of this application. Optionally, the above motion capture data may correspond to multiple motion capture objects, that is, the animation data includes redirection objects corresponding to the multiple motion capture objects.

For example, animation data can be interaction data between animated characters, animation data can also be interaction data between animated characters and object models, and animation data can also be interaction data between object models. The embodiments of this application are useful for This is not a limitation. The interaction data here can be considered as the data of physical collisions.

Optionally, the animation data to be repaired refers to the animation data that needs to be repaired if there is action data of the redirected object. For example, due to differences between the skeletal data (such as height proportion) of the motion capture object (such as the motion capture actor) and the skeletal data (such as the height proportion) of the retargeted object (such as the animated character), there are interleavings in the animation data. phenomenon (such as limbs intersecting with limbs, limbs intersecting with object models, etc.), the animation data with the intersecting phenomenon can be determined as the animation data to be repaired.

The animation data to be repaired may be skeletal animation data. The skeletal animation data refers to animation data that uses the bones of the redirected object to display actions. The skeletal animation data may include position information, steering information, movement information, etc. of the bones of the redirected object in each frame.

In one example, the process of obtaining the animation data to be repaired can be as follows: obtain the motion capture data corresponding to the motion capture object; convert the motion capture data to obtain the skeletal motion capture data, which corresponds to the bones of the motion capture object Data; redirect the skeletal motion capture data to obtain the animation data to be repaired. Among them, skeletal motion capture data refers to animation data that uses the skeleton of a motion capture object to display actions. Bone data can include bone size, number of bones, bone level association information, etc.

For example, based on the skeletal data of the motion capture object, the motion capture data corresponding to the motion capture object is converted into skeletal motion capture data, and then based on the skeletal data of the redirected object and the skeletal data of the motion capture object, the skeletal motion capture data is reconstructed. Oriented to the animation data to be repaired. Optionally, forward dynamics or reverse dynamics can be used to obtain the animation data to be repaired.

The technical solution provided by the embodiment of this application determines the repair animation data based on the skeletal motion capture data. The interaction between the motion capture objects is directly reflected in the interaction of the bones. The interaction here can be understood as a collision. For the same position, For the same movement, motion capture object branches with different bone sizes may or may not interact with each other. Further, according to the redefinition Redirect the skeletal motion capture data to the skeletal data of the object and the skeletal data of the motion capture object into the animation data to be repaired, and determine the animation data to be repaired based on the skeletal data. It can be understood that the interaction between the motion capture objects does not Represents the interaction between redirected objects. Therefore, using the corresponding skeletal data as a medium to determine the animation that needs to be repaired can improve the accuracy of the obtained animation data to be repaired, and at the same time improve the efficiency of the obtained animation data to be repaired. .

Step 202: Create a collision body for at least one object in the animation data to be repaired, and obtain a collection of collision bodies corresponding to at least one object. The collection of collision bodies includes at least one collision body.

At least one object in the animation data to be repaired is the above-mentioned redirection object. The collider is a three-dimensional object with a specific volume or shape used for collision detection of redirected objects. The collider may refer to a surrounding sphere, a capsule, a bounding box, etc. The embodiment of the present application does not limit the volume or shape of the collider. . In this embodiment of the present application, since the redirection object can correspond to multiple bones, in order to ensure the accuracy of collision detection, a collision body can be created for each bone.

In one example, the creation process of the collision body can be as follows: for the first object in at least one object, obtain the polygon mesh of the first object, which is used to represent the shape of the object; for the target corresponding to the first object Part, obtain the target local polygon mesh corresponding to the target part. The target local polygon mesh is affected by the target part; based on the grid points corresponding to the target local polygon mesh, a collision body of the target part is constructed, and the collision body of the target part surrounds the target. Grid points corresponding to the local polygon mesh; construct collision bodies for each part corresponding to the first object to obtain a set of collision bodies corresponding to the first object.

Wherein, the first object may refer to any object among the at least one object. The target part may refer to any part of the first object, and the part may be represented by a bone. The target local polygon mesh can be a local polygon mesh affected by the target bone. Optionally, the smallest collision body that can surround all grid points corresponding to the target local polygon mesh can be determined as the collision body of the target part. Optionally, the target site can be adaptively set according to actual usage requirements. For example, you can create colliders for only part of the redirected object, or you can create colliders for all parts of the redirected object. In some embodiments, the target site is a site in the redirected object where the interaction will occur. Optionally, at least one part of the redirected object where interaction will occur is confirmed as the target part.

For example, referring to FIG. 3 , for the animated character 300 , a collision body 302 corresponding to the head skeleton 301 can be constructed based on all grid points corresponding to the head skeleton 301 . At the same time, a collision body corresponding to the hand bones of the animated character 300 can be constructed based on all grid points corresponding to the hand bones of the animated character 300, and a collision corresponding to the foot bones can be constructed based on all grid points corresponding to the foot bones of the animated character 300. body.

Optionally, the collision body corresponding to the target part moves with the target part. For example, the target part and the collider corresponding to the target part can be set to a parent-child relationship, with the target part being the parent and the collider corresponding to the target part being the child. Then the collider corresponding to the target part will move following the movement of the target part, so that It avoids calculating and creating collision bodies frame by frame, thus greatly reducing the amount of calculation and calculation time, which is beneficial to improving the efficiency of animation data repair. For example, referring to FIG. 3 , if the head skeleton 301 and the collision body 302 are set to a parent-child relationship, the collision body 302 will move along with the head skeleton 301 . In some embodiments, when constructing the collider of the target part, the center position of the collider is bound to the bone data of the redirected object, so that when the redirected object changes, the collider moves accordingly.

Step 203: Based on the set of colliders corresponding to at least one object, collision detection is performed on the objects in the multi-frame animation data to obtain at least one key frame data group, and each key frame data group corresponds to an interleaving process.

Each keyframe data group can include multiple frames of keyframe data. Each frame of keyframe data corresponds to one frame of animation data. This frame of animation data includes key interleaving actions in the interleaving process. A complete interleaving process can use multiple key interleaving actions. representation.

In some embodiments, the interspersing action can be considered as the overlap of the spaces occupied by the redirected object and other objects in the animation. According to the logic in the normal world, there is generally no superposition between different objects. For example, object A does not occupy the same space as object B in the real world. That is, the space occupied by object A in the real world and The space occupied by object B in the real world should be independent of each other and non-overlapping. In this way, in the animated world, the redirected object and other objects in the animated world should also occupy different spaces, and the space occupied by the redirected object and the space occupied by other objects in the animated world should be independent of each other, unless here The space occupied by other objects is It can be affected by the redirected object. For example, if other objects are swamps, the redirected object may fall into the swamp. At this time, the redirected object and other objects overlap in space, but this is not considered a interleaving action. The interleaving action in the embodiment of the present application is considered to be that the spaces occupied by at least two objects that do not change in volume produce at least a partial overlap. Of course, the embodiment of the present application does not limit the interspersing width of the interspersing behavior, that is, it does not limit the overlapping width.

Optionally, the above key frame data group includes start key frame data, peak key frame data and end key frame data; where the start key frame data refers to the animation data corresponding to the starting moment of the interspersed behavior, and the peak key frame data It refers to the animation data corresponding to the maximum extent of the interspersed behavior, and the end key frame data refers to the animation data corresponding to the end moment of the interspersed behavior. One interspersed behavior corresponds to one interspersed process. For example, if there is an interpenetration between the limbs of animated character A and the limbs of animated character B, then the interpenetration process from the beginning of the limb to the end of the limb is an interpenetration process.

In an example, referring to Figure 4, step 203 may also include the following sub-steps:

Step 203a: For the target frame animation data in the multi-frame animation data, perform collision detection on the objects in the target frame animation data, and obtain at least one interleaving degree quantified value corresponding to the target frame animation data. The interleaving degree quantified value is used to represent at least The degree of interpenetration between pairs of objects within an object.

The target frame animation data may refer to any frame of animation data among multiple frames of animation data. The quantitative value of the degree of interleaving is positively correlated with the degree of interleaving between pairs of objects. For example, assuming that there is an intersection between the limbs of animated character A and the limbs of animated character B, when it is detected that the two limbs first come into contact, the quantified value of the degree of intersection can be set to 0, and the intersection of the two limbs is detected. As the degree gradually increases (for example, relative to the intersection point of two limbs, the end of the limb to the intersection point accounts for an increasingly larger portion of the entire limb), the quantified value of the degree of interpenetration gradually increases. When it is detected that two limbs are intersecting to the maximum extent, the quantified value of the interpenetration degree can be set to 1. Then it is detected that the two limbs are gradually separated, and the quantified value of the degree of interpenetration gradually decreases. When it is detected that the two limbs are separated (that is, the penetration is completed), the quantified value of the penetration degree can be set to 0. Optionally, if it is detected that there is no contact between the two limbs, the quantified value of the degree of penetration can be directly set to 0.

In some embodiments, the quantified value of the degree of interspersion is determined based on the overlapping space between the space occupied by the limbs of the animated character A and the space occupied by the limbs of the animated character B. Optionally, the quantified value of the interleaved degree and the overlapping space are determined. proportional to the size of the space. In some embodiments, at least two points are distributed on the surface of the overlapping space, and the maximum value of the distance between the two points on the surface of the overlapping space is used as the quantified value of the interleaving degree.

Each object pair can obtain at least one interleaving degree quantified value sequence in units of time, and then can generate at least one interleaving degree quantified value curve. Each peak segment in the interleaving degree quantified value curve can correspond to an interleaving process. Optionally, an object pair can correspond to multiple interleaving processes in the same period, and the sequence of quantified interleaving degree values corresponding to each action can be obtained in units of actions, thereby determining whether a certain action is an interleaving behavior and whether a certain action is an interleaving behavior. Keyframe data group corresponding to an action.

Since the target frame animation data can correspond to multiple actions or multiple object pairs, the target frame animation data can correspond to multiple quantized values of the degree of interspersion.

Step 203b: Determine at least one key frame data group from the multi-frame animation data based on at least one interleaving degree quantization value corresponding to the multi-frame animation data.

Optionally, for an object pair with an interleaving behavior, the object pair includes a first object and a second object with an interleaving behavior, and based on the quantified value of the interleaving degree corresponding to the object pair, obtain at least one corresponding object pair from the multi-frame animation data. Candidate frame data sequence; wherein each candidate frame data sequence corresponds to an interleaving behavior between the first object and the second object; for the target candidate frame data sequence in at least one candidate frame data sequence, for the target candidate frame data sequence Key frames are selected to obtain a key frame data group corresponding to the target candidate frame data sequence; based on at least one candidate frame data sequence, at least one key frame data group corresponding to the object pair is determined.

The second object may refer to any object in the at least one object except the first object. The candidate frame data sequence may include multiple frames of candidate frame data, and each frame of candidate frame data corresponds to an interleaving action of an interleaving behavior at a certain moment. Optionally, the candidate frame data sequence may correspond to the interleaving behaviors of a certain object pair in different time periods, and the candidate frame data sequence may also correspond to the different interspersing behaviors of a certain object pair in the same time period. In this regard, the embodiment of the present application Not limited.

Exemplarily, the first object may be obtained based on at least one interleaved degree quantified value sequence between the first object and the second object. At least one candidate frame data sequence corresponding to an object and a second object. For example, the multi-frame animation data corresponding to the peak segment in the interspersed degree quantized value curve can be determined as the candidate frame data sequence.

The target candidate frame data sequence may refer to any candidate frame data sequence among the at least one candidate frame data sequence. In an example, taking the keyframe data group including starting keyframe data, peak keyframe data and end keyframe data as an example, the method of selecting keyframes corresponding to the target candidate frame data sequence is introduced. The specific content can be as follows : For the target interleaving behavior corresponding to the target candidate frame data sequence, the animation data of the previous frame of the animation data corresponding to the first interleaving degree quantification value of the target interleaving behavior is not zero is determined as the start of the target candidate frame data sequence. Keyframe data; the animation data with the maximum quantified interleaving degree value corresponding to the target interleaving behavior is determined as the peak keyframe data corresponding to the target candidate frame data sequence; the first interleaving degree quantified value after the peak keyframe data is zero The animation data is determined to be the end key frame data corresponding to the target candidate frame data sequence. Of course, considering that animation data may sometimes be biased, when confirming the start keyframe data or the end keyframe data, not only the previous frame of the animation data corresponding to the first interleaving degree quantified value of the target interleaving behavior is not zero is considered. data and the animation data of the first intersection level quantization value after the peak key frame data is zero, and also refer to the S frame animation data and peak value before the first animation data of the intersection level quantization value corresponding to the target interspersion behavior is not zero. The K frame animation data after the first animation data with a quantified interleaving degree value of zero after the key frame data. When the S frame animation data and the K frame animation data are both zero, the first animation data corresponding to the target interleaving behavior is The animation data of the previous frame of animation data whose interleaving level quantization value is not zero is determined as the starting key frame data corresponding to the target candidate frame data sequence, and the first interleaving level quantization value after the peak key frame data is zero. Animation data is determined to be the end key frame data corresponding to the target candidate frame data sequence. When the S-frame animation data and the K-frame animation data have a quantized value of the interleaving degree that is not zero, the S-frame animation data and the K-frame animation data have a specific frame of animation data that has a quantified interleaving value that is not zero. Number, determine the starting keyframe data, peak keyframe data and end keyframe data. Among them, K and S are positive integers.

Optionally, the embodiment of the present application does not limit the timing of determining the starting key frame data, the peak key frame data, and the ending key frame data.

Step 204: Obtain at least one repaired data segment based on at least one key frame data group. The repaired data segment refers to the data segment that has been repaired during the interleaving process.

Wherein, repairing the data fragments may refer to repairing data fragments in which there is no interleaving phenomenon between redirect objects corresponding to the data fragments. The repair data fragment can correspond to a complete action, that is, in addition to the key frame data corresponding to the action, it also includes transition frame data between the key frame data. The transition frame data is used to achieve a smooth transition of the action.

Optionally, at least one key frame data group can be repaired respectively to obtain at least one repaired key frame data group; wherein, the interspersed behavior in the repaired key frame data group is repaired; and then at least one repaired key frame data group can be repaired respectively. Perform transition frame interpolation on the keyframe data group to obtain at least one repaired data segment.

Wherein, for each frame of animation data in the key frame data group, at least one object is redirected again so that there is no interleaving behavior between at least one object. For example, based on the skeletal data corresponding to at least one object, and guided by the actions corresponding to the key frame data group, the actions of at least one object are recalculated and corrected respectively, so that the actions of at least one object do not intersperse. Next, get as close as possible to the action corresponding to the keyframe data group, thereby obtaining the repaired keyframe data group.

The repaired data fragments with complete movements can be obtained by performing transition frame interpolation between each frame of animation data in the repaired keyframe data group. The transition frame can be constructed according to the set motion interpolation algorithm.

When the animation curve composed of keyframe data groups has a very high beating frequency (that is, frequent switching back and forth between interspersed and non-interspersed), the animation curve of the repaired animation data will also beat at a high frequency, which is very unstable. Therefore, the embodiment of the present application can introduce a filter to filter the high-frequency signal, and thereby obtain repair animation data with a stable animation curve. In addition, because the completion process of the action has a certain relationship with the skeletal data. For example, for the same distance, a larger stride can be completed with fewer strides, while a smaller stride needs to be completed with more strides. Therefore, for this point, you can redirect the object's bone data based on and the difference between the skeletal data of the motion capture object, and further adjust the time period corresponding to the key frame data.

In one example, the above optimization process may include the following: for the first object pair in at least one object, filter at least one key frame data group corresponding to the first object pair to obtain at least one key frame data group corresponding to the first object pair. The filtered key frame data group; wherein the time period length corresponding to the filtered key frame data group is greater than the first duration threshold; post-processing is performed on at least one filtered key frame data group corresponding to the first object pair to obtain At least one adjusted keyframe data group corresponding to the first object pair; wherein the action span of the adjusted keyframe data group conforms to the skeletal data of the object pair; and the adjusted keyframes corresponding to at least one keyframe data group are obtained. data group.

The first duration threshold is used for high-frequency filtering to filter out too short interspersed behaviors (that is, it does not affect the animation effect) and data noise (such as jitter). For example, the first duration threshold can be set according to actual usage requirements, such as 0.05s, 0.07s, 0.1s, etc., which is not limited in the embodiments of the present application.

Optionally, the above post-processing process may be as follows: determine the first adjustment parameter based on the skeletal data of the first object pair and the skeletal data of the motion capture object corresponding to the first object pair; in the case where the first adjustment parameter is greater than the first threshold Next, the time periods corresponding to at least one filtered key frame data group are expanded backward to obtain at least one adjusted key frame data group; when the first adjustment parameter is less than the first threshold, at least one filtered key frame data group is The corresponding time periods of the key frame data groups are compressed forward to obtain at least one adjusted key frame data group. In some embodiments, when the first adjustment parameter is equal to the first threshold, the time periods respectively corresponding to the filtered key frame data groups are not expanded backward or compressed forward.

Among them, the first adjustment parameter is used to adjust the timestamp of the key frame data to make the action process corresponding to the key frame data smoother and more reasonable. Optionally, the difference between the skeletal data of the first object pair and the skeletal data of the motion capture object corresponding to the first object pair can be determined as the first adjustment parameter, or the skeletal data of the first object pair and The ratio between the first object and the corresponding skeleton data of the motion capture object is determined as the first adjustment parameter, which is not limited in the embodiment of the present application.

For example, based on the skeletal data of the first object pair and the skeletal data of the motion capture object corresponding to the first object pair, the heights of the two redirected objects in the first object pair and the heights of the two motion capture objects can be determined. , and then determine the first adjustment parameter based on the ratio between the heights of the two redirected objects (such as the average value) and the heights of the two motion capture objects (such as the average value).

Optionally, when there are multiple pairs of objects in one key frame data, it can be determined whether the key frame data is compressed forward or expanded based on the weighted sum of the first adjustment parameters corresponding to at least one object pair. . The specific offset corresponding to the keyframe data (that is, the degree of compression or expansion) is related to the height of the redirected object. The higher the height of the redirected object, the greater the offset.

The first threshold corresponds to the first adjustment parameter, and the first threshold can be set and adjusted based on experience values.

For example, when the height ratio is determined as the first adjustment parameter, the first threshold can be set to 1, which indicates that the height of the first object pair and the height of the motion capture object corresponding to the first object pair are generally the same. , the time period of the keyframe data does not need to be adjusted at this time. In the case where the first adjustment parameter is greater than 1, it indicates that the height of the first object pair is overall greater than the height of the motion capture object corresponding to the first object pair, and the time period of the key frame data can be expanded backward (such as the above Peak keyframe data and end keyframe data are delayed). When the first adjustment parameter is less than 1, it means that the height of the first object pair is overall smaller than the height of the motion capture object corresponding to the first object pair, and the time period of the key frame data can be compressed forward (such as the above Peak keyframe data and end keyframe data are moved forward).

Using the above method, at least one repair data segment can be obtained based on the adjusted key frame data group corresponding to at least one key frame data group.

Step 205: Superimpose at least one repair data segment and the animation data to be repaired according to the time periods corresponding to the at least one repair data segment to obtain repair animation data.

Optionally, for the target repair data segment in at least one repair data segment, the original data segment corresponding to the target time period can be obtained from the animation data to be repaired according to the target time period corresponding to the target repair data segment; based on the corresponding original data segment The skeletal action parameters and the redirection repair parameters corresponding to the target repair data fragment are superimposed on the original data fragment and the target repair data fragment to obtain the repair animation data corresponding to the target period.

The target repair data fragment may be any repair data fragment among the at least one repair data fragment. Bone action parameters are used to indicate the action of the redirected object, such as the rotation angle, movement distance, rotation direction, etc. of each bone. Heavy Orientation repair parameters are used to indicate the status of the redirected object, such as the position, posture, etc. of the redirected object.

The skeletal action parameters can be used to make the action of the redirected object match the action of the motion capture object as much as possible, and the redirection repair parameters can be used to repair the state of the redirected object so that there is no interleaving between the redirected objects.

Optionally, for the remaining original animation data in the animation data to be repaired (that is, the original data fragments corresponding to the repaired data fragments are removed), the embodiment of the present application reserves it and does not process it.

For example, referring to Figure 5, during the interaction process between the animated character and the animated environment (such as objects, the ground, walls, etc. in the animated environment), there is an intersection between the hand of the animated character and the ground. Among them, the animation data 501 is a certain frame of animation data in the animation data to be repaired. In the animation data 501, the hand of the animated character intersperses with the ground. After the animation data to be repaired is repaired, the repair animation data 502 corresponding to the animation data 501 is obtained. In the repair animation data 502, the interpenetration phenomenon between the animated character's hand and the ground has been repaired, that is, the animated character's hand No longer interspersed between the base and the ground.

For another example, referring to FIG. 6 , during the interaction process between the animated characters, there is an intersection between the hands of the animated character 603 and the animated character 604 . Among them, the animation data 601 is a certain frame of animation data in the animation data to be repaired. In the animation data 601, the hand of the animated character 603 and the animated character 604 are interspersed. After the animation data to be repaired is repaired, the repaired animation data 602 corresponding to the animation data 601 is obtained. In the repaired animation data 602, the interpenetration phenomenon between the hand of the animated character 603 and the animated character 604 has been repaired, that is, the animation The hand of the character 603 is no longer interspersed with the animated character 604.

To sum up, the technical solution provided by the embodiments of the present application is to create a collision body for at least one object in the animation data to be repaired, and then based on the created collision body, perform collision detection on multiple frames of animation data corresponding to the animation data to be repaired. , the key frame data group is obtained, and the automatic acquisition of the interleaving process is realized. Compared with obtaining the interleaving process through manual frame-by-frame detection in related technologies, the technical solution provided by the embodiment of the present application can improve the acquisition efficiency of the interleaving process, thereby improving the efficiency of the interleaving process. Repair efficiency of animation data.

In addition, by filtering and post-processing the keyframe data group, the quality of the keyframe data group can be improved, thereby improving the repair quality of the animation data. At the same time, by filtering and post-processing the key frame data group, the rationality of the distribution of the key frame data group can also be improved, thereby improving the rationality of the repair of the animation data.

In addition, by solving and quantifying the collision detection results, the degree of interspersing behavior at different stages can be quickly and easily obtained, which is conducive to improving the extraction efficiency of key frame data, thereby further improving the efficiency of repairing animation data.

In an exemplary embodiment, taking the collision body as a surrounding ball as an example, the animation data repair method provided by the embodiment of the present application is described. The specific content may be as follows:

Get the animation data to be repaired. In this embodiment of the present application, there is an interleaving phenomenon in the animation data to be repaired. For example, referring to FIG. 6 , the animation data 601 is a certain frame in the animation data to be repaired. In the animation data 601 , there are intersperses between the hands of the animated character.

Create a bounding ball for at least one object in the animation data to be repaired, and obtain a set of bounding balls corresponding to at least one object. For example, referring to Figure 7, during the interaction process between the animated character 701 and the animated character 702, based on the bone distribution of the animated character 701, the polygon mesh corresponding to the animated character 701 is divided, and each bone of the animated character 701 is obtained. , and then based on the local polygon mesh corresponding to each bone, a bounding ball corresponding to each bone is constructed, and a set of bounding balls corresponding to the animated character 701 is obtained. Among them, the enclosing sphere is the sphere with the smallest diameter that can enclose the local polygon mesh. Using the same method, based on the bone distribution of the animated character 702, a set of bounding balls corresponding to the animated character 702 is obtained. You can set the bounding ball and bones to have a parent-child relationship, and the bounding ball will follow the bones.

For another example, referring to Figure 8, during the interaction process between the animated character 801 and the prop 802, since only the hands of the animated character 801 are in contact with the prop 802, the surrounding ball can be created only for the hands of the animated character 801.

Based on a set of bounding balls corresponding to at least one object, collision detection is performed on each frame of animation data corresponding to the animation data to be repaired, and a collision detection result corresponding to each frame of animation data is obtained.

For example, if the distance between the centers of the two surrounding spheres is greater than the sum of the radii of the two surrounding spheres, it is determined that the corresponding parts of the two surrounding spheres are not interspersed; or, if the distance between the centers of the two surrounding spheres is The distance is equal to the sum of the radii of the two enclosing spheres, then determine whether the corresponding parts of the two enclosing spheres begin to intersect or end intersecting; or, if the distance between the centers of the two enclosing spheres is less than the sum of the radii of the two enclosing spheres , then it is determined that the corresponding parts of the two surrounding spheres are in the interspersed state.

For example, referring to Figure 9, if the distance between the center of the circle of the surrounding sphere 901 and the center of the circle of the surrounding sphere 902 (hereinafter referred to as the circle center distance) is greater than the sum of the radii between the surrounding sphere 901 and the surrounding sphere 902, then the corresponding radius of the surrounding sphere 901 is determined. The part (such as the hand) and the part corresponding to the surrounding ball 902 (such as the hand) are not interspersed. During the movement of the enclosing ball 901 and the enclosing ball 902, if the center distance between the enclosing ball 901 and the enclosing ball 902 becomes equal to the sum of the radii between the enclosing ball 901 and the enclosing ball 902, then the enclosing ball 901 corresponding to The parts (such as hands) and the parts (such as hands) corresponding to the surrounding ball 902 begin to intersect. If the center distance between the enclosing ball 901 and the enclosing ball 902 becomes smaller than the sum of the radii between the enclosing ball 901 and the enclosing ball 902, then the parts corresponding to the enclosing ball 901 (such as the hand) and the parts corresponding to the enclosing ball 902 are determined. (such as hands) in a penetrating state.

The collision detection results corresponding to each frame of animation data are solved to obtain at least one interspersed degree quantified value corresponding to each frame of animation data. Among them, the quantitative value of the degree of interleaving is positively correlated with the degree of interpenetration. For example, referring to FIG. 7 , one quantified value of the degree of interspersion can be obtained based on the collision detection result 703 , and another quantified value of the degree of interspersion can be obtained based on the collision detection result 704 .

At least one key frame data group is determined from the multi-frame animation data based on at least one interleaving degree quantization value respectively corresponding to each frame of animation data. For example, referring to Figure 7, for the hand interpenetration phenomenon, obtain all the quantified values of the degree of interpenetration corresponding to the hand interpenetration phenomenon, generate a quantified value curve of the degree of interpenetration, and determine the corresponding start point of the hand interpenetration phenomenon based on the quantified value curve of the degree of interpenetration. Key frame data, peak key frame data and end key frame data are used to obtain the key frame data group corresponding to the hand interspersion phenomenon.

Filter and post-process at least one key frame data group respectively to obtain at least one adjusted key frame data group. Repair at least one adjusted key frame data group respectively to obtain at least one repaired key frame data group; perform transition frame interpolation on at least one repaired key frame data group respectively to obtain at least one repaired data segment.

According to the time periods corresponding to the at least one repaired data segment, at least one repaired data segment is superimposed on the animation data to be repaired to obtain the repaired animation data.

The following are device embodiments of the present application, which can be used to execute method embodiments of the present application. For details not disclosed in the device embodiments of this application, please refer to the method embodiments of this application.

Referring to Figure 10, which shows a block diagram of an animation data repair device provided by an embodiment of the present application. The device has the function of implementing the above method example, and the function can be implemented by hardware, or can be implemented by hardware executing corresponding software. The device may be the computer equipment introduced above, or may be provided in the computer equipment. As shown in Figure 10, the device 1000 includes: an animation data acquisition module 1001, a collision body creation module 1002, a key frame acquisition module 1003, a repair fragment acquisition module 1004, and an animation data repair module 1005.

The animation data acquisition module 1001 is used to acquire animation data to be repaired, where the animation data to be repaired includes multi-frame animation data obtained by redirecting motion capture data.

The collision body creation module 1002 is used to create a collision body for at least one object in the animation data to be repaired, and obtain a collection of collision bodies respectively corresponding to the at least one object, and the collection of collision bodies includes at least one collision body.

The key frame acquisition module 1003 is configured to perform collision detection on the objects in the multi-frame animation data based on the set of colliders respectively corresponding to the at least one object, and obtain at least one key frame data group, each of the key frames data group Corresponds to a interspersed process.

The repair segment acquisition module 1004 is configured to obtain at least one repair data segment based on the at least one key frame data group, where the repair data segment refers to the data segment after the interleaving process is repaired.

The animation data repair module 1005 is configured to superimpose the at least one repair data segment and the animation data to be repaired according to the time periods corresponding to the at least one repair data segment to obtain repair animation data.

In an exemplary embodiment, the key frame acquisition module 1003 is used to:

For the target frame animation data in the multi-frame animation data, collision detection is performed on the objects in the target frame animation data to obtain at least one quantified interleaving degree value corresponding to the target frame animation data. The quantified interleaving degree value is Used to characterize the degree of interpenetration between pairs of objects in the at least one object;

The at least one key frame data group is determined from the multi-frame animation data based on at least one interleaving degree quantization value respectively corresponding to the multi-frame animation data.

In some embodiments, the object pair includes a first object and a second object in which interleaving behavior exists.

In an exemplary embodiment, the key frame acquisition module 1003 is also used to:

For the object pair with interleaving behavior, at least one candidate frame data sequence corresponding to the object pair is obtained from the multi-frame animation data based on the quantified value of the interleaving degree corresponding to the object pair; wherein, each of the The candidate frame data sequence corresponds to an interleaving behavior between the first object and the second object;

For the target candidate frame data sequence in the at least one candidate frame data sequence, perform key frame selection on the target candidate frame data sequence to obtain a key frame data group corresponding to the target candidate frame data sequence;

Based on the at least one candidate frame data sequence, at least one key frame data group corresponding to the object pair is determined.

In an exemplary embodiment, the key frame data group includes starting key frame data, peak key frame data and ending key frame data; wherein the starting key frame data refers to the starting moment of the interspersed behavior Corresponding animation data, the peak key frame data refers to the animation data corresponding to the maximum extent of the interspersed behavior, and the end key frame data refers to the animation data corresponding to the end moment of the interspersed behavior; the key frame acquisition Module 1003, also used for:

For the target interleaving behavior corresponding to the target candidate frame data sequence, the animation data of the previous frame of animation data corresponding to the first interleaving degree quantified value of the target interleaving behavior is not zero is determined as the target candidate frame data. The starting keyframe data corresponding to the sequence;

Determine the animation data with the largest quantified interleaving degree value corresponding to the target interleaving behavior as the peak key frame data corresponding to the target candidate frame data sequence;

The animation data whose first interleaving degree quantization value after the peak key frame data is zero is determined as the end key frame data corresponding to the target candidate frame data sequence.

In an exemplary embodiment, the repair fragment acquisition module 1004 is used to:

Repair the at least one key frame data group respectively to obtain at least one repaired key frame data group; wherein the interspersed behavior in the repaired key frame data group is repaired;

Transition frame interpolation is performed on the at least one repaired key frame data group respectively to obtain the at least one repaired data segment.

In an exemplary embodiment, as shown in Figure 11, the device 1000 further includes: a key frame filtering module 1006 and a key frame adjusting module 1007.

The key frame filtering module 1006 is configured to filter at least one key frame data group corresponding to the first object pair in the at least one object, and obtain at least one key frame data group corresponding to the first object pair. A filtered key frame data group; wherein the length of the time period corresponding to the filtered key frame data group is greater than the first duration threshold.

The key frame adjustment module 1007 is configured to perform post-processing on at least one filtered key frame data group corresponding to the first object pair, respectively, to obtain at least one adjusted key frame data group corresponding to the first object pair; Wherein, the action span of the adjusted key frame data group conforms to the skeletal data of the object pair.

The key frame adjustment module 1007 is also used to obtain the adjusted key frame data group corresponding to the at least one key frame data group.

The repair segment acquisition module 1004 is also configured to obtain the at least one repair data segment based on the adjusted key frame data group corresponding to the at least one key frame data group.

In an exemplary embodiment, the key frame adjustment module 1007 is used for:

Determine a first adjustment parameter based on the skeletal data of the first object pair and the skeletal data of the motion capture object corresponding to the first object pair;

When the first adjustment parameter is greater than the first threshold, extending the time periods corresponding to the at least one filtered key frame data group backward to obtain the at least one adjusted key frame data group;

When the first adjustment parameter is less than the first threshold, compress the time periods corresponding to the at least one filtered key frame data group forward to obtain the at least one adjusted key frame data group. .

In an exemplary embodiment, the collision body creation module 1002 is used for:

For the first object in the at least one object, obtain a polygon mesh of the first object, where the polygon mesh is used to represent the appearance of the object;

For the target part corresponding to the first object, obtain a target local polygon mesh corresponding to the target part, and the target local polygon mesh is affected by the target part;

Based on the grid points corresponding to the target local polygon grid, construct a collision body of the target part, and the collision body of the target part surrounds the grid points corresponding to the target local polygon grid;

Colliders are constructed for each part corresponding to the first object to obtain a set of colliders corresponding to the first object.

In an exemplary embodiment, the collision body corresponding to the target part moves along with the target part.

In an exemplary embodiment, as shown in Figure 11, the device 1000 further includes: a penetration state determination module 1008.

The collision body is an enclosing ball, and the penetration state determination module 1008 is used to:

If the distance between the centers of the two surrounding spheres is greater than the sum of the radii of the two surrounding spheres, it is determined that the corresponding parts of the two surrounding spheres are not interspersed;

Or, if the distance between the centers of the two surrounding spheres is equal to the sum of the radii of the two surrounding spheres, then it is determined that the corresponding parts of the two surrounding spheres start to intersect or end the interleaving;

Alternatively, if the distance between the centers of the two surrounding spheres is less than the sum of the radii of the two surrounding spheres, it is determined that the corresponding parts of the two surrounding spheres are in an intersecting state.

In an exemplary embodiment, the animation data repair module 1005 is used to:

For the target repair data segment in the at least one repair data segment, obtain the original data segment corresponding to the target time period from the animation data to be repaired according to the target time period corresponding to the target repair data segment;

Based on the skeletal action parameters corresponding to the original data fragments and the redirection repair parameters corresponding to the target repair data fragments, the original data fragments and the target repair data fragments are superimposed to obtain the repair animation corresponding to the target period. data.

In an exemplary embodiment, the animation data acquisition module 1001 is used to:

Obtain the motion capture data corresponding to the motion capture object;

Convert the motion capture data to obtain skeletal motion capture data, where the skeletal motion capture data corresponds to the skeletal data of the motion capture object;

The skeletal motion capture data is redirected to obtain the animation data to be repaired.

It should be noted that when implementing the functions of the device provided by the above embodiments, only the division of the above functional modules is used as an example. In practical applications, the above functions can be allocated to different functional modules according to needs, that is, The internal structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the above The devices and method embodiments provided in the embodiments belong to the same concept. For details of the implementation process, please refer to the method embodiments, which will not be described again here.

Please refer to Figure 12, which shows a structural block diagram of a computer device provided by an embodiment of the present application. The computer device can be used to implement the animation data repair method provided in the above embodiment. Specifically, it may include the following.

The computer device 1200 includes a central processing unit (such as CPU (Central Processing Unit, central processing unit), GPU (Graphics Processing Unit, graphics processor) and FPGA (Field Programmable Gate Array, field programmable logic gate array), etc.) 1201, A system memory 1204 including a RAM (Random-Access Memory) 1202 and a ROM (Read-Only Memory) 1203, and a system bus 1205 connecting the system memory 1204 and the central processing unit 1201. The computer device 1200 also includes a basic input/output system (I/O system) 1206 that helps transfer information between various devices in the server, and a module 1215 that stores an operating system 1213, application programs 1214, and other programs. Mass storage device 1207.

The basic input/output system 1206 includes a display 1208 for displaying information and an input device 1209 such as a mouse and a keyboard for the user to input information. Wherein, the display 1208 and the input device 1209 are both connected to the central processing unit 1201 through the input and output controller 1210 connected to the system bus 1205. The basic input/output system 1206 may also include an input/output controller 1210 for receiving and processing input from a plurality of other devices such as a keyboard, mouse, or electronic stylus. Similarly, input and output controller 1210 also provides output to a display screen, printer, or other type of output device.

The mass storage device 1207 is connected to the central processing unit 1201 through a mass storage controller (not shown) connected to the system bus 1205 . The mass storage device 1207 and its associated computer-readable media provide non-volatile storage for the computer device 1200 . That is, the mass storage device 1207 may include a computer-readable medium (not shown) such as a hard disk or a CD-ROM (Compact Disc Read-Only Memory) drive.

Without loss of generality, the computer-readable media may include computer storage media and communication media. Computer storage media includes volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer programs, data structures, program modules or other data. Computer storage media include RAM, ROM, EPROM (Erasable Programmable Read-Only Memory, Erasable Programmable Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory, Electrically Erasable Programmable Read-Only Memory), flash memory or Other solid-state storage technologies, CD-ROM, DVD (Digital Video Disc, high-density digital video disc) or other optical storage, tape cassettes, magnetic tapes, disk storage or other magnetic storage devices. Of course, those skilled in the art will know that the computer storage medium is not limited to the above types. The above-mentioned system memory 1204 and mass storage device 1207 may be collectively referred to as memory.

According to the embodiment of the present application, the computer device 1200 can also be connected to a remote computer on the network through a network such as the Internet to run. That is, the computer device 1200 can be connected to the network 1212 through the network interface unit 1211 connected to the system bus 1205, or the network interface unit 1211 can also be used to connect to other types of networks or remote computer systems (not shown) .

The memory also includes a computer program, which is stored in the memory and configured to be executed by one or more processors to implement the above animation data repair method.

In an exemplary embodiment, a computer-readable storage medium is also provided, and a computer program is stored in the storage medium. When executed by a processor, the computer program implements the above animation data repair method.

Optionally, the computer-readable storage medium may include: ROM (Read-Only Memory), RAM (Random-Access Memory), SSD (Solid State Drives, solid state drive) or optical disk, etc. Among them, random access memory can include ReRAM (Resistance Random Access Memory, resistive random access memory) and DRAM (Dynamic Random Access Memory, dynamic random access memory).

In an exemplary embodiment, a computer program product is also provided, the computer program product including a computer program stored in a computer-readable storage medium. a processor of a computer device from which the computer The computer program is read from a readable storage medium, and the processor executes the computer program, so that the computer device performs the above animation data repair method.

It should be noted that this application can display a prompt interface, pop-up window or output voice prompt information before collecting user-related data and during the process of collecting user-related data. The prompt interface, pop-up window or voice prompt information is used In order to prompt the user that his/her relevant data is currently being collected, this application only starts to execute the relevant steps for obtaining the user's relevant data after obtaining the user's confirmation operation on the prompt interface or pop-up window, otherwise (that is, the user's confirmation operation is not obtained) When the prompt interface or pop-up window sends a confirmation operation), the relevant steps of obtaining user-related data are completed, that is, the user-related data is not obtained. In other words, all user data collected by this application (including motion capture data, animation data, skeletal data, etc.) will be processed strictly in accordance with the requirements of relevant national laws and regulations, with the informed consent or separate consent of the personal information subject obtained, and Carry out subsequent data use and processing within the scope of laws, regulations and the authorization of the personal information subject.

It should be understood that "plurality" mentioned in this article means two or more. "And/or" describes the relationship between related objects, indicating that there can be three relationships. For example, A and/or B can mean: A exists alone, A and B exist simultaneously, and B exists alone. The character "/" generally indicates that the related objects are in an "or" relationship. In addition, the step numbers described in this article only illustrate a possible execution sequence between the steps. In some other embodiments, the above steps may not be executed in the numbering sequence, such as two different numbers. The steps are executed simultaneously, or two steps with different numbers are executed in the reverse order as shown in the figure, which is not limited in the embodiments of the present application.

The above are only exemplary embodiments of the present application and are not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application shall be included in the protection of the present application. within the range.

Claims

An animation data repair method, the method is executed by a computer device, the method includes:

Obtain animation data to be repaired, where the animation data to be repaired includes multi-frame animation data obtained by redirecting motion capture data;

Create a collision body for at least one object in the animation data to be repaired, and obtain a collection of collision bodies corresponding to the at least one object, and the collection of collision bodies includes at least one collision body;

Based on the set of colliders respectively corresponding to the at least one object, collision detection is performed on the objects in the multi-frame animation data to obtain at least one key frame data group, each of the key frame data groups corresponding to an interleaving process;

Based on the at least one key frame data group, at least one repaired data segment is obtained, where the repaired data segment refers to the data segment that is repaired by the interleaving process;

According to the time periods corresponding to the at least one repair data segment, the at least one repair data segment and the animation data to be repaired are superimposed to obtain repair animation data.
The method according to claim 1, wherein collision detection is performed on the objects in the multi-frame animation data based on the set of colliders respectively corresponding to the at least one object, and at least one key frame data group is obtained, including:

For the target frame animation data in the multi-frame animation data, collision detection is performed on the objects in the target frame animation data to obtain at least one quantified interleaving degree value corresponding to the target frame animation data. The quantified interleaving degree value is Used to characterize the degree of interpenetration between pairs of objects in the at least one object;

The at least one key frame data group is determined from the multi-frame animation data based on at least one interleaving degree quantization value respectively corresponding to the multi-frame animation data.
The method according to claim 2, wherein the object pair includes a first object and a second object with interleaving behavior;

Determining the at least one key frame data group from the multi-frame animation data based on at least one interspersed degree quantization value respectively corresponding to the multi-frame animation data includes:

For the object pair with interleaving behavior, at least one candidate frame data sequence corresponding to the object pair is obtained from the multi-frame animation data based on the quantified value of the interleaving degree corresponding to the object pair; wherein, each of the The candidate frame data sequence corresponds to an interleaving behavior between the first object and the second object;

For the target candidate frame data sequence in the at least one candidate frame data sequence, perform key frame selection on the target candidate frame data sequence to obtain a key frame data group corresponding to the target candidate frame data sequence;

Based on the at least one candidate frame data sequence, at least one key frame data group corresponding to the object pair is determined.
The method according to claim 3, wherein the key frame data group includes starting key frame data, peak key frame data and end key frame data; wherein the starting key frame data refers to the interspersed behavior Animation data corresponding to the starting moment, the peak key frame data refers to the animation data corresponding to the maximum extent of the interspersed behavior, and the end key frame data refers to the animation data corresponding to the end moment of the interspersed behavior;

The key frame selection of the target candidate frame data sequence to obtain the key frame data group corresponding to the target candidate frame data sequence includes:

For the target interleaving behavior corresponding to the target candidate frame data sequence, the animation data of the previous frame of animation data corresponding to the first interleaving degree quantified value of the target interleaving behavior is not zero is determined as the target candidate frame data. The starting keyframe data corresponding to the sequence;

Determine the animation data with the largest quantified interleaving degree value corresponding to the target interleaving behavior as the peak key frame data corresponding to the target candidate frame data sequence;

The animation data whose first interleaving degree quantization value after the peak key frame data is zero is determined as the end key frame data corresponding to the target candidate frame data sequence.
The method according to claim 1, wherein said obtaining at least one repair data segment based on said at least one key frame data group includes:

Repair the at least one key frame data group respectively to obtain at least one repaired key frame data group; wherein the interspersed behavior in the repaired key frame data group is repaired;

Transition frame interpolation is performed on the at least one repaired key frame data group respectively to obtain the at least one repaired data segment.
The method according to claim 1, wherein before obtaining at least one repair data segment based on the at least one key frame data group, the method further includes:

For the first object pair in the at least one object, filter at least one key frame data group corresponding to the first object pair to obtain at least one filtered key frame data group corresponding to the first object pair. ; Wherein, the length of the time period corresponding to the filtered key frame data group is greater than the first duration threshold;

Perform post-processing on at least one filtered key frame data group corresponding to the first object pair respectively to obtain at least one adjusted key frame data group corresponding to the first object pair; wherein, the adjusted key frame data group The action span of the frame data group conforms to the skeletal data of the object pair;

Obtain the adjusted key frame data group corresponding to the at least one key frame data group;

Obtaining at least one repair data segment based on the at least one key frame data group includes:

The at least one repair data segment is obtained based on the adjusted key frame data group respectively corresponding to the at least one key frame data group.
The method according to claim 6, wherein the at least one filtered key frame data group corresponding to the first object pair is post-processed to obtain at least one adjusted key frame data group corresponding to the first object pair. Keyframe data group, including:

Determine a first adjustment parameter based on the skeletal data of the first object pair and the skeletal data of the motion capture object corresponding to the first object pair;

When the first adjustment parameter is greater than the first threshold, extending the time periods corresponding to the at least one filtered key frame data group backward to obtain the at least one adjusted key frame data group;

When the first adjustment parameter is less than the first threshold, compress the time periods corresponding to the at least one filtered key frame data group forward to obtain the at least one adjusted key frame data group. .
The method according to claim 1, wherein said creating a collision body for at least one object in the animation data to be repaired to obtain a collection of collision bodies respectively corresponding to the at least one object includes:

For the first object in the at least one object, obtain a polygon mesh of the first object, where the polygon mesh is used to represent the appearance of the object;

For the target part corresponding to the first object, obtain a target local polygon mesh corresponding to the target part, and the target local polygon mesh is affected by the target part;

Based on the grid points corresponding to the target local polygon grid, construct a collision body of the target part, and the collision body of the target part surrounds the grid points corresponding to the target local polygon grid;

Construct a collision body on at least one part corresponding to the first object to obtain a set of collision bodies corresponding to the first object.
The method according to claim 8, wherein the collision body corresponding to the target part moves following the target part.
The method according to claim 1, wherein the collision body is an enclosing sphere, the method further comprising:

If the distance between the centers of the two surrounding spheres is greater than the sum of the radii of the two surrounding spheres, it is determined that the corresponding parts of the two surrounding spheres are not interspersed;

or,

If the distance between the centers of the two surrounding spheres is equal to the sum of the radii of the two surrounding spheres, then it is determined that the corresponding parts of the two surrounding spheres start to intersect or end to intersect;

or,

If the distance between the centers of the two surrounding spheres is less than the sum of the radii of the two surrounding spheres, it is determined that the corresponding parts of the two surrounding spheres are in an intersecting state.
The method according to claim 1, wherein the at least one repair data segment and the animation data to be repaired are superimposed according to the time periods corresponding to the at least one repair data segment to obtain the repair animation data, include:

For the target repair data segment in the at least one repair data segment, obtain the original data segment corresponding to the target time period from the animation data to be repaired according to the target time period corresponding to the target repair data segment;

Based on the skeletal action parameters corresponding to the original data fragments and the redirection repair parameters corresponding to the target repair data fragments, the original data fragments and the target repair data fragments are superimposed to obtain the repair animation corresponding to the target period. data.
The method according to claim 1, wherein said obtaining animation data to be repaired includes:

Obtain the motion capture data corresponding to the motion capture object;

Convert the motion capture data to obtain skeletal motion capture data, where the skeletal motion capture data corresponds to the skeletal data of the motion capture object;

The skeletal motion capture data is redirected to obtain the animation data to be repaired.
An animation data repair device, the device includes:

An animation data acquisition module, used to acquire animation data to be repaired, where the animation data to be repaired includes multi-frame animation data obtained by redirecting motion capture data;

A collision body creation module, configured to create a collision body for at least one object in the animation data to be repaired, and obtain a collection of collision bodies corresponding to the at least one object, and the collection of collision bodies includes at least one collision body;

A key frame acquisition module, configured to perform collision detection on the objects in the multi-frame animation data based on the set of colliders respectively corresponding to the at least one object, and obtain at least one key frame data group, each of the key frame data The group corresponds to an interspersed process;

A repair fragment acquisition module, configured to obtain at least one repair data fragment based on the at least one key frame data group, where the repair data fragment refers to the data fragment after the interleaving process is repaired;

An animation data repair module is configured to superimpose the at least one repair data segment and the animation data to be repaired according to the time periods corresponding to the at least one repair data segment to obtain repair animation data.
A computer device, the computer device includes a processor and a memory, a computer program is stored in the memory, and the computer program is loaded and executed by the processor to implement the method described in any one of claims 1 to 12 Animation data repair method.
A computer-readable storage medium, in which a computer program is stored, and the computer program is loaded and executed by a processor to implement the animation data repair method according to any one of claims 1 to 12.
A computer program product including computer instructions stored in a computer-readable storage medium, and a processor reads and executes the computer instructions from the computer-readable storage medium to Implement the animation data repair method as described in any one of claims 1 to 12.