CN117372584A

CN117372584A - Method and device for configuring mouth shape

Info

Publication number: CN117372584A
Application number: CN202210770422.1A
Authority: CN
Inventors: 吴贺康
Original assignee: Perfect World Beijing Software Technology Development Co Ltd
Current assignee: Perfect World Beijing Software Technology Development Co Ltd
Priority date: 2022-06-30
Filing date: 2022-06-30
Publication date: 2024-01-09

Abstract

The embodiment of the invention provides a method and a device for configuring a mouth shape. The method comprises the following steps: creating a target mouth shape of the virtual object in a deformer template for the virtual object to be configured in the virtual scene; selecting a basic mouth shape from a pre-configured mapping pool, wherein the mapping pool is used for storing a basic deformer and basic mouth shape parameters corresponding to the basic mouth shape; and configuring a target deformer and a target mouth shape parameter corresponding to the target mouth shape according to the selected basic deformer and the basic mouth shape parameter corresponding to the basic mouth shape, and deriving the configured target mouth shape for the virtual object. According to the method, the configuration of the target mouth shapes in the deformer template can be completed through any number of basic mouth shapes in the mapping pool, so that the configuration of the deformer template is not limited to fixed mouth shape parameter values, the flexibility of a mouth shape image manufacturing process is improved, a foundation is provided for batch mouth shape configuration, the manufacturing efficiency of mouth shape images is improved, and the visual effect of the mouth shape images is optimized.

Description

Method and device for configuring mouth shape

Technical Field

The present invention relates to the field of image technologies, and in particular, to a method and an apparatus for configuring a mouth shape.

Background

In scenes such as games, videos, network live broadcast and the like, mouth shape animation corresponding to the character audio needs to be adapted for the virtual character, so that mouth shape actions in the mouth shape animation are matched with pronunciation in the character audio, and the authenticity of the virtual character is improved. Virtual character colors are, for example, game characters, character characters in movie works, avatars of anchor in webcast, and the like.

In the related art, when a user creates a mouth shape animation, a mouth shape configuration table created in advance is generally called by mapping an address, and a mouth shape animation of a virtual object is obtained by setting fixed parameter values in the configuration table to the virtual object. The implementation is limited by a limited number of fixed parameter values in the mouth shape configuration table, for example, the configuration table is provided with fixed parameter values of 5 mouth shape corresponding deformers, and then the available deformers in the mouth shape animation generation process are limited to the 5 types, so that the user can be greatly limited in creation freedom, the mouth shape animation is visually harder, and the animation production efficiency is reduced. In addition, the fixed parameter values in the mouth shape configuration table require a lot of manpower production, and the animation production efficiency is greatly reduced, so that the method is difficult to deal with large-scale virtual character mouth shape animation production scenes.

In summary, how to realize the configuration of the mouth shape and improve the manufacturing efficiency of the mouth shape image becomes a technical problem to be solved urgently.

Disclosure of Invention

The embodiment of the invention provides a mouth shape configuration method and device, which are used for realizing mouth shape configuration in a deformer template, improving the flexibility of a mouth shape image manufacturing process, optimizing the visual effect of a mouth shape image and improving the manufacturing efficiency of the mouth shape image.

In a first aspect, an embodiment of the present invention provides a method for configuring a die, including:

creating a target mouth shape of a virtual object in a deformer template for the virtual object to be configured in the virtual scene, wherein the virtual object comprises a plurality of virtual roles related to the virtual scene;

selecting a basic mouth shape from a pre-configured mapping pool, wherein the mapping pool is used for storing a basic deformer and basic mouth shape parameters corresponding to the basic mouth shape;

and configuring the target deformer and the target mouth shape parameters corresponding to the target mouth shape according to the basic deformer and the basic mouth shape parameters corresponding to the basic mouth shape, and deriving the configured target mouth shape for the virtual object.

In one possible embodiment, the virtual object includes a plurality of game characters associated with a game scene. Deriving a configured target profile for a virtual object, comprising: and responding to a batch export instruction of the target mouth shapes, determining the identifiers corresponding to the items of the plurality of game characters, and exporting the target mouth shapes into mouth shape configuration schemes corresponding to the items of the plurality of game characters based on the identifiers.

In one possible embodiment, the identifiers corresponding to the items in which the plurality of game characters are located include at least one of a game item identifier, a game scenario identifier in the game item, and a game stage identifier.

In one possible embodiment, selecting a base profile from a pre-configured mapping pool includes: and responding to a selection instruction of at least one basic mouth shape in the mapping pool, and acquiring a basic deformer corresponding to the at least one basic mouth shape and basic mouth shape parameters, wherein the basic mouth shape parameters comprise an identifier.

According to the basic deformer and basic mouth shape parameter corresponding to the basic mouth shape, configuring the target deformer and target mouth shape parameter corresponding to the target mouth shape, including: and establishing a mapping relation between the target mouth shape and at least one basic mouth shape so as to configure a basic deformer corresponding to at least one basic mouth shape and basic mouth shape parameters as target deformer corresponding to the target mouth shape and target mouth shape parameters.

In one possible embodiment, establishing a mapping relationship between the target die and at least one base die includes: and adding the identification corresponding to the at least one basic mouth shape into a mapping list of the target mouth shape.

In one possible embodiment, the method further comprises: configuring weight parameters of the basic mouth shape in the shape change of the target mouth shape in the deformer template; wherein the larger the weight parameter, the larger the influence of the basic mouth shape on the morphological change of the target mouth shape.

In one possible embodiment, if the base mouth shape mapped to the target mouth shape is a plurality of, the weight parameters include: the overall weight parameters of the plurality of base patterns to the target pattern and/or the independent weight parameters of each base pattern to the target pattern.

In one possible embodiment, the method further comprises: displaying a deformer template in a deformer panel; and responding to a selection instruction of a target mouth shape in the deformer template, and selecting a target mouth shape matched with the virtual object from the target mouth shapes set by the deformer template so as to call the target deformer and the target mouth shape parameters to generate a mouth shape image of the virtual object.

In one possible embodiment, a corresponding bone model is provided for a deformer in the deformer template, wherein the corresponding bone model is multiplexed to a plurality of virtual objects.

In one possible embodiment, the method further comprises: binding a specific visual element associated with the virtual object for the target die; wherein the specific visual element comprises a facial expression and/or action bound to the bone model, the specific visual element being triggered by a semantic recognition result of the dubbing material to the virtual object.

In one possible embodiment, the association of the virtual object with the specific visual element includes: the association relationship between the virtual object and the specific visual element; and/or association relation between preset sentences of the virtual object and specific visual elements; and/or association between a preset scenario in the dubbing material and a specific visual element.

In a second aspect, an embodiment of the present invention provides a die configuration apparatus, including:

the creation module is used for creating a target mouth shape of the virtual object in the deformer template for the virtual object to be configured in the virtual scene, wherein the virtual object comprises a plurality of virtual roles related to the virtual scene;

the selection module is used for selecting a basic mouth shape from a pre-configured mapping pool, and the mapping pool is used for storing a basic deformer and basic mouth shape parameters corresponding to the basic mouth shape;

and the configuration module is used for configuring the target deformer and the target mouth shape parameter corresponding to the target mouth shape according to the basic deformer and the basic mouth shape parameter corresponding to the basic mouth shape, and exporting the configured target mouth shape for the virtual object.

Embodiments of the present invention also provide a system including a processor and a memory having at least one instruction, at least one program, code set, or instruction set stored therein, the at least one instruction, at least one program, code set, or instruction set being loaded and executed by the processor to implement the method of mouth shape configuration described above.

Embodiments of the present invention provide a computer readable medium having stored thereon at least one instruction, at least one program, code set, or instruction set, loaded and executed by a processor to implement the method of mouth shape configuration described above.

In the embodiment of the invention, for the virtual object to be configured in the virtual scene, a target mouth shape of the virtual object is created in the deformer template, and the virtual object comprises a plurality of virtual roles related to the virtual scene. Further, a base mouth shape is selected from a pre-configured mapping pool for storing base deformers and base mouth shape parameters corresponding to the base mouth shape. After the basic mouth shape required for configuring the deformer template is selected, configuring a target deformer and a target mouth shape parameter corresponding to the target mouth shape according to the basic deformer and the basic mouth shape parameter corresponding to the selected basic mouth shape, and exporting the configured target mouth shape for the virtual object, thereby realizing the configuration process of the target mouth shape in the deformer template. According to the embodiment of the invention, the configuration of the target mouth shape in the deformer template can be completed through any number of basic mouth shapes in the mapping pool, so that the configuration of the deformer template is not limited to fixed mouth shape parameter values, the flexibility of the mouth shape image manufacturing process is greatly improved, and the mouth shape image manufacturing efficiency is improved. In particular, for virtual objects needing batch configuration in a virtual scene, such as a plurality of game characters in a certain series in a game development project, or a plurality of appearance forms of a certain game character, the embodiment of the invention can configure corresponding target mouth forms for the virtual objects in batches through automatic mapping of a basic mouth form and a target mouth form, thereby improving the efficiency of virtual object batch configuration. In addition, the combination of multiple basic mouth shapes can also enable the morphological change of the target mouth shape in the deformer template to be more natural, and the visual effect of the mouth shape image is greatly optimized.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required for the description of the embodiments will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.

FIG. 1 is a flow chart of a method for configuring a die according to an embodiment of the present invention;

FIG. 2 is a schematic diagram of a die configuration interface according to an embodiment of the present invention;

FIG. 3 is a schematic diagram of an introductory column according to one embodiment of the present invention;

fig. 4 is a schematic structural diagram of a die configuration device according to an embodiment of the present invention;

fig. 5 is a schematic structural diagram of an electronic device corresponding to the die configuration apparatus provided in the embodiment shown in fig. 4.

Detailed Description

The present disclosure will now be discussed with reference to several exemplary embodiments. It should be understood that these embodiments are discussed only to enable those of ordinary skill in the art to better understand and thus practice the teachings of the present invention, and are not meant to imply any limitation on the scope of the invention.

As used herein, the term "comprising" and variants thereof are to be interpreted as meaning "including but not limited to" open-ended terms. The term "based on" is to be interpreted as "based at least in part on". The terms "one embodiment" and "an embodiment" are to be interpreted as "at least one embodiment. The term "another embodiment" is to be interpreted as "at least one other embodiment".

In addition, the sequence of steps in the method embodiments described below is only an example and is not strictly limited.

At present, in scenes such as games, videos, network live broadcast and the like, a mouth shape animation corresponding to character audio needs to be adapted to a virtual character, so that mouth shape actions in the mouth shape animation are matched with pronunciation in the character audio, and the authenticity of the virtual character is improved. Virtual character colors are, for example, game characters, character characters in movie works, avatars of anchor in webcast, and the like.

The applicant found that, in the related art, when a user creates a mouth shape animation, a mouth shape configuration table created in advance is generally called by mapping an address, and a mouth shape animation of a virtual object is obtained by setting fixed parameter values in the configuration table to the virtual object. In short, when a user custom creates a mouth shape of a virtual character, the user needs to configure the custom mouth shape to a fixed mouth shape, and then configure the fixed mouth shape to a required mouth shape parameter to complete creation of the custom mouth shape.

The applicant found that this implementation is limited to a limited number of fixed parameter values in the mouth shape configuration table, for example, the configuration table is configured with fixed parameter values of 5 mouth shape corresponding deformers, and then the available deformers in the mouth shape animation generation process are limited to the above 5 types, which greatly limits the user's creation freedom, makes the mouth shape animation visually harder, and reduces the animation production efficiency. For example, in a game development project, it is necessary to make a model of a deformer corresponding to a mouth shape or a model of a deformer entirely in accordance with a fixed value. In addition, the fixed parameter values in the mouth shape configuration table require a lot of manpower production, and the animation production efficiency is greatly reduced, so that the method is difficult to deal with large-scale virtual character mouth shape animation production scenes.

The mouth shape configuration scheme provided by the embodiment of the invention can be executed by an electronic device, and the electronic device can be a terminal device such as a smart phone, a tablet computer, a PC (personal computer), a notebook computer and the like. In an alternative embodiment, the electronic device may have an application installed thereon for executing the die configuration scheme. Alternatively, in another alternative embodiment, the die configuration scheme may be performed by the server device and the terminal device in cooperation.

For example, the electronic device may be implemented as a service program for exposing a mouth shape configuration interface. The service may be connected to another service, and after the deformer template loaded by the service is created and adjusted, the deformer template is imported into a virtual scene loaded by the other service for application.

In practical applications, the service program for exposing the mouth shape configuration interface is, for example, a mouth shape configuration plug-in, and the plug-in can be installed on another service program for running, and the other service program is, for example, a virtual scene editor, a game editor, and a virtual engine. Of course, the service program for exposing the mouth shape configuration interface may be an application program running independently, besides the plug-in form, and the present invention is not limited thereto.

The scheme provided by the embodiment of the invention is suitable for various mouth shape image making scenes, such as a virtual object mouth shape image generating scene, a modifying scene and an optimizing scene. For example, mouth-shaped image production scenes in the fields of games, movie works, web living broadcast, and the like. Optionally, the deformer template configured in the embodiment of the invention can be multiplexed into a plurality of game development projects, so that the mouth shape image production efficiency of the game development projects is improved.

In view of the foregoing technical problems, in some embodiments of the present invention, a solution is provided, and in the following, the technical solutions provided by the embodiments of the present invention are described in detail with reference to the accompanying drawings.

The execution of the die arrangement method will be described with reference to the following examples. Fig. 1 is a flowchart of a method for configuring a mouth shape according to an embodiment of the present invention. As shown in fig. 1, the die configuration method includes the following steps:

101. creating a target mouth shape of a virtual object in a deformer (Morph) template for the virtual object to be configured in the virtual scene;

102. selecting a basic mouth shape from a pre-configured mapping pool, wherein the mapping pool is used for storing a basic deformer and basic mouth shape parameters corresponding to the basic mouth shape;

103. and configuring a target deformer and a target mouth shape parameter corresponding to the target mouth shape according to the basic deformer and the basic mouth shape parameter corresponding to the basic mouth shape.

The method for configuring the mouth shape in the embodiment of the invention is applied to an application program, and the application program can be arranged in the terminal equipment. The deformer template obtained by the application program configuration can be applied to a virtual object of a virtual scene. Wherein the virtual object includes, but is not limited to, a plurality of virtual characters associated with the virtual scene. For example, the virtual object may be implemented as a game character in a game, a character in a movie work, an avatar of a host in a webcast, and so on. Taking a game character in a game as an example, a plurality of game characters in a certain series or a plurality of appearance forms of a certain game character in a game development project.

In the embodiment of the invention, the deformer comprises a mapping relation between the pronunciation mouth shape and the bone model. The deformer is used for mapping the dubbing material into the matched virtual object, so as to generate a mouth shape image of the virtual object. Wherein the dubbing material includes, but is not limited to, audio data and/or text data corresponding to the virtual object. Taking a virtual character in a game as an example, the dubbing material can be a dubbing file corresponding to the virtual character or a dialogue text corresponding to the virtual character.

It can be understood that the matching of the deformer and the virtual object may be a visual style matching, for example, the mouth shape animation style of the virtual object is matched with the mapping relationship set in the deformer, so that the deformer can obtain a mouth shape image unified with the virtual object in the mouth shape animation style. That is, by setting parameters related to the mapping relationship between the pronunciation mouth shape and the skeleton model, the deformer can have mouth shape animation styles required by different virtual objects, so that the deformer can be multiplexed to different virtual objects. The mouth-shaped animation style is, for example, cartoon style, pictorial style, ink style, and pixel style.

To facilitate editing of the imported deformer during the production of the mouth shape image, the deformer may be integrated in a deformer template, so that a deformer matching the virtual object is obtained in the deformer template.

How to configure the die for the desired use in the deformer template is described below in connection with specific embodiments. The mouth shape as used herein refers to the deformer and associated mouth shape parameters that are invoked in the project to which the deformer template is applied.

In 101, for a virtual object to be configured in a virtual scene, a target mouth shape of the virtual object is created in a deformer template. Wherein the virtual object includes a plurality of virtual characters associated with the virtual scene. In an alternative embodiment, the virtual object includes a plurality of game characters associated with a game scene, for example, all or part of a game character in a game item, where the game characters may be a plurality of game characters belonging to a job, a plurality of game characters belonging to a game scenario, or a plurality of game characters belonging to a game level or copy.

Taking the mouth shape configuration interface shown in fig. 2 as an example, editing operations for the deformer template, such as adding (i.e., creating), deleting, importing, exporting, etc., to the deformer template may be performed in the "deformer template" control column. In practical applications, the imported deformer template may be a default template preconfigured in the mouth-shape animation scheme, for example, in fig. 2, the deformer template to be configured is selected through a pull-down menu.

Optionally, the name of the deformer template may also be edited, so as to avoid collision between the name of the deformer template and other file names. In FIG. 2, a user-defined template name may be entered in a "template name" control field.

After the deformer template is obtained, the mouth shape set in the deformer template can be edited in a self-defined mode. For convenience of description, the die set in the deformer template is referred to as a target die in the present invention. Taking the mouth shape configuration interface shown in fig. 2 as an example, the target mouth shape in the deformer template may be edited in the mapping list. For example, through a "+" control in the mapping list, a configuration item corresponding to the target mouth shape is created in the mapping list, and the name of the target mouth shape and the mapping value (i.e., the overall weight parameters of a plurality of basic mouth shapes to the target mouth shape described below) can be configured in the configuration item.

After creating the target mouth shape of the virtual object to be configured, in 102, a base mouth shape is selected from a pre-configured mapping pool. 103, configuring a target deformer and a target mouth shape parameter corresponding to the target mouth shape according to the basic deformer and the basic mouth shape parameter corresponding to the basic mouth shape, and deriving the configured target mouth shape for the virtual object.

In the embodiment of the invention, the mapping pool is used for storing the basic deformer and basic mouth shape parameters corresponding to the basic mouth shape, and the selectable basic mouth shape in the current deformer template can be intuitively displayed through the mapping pool, so that the mouth shape configuration efficiency in the deformer template is improved. For example, the mapping pool may be presented as a mapping pool in the die configuration interface shown in FIG. 2. In practical application, the basic mouth shape may be configured according to a language pronunciation rule, may be configured according to a project requirement or a language style, or may be configured according to other modes, and the embodiment is not limited. For example, in the mouth shape configuration interface shown in fig. 2, the mapping pool includes 10 basic mouth shapes, and the basic deformers and basic mouth shape parameters corresponding to the 10 basic mouth shapes. Wherein, 10 basic mouth forms are respectively: a. b, d, e, g, i, z, zh, u, ou.

In an alternative embodiment, 102, in response to a selection instruction for at least one basic mouth shape in the mapping pool, a basic deformer corresponding to the at least one basic mouth shape and basic mouth shape parameters are obtained. The basic die parameters include, but are not limited to: and the identification corresponding to the basic mouth shape. Taking the mouth shape configuration interface shown in fig. 2 as an example, one or more basic mouth shapes can be selected from the mapping pool for configuration of the target mouth shape through a fixed name control column on the left side of the interface. In practical applications, the name (i.e. the identifier) and the interpolation (i.e. the weight parameters described below) of each basic mouth shape are shown in the "fixed name" control column, and note that the interpolation herein is an independent weight parameter of the basic mouth shape to the target mouth shape.

In another alternative embodiment, in 102, configuration parameters of multiple virtual roles related to the virtual scene may also be parsed. And selecting a basic mouth shape matched with the configuration parameters from the mapping pool through the analyzed configuration parameters of the multiple virtual roles, so as to further improve the mouth shape configuration efficiency. For example, after a plurality of game characters to be configured in a game item are imported, configuration parameters of the game characters, such as gender, age, appearance characteristics, occupation, class, and the like of the game characters are parsed. And then, selecting basic mouth shapes matched with the respective configuration parameters for the game characters from the mapping pool through the analyzed configuration parameters of the game characters, and establishing a mapping list a of the game characters and the basic mouth shapes, thereby facilitating the subsequent batched configuration of corresponding target mouth shapes for the game characters. It will be appreciated that, to meet game development requirements, base patterns with different action style characteristics may also be pre-imported into the mapping pool, for example, multiple base patterns with different action style characteristics may be imported for pronunciation a, such as a rough style pronunciation a base pattern, a gentle style pronunciation a base pattern, a stuttering style pronunciation a base pattern, and a combat style pronunciation a base pattern. In practical applications, different action style characteristics may be configured according to the setting of the game character.

Further, 103, a mapping relationship between the target mouth shape and at least one basic mouth shape is established, so as to configure a basic deformer and basic mouth shape parameters corresponding to at least one basic mouth shape as target deformer and target mouth shape parameters corresponding to the target mouth shape. Specifically, the identification corresponding to the at least one basic die may be added to the mapping list of the target die. Taking the mouth shape configuration interface shown in fig. 2 as an example, after one or more basic mouth shapes in the mapping pool are selected through the "fixed name" control column, the configuration items of the target mouth shape a mapped by the selected basic mouth shape a are edited in the mapping list. Here, the configuration items of the target die a include: the name of the target die (i.e., a) and the mapped value (i.e., 1, where mapped value refers to the overall weight parameter of the plurality of base dies to the target die as described below). It will be appreciated that it is also possible to map a plurality of basic mouth shapes to a mapping list of the same target mouth shape, thereby establishing a mapping relationship between a plurality of basic mouth shapes and the same target mouth shape. For example, the basic patterns b and a are mapped to the target pattern ba, and the target pattern formed by the basic patterns b and a is obtained. In practical application, the name and the mapping value of the target mouth shape can be edited in the configuration item of the target mouth shape. The name of the target mouth shape can be modified to avoid name conflict in the project development process, meanwhile, the identification degree of the name of the target mouth shape is enhanced, and the difficulty in making mouth shape images is reduced. The mapping value of the target mouth shape is modified, so that the pronunciation action style of the target mouth shape can be changed, and the target mouth shape meets the differentiated requirements of various application scenes.

Continuing with the above example, assuming that the virtual object is a plurality of game characters to be configured in the game item, after a mapping list a of the game characters and the basic mouth shapes is established in 102, in 103, the corresponding target mouth shapes are configured for the respective game characters according to the mapping list a. Specifically, taking the game character a1 and the corresponding basic mouth shapes { b1, b2, … …, bn } in the mapping list a as an example, for the target mouth shape c1 to be configured in the game character a1, a mapping relationship between the target mouth shape c1 and at least one basic mouth shape in the basic mouth shapes { b1, b2, … …, bn } is obtained, so as to configure the basic deformer and the basic mouth shape parameter corresponding to at least one basic mouth shape as the target deformer and the target mouth shape parameter corresponding to the target mouth shape c 1.

Finally, in 103, the configured target mouth shape also needs to be exported for the virtual object. Specifically, it is assumed that the virtual object includes a plurality of game characters associated with a game scene, based on this, in 103, in response to a batch export instruction for the target mouth shape, an identifier corresponding to an item in which the plurality of game characters are located is determined, and based on the identifier, the target mouth shape is exported as a mouth shape configuration scheme corresponding to the item in which the plurality of game characters are located. Optionally, the identification corresponding to the item in which the plurality of game characters are located includes, but is not limited to, one or a combination of the following: a game item identification, a game scenario identification in the game item, and a game stage identification. In practical application, the mouth shape configuration scheme can be added into the animation export scheme or directly generated into the mouth shape configuration template of the project, thereby facilitating subsequent modification and application.

In consideration of the differences in facial expression changes of each virtual object, in an alternative embodiment, the weighting parameters of the basic mouth shape in the morphological changes of the target mouth shape may also be configured in the deformer template after 103. The larger the weight parameter of the basic mouth shape is, the larger the influence of the basic mouth shape on the morphological change of the target mouth shape is. For example, assuming that both the basic mouth shape z and the basic mouth shape a are mapped to the target mouth shape, accents are usually dropped on a in daily pronunciation, so that the weight parameters of the basic mouth shape a can be adjusted to make the pronunciation action of the basic mouth shape a in the target mouth shape more obvious.

Further alternatively, if the base mouth shape mapped to the target mouth shape is a plurality, then the weight parameters of the base mouth shape include, but are not limited to, one or a combination of the following: the overall weight parameters of the multiple basic mouth shapes to the target mouth shape, and the independent weight parameters of each basic mouth shape to the target mouth shape. For example, in the mouth shape configuration interface shown in fig. 2, assuming that the basic mouth shape z and the basic mouth shape a are mapped to the target mouth shape, interpolation (i.e., independent weight parameter) of the basic mouth shape a to the target mouth shape a may be set in the "fixed name" control column, and a mapping value (i.e., overall weight parameter) of the combined basic mouth shape z and a to the target mouth shape a may also be set in the mapping list of the target mouth shape.

Optionally, basic die related introduction information is presented in the die configuration interface. For example, in the introductory column shown in fig. 3, the currently selected basic mouth shape a is described in detail in a graphic combination manner, including mouth shape image effect of the basic mouth shape a and text introduction of pronunciation key points.

In an alternative embodiment, a corresponding bone model may also be provided for the deformer in the deformer template. Specifically, the corresponding skeleton model is related to the application scene of the virtual object, and the corresponding skeleton model is related to the virtual object. In fact, in order to meet the requirement of large-scale development, the skeletal models used by the plurality of virtual objects can be set for the deformer in batches, so that the skeletal models corresponding to the deformer can be multiplexed to the plurality of virtual objects. For example, assuming that the application scenario of the virtual object is a game development scenario and the virtual object is a virtual character in a game, a common skeleton model may be set for multiple virtual characters in the game, that is, a deformer in a deformer template is bound with a basic skeleton model bound by multiple virtual characters in the game, so that the basic skeleton model is used as a skeleton model corresponding to the deformer. Alternatively, multiple morphers may use the same skeletal model to enable multiplexing of morpher templates by multiple virtual characters in a game. For example, skeleton models of different virtual characters in a game can be respectively bound into deformers of the deformer template according to the character style, so that the manufacturing efficiency of mouth shape images is further improved, and the animation development efficiency of virtual objects is reduced. Of course, in order to ensure that the mouth shape animation styles of different virtual characters can be embodied in the mouth shape image, optionally, in response to an editing instruction to the deformer template, the mapping parameters of the deformer are adjusted to modify the mapping relationship of the pronunciation mouth shape and the bone model. That is, the deformer is adapted to the mouth shape animation style required for different virtual objects by editing parameters of different deformers in the deformer template, such as the parameters mentioned above relating to the mapping relationship of the pronunciation mouth shape and the bone model.

In an alternative embodiment, the deformer template is presented in a deformer panel after 103; and responding to a selection instruction of a target mouth shape in the deformer template, and selecting a target mouth shape matched with the virtual object from the target mouth shapes set by the deformer template so as to call the target deformer and the target mouth shape parameters to generate a mouth shape image of the virtual object.

Specifically, in the above steps, the deformer template completed via the 103 configuration is first shown in the deformer panel. Further, in response to a selection instruction of the target mouth shape, a target mouth shape matched with the virtual object is selected from the target mouth shapes set by the deformer template, so that the target deformer and the target mouth shape parameters are called to generate a mouth shape image of the virtual object. Specifically, a deformer matching the virtual object may be selected from the deformer templates. In some embodiments, the selection instruction for the target die may be user-triggered. For example, a corresponding deformer is selected from a pull-down menu showing deformer templates in the deformer panel, or a deformer matching a virtual object may be imported in the deformer panel. Of course, in practical application, if the number of deformers is large, the deformers matched with the virtual object may be selected by the user in a searching or fuzzy matching manner, which is not limited in this embodiment. In other embodiments, the selection instruction of the target mouth shape may be automatically triggered according to dubbing materials and/or virtual objects. Taking a game development scene as an example, the flow of a deformer selection instruction is automatically triggered, the dubbing material is analyzed, corresponding pronunciation style characteristics, such as young or old, male or female, dumb or clear, and the like, are obtained, and therefore the deformer matched with the pronunciation style characteristics is selected as a deformer matched with a virtual object. The attribute parameters of the virtual object to be generated can be analyzed, the pronunciation style characteristics of the virtual object can be determined, and similarly, a deformer matched with the pronunciation style characteristics can be selected as the deformer matched with the virtual object. Of course, the dubbing material and the virtual object to be generated can be combined when the pronunciation style characteristics are analyzed, so that the adaptation degree of the deformer and the virtual object is improved, and the visual effect of the finally generated mouth shape image is improved. Further, after the target mouth shape is selected, since the deformer of the target mouth shape includes the mapping relation between the sound producing mouth shape and the bone model, the dubbing material can be mapped to the bone model of the virtual object by the deformer of the target mouth shape, and the face mouth shape image synchronized with the dubbing material can be generated as the mouth shape image of the virtual object.

In the above or below embodiments, optionally, specific visual elements associated with the virtual object may also be bound for the target die. Wherein the specific visual elements include, but are not limited to: facial expressions and/or actions bound to the skeletal model, the particular visual element being triggered by semantic recognition of the dubbing material of the virtual object. Through the binding relation, personalized setting of the mouth shape image of the virtual object can be realized, more visual elements related to the setting or attribute parameters of the virtual object are added to the mouth shape image, and therefore the visual effect and the manufacturing efficiency of the mouth shape image of the virtual object are further improved.

In practical applications, specifically, the association relationship between the virtual object and the specific visual element includes, but is not limited to, one or more of the following association relationships: the association relation between the virtual object and the specific visual element, the association relation between the preset statement of the virtual object and the specific visual element, and the association relation between the preset scenario in the dubbing material and the specific visual element. Optionally, a specific visual element, such as a specific facial expression and/or action, is associated for the virtual object, thereby establishing an association of the virtual object with the specific visual element. Wherein a particular visual element, such as a facial expression and/or action, may be achieved by setting bone model parameters in the bone model. Taking a game development project as an example, for different game characters in the game project, association relations between the facial expressions bound with the skeleton models of the game characters can be respectively established for the game characters so as to obtain a facial expression list associated with the game characters.

It will be appreciated that the facial expressions and/or actions described above as being tied to the skeletal model may be targeted for different virtual objects. Of course, besides setting exclusive facial expressions and/or actions for the virtual object, if the game characters conform to the setting conditions, for example, the game characters belong to the same series, or the game characters belong to the same scenario branch, then the facial expressions and/or actions bound respectively can be multiplexed between the skeleton models of the game characters, so that migration of the facial expressions and/or actions among the game characters is facilitated, and the manufacturing efficiency of the mouth shape image is further improved. In practice, the same facial expression and/or action, after binding to skeletal models of different virtual objects (e.g., game characters), may be associated with different sentences in different virtual object dubbing materials. For example, assuming that the facial expression of the eyebrow is associated with preset sentences of a plurality of virtual objects, the facial expression may be respectively associated with different sentences of different virtual objects, for example, "true" in the dubbing material of the virtual object a? "and" do not get bar? "associated". Of course, the same facial expression and/or action may also be associated with the same sentence or the same scenario in multiple virtual objects. For example, a facial expression of a picked eyebrow may be associated with a "true mock" of multiple virtual objects. For example, a facial expression of a picked eyebrow may also be associated with a scenario in which multiple virtual objects encounter monster 1 in checkpoint 1, i.e., if any of the virtual objects are detected to encounter monster 1 in checkpoint 1, the presentation of that facial expression is triggered.

In practical applications, the specific facial expression is, for example, a signboard expression set for a game character, or a facial expression obtained by adjusting attribute parameters of the game character, and of course, may also be a personalized setting of a player for the game character, for example, a facial expression obtained by a face pinching operation. Specifically, the resulting facial expressions, including but not limited to eyebrows, smiles, blinks, pucker, and the like, are adjusted for the attribute parameters of the game character. Similarly, the specific action is, for example, a signboard action set for the game character or an action adjusted to the attribute parameter of the game character. Of course, the specific action may also be a personalized setting of the player for the game character, such as a player-specific action derived by interaction with the player or parsing player preference data.

Optionally, based on the binding relationship, semantic recognition can be performed on dubbing materials of the virtual object, and whether the dubbing materials meet preset conditions is judged based on the recognition result. If the dubbing material meets the preset condition, adding a specific visual element associated with the virtual object in the mouth shape image, wherein the specific visual element comprises facial expression and/or action. Specifically, the facial expression and/or action associated with the virtual object may be added to the mouth shape image synchronized with the dubbing material based on the association relationship between the virtual object and the facial expression and/or action. In practice, the preset conditions include, but are not limited to: the dubbing material comprises a preset sentence, the dubbing material belongs to a preset virtual object, and the dubbing material belongs to a preset game development project or game character series.

For example, it is assumed that the preset condition is that the dubbing material belongs to a preset virtual object, and the dubbing material includes a preset sentence. Let us assume that the preset sentence "why" of the virtual object a is associated with the eyebrow (facial expression). Based on the above assumption, first, it is detected whether the dubbing material belongs to a preset virtual object a, and whether "why" (i.e., a preset sentence) is contained in the dubbing material. If the dubbing material is detected to belong to a preset virtual object a and contains ' why woolen, based on the association relation between the preset sentence of the virtual object a and the eyebrow (namely, the facial expression), the eyebrow expression associated with the virtual object a is added into the mouth-shaped image synchronous with the preset sentence in the dubbing material, namely, the ' why woolen '.

Alternatively, the steps may be: suppose that virtual object b is associated with a smile (i.e., facial expression). Based on the above, whether the dubbing material belongs to a preset virtual object b is detected, and if the dubbing material belongs to the preset virtual object b is detected, based on the association relationship between the virtual object b and the smile, the smile expression associated with the virtual object b is added in the mouth shape image synchronized with the dubbing material. The smile expression may be any position added in the mouth shape image of the virtual object b, for example, at the end or start of each sentence conversation.

In the above or below embodiments, optionally, after 103, the deformer template may also be derived, so that the deformer template may be subsequently applied to a specific scenario, to achieve multiplexing of the deformer template across operation platforms or across development projects. Specifically, taking the mouth shape configuration interface shown in fig. 2 as an example, the currently edited deformer template can be stored and exported through a "save" control. In this embodiment, a format file of ". Morph_map_data" supported by a phantom engine (UE) is generally outputted as a default export format.

In the execution process of the mouth shape configuration method shown in fig. 1, the configuration of the target mouth shape in the deformer template can be completed through any number of basic mouth shapes in the mapping pool, so that the configuration of the deformer template is not limited to fixed mouth shape parameter values any more, the flexibility of the mouth shape image manufacturing process is greatly improved, and the mouth shape image manufacturing efficiency is improved. In particular, for virtual objects needing batch configuration in a virtual scene, the method can configure corresponding target mouth shapes for the virtual objects in batches through automatic mapping of basic mouth shapes and target mouth shapes, so that efficiency of virtual object batch configuration is improved. In addition, the combination of multiple basic mouth shapes can also enable the morphological change of the target mouth shape in the deformer template to be more natural, and the visual effect of the mouth shape image is greatly optimized.

The die arrangement of one or more embodiments of the present invention will be described in detail below. Those skilled in the art will appreciate that these die configuration devices can be constructed using commercially available hardware components configured through the steps taught by the present solution.

Fig. 4 is a schematic structural diagram of a die configuration device according to an embodiment of the present invention. The die configuration device is applied to a server, as shown in fig. 4, and includes: an acquisition module 11 and a generation module 12. Optionally, the mouth shape configuration device is applied to an application program for loading the virtual object.

A creating module 11, configured to create, for a virtual object to be configured in a virtual scene, a target mouth shape of the virtual object in a deformer template, where the virtual object includes a plurality of virtual roles related to the virtual scene;

a selection module 12, configured to select a basic mouth shape from a pre-configured mapping pool, where the mapping pool is configured to store a basic deformer and basic mouth shape parameters corresponding to the basic mouth shape;

and the configuration module 13 is used for configuring the target deformer and the target mouth shape parameter corresponding to the target mouth shape according to the basic deformer and the basic mouth shape parameter corresponding to the basic mouth shape, and deriving the configured target mouth shape for the virtual object.

Optionally, the virtual object includes a plurality of game characters associated with the game scene. The configuration module 13 is specifically configured to, when exporting the configured target mouth shape for the virtual object: and responding to a batch export instruction of the target mouth shapes, determining the identifiers corresponding to the items of the plurality of game characters, and exporting the target mouth shapes into mouth shape configuration schemes corresponding to the items of the plurality of game characters based on the identifiers.

Optionally, the identifiers corresponding to the items where the plurality of game characters are located include at least one of a game item identifier, a game scenario identifier in the game item, and a game stage identifier.

Optionally, the selecting module 12 is specifically configured to: and responding to a selection instruction of at least one basic mouth shape in the mapping pool, and acquiring a basic deformer corresponding to the at least one basic mouth shape and basic mouth shape parameters, wherein the basic mouth shape parameters comprise an identifier.

The configuration module 13 is specifically configured to, when configuring the target deformer and the target mouth shape parameter corresponding to the target mouth shape according to the basic deformer and the basic mouth shape parameter corresponding to the basic mouth shape: and establishing a mapping relation between the target mouth shape and at least one basic mouth shape so as to configure a basic deformer corresponding to at least one basic mouth shape and basic mouth shape parameters as target deformer corresponding to the target mouth shape and target mouth shape parameters.

Optionally, when the configuration module 13 establishes the mapping relationship between the target mouth shape and at least one basic mouth shape, the configuration module is specifically configured to: and adding the identification corresponding to the at least one basic mouth shape into a mapping list of the target mouth shape.

Optionally, the method further comprises a weight configuration module for: configuring weight parameters of the basic mouth shape in the shape change of the target mouth shape in the deformer template; wherein the larger the weight parameter, the larger the influence of the basic mouth shape on the morphological change of the target mouth shape.

Optionally, if the basic mouth shapes mapped to the target mouth shape are plural, the weight parameters include: the overall weight parameters of the plurality of base patterns to the target pattern and/or the independent weight parameters of each base pattern to the target pattern.

Optionally, the method further comprises a generating module for: displaying a deformer template in a deformer panel; and responding to a selection instruction of a target mouth shape in the deformer template, and selecting a target mouth shape matched with the virtual object from the target mouth shapes set by the deformer template so as to call the target deformer and the target mouth shape parameters to generate a mouth shape image of the virtual object.

Optionally, the device further comprises a setting module for: corresponding bone models are set for the deformers in the deformer template, wherein the corresponding bone models are multiplexed to a plurality of virtual objects.

Optionally, the method further comprises a binding module for: binding a specific visual element associated with the virtual object for the target die; wherein the specific visual element comprises a facial expression and/or action bound to the bone model, the specific visual element being triggered by a semantic recognition result of the dubbing material to the virtual object.

Optionally, the association relationship between the virtual object and the specific visual element includes: the association relationship between the virtual object and the specific visual element; and/or association relation between preset sentences of the virtual object and specific visual elements; and/or association between a preset scenario in the dubbing material and a specific visual element.

The die configuration device shown in fig. 4 may perform the method provided in the foregoing embodiments, and for the portions of this embodiment not described in detail, reference may be made to the related description of the foregoing embodiments, which are not described herein.

In one possible design, the configuration of the die arrangement shown in fig. 4 described above may be implemented as an electronic device.

As shown in fig. 5, the electronic device may include: a processor 21, and a memory 22. Wherein said memory 22 has stored thereon executable code which, when executed by said processor 21, at least enables said processor 21 to implement a die configuration method as provided in the previous embodiments. The electronic device may further include a communication interface 23 for communicating with other devices or a communication network.

The apparatus embodiments described above are merely illustrative, wherein the various modules illustrated as separate components may or may not be physically separate. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment. Those of ordinary skill in the art will understand and implement the present invention without undue burden.

The systems, methods and apparatus of embodiments of the present invention may be implemented as pure software (e.g., a software program written in Java), as pure hardware (e.g., a special purpose ASIC chip or FPGA chip), or as a system that combines software and hardware (e.g., a firmware system with fixed code or a system with general purpose memory and a processor), as desired.

Another aspect of the invention is a computer readable medium having stored thereon computer readable instructions which, when executed, may implement the die configuration method of the embodiments of the invention.

The foregoing description of embodiments of the invention has been presented for purposes of illustration and description, and is not intended to be exhaustive or limited to the embodiments disclosed. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the various embodiments described. The scope of the claimed subject matter is limited only by the following claims.

Claims

1. A method of die configuration, comprising:

for a virtual object to be configured in a virtual scene, creating a target mouth shape of the virtual object in a deformer template, wherein the virtual object comprises a plurality of virtual roles related to the virtual scene;

and configuring a target deformer and a target mouth shape parameter corresponding to the target mouth shape according to the basic deformer and the basic mouth shape parameter corresponding to the basic mouth shape, and exporting the configured target mouth shape for the virtual object.

2. The method of claim 1, wherein the virtual object comprises a plurality of game characters associated with a game scene;

the method for exporting the configured target mouth shape for the virtual object comprises the following steps:

and responding to the batch export instruction of the target mouth shapes, determining the identifiers corresponding to the items of the plurality of game characters, and exporting the target mouth shapes into mouth shape configuration schemes corresponding to the items of the plurality of game characters based on the identifiers.

3. The method of claim 2, wherein the identification comprises at least one of a game item identification, a game scenario branch identification in a game item, a game level identification.

4. The method of claim 1, wherein selecting a base pattern from a pre-configured mapping pool comprises:

responding to a selection instruction of at least one basic mouth shape in the mapping pool, and acquiring a basic deformer corresponding to the at least one basic mouth shape and basic mouth shape parameters, wherein the basic mouth shape parameters comprise an identifier;

the configuring the target deformer and the target mouth shape parameter corresponding to the target mouth shape according to the basic deformer and the basic mouth shape parameter corresponding to the basic mouth shape comprises the following steps:

and establishing a mapping relation between the target mouth shape and at least one basic mouth shape so as to configure a basic deformer corresponding to at least one basic mouth shape and basic mouth shape parameters as target deformer corresponding to the target mouth shape and target mouth shape parameters.

5. The method of claim 4, wherein said establishing a mapping between said target die and at least one base die comprises:

and adding the identification corresponding to the at least one basic mouth shape into a mapping list of the target mouth shape.

6. The method as recited in claim 1, further comprising:

the weight parameters of the basic mouth shape in the form change of the target mouth shape are configured in the deformer template; the larger the weight parameter is, the larger the influence of the basic mouth shape on the morphological change of the target mouth shape is.

7. The method of claim 6, wherein if the base mouth shape mapped to the target mouth shape is a plurality of mouth shapes, the weight parameters comprise: the overall weight parameters of the plurality of base patterns to the target pattern and/or the independent weight parameters of each base pattern to the target pattern.

8. The method as recited in claim 1, further comprising:

displaying the deformer template in a deformer panel;

and responding to a selection instruction of a target mouth shape in the deformer template, and selecting a target mouth shape matched with the virtual object from the target mouth shapes set by the deformer template so as to call the target deformer and the target mouth shape parameters to generate a mouth shape image of the virtual object.

9. The method as recited in claim 1, further comprising:

binding a particular visual element associated with the virtual object for the target die;

wherein the specific visual element comprises facial expressions and/or actions bound to a skeletal model, the specific visual element being triggered by a semantic recognition result of dubbing material of the virtual object.

10. A die configuration device, the device comprising:

The creation module is used for creating a target mouth shape of a virtual object to be configured in a virtual scene in a deformer template, wherein the virtual object comprises a plurality of virtual roles related to the virtual scene;

the selection module is used for selecting a basic mouth shape from a pre-configured mapping pool, wherein the mapping pool is used for storing a basic deformer and basic mouth shape parameters corresponding to the basic mouth shape;

and the configuration module is used for configuring the target deformer and the target mouth shape parameter corresponding to the target mouth shape according to the basic deformer and the basic mouth shape parameter corresponding to the basic mouth shape, and guiding out the configured target mouth shape for the virtual object.