WO2023179292A1

WO2023179292A1 - Virtual prop driving method and apparatus, electronic device and readable storage medium

Info

Publication number: WO2023179292A1
Application number: PCT/CN2023/077873
Authority: WO
Inventors: 顾佳祺; 陈都
Original assignee: 北京字跳网络技术有限公司
Priority date: 2022-03-21
Filing date: 2023-02-23
Publication date: 2023-09-28
Also published as: CN114618163A

Abstract

The present disclosure provides a virtual prop driving method and apparatus, an electronic device and a storage medium. The virtual prop driving method comprises: obtaining multi-segment driving information of a virtual prop, wherein the driving information is used for driving at least one part of the virtual prop, and the virtual prop is a virtual prop capable of deforming; determining complete driving information of the virtual prop on the basis of the multi-segment driving information; and on the basis of the complete driving information, driving the virtual prop to move in a 3D scene, wherein the 3D scene is generated after 3D scene information in a 3D rendering environment is rendered, the 3D rendering environment runs in an electronic device, the 3D scene information comprises virtual prop information, and the virtual prop information is used for generating the virtual prop after rendering. According to embodiments of the present application, the driving effect of a flexible virtual prop may be improved.

Description

Driving method, device, electronic device and readable storage medium for virtual props

This application requires the priority of the Chinese patent application submitted to the China Patent Office on March 21, 2022, with the application number 202210279097.9 and the application name "Driving method, device, electronic device and readable storage medium for virtual props", all of which The contents are incorporated into this application by reference.

Technical field

The present disclosure relates to the field of virtual prop driving technology, and specifically, to a driving method, device, electronic device and storage medium for virtual props.

Background technique

In related technologies, the main method of virtual live broadcast includes: obtaining control signals about the actor's (the person's) action expression data through a motion capture device, and driving the virtual image's movements.

The process of live broadcasting of a virtual image will involve interaction with virtual props. The driving of virtual props is similar to the driving of virtual images. Movement data about real props are obtained through motion capture equipment and the movement of virtual props is driven.

However, current virtual props are usually rigid objects that do not deform (such as glasses and microphones, etc.). For flexible virtual props that can deform (such as fitness rings), if the motion capture processing method of rigid virtual props is still used, , will lead to the loss of some motion capture data, which will lead to distortion of the display form of flexible virtual props.

Contents of the invention

Embodiments of the present disclosure at least provide a method, device, electronic device, and storage medium for driving virtual props, which can improve the driving effect of flexible virtual props.

Embodiments of the present disclosure provide a driving method for virtual props, including:

Obtaining multiple pieces of driving information for virtual props; wherein the driving information is used to drive at least one part of the virtual props, and the virtual props are virtual props capable of deformation;

Based on the multiple pieces of driving information, determine the complete driving information of the virtual prop;

Based on the complete driving information, the virtual props are driven to move in the 3D scene; the 3D scene is generated by rendering the 3D scene information in the 3D rendering environment, the 3D rendering environment runs in the electronic device, and the 3D scene The information includes virtual prop information, which is used to generate the virtual props after rendering.

In the embodiment of the present disclosure, since the complete driving information of the virtual prop is composed of multiple segments of driving information, that is, each part of the flexible virtual prop is regarded as a target for driving. In this way, even when the flexible virtual prop is deformed, Under this condition, each part will also achieve the corresponding driving effect, so that the virtual props can display a complete driving effect, and the display form will not be distorted due to the deformation of a certain part, thus improving the performance of flexible virtual props under deformation. display effect.

In a possible implementation, the multi-segment driving information is obtained through a motion capture device, the multi-segment driving information corresponds to different target parts of the virtual prop, and the motion capture device is set at a corresponding position of the real prop, and the The corresponding position of the real prop corresponds to the target part of the virtual prop.

In a possible implementation, determining the complete driving information of the virtual prop based on the multiple pieces of driving information includes:

Based on the attribute information of the virtual prop, the multiple pieces of driving information are fused to obtain the complete driving information.

In the embodiment of the present disclosure, based on the attribute information of the virtual prop, the obtained complete driving information can be more consistent with the attributes of the virtual prop, thereby improving the driving effect of the virtual prop.

In a possible implementation, the attribute information of the virtual prop includes at least one of the type of the virtual prop, the deformation direction of the virtual prop, the deformation range of the virtual prop, and the structural form of the virtual prop. A sort of.

In a possible implementation, the multiple pieces of driving information are fused based on the attribute information of the virtual props to obtain the complete driving information, including:

Based on the attribute information of the virtual prop, determine whether the data in the multi-segment driving information meets the preset conditions;

Eliminate data that does not meet the preset conditions to obtain multiple segments of target drive information;

The multiple pieces of target driving information are fused to obtain the complete driving information.

In the embodiment of the present disclosure, before merging multiple segments of drive information, it is first determined whether there is data that does not meet the preset conditions in the multiple segments of drive information. If there is, the data that does not meet the preset conditions is first eliminated, and then the fusion is performed. , In this way, the accuracy of the complete driving information can be improved, and the driving effect of the virtual props can be further improved.

Determine whether the multiple pieces of driving information correspond to the target part of the virtual prop;

In the case where at least one target part lacks corresponding driving information, determine first driving information of at least one first target part based on at least one part of the plurality of pieces of driving information, and the first target part lacks corresponding driving information. The target part of the information;

The complete driving information is obtained based on the plurality of pieces of driving information and at least one piece of the first driving information.

In the embodiment of the present disclosure, since the missing driving information is determined based on the obtained driving information, in this way, the driving effect of the target part lacking the driving information can be coordinated with other target parts, improving the performance of the virtual props in the absence of driving information. display effect.

Based on the attribute information of the virtual prop, determine the target data in the multi-segment driving information;

The target data in the multiple segments of driving information are fitted to obtain the complete driving information.

In the embodiments of the present disclosure, through data fitting, the connection between each target part of the virtual props can be smoothly transitioned, so that the display effect of the virtual props is more consistent with the effect of the real props, and the user's viewing experience is improved.

An embodiment of the present disclosure provides a driving device for virtual props, including:

A driving information acquisition module, used to obtain multiple pieces of driving information of virtual props; wherein the driving information is used to drive at least one part of the virtual props, and the virtual props are virtual props capable of deformation;

A driving information fusion module, configured to determine the complete driving information of the virtual prop based on the multi-segment driving information;

A virtual prop driving module, used to drive the virtual props to move in a 3D scene based on the complete driving information; the 3D scene is generated by rendering the 3D scene information in the 3D rendering environment, and the 3D rendering environment runs on the electronic In the device, the 3D scene information includes virtual prop information, and the virtual prop information is used to generate the virtual props after rendering.

In a possible implementation, the multi-segment driving information is obtained through a motion capture device, the multiple segments of driving information respectively correspond to different target parts of the virtual prop, and the motion capture device is set at a corresponding position of the real prop, so The corresponding position of the real prop corresponds to the target part of the virtual prop.

In a possible implementation, the driving information fusion module is specifically used to:

An embodiment of the present disclosure provides an electronic device, including: a processor, a memory, and a bus. The memory stores machine-readable instructions executable by the processor. When the electronic device is running, the processor and the Memories communicate with each other through a bus, and when the machine-readable instructions are executed by the processor, the virtual prop driving method as described above is performed.

Embodiments of the present disclosure provide a computer-readable storage medium. A computer program is stored on the computer-readable storage medium. When the computer program is run by a processor, the computer program executes the virtual prop driving method as described above.

In order to make the above-mentioned objects, features and advantages of the present disclosure more obvious and understandable, preferred embodiments are given below and described in detail with reference to the accompanying drawings.

Description of the drawings

In order to explain the technical solutions of the embodiments of the present disclosure more clearly, the drawings required to be used in the embodiments will be briefly introduced below. The drawings here are incorporated into the specification and constitute a part of this specification. These drawings are The drawings illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the technical solutions of the present disclosure. It should be understood that the following drawings only illustrate certain embodiments of the present disclosure, and therefore should not be regarded as limiting the scope. For those of ordinary skill in the art, without exerting creative efforts, they can also Other relevant drawings are obtained based on these drawings.

Figure 1 shows a flow chart of a first virtual prop driving method provided by an embodiment of the present disclosure;

Figure 2 shows a schematic diagram of the corresponding relationship between different parts of a virtual prop and each piece of driving information provided by an embodiment of the present disclosure;

Figure 3 shows a schematic diagram of driving virtual props based on original multi-segment driving information provided by an embodiment of the present disclosure;

Figure 4 shows a schematic diagram of driving virtual props based on fitted multi-segment driving information provided by an embodiment of the present disclosure;

Figure 5 shows a flow chart of a method for merging multiple pieces of driving information provided by an embodiment of the present disclosure;

Figure 6 shows a flow chart of another method for fusing multiple pieces of driving information provided by an embodiment of the present disclosure;

Figure 7 shows a schematic structural diagram of a driving device for virtual props provided by an embodiment of the present disclosure;

FIG. 8 shows a schematic diagram of an electronic device provided by an embodiment of the present disclosure.

Detailed ways

In order to make the purpose, technical solutions and advantages of the embodiments of the present disclosure clearer, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present disclosure. Obviously, the described embodiments are only These are some embodiments of the present disclosure, but not all embodiments. The components of the embodiments of the present disclosure generally described and illustrated in the figures herein may be arranged and designed in a variety of different configurations. Therefore, the following detailed description of the embodiments of the disclosure provided in the appended drawings is not intended to limit the scope of the claimed disclosure, but rather to represent selected embodiments of the disclosure. Based on the embodiments of the present disclosure, all other embodiments obtained by those skilled in the art without any creative efforts shall fall within the scope of protection of the present disclosure.

It should be noted that similar reference numerals and letters represent similar items in the following figures, therefore, once an item is defined in one figure, it does not need further definition and explanation in subsequent figures.

The term "and/or" in this article only describes an association relationship, indicating that three relationships can exist. For example, A and/or B can mean: A alone exists, A and B exist simultaneously, and B alone exists. situation. In addition, the term "at least one" herein means any one of a plurality or any combination of at least two of a plurality, for example, including at least one of A, B, and C, which can mean including from A, Any one or more elements selected from the set composed of B and C.

In a virtual image live broadcast scenario, it usually involves the action drive of virtual characters and virtual props. Current virtual props are usually rigid objects that do not deform (such as glasses and microphones, etc.). For flexible virtual props that can deform (such as fitness rings), if the motion capture processing method of rigid virtual props is still used, it will Resulting in distortion of the display form of flexible virtual props. Therefore, how to improve the driving effect of flexible virtual props is a goal that the industry has been pursuing.

The present disclosure provides a driving method for virtual props, including:

In the embodiment of the present disclosure, since the complete driving information of the virtual prop is composed of multiple segments of driving information, that is, each part of the flexible virtual prop is regarded as a target for driving. In this way, even when the flexible virtual prop is deformed, Next, each part will also achieve the corresponding driving effect, thus allowing the virtual props to display a complete driving effect. As a result, the display form will not be distorted due to deformation of certain parts, thereby improving the display effect of flexible virtual props in a deformed state.

The execution subject of the virtual prop driving method provided by the embodiments of the present disclosure is generally an electronic device with certain computing capabilities. The electronic device includes, for example, a terminal device or a server or other processing device. The terminal device may be a user equipment (User Equipment). UE), mobile devices, user terminals, terminals, cellular phones, cordless phones, Personal Digital Assistant (PDA), handheld devices, vehicle-mounted devices, wearable devices, etc. The server can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers. It can also be a basic cloud that provides cloud services, cloud databases, cloud computing, cloud storage, big data and artificial intelligence platforms. Cloud server for computing services. In addition, the driving method of the virtual prop can be implemented by the processor calling computer readable instructions stored in the memory.

Referring to FIG. 1 , a flow chart of a driving method for virtual props provided by an embodiment of the present disclosure is shown. The driving method for virtual props includes the following S101 to S103:

S101. Obtain multiple pieces of driving information of a virtual prop; wherein the driving information is used to drive at least one part of the virtual prop, and the virtual prop is a virtual prop capable of deformation.

For example, virtual props refer to objects that exist in a 3D scene and can interact with virtual objects. Specifically, the type of virtual props can be determined according to the specific plot involved in the specific performance content. For example, the virtual props can be fitness rings, bags, etc. In addition, the virtual props in the embodiments of the present disclosure refer to flexible virtual props that can deform, that is, the form or shape of the virtual props can change.

Wherein, the 3D scene is generated by rendering 3D scene information in a 3D rendering environment. The 3D rendering environment runs in an electronic device. The 3D scene information includes virtual object information and virtual prop information. The virtual object information is A virtual object is generated after rendering, and the virtual prop information is used to generate the virtual prop after rendering. The virtual object may include a virtual anchor or a digital person. Among them, the image of the virtual anchor can be an animation image or a cartoon image.

For example, the 3D scene information can be run on the computer CPU (Central Processing Unit, central processing unit), GPU (Graphics Processing Unit, graphics processor) and memory, which includes gridded model information and texture information. Accordingly, as an example, virtual prop information or virtual object information includes, but is not limited to, gridded model data, voxel data, and texture data, or combinations thereof. Among them, the mesh includes but is not limited to triangular mesh, quadrilateral mesh, other polygon mesh or combinations thereof. In the embodiment of the present disclosure, the mesh is a triangular mesh.

The 3D scene information is rendered in a 3D rendering environment to generate a 3D scene. The 3D rendering environment may be a 3D engine running in an electronic device, capable of generating image information based on one or more perspectives based on the data to be rendered. Virtual object information is a character model that exists in the 3D engine and can generate corresponding virtual objects after rendering. Virtual prop information is a prop model that exists in the 3D engine and can generate corresponding virtual props after rendering.

In some embodiments, one form of virtual objects is to capture the motion of an actor (the person), obtain control signals, and then drive the virtual object movements in the 3D engine. At the same time, the actor's voice is acquired, and the actor's voice is combined with the virtual object screen. Fusion to generate video data.

Similarly, one form of virtual props is to obtain motion data of real props through motion capture of real props, and then obtain driving information based on the real motion data. Among them, real props refer to the utensils used by real objects (actors) during the performance. The real props can interact with the real object to achieve the expected performance effect. In addition, for different performance scenes and content, the real props used are also different.

In some implementations, multiple optical marking points can be set on the real props in advance (for example, they can be made of reflective materials), and then the position information of each optical marking point of the real props can be captured through optical equipment, and then the position information of the real props can be obtained. Real sports data. The optical capture device includes at least one of an infrared camera, an RGB camera, and a depth camera. The embodiment of the present disclosure does not limit the type of the optical capture device.

For example, real props and virtual props are used as fitness rings as an example for explanation. As shown in Figure 2, the real props can be divided into several segments. For example, the real props fitness ring can be divided into "Segment 1" and "Segment 2". "Section", "Section 3" and "Section 4", a total of four sections. Correspondingly, the virtual prop fitness ring is also divided into four parts: A part, B part, C part and D part. Among them, each segment of the real prop corresponds one-to-one with each part of the virtual prop. That is, a motion capture device can be set up in segment 1, and the driving information of part A can be obtained through the motion capture device set in segment 1. In the same way, through The driving information obtained by the 4-segment motion capture device is used to drive the D part.

Therefore, in this embodiment, the multi-segment driving information is obtained through a motion capture device. The multi-segment driving information respectively corresponds to different target parts of the virtual prop (such as part A or part B). The motion capture device is arranged on the real prop. The corresponding position (such as segment 1 or segment 2), the corresponding position of the real prop corresponds to the target part of the virtual prop.

It should be noted that the size of the virtual props can be the same as the size of the real props, or they can be different, as long as they are in proportion.

S102. Based on the multi-segment driving information, determine the complete driving information of the virtual prop.

For example, after obtaining multiple pieces of driving information, the complete driving information of the virtual prop can be determined based on the multiple pieces of driving information. It can be understood that in order to achieve better driving effects of virtual props, constraints need to be imposed during the fusion of multi-segment driving information to prevent abnormal situations from occurring. For example, in the specific fusion process, the position data in a certain piece of driving information can be selected based on the attribute information of the virtual prop, and the rotation data can be discarded. The specific data selection in the driving information needs to be determined according to the actual situation.

Therefore, in some implementations, the multiple pieces of driving information can be fused based on the attribute information of the virtual prop to obtain the complete driving information. The attribute information of the virtual prop includes at least one of the type of the virtual prop, the deformation direction of the virtual prop, the deformation range of the virtual prop, and the structural form of the virtual prop. Among them, the structural form refers to structural characteristics and morphological characteristics.

For example, taking a fitness ring as an example, please refer to Figure 2 again. According to the type of the virtual prop, it is determined that the fitness ring can only dent inward along the F direction under the action of external force, but not in the F direction. Deformation occurs in the opposite direction. Therefore, when merging multiple segments of drive information, the data that does not meet the requirements (data opposite to the direction of F) in the drive information corresponding to part A is removed, and then fused to obtain complete drive information.

S103. Based on the complete driving information, drive the virtual props to move in the 3D scene; the 3D scene is generated by rendering the 3D scene information in the 3D rendering environment, and the 3D rendering environment runs in the electronic device. The 3D scene information includes virtual prop information, and the virtual prop information is used to generate the virtual props after rendering.

For example, after obtaining the complete driving information of the virtual prop, the virtual prop can be driven to move in the 3D scene based on the complete driving information, thereby realizing driving of the flexible virtual prop.

In the embodiment of the present disclosure, since the complete driving information of the virtual prop is composed of multiple pieces of driving information, that is, each part of the flexible virtual prop is regarded as a target for driving. In this way, even if the flexible virtual prop occurs, In the case of deformation, each part will also achieve the corresponding driving effect, so that the virtual props can display a complete driving effect, and the display form will not be distorted due to the deformation of certain parts, thereby improving the performance of flexible virtual props. Display effect under deformation state.

In some embodiments, for the above step S102, when determining the complete driving information of the virtual prop based on the multi-segment driving information, the following (1) to (2) may be included:

(1) Based on the attribute information of the virtual prop, determine the target data in the multi-segment driving information;

(2) Fit the target data in the multi-segment driving information to obtain the complete driving information.

For example, the virtual prop is a bag as an example. As shown in Figure 3, after obtaining multiple segments of drive information S1 to S6, if the multiple segments of drive information are directly fused to obtain complete drive information, the virtual prop can then be driven. Display, there will be a connection point where two adjacent pieces of driving information are connected (such as S1 and S2, S2 and S3), which will cause the strap of the bag to show the driving effect as shown in Figure 3, thus affecting the user's viewing experience. .

Therefore, in order to improve the display effect of the strap to achieve an effect similar to that of a real bag strap, the target data in the multi-segment driving information can be determined based on the attribute information of the virtual prop (bag strap), and then the multi-segment driving information can be The target data in the information is fitted to obtain the complete driving information. In this way, as shown in Figure 4, data fitting is performed through multiple segments of data (as eigenvalues), so that the target data in the two adjacent segments of driving information transitions. connection, thereby achieving the soft effect of the bag strap.

In other embodiments, as shown in FIG. 5 , for the above step S102, when determining the complete driving information of the virtual prop based on the multi-segment driving information, the following S1021 to S1024 may be included:

S1021. Based on the attribute information of the virtual prop, determine whether the data in the multi-segment driving information contains data that does not meet the preset conditions; if yes, execute step S1022; if not, execute step S1024.

S1022: Eliminate data that does not meet the preset conditions to obtain multiple pieces of target driving information.

S1023: Fusion of the multiple pieces of target drive information to obtain the complete drive information.

S1024: Fusion of the multiple pieces of driving information to obtain the complete driving information.

For example, before fusing multiple pieces of driving information, it is necessary to determine whether the data in the multiple pieces of driving information all meet the preset conditions. If the data in the multiple pieces of driving information all meet the preset conditions, step S1024 can be performed to directly merge the multiple pieces of driving information. The driving information can be fused to obtain complete driving information; if there is data that does not meet the preset conditions in the multiple segments of driving information, step S1022 needs to be performed to eliminate the data that does not meet the preset conditions to obtain multiple segments of target driving information.

It should be noted that data that does not meet the preset conditions may exist in at least one piece of the multi-piece driving information, or data that does not meet the preset conditions may exist in each piece of the multi-piece driving information.

Among them, the preset conditions can be specifically determined based on the attribute information of the virtual props, and are not limited here. For example, the noise data in each piece of driving information can be regarded as data that does not meet the preset conditions, where the noise data refers to data that is not related to the virtual props. If the virtual prop is a table tennis ball, the motion area range of the table tennis ball can be determined based on the previous frame image. At this time, if the data in the driving information includes data outside the motion area range (such as data on the ground), then the motion area range of the table tennis ball can be determined based on the previous frame image. This data is determined to be noise data and needs to be removed.

For another example, data that does not meet the preset direction can be determined as data that does not meet the preset conditions, and rotation data can also be determined as data that does not meet the preset conditions, which are not limited here.

In the embodiment of the present disclosure, before fusing multiple pieces of driving information, it is first determined whether there are If the data that does not meet the preset conditions exists, the data that does not meet the preset conditions will be eliminated first and then fused. In this way, the accuracy of the complete driving information can be improved and the driving effect of the virtual props can be further improved.

Normally, the driver information corresponding to each part of the virtual prop is obtained. However, in some cases, due to abnormalities in the motion capture device or abnormalities in the information transmission process, some parts of the virtual prop lack corresponding drivers. Information situation occurs. Therefore, in order to ensure the integrity of the complete driving information of the virtual props, in some embodiments, for the above step S102, see Figure 6, based on the multiple pieces of driving information, determine the virtual props Complete driver information can include the following S102a~S102c:

S102a. Determine whether the multi-segment driving information corresponds to the target part of the virtual prop.

For example, please refer to Figure 2 again. After obtaining the multi-segment driving information, it is necessary to determine whether the multi-segment driving information corresponds to the target part of the virtual prop. For example, whether the A target part has a corresponding 1-segment driving information. B. Whether there is a corresponding 2-segment driving information for the target part, and so on, until each target part of the virtual prop is confirmed.

S102b: In the case where at least one target part lacks corresponding driving information, determine the first driving information of at least one first target part based on at least one part of the multi-segment driving information, and the first target part is missing Corresponds to the target part of the drive information.

For example, if there is at least one target part that lacks corresponding driving information, for example, if the B target part lacks the corresponding 2-segment driving information, then the B target needs to be determined based on the existing 1-segment driving information and 3-segment driving information. The first driving information of the part (the first target part). That is, the missing driving information (first driving information) can be determined based on the pieces of driving information that have been obtained.

Therefore, when determining the first driving information of the first target part, a second target part that has a preset relationship (such as adjacent) with the first target part may be determined first, and then the determination may be based on the driving information corresponding to the second target part. First driver information.

S102c: Obtain the complete driving information based on the multiple pieces of driving information and at least one piece of the first driving information.

It can be understood that after the first driving information is determined, each target part has corresponding driving information, and the complete driving information can be obtained based on the multiple segments of driving information and at least one segment of the first driving information.

Those skilled in the art can understand that in the above-mentioned methods of specific embodiments, the writing order of each step does not mean a strict execution order and does not constitute any limitation on the implementation process. The specific execution order of each step should be based on its function and possible The internal logic is determined.

Based on the same technical concept, the embodiments of the present disclosure also provide a driving device for virtual props corresponding to the driving method of the virtual props. Since the problem-solving principle of the device in the embodiments of the present disclosure is consistent with the driving method of the virtual props described above in the embodiments of the present disclosure, are similar, so the implementation of the device can refer to the implementation of the method, and repeated details will not be repeated.

Referring to FIG. 7 , which is a schematic diagram of a virtual prop driving device 500 provided by an embodiment of the present disclosure, the device includes:

A driving information acquisition module is used to obtain multi-segment driving information of virtual props; wherein the driving information is used to drive Move at least one part of the virtual prop, and the virtual prop is a virtual prop capable of deformation;

A virtual prop driving module, used to drive the virtual props to move in the 3D scene based on the complete driving information; the 3D scene is generated by rendering the 3D scene information in the 3D rendering environment, and the 3D rendering environment runs on the electronic In the device, the 3D scene information includes virtual prop information, and the virtual prop information is used to generate the virtual props after rendering.

In a possible implementation, the driving information fusion module 502 is specifically used to:

For a description of the processing flow of each module in the device and the interaction flow between the modules, please refer to the relevant descriptions in the above method embodiments, and will not be described in detail here.

Based on the same technical concept, embodiments of the present disclosure also provide an electronic device. Referring to FIG. 8 , a schematic structural diagram of an electronic device 700 provided for an embodiment of the present disclosure includes a processor 701 , a memory 702 , and a bus 703 . Among them, the memory 702 is used to store execution instructions, including the memory 7021 and the external memory 7022; the memory 7021 here is also called the internal memory, and is used to temporarily store the operation data in the processor 701, as well as the data exchanged with the external memory 7022 such as the hard disk, The processor 701 exchanges data with the external memory 7022 through the memory 7021.

In the embodiment of the present application, the memory 702 is specifically used to store application program code for executing the solution of the present application, and is controlled by the processor 701 for execution. That is, when the electronic device 700 is running, the processor 701 and the memory 702 communicate through the bus 703, so that the processor 701 executes the application code stored in the memory 702, and then executes the method described in any of the foregoing embodiments.

Among them, the memory 702 can be, but is not limited to, random access memory (Random Access Memory, RAM), read-only memory (Read Only Memory, ROM), programmable read-only memory (Programmable Read-Only Memory, PROM), and can Erasable Programmable Read-Only Memory (EPROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), etc.

The processor 701 may be an integrated circuit chip with signal processing capabilities. The above-mentioned processor can be a general-purpose processor, including a central processing unit (CPU), a network processor (Network Processor, NP), etc.; it can also be a digital signal processor (DSP) or an application-specific integrated circuit (ASIC) , field programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components. Each method, step and logical block diagram disclosed in the embodiment of the present invention can be implemented or executed. A general-purpose processor may be a microprocessor or the processor may be any conventional processor, etc.

It can be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the electronic device 700 . In other embodiments of the present application, the electronic device 700 may include more or less components than shown in the figures, or some components may be combined, some components may be separated, or some components may be arranged differently. The components illustrated may be implemented in hardware, software, or a combination of software and hardware.

Embodiments of the present disclosure also provide a computer-readable storage medium. A computer program is stored on the computer-readable storage medium. When the computer program is run by a processor, the steps of the virtual prop driving method in the above method embodiment are executed. Wherein, the storage medium may be a volatile or non-volatile computer-readable storage medium.

Embodiments of the present disclosure also provide a computer program product. The computer program product carries program code. The instructions included in the program code can be used to execute the steps of the virtual prop driving method in the above method embodiment. For details, please refer to the above method. The embodiments will not be described again here.

Among them, the above-mentioned computer program product can be specifically implemented by hardware, software or a combination thereof. In an optional embodiment, the computer program product is embodied as a computer storage medium. In another optional embodiment, the computer program product is embodied as a software product, such as a Software Development Kit (SDK), etc. wait.

Those skilled in the art can clearly understand that for the convenience and simplicity of description, the specific working processes of the systems and devices described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be described again here. In the several embodiments provided in this disclosure, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. The device embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components may be combined or can be integrated into another system, or some features can be ignored, or not implemented. On the other hand, the coupling or direct coupling or communication connection between each other shown or discussed may be through some communication interfaces, and the indirect coupling or communication connection of the devices or units may be in electrical, mechanical or other forms.

The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place, or they may be distributed to multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in various embodiments of the present disclosure may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit.

If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a non-volatile computer-readable storage medium that is executable by a processor. Based on this understanding, the technical solution of the present disclosure is essentially or the part that contributes to the existing technology or the part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a storage medium, including Several instructions are used to cause a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in various embodiments of the present disclosure. The aforementioned storage media include: U disk, mobile hard disk, read-only memory (ROM), random access memory (Random Access Memory, RAM), magnetic disk or optical disk and other media that can store program code. .

Finally, it should be noted that the above-mentioned embodiments are only specific implementations of the present disclosure and are used to illustrate the technical solutions of the present disclosure rather than to limit them. The protection scope of the present disclosure is not limited thereto. Although refer to the foregoing The embodiments describe the present disclosure in detail. Those of ordinary skill in the art should understand that any person familiar with the technical field can still modify the technical solutions recorded in the foregoing embodiments within the technical scope disclosed in the present disclosure. Changes may be easily imagined, or equivalent substitutions may be made to some of the technical features; and these modifications, changes or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present disclosure, and shall be included in the present disclosure. within the scope of protection. Therefore, the protection scope of the present disclosure should be determined by the protection scope of the claims.

Claims

A driving method for virtual props, including:

Obtaining multiple pieces of driving information for virtual props; wherein the driving information is used to drive at least one part of the virtual props, and the virtual props are virtual props capable of deformation;

Based on the multiple pieces of driving information, determine the complete driving information of the virtual prop;

Based on the complete driving information, the virtual props are driven to move in the 3D scene; the 3D scene is generated by rendering the 3D scene information in the 3D rendering environment, the 3D rendering environment runs in the electronic device, and the 3D scene The information includes virtual prop information, which is used to generate the virtual props after rendering.
The method according to claim 1, wherein the multi-segment driving information is obtained through a motion capture device, the multi-segment driving information corresponds to different target parts of the virtual prop, and the motion capture device is arranged at a corresponding position of the real prop, The corresponding position of the real prop corresponds to the target part of the virtual prop.
The method according to claim 1, wherein determining the complete driving information of the virtual prop based on the multiple pieces of driving information includes:

Based on the attribute information of the virtual prop, the multiple pieces of driving information are fused to obtain the complete driving information.
The method according to claim 3, wherein the attribute information of the virtual prop includes the type of the virtual prop, the deformation direction of the virtual prop, the deformation range of the virtual prop, and the structural form of the virtual prop. of at least one.
The method according to claim 3, wherein the multiple pieces of driving information are fused based on the attribute information of the virtual prop to obtain the complete driving information, including:

Based on the attribute information of the virtual prop, determine whether the data in the multi-segment driving information meets the preset conditions;

Eliminate data that does not meet the preset conditions to obtain multiple segments of target drive information;

The multiple pieces of target driving information are fused to obtain the complete driving information.
The method of claim 2, wherein determining the complete driving information of the virtual prop based on the multiple segments of driving information includes:

Determine whether the multiple pieces of driving information correspond to the target part of the virtual prop;

In the case where at least one target part lacks corresponding driving information, determine first driving information of at least one first target part based on at least one part of the plurality of pieces of driving information, and the first target part lacks corresponding driving information. The target part of the information;

The complete driving information is obtained based on the plurality of pieces of driving information and at least one piece of the first driving information.
The method according to claim 3, wherein the multiple pieces of driving information are fused based on the attribute information of the virtual prop to obtain the complete driving information, including:

Based on the attribute information of the virtual prop, determine the target data in the multi-segment driving information;

The target data in the multiple segments of driving information are fitted to obtain the complete driving information.
A driving device for virtual props, including:

A driving information acquisition module, used to obtain multiple pieces of driving information of virtual props; wherein the driving information is used to drive at least one part of the virtual props, and the virtual props are virtual props capable of deformation;

A driving information fusion module, configured to determine the complete driving information of the virtual prop based on the multi-segment driving information;

A virtual prop driving module, used to drive the virtual props to move in a 3D scene based on the complete driving information; the 3D scene is generated by rendering the 3D scene information in the 3D rendering environment, and the 3D rendering environment runs on the electronic In the device, the 3D scene information includes virtual prop information, and the virtual prop information is used to generate the virtual props after rendering.
An electronic device includes: a processor, a memory and a bus. The memory stores machine-readable instructions executable by the processor. When the electronic device is running, the processor and the memory are connected via When the bus communication and the machine-readable instructions are executed by the processor, the virtual prop driving method according to any one of claims 1-7 is executed.
A computer-readable storage medium. A computer program is stored on the computer-readable storage medium. When the computer program is run by a processor, the computer program executes the virtual prop driving method according to any one of claims 1-7.
A computer program product, the computer program product carries a program code, and the instructions included in the program code can be used to execute the steps of the virtual prop driving method according to any one of claims 1 to 7.