CN115994965A

CN115994965A - Virtual object processing method, device, equipment and storage medium

Info

Publication number: CN115994965A
Application number: CN202310080511.8A
Authority: CN
Inventors: 廖昀昊
Original assignee: Beijing Zitiao Network Technology Co Ltd
Current assignee: Beijing Zitiao Network Technology Co Ltd
Priority date: 2023-01-18
Filing date: 2023-01-18
Publication date: 2023-04-21

Abstract

The embodiment of the disclosure provides a virtual object processing method, device, equipment and storage medium. The method comprises the following steps: constructing a virtual object based on a target object in the original image; wherein the virtual object is assembled by a plurality of virtual elements; layering the plurality of virtual elements according to the first position information to obtain a multi-layer virtual element group; wherein each layer of virtual element group comprises one or more virtual elements; sorting one or more virtual elements in at least part of the virtual element groups in the multi-layer virtual element groups to obtain a first sorting result; and controlling at least part of the virtual elements in the plurality of virtual elements to sequentially move to a target position in a picture according to the first sequencing result so as to assemble and generate the virtual object. According to the embodiment of the disclosure, the diversity of the virtual object presentation modes can be increased, so that the display effect is improved.

Description

Virtual object processing method, device, equipment and storage medium

Technical Field

The embodiment of the disclosure relates to the technical field of image processing, in particular to a virtual object processing method, device, equipment and storage medium.

Background

With the rapid development of mobile communication technology, mobile terminals have become one of entertainment tools, etc., which are indispensable to users. The virtual object is generated based on the user image and is one of application scenes. And virtual objects are widely used in special effect processing and virtual reality.

Conventionally, after a virtual object or a virtual model is generated, the virtual object is directly displayed on a screen as a whole. The virtual object is presented in a relatively single mode, and is lack of interest.

Disclosure of Invention

The embodiment of the disclosure provides a method, a device, equipment and a storage medium for processing a virtual object, which can increase the diversity of the presentation modes of the virtual object, thereby improving the display effect.

In a first aspect, an embodiment of the present disclosure provides a method for processing a virtual object, including: constructing a virtual object based on a target object in the original image; wherein the virtual object is assembled by a plurality of virtual elements; layering the plurality of virtual elements according to the first position information to obtain a multi-layer virtual element group; wherein each layer of virtual element group comprises one or more virtual elements; sorting one or more virtual elements in at least part of the virtual element groups in the multi-layer virtual element groups to obtain a first sorting result; and controlling at least part of the virtual elements in the plurality of virtual elements to sequentially move to a target position in a picture according to the first sequencing result so as to assemble and generate the virtual object.

In a second aspect, an embodiment of the present disclosure further provides a processing apparatus for a virtual object, including: the virtual object construction module is used for constructing a virtual object based on a target object in the original image; wherein the virtual object is assembled by a plurality of virtual elements; the virtual element layering module is used for layering the plurality of virtual elements according to the first position information to obtain a multi-layer virtual element group; wherein each layer of virtual element group comprises one or more virtual elements; the virtual element ordering module is used for ordering one or more virtual elements in at least part of the virtual element groups in the multi-layer virtual element groups to obtain a first ordering result; and the virtual element control module is used for controlling at least part of the virtual elements in the plurality of virtual elements to sequentially move to a target position in a picture according to the first sequencing result so as to assemble and generate the virtual object.

In a third aspect, embodiments of the present disclosure further provide an electronic device, including:

one or more processors;

storage means for storing one or more programs,

the one or more programs, when executed by the one or more processors, cause the one or more processors to implement a method of processing virtual objects as described in embodiments of the present disclosure.

In a fourth aspect, the disclosed embodiments also provide a storage medium containing computer-executable instructions, which when executed by a computer processor, are for performing a method of processing a virtual object as described in the disclosed embodiments.

According to the technical scheme, a virtual object is constructed based on a target object in an original image; wherein the virtual object is assembled by a plurality of virtual elements; layering the plurality of virtual elements according to the first position information to obtain a multi-layer virtual element group; wherein each layer of virtual element group comprises one or more virtual elements; sorting one or more virtual elements in at least part of the virtual element groups in the multi-layer virtual element groups to obtain a first sorting result; and controlling at least part of the virtual elements in the plurality of virtual elements to sequentially move to a target position in a picture according to the first sequencing result so as to assemble and generate the virtual object. According to the embodiment of the disclosure, the first sorting result is obtained by sorting one or more virtual elements in at least part of the virtual element groups in the multi-layer virtual element groups, and the scheme that at least part of the virtual elements in the plurality of virtual elements sequentially move to the target position in the picture according to the first sorting result is controlled, so that the diversity of the virtual object presentation mode can be increased, the interestingness of the virtual object presentation is increased, and the display effect is improved.

Drawings

The above and other features, advantages, and aspects of embodiments of the present disclosure will become more apparent by reference to the following detailed description when taken in conjunction with the accompanying drawings. The same or similar reference numbers will be used throughout the drawings to refer to the same or like elements. It should be understood that the figures are schematic and that elements and components are not necessarily drawn to scale.

Fig. 1 is a schematic flow chart of a method for processing a virtual object according to an embodiment of the disclosure;

fig. 2 is a diagram showing an effect of a virtual element in a moving process according to an embodiment of the present invention;

fig. 3 is a diagram showing an effect of another virtual element in a moving process according to an embodiment of the present invention;

FIG. 4 is a virtual object effect diagram provided by an embodiment of the present invention;

FIG. 5 is a schematic diagram of a processing apparatus for virtual objects according to an embodiment of the disclosure;

fig. 6 is a schematic structural diagram of an electronic device according to an embodiment of the disclosure.

Detailed Description

Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While certain embodiments of the present disclosure have been shown in the accompanying drawings, it is to be understood that the present disclosure may be embodied in various forms and should not be construed as limited to the embodiments set forth herein, but are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are for illustration purposes only and are not intended to limit the scope of the present disclosure.

It should be understood that the various steps recited in the method embodiments of the present disclosure may be performed in a different order and/or performed in parallel. Furthermore, method embodiments may include additional steps and/or omit performing the illustrated steps. The scope of the present disclosure is not limited in this respect.

The term "including" and variations thereof as used herein are intended to be open-ended, i.e., including, but not limited to. The term "based on" is based at least in part on. The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments. Related definitions of other terms will be given in the description below.

It should be noted that the terms "first," "second," and the like in this disclosure are merely used to distinguish between different devices, modules, or units and are not used to define an order or interdependence of functions performed by the devices, modules, or units.

It should be noted that references to "one", "a plurality" and "a plurality" in this disclosure are intended to be illustrative rather than limiting, and those of ordinary skill in the art will appreciate that "one or more" is intended to be understood as "one or more" unless the context clearly indicates otherwise.

The names of messages or information interacted between the various devices in the embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of such messages or information.

It will be appreciated that prior to using the technical solutions disclosed in the embodiments of the present disclosure, the user should be informed and authorized of the type, usage range, usage scenario, etc. of the personal information related to the present disclosure in an appropriate manner according to the relevant legal regulations.

For example, in response to receiving an active request from a user, a prompt is sent to the user to explicitly prompt the user that the operation it is requesting to perform will require personal information to be obtained and used with the user. Thus, the user can autonomously select whether to provide personal information to software or hardware such as an electronic device, an application program, a server or a storage medium for executing the operation of the technical scheme of the present disclosure according to the prompt information.

As an alternative but non-limiting implementation, in response to receiving an active request from a user, the manner in which the prompt information is sent to the user may be, for example, a popup, in which the prompt information may be presented in a text manner. In addition, a selection control for the user to select to provide personal information to the electronic device in a 'consent' or 'disagreement' manner can be carried in the popup window.

It will be appreciated that the above-described notification and user authorization process is merely illustrative and not limiting of the implementations of the present disclosure, and that other ways of satisfying relevant legal regulations may be applied to the implementations of the present disclosure.

It will be appreciated that the data (including but not limited to the data itself, the acquisition or use of the data) involved in the present technical solution should comply with the corresponding legal regulations and the requirements of the relevant regulations.

Fig. 1 is a schematic flow chart of a processing method of a virtual object provided by an embodiment of the present disclosure, where the embodiment of the present disclosure is applicable to a case where the virtual object is displayed in a screen after the virtual object is generated, and the method may be performed by a processing apparatus of the virtual object, where the apparatus may be implemented in a form of software and/or hardware, and optionally, may be implemented by an electronic device, where the electronic device may be a mobile terminal, a PC side, a server, or the like.

As shown in fig. 1, the method includes:

s110, constructing a virtual object based on the target object in the original image.

The virtual object is assembled by a plurality of virtual elements, and the virtual elements are virtual three-dimensional polyhedrons, for example, may be: virtual cuboids, virtual prisms, etc. to assemble virtual objects with a "building block" style. The original image may be an image stored locally by the electronic device or may be an image captured by the electronic device. Electronic devices may include, but are not limited to, cell phones, tablet computers, smart cameras, and servers. The target object may be a person, an animal, or the like in the original image. For the virtual object, if the target object is a person, the virtual object may be a person in a 'building block' style, and if different target objects, the corresponding virtual objects are different.

Specifically, a plurality of virtual elements are generated based on the target object, and each virtual element comprises a corresponding splicing mode. And reading the corresponding splicing mode of each virtual element, and assembling a plurality of virtual elements according to the corresponding splicing mode to generate the virtual object in real time.

S120, layering the plurality of virtual elements according to the first position information to obtain a multi-layer virtual element group.

The first position information is position information of a plurality of virtual elements in a first coordinate system. Wherein each layer of virtual element group comprises one or more virtual elements. The first coordinate system may be a world coordinate system. Specifically, the position information of each virtual element in the model space is converted into the position information in the first coordinate system, the first position information of each virtual element in the first coordinate system is obtained, and the plurality of virtual elements are divided into multiple layers according to the first position information, so that a multi-layer virtual element group is obtained.

Optionally, the layering manner of the plurality of virtual elements according to the first location information may be: determining a position interval where the virtual object is located according to the first position information; dividing the position interval into a plurality of layers of subintervals according to a first set step length; dividing the plurality of virtual elements into corresponding subintervals according to the first position information.

Wherein the location interval is characterized by an interval of the first component of the first location information. The first component may be a coordinate y or a coordinate x in the first coordinate system. The first set step may be a length of a position interval of a set multiple, and the first set step is a positive number. The multiple is set to a positive number less than 1, such as 0.2. The length of the location interval can be obtained as follows: the maximum value of the location interval is subtracted from the minimum value of the location interval. If the first component is represented by a coordinate y in the first coordinate system, the height of each layer of virtual element group is a first set step length, and if the first component is represented by a coordinate x in the first coordinate system, the width of each layer of virtual element group is a first set step length.

Specifically, in the first position information corresponding to the plurality of virtual elements, the maximum value and the minimum value of the first component of the first position information are determined, and the position interval where the virtual object is located is determined according to the maximum value and the minimum value of the first component. Based on the first set step length, dividing the position interval into multiple layers of subintervals, namely, one subinterval corresponds to one layer, and the step length of each subinterval is the same. For example, if the location interval is [5, 10], and the first set step size is 1, the corresponding multi-layer subintervals may be respectively: [5,6], [6,7], [7,8], [8,9] and [9, 10]. After the multi-layer subinterval is obtained, each virtual element is divided into corresponding subintervals according to the first component of the first position information.

According to the embodiment, the position interval where the virtual object is located is determined according to the first position information, the position interval is divided into multiple layers of subintervals according to the first set step length, and the multiple virtual elements are divided into the corresponding subintervals according to the first position information, so that the multiple virtual elements can be accurately divided into the corresponding subintervals, layering of the virtual elements can be accurately achieved, and the virtual object can be conveniently presented according to the subintervals to which the virtual elements belong.

S130, sorting one or more virtual elements in at least part of the virtual element groups in the multi-layer virtual element groups to obtain a first sorting result.

In this embodiment, the sorting method may be any sorting method, for example, sorting the virtual elements in the virtual element group based on random numbers, angle information and distance information. The angle information may be determined according to first position information of the virtual element, and the distance information may be determined according to the first position information and an origin of the first coordinate system. In this embodiment, the ordering manners of the virtual elements in each layer may be the same or different, and the ordering manner of the virtual elements in each layer is not limited in this embodiment. The sorting result may be a result corresponding to an ascending order or a result corresponding to a descending order.

It should be noted that, one or more virtual elements in each layer of virtual element group may be ordered; one or more virtual elements in a partial virtual element group in the multi-layer virtual element group may also be ordered, and virtual elements in another partial virtual element group may not be ordered.

Optionally, sorting one or more virtual elements in at least part of the virtual element groups in the multi-layer virtual element group includes: for at least part of the virtual element groups, generating a random number for one or more virtual elements in the virtual element groups respectively; and sorting one or more virtual elements in the virtual element group according to the random numbers.

In this embodiment, for at least a part of the virtual element group, a corresponding random number may be generated for each virtual element by a random number generation algorithm. Since each random number is different, the virtual elements in the virtual element group may be arranged in ascending or descending order according to the random number.

According to the embodiment, the virtual elements in the virtual element group are ordered according to the random number, and the ordering result is obtained, so that the virtual elements are convenient to assemble based on the ordering result, and meanwhile, each virtual element in the virtual element group is randomly presented, and the display effect of the virtual object is improved.

Optionally, the manner of ordering one or more virtual elements in at least part of the virtual element groups in the multi-layer virtual element group may be: for at least part of the virtual element group, acquiring a second component and a third component in the first position information of one or more virtual elements in the virtual element group; determining angle information and/or distance information corresponding to the virtual element according to the second component and the third component; one or more virtual elements in the set of virtual elements are ordered based on the angle information and/or distance information.

Wherein for the second component and the third component, if the first component is characterized by a coordinate y in the first coordinate system, the second component is characterized by a coordinate x in the first coordinate system, and the third component is characterized by a coordinate z in the first coordinate system. The coordinates corresponding to the first component, the second component and the third component are different.

Specifically, for at least part of the virtual element group, a second component and a third component in the first position information of one or more virtual elements in the virtual element group are acquired, the ratio of the second component to the third component is arctangent, angle information corresponding to the virtual elements is acquired, distance information between each virtual element and the origin of the first coordinate system can be determined according to the second component and the third component, and one or more virtual elements in the virtual element group are arranged in ascending order or descending order based on the angle information and/or the distance information.

In this embodiment, the angle information corresponding to the virtual element is determined by the second component and the third component in the first position information of the virtual element, and one or more virtual elements in the virtual element group are ordered according to the angle information and/or the distance information, and the ordering result is obtained, so that the virtual elements are convenient to assemble based on the ordering result.

Optionally, sorting one or more virtual elements in the virtual element group based on the angle information and/or the distance information includes: sorting one or more virtual elements in the virtual element group according to the angle information; and secondly ordering one or more virtual elements in the virtual element group based on the distance information.

In this embodiment, the algorithm used for the secondary sorting may be any stable sorting algorithm, such as a merge sorting algorithm. In this embodiment, if one or more virtual elements in the virtual element group are ordered according to the angle information and one or more virtual elements in the virtual element group are arranged in ascending order, the virtual elements in the virtual element group may be presented in a clockwise manner. If one or more virtual elements in the virtual element group are ordered according to the angle information and one or more virtual elements in the virtual element group are arranged in a descending order, the virtual elements in the virtual element group may be presented in a counterclockwise manner. If one or more virtual elements in the virtual element group are ordered according to the distance information and one or more virtual elements in the virtual element group are arranged in ascending or descending order, the virtual elements in the virtual element group may be presented in an irregularly shaped manner. If one or more virtual elements in the virtual element group are ordered according to the angle information and the distance information, namely, one or more virtual elements in the virtual element group are ordered secondarily based on the distance information, the virtual elements in the virtual element group can be presented in a spiral shape mode, and the display effect of the virtual object is improved.

Optionally, the manner of secondarily ordering one or more virtual elements in the virtual element group based on the distance information may be: determining a distance interval where the virtual element group is located according to the distance information; dividing the distance interval into a plurality of sub-distance intervals according to a second set step length; dividing the ordered virtual elements into corresponding sub-distance intervals according to the distance information; the sub-distance intervals dividing the virtual elements are ordered.

In this embodiment, the maximum distance and the minimum distance may be obtained by determining the distance information between each virtual element and the origin of the first coordinate system, and determining the distance interval corresponding to the virtual element of the virtual element group according to the minimum distance and the maximum distance, and dividing the distance interval into a plurality of sub-distance intervals according to the second set step length, where the second set step length may be understood as the length of the sub-distance interval, and the length of each sub-distance interval is the second set step length, and the length of the sub-distance interval may be obtained by: for the current sub-distance interval, the maximum value of the sub-distance interval is subtracted from the minimum value of the sub-distance interval. After a plurality of sub-distance intervals are obtained, dividing the ordered virtual elements into corresponding sub-distance intervals according to the distance information, and then secondarily ordering the virtual elements in the sub-distance intervals.

In this embodiment, the virtual elements in the sub-distance interval are secondarily ordered by adopting a stable ordering algorithm, so that after the virtual elements in the sub-distance interval are ordered based on the angle information (primary ordering), the relative positional relationship between the virtual elements obtained by the primary ordering can be still maintained by the ordering result obtained by secondarily ordering the virtual elements in the sub-distance interval.

In this embodiment, if the manner of ordering the virtual elements in the virtual element group based on the angle information is ascending, and the manner of ordering the virtual elements in the sub-distance interval twice is ascending, each virtual element in the virtual element group may be presented in a spiral manner from inside to outside and clockwise; if the manner of ordering the virtual elements in the virtual element group based on the angle information is ascending, and the manner of ordering the virtual elements in the sub-distance interval secondarily is descending, each virtual element in the virtual element group can be presented in a spiral manner from outside to inside and clockwise; if the manner of ordering the virtual elements in the virtual element group based on the angle information is descending order and the manner of ordering the virtual elements in the sub-distance section secondarily is ascending order, each virtual element in the virtual element group can be presented in a spiral manner from inside to outside and anticlockwise; if the manner of ordering the virtual elements in the virtual element group based on the angle information is descending order and the manner of ordering the virtual elements in the sub-distance section secondarily is descending order, each virtual element in the virtual element group can be presented in a spiral manner from outside to inside and anticlockwise, so that the display effect of the virtual object is improved.

And S140, controlling at least part of the virtual elements in the plurality of virtual elements to sequentially move to a target position in the picture according to the first sequencing result so as to assemble and generate the virtual object.

Wherein at least part of the virtual elements may be understood as virtual elements ordered within a virtual element group. The target position may be a position set in advance for each virtual element.

Optionally, after obtaining the multi-layer virtual element group, the method further includes the following steps: and sequencing the multi-layer virtual element group to obtain a second sequencing result.

In this embodiment, a location interval corresponding to the virtual object may be determined according to the first location information, after the multiple virtual elements are layered, each virtual element group of the multiple layers has a corresponding subinterval, and the multiple virtual element groups may be arranged in ascending order or descending order according to the subintervals, so as to obtain a second ordering result between the multiple virtual element groups.

Correspondingly, the method for controlling at least part of the virtual elements to sequentially move to the target position in the picture according to the first sorting result so as to assemble and generate the virtual object may be as follows: and controlling at least part of the virtual elements in the plurality of virtual elements to sequentially move to a target position in the picture according to the first sorting result and/or the second sorting result so as to assemble and generate the virtual object.

In this embodiment, in the process of displaying the virtual object on the screen, the virtual element group may be controlled to move according to the second sorting result (the sequence between layers), that is, after all the virtual elements in the previous layer are assembled, the virtual elements in the next layer are assembled. And for the virtual elements in the virtual element group, controlling the virtual elements to sequentially move to a target position in the picture according to a first sequencing result corresponding to the virtual element group so as to assemble the virtual elements in the virtual element group.

Optionally, the process of controlling at least some virtual elements of the plurality of virtual elements to sequentially move to the target position in the frame according to the first ordering result and/or the second ordering result may be: and controlling the multi-layer virtual element group to sequentially move in the picture according to the second sorting result: if the virtual elements in the virtual element group are not ordered, controlling one or more virtual elements in the virtual element group to move to corresponding target positions on the picture at the same time; and if the virtual elements in the arranged virtual element group are ordered, controlling one or more virtual elements in the virtual element group to sequentially move to corresponding target positions on the picture according to the first ordering result.

In this embodiment, one or more virtual elements in each layer of virtual element group may be ordered; one or more virtual elements in a partial virtual element group may also be ordered, and virtual elements in another partial virtual element group may not be ordered. The order among the virtual element groups may be determined based on the second ranking result, and for the virtual elements within a group, the order of the virtual elements may be determined based on the first ranking result.

Specifically, after determining the order among the virtual element groups according to the second sorting result, the virtual elements in each virtual element group are sequentially controlled to move in the picture. When the virtual elements in the virtual element group are not ordered, one or more virtual elements in the virtual element group are controlled to move to corresponding target positions on the screen at the same time. And when the virtual elements in the arranged virtual element groups are ordered, controlling one or more virtual elements in the virtual element groups to sequentially move to corresponding target positions on the picture according to the first ordering result.

In this embodiment, the virtual elements in the partial virtual element groups are ordered, so that when the virtual objects are displayed, the virtual elements in the partial layers sequentially move according to a determined order, and the virtual elements in the partial layers integrally move, thereby improving the diversity of virtual object display.

Optionally, controlling the plurality of virtual elements to sequentially move to a target position in the frame according to the first sorting result and/or the second sorting result, so as to assemble and generate the virtual object, including: for each frame, acquiring a timestamp of the current frame; determining a virtual element displayed in the current frame according to at least one of the timestamp, the first sorting result and the second sorting result as a target virtual element; determining second location information of the target virtual element; rendering the target virtual element according to the second position information.

Wherein the second position information is the position information of the target virtual element in the screen. It should be noted that, for the form of presenting the virtual object, the presentation process from the first virtual element to the last virtual element in the virtual object may be understood as a video, and the playing frame of the video may be the following presentation process: first, the virtual elements of the first layer drop to the target position in the screen from top to bottom in order according to the second sorting result. Fig. 2 is a diagram showing an effect of a virtual element in a moving process according to an embodiment of the present invention. The lower virtual element is a virtual element which is assembled and stops moving, namely a stacked virtual element; the upper virtual element is a virtual element that does not stop moving, i.e., the upper virtual element is in the process of falling to the target position. Next, the virtual elements of the second layer sequentially fall to the target position from top to bottom in the frame according to the second sorting result, as shown in fig. 3, fig. 3 is a view showing the effect of another virtual element in the moving process provided in the embodiment of the present invention, and it can be seen that the upper virtual element in fig. 2 becomes the virtual element stopping moving in fig. 3, and the new upper virtual element is in the process of falling to the target position. And so on until the last virtual element of the last layer moves to the target position, all the virtual elements are assembled, and finally a complete virtual object is presented. As shown in fig. 4, fig. 4 is a virtual object effect diagram provided in an embodiment of the present invention.

In this embodiment, the timestamp of the current frame may be understood as the time of the current frame in the virtual object video, for example, the virtual object video duration is 20 minutes, and if the video frame of the 10 th minute is taken as the current frame, the timestamp of the corresponding current frame may be 10 minutes.

In this embodiment, for each frame, the timestamp of the current frame is obtained, the virtual element displayed in the current frame is determined according to at least one of the timestamp, the first ordering result and the second ordering result, and is used as the target virtual element, the second position information of the target virtual element in the screen is determined, and the rendering of multiple virtual elements can be accurately and effectively implemented according to the manner of rendering the target virtual element according to the second position information, so that the display of the virtual element in each frame can be implemented.

Optionally, determining the virtual element displayed in the current frame according to at least one of the timestamp, the first sorting result and the second sorting result may be as follows: setting time intervals of the entering pictures of the virtual elements; determining the time stamps of the incoming pictures of the virtual elements according to the time interval, the first sorting result and the second sorting result; a virtual element having an incoming picture timestamp earlier than the timestamp of the current frame is determined as the target virtual element.

The time interval may be any duration, such as 0.1 seconds, 0.2 seconds, etc. For example, if the time interval is 0.1 seconds, the previous virtual element enters the screen for 0.1 seconds, then the current virtual element enters the screen again, and after the current virtual element enters the screen for 0.1 seconds, the next virtual element enters the screen again.

Specifically, the time interval of entering the screen picture by the plurality of virtual elements is set, and the time stamp of the entering picture of each virtual element can be determined according to the time interval and the sorting result. For example, the incoming picture timestamp of the first virtual element is 0, the incoming picture timestamp of the second virtual element is 0.1, the incoming picture timestamp of the third virtual element is 0.2 seconds, and so on, the incoming picture timestamp of each virtual element can be determined. After determining the incoming frame time stamp of the plurality of virtual elements, determining the virtual element with the incoming frame time stamp earlier than the time stamp of the current frame as the target virtual element, namely, the virtual element with the incoming frame time stamp earlier than the time stamp of the current frame already enters the display frame of the current frame, wherein the virtual element may be in a state of stopping movement in the falling process. The virtual element having an incoming picture time stamp later than the time stamp of the current frame does not enter the display picture of the current frame. The virtual element having an incoming picture timestamp equal to the timestamp of the current frame is at the initial position (top) in the display picture of the incoming current frame.

According to the method, the device and the system, the incoming picture time stamp of the virtual elements is determined according to the time interval, the first sorting result and the second sorting result, and the virtual element with the incoming picture time stamp earlier than the time stamp of the current frame is determined as the target virtual element, so that the target virtual element in the display picture of the current frame can be effectively and accurately determined.

Optionally, the manner of determining the second location information of the target virtual element may be: configuring a desired movement duration of the plurality of virtual elements; for the virtual element stopped moving, determining a target position of the virtual element as second position information; for a virtual element that does not stop moving, second position information of the virtual element is determined according to at least one of an incoming screen time stamp of the virtual element, a time stamp of a current frame, a desired movement duration, and a target position.

Wherein the target virtual element includes a virtual element that stops moving and a virtual element that does not stop moving. A virtual element that does not stop movement may be understood as a virtual element during movement (drop). A virtual element that stops moving may be understood as a virtual element that has been assembled. Wherein the target position may be position information in the model space.

The desired movement duration may be understood as a movement duration of the virtual element from the top to the initial position in the screen to the target position.

Specifically, a desired time length of each virtual element is configured, for the virtual element stopped moving, the target position of the virtual element is determined as second position information, and the virtual element stopped moving in the previous frame is still in a state of stopped moving in the screen in the current frame. The second position information for the virtual element in the current frame that does not stop moving may be determined according to the following manner: the time stamp of the entering picture of the current virtual element of the current frame is T1, the time stamp of the current frame is T2, the expected moving time length is T, the distance from the initial position of the entering picture to the target position of the current virtual element is L, the time length of the moving of the current virtual element from the initial position of the entering picture to the second position information can be obtained by subtracting T2 from T1, and the distance from the initial position of the entering picture to the second position information is x, and then x can be determined by the following method:

(x)/(T2-T1)＝L/T；

after determining the distance from the initial position of the entry screen to the second position information of the current virtual element, the second position information of the current virtual element may be determined according to the distance from the initial position of the entry screen to the second position information of the current virtual element.

In this embodiment, for the virtual element stopped moving, the target position of the virtual element is determined as the second position information; for the virtual element that does not stop moving, the second position information of each target virtual element in the display screen (or referred to as screen) can be effectively and accurately determined by determining the second position information of the virtual element according to at least one of the entry screen time stamp of the virtual element, the time stamp of the current frame, the expected movement time length, and the target position.

Fig. 5 is a schematic structural diagram of a processing apparatus for virtual objects according to an embodiment of the present disclosure, where, as shown in fig. 5, the apparatus includes: virtual object construction module 210, virtual element layering module 220, virtual element second ordering module 230, and virtual element control module 240.

A virtual object construction module 210 constructing a virtual object based on a target object in the original image; wherein the virtual object is assembled by a plurality of virtual elements;

the virtual element layering module 220 performs layering on the plurality of virtual elements according to the first position information to obtain a multi-layer virtual element group; wherein each layer of virtual element group comprises one or more virtual elements;

the virtual element ordering module 230 orders one or more virtual elements in at least part of the virtual element groups in the multi-layer virtual element groups to obtain a first ordering result;

the virtual element control module 240 controls at least some virtual elements of the plurality of virtual elements to sequentially move to a target position in the frame according to the first sorting result, so as to assemble and generate the virtual object.

According to the technical scheme, a virtual object is constructed based on a target object in an original image through a virtual object construction module; wherein the virtual object is assembled by a plurality of virtual elements; layering the plurality of virtual elements according to the first position information through a virtual element layering module to obtain a multi-layer virtual element group; wherein each layer of virtual element group comprises one or more virtual elements; sorting one or more virtual elements in at least part of the virtual element groups in the multi-layer virtual element groups by a virtual element second sorting module to obtain a first sorting result; and controlling at least part of the virtual elements in the plurality of virtual elements to sequentially move to a target position in a picture according to the first sequencing result by a virtual element control module so as to assemble and generate the virtual object. According to the embodiment of the disclosure, the first sorting result is obtained by sorting one or more virtual elements in at least part of the virtual element groups in the multi-layer virtual element groups, and the scheme that at least part of the virtual elements in the plurality of virtual elements sequentially move to the target position in the picture according to the first sorting result is controlled, so that the diversity of the virtual object presentation mode can be increased, the interestingness of the virtual object presentation is increased, and the display effect is improved.

Optionally, the virtual element layering module is specifically configured to: determining a position interval where the virtual object is located according to the first position information; wherein the location interval is characterized by an interval of a first component of the first location information; dividing the position interval into a plurality of layers of subintervals according to a first set step length; dividing the plurality of virtual elements into corresponding subintervals according to the first position information.

Optionally, the virtual element ordering module is specifically configured to: for at least part of the virtual element group, acquiring a second component and a third component in the first position information of one or more virtual elements in the virtual element group; determining angle information and/or distance information corresponding to the virtual element according to the second component and the third component; one or more virtual elements in the set of virtual elements are ordered based on the angle information and/or distance information.

Optionally, the virtual element ordering module is further configured to: sorting one or more virtual elements in the virtual element group according to the angle information; and secondly ordering one or more virtual elements in the virtual element group based on the distance information.

Optionally, the virtual element ordering module is further configured to: determining a distance interval where the virtual element group is located according to the distance information; dividing the distance interval into a plurality of sub-distance intervals according to a second set step length; dividing the ordered virtual elements into corresponding sub-distance intervals according to the distance information; the sub-distance intervals dividing the virtual elements are ordered.

Optionally, the virtual element ordering module is further configured to: for at least part of the virtual element groups, generating a random number for one or more virtual elements in the virtual element groups respectively; and sorting one or more virtual elements in the virtual element group according to the random numbers.

Optionally, the method further comprises: a virtual element group ordering module, configured to: and sequencing the multi-layer virtual element group to obtain a second sequencing result.

Optionally, the virtual element control module is specifically configured to:

and controlling at least part of the virtual elements in the plurality of virtual elements to sequentially move to a target position in a picture according to the first sorting result and/or the second sorting result so as to assemble and generate the virtual object.

Optionally, the virtual element control module is specifically configured to:

And controlling the multi-layer virtual element group to sequentially move in the picture according to the second sorting result:

if the virtual elements in the virtual element group are not ordered, controlling one or more virtual elements in the virtual element group to move to corresponding target positions on the picture at the same time;

and if the virtual elements in the arranged virtual element groups are ordered, controlling one or more virtual elements in the virtual element groups to sequentially move to corresponding target positions on the picture according to the first ordering result.

Optionally, the virtual element control module is specifically configured to: for each frame, acquiring a timestamp of the current frame; determining a virtual element displayed in the current frame according to at least one of the timestamp, the first sorting result and the second sorting result as a target virtual element; determining second location information of the target virtual element; the second position information is the position information of the target virtual element in a screen; and rendering the target virtual element according to the second position information.

Optionally, the virtual element control module is further configured to: setting time intervals of the incoming pictures of the plurality of virtual elements; determining the time stamps of the incoming pictures of the virtual elements according to the time interval, the first sorting result and the second sorting result; and determining the virtual element with the time stamp of the incoming picture earlier than the time stamp of the current frame as a target virtual element.

Optionally, the target virtual element includes a virtual element that stops moving and a virtual element that does not stop moving, and the virtual element control module is further configured to: comprising the following steps: configuring a desired movement duration of the plurality of virtual elements; for a virtual element stopped moving, determining a target position of the virtual element as second position information; for a virtual element that does not stop moving, determining second position information of the virtual element according to at least one of an incoming screen time stamp of the virtual element, a time stamp of the current frame, the expected movement duration, and the target position.

The virtual object processing device provided by the embodiment of the disclosure can execute the virtual object processing method provided by any embodiment of the disclosure, and has the corresponding functional modules and beneficial effects of the execution method.

It should be noted that each unit and module included in the above apparatus are only divided according to the functional logic, but not limited to the above division, so long as the corresponding functions can be implemented; in addition, the specific names of the functional units are also only for convenience of distinguishing from each other, and are not used to limit the protection scope of the embodiments of the present disclosure.

Fig. 6 is a schematic structural diagram of an electronic device according to an embodiment of the disclosure. Referring now to fig. 6, a schematic diagram of an electronic device (e.g., a terminal device or server in fig. 6) 500 suitable for use in implementing embodiments of the present disclosure is shown. The terminal devices in the embodiments of the present disclosure may include, but are not limited to, mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), in-vehicle terminals (e.g., in-vehicle navigation terminals), and the like, and stationary terminals such as digital TVs, desktop computers, and the like. The electronic device shown in fig. 6 is merely an example and should not be construed to limit the functionality and scope of use of the disclosed embodiments.

As shown in fig. 6, the electronic device 500 may include a processing means (e.g., a central processing unit, a graphics processor, etc.) 501, which may perform various appropriate actions and processes according to a program stored in a Read Only Memory (ROM) 502 or a program loaded from a storage means 508 into a Random Access Memory (RAM) 503. In the RAM503, various programs and data required for the operation of the electronic apparatus 500 are also stored. The processing device 501, the ROM502, and the RAM503 are connected to each other via a bus 504. An edit/output (I/O) interface 505 is also connected to bus 504.

In general, the following devices may be connected to the I/O interface 505: input devices 506 including, for example, a touch screen, touchpad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; an output device 507 including, for example, a Liquid Crystal Display (LCD), a speaker, a vibrator, and the like; storage 508 including, for example, magnetic tape, hard disk, etc.; and communication means 509. The communication means 509 may allow the electronic device 500 to communicate with other devices wirelessly or by wire to exchange data. While fig. 6 shows an electronic device 500 having various means, it is to be understood that not all of the illustrated means are required to be implemented or provided. More or fewer devices may be implemented or provided instead.

In particular, according to embodiments of the present disclosure, the processes described above with reference to flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a non-transitory computer readable medium, the computer program comprising program code for performing the method shown in the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network via the communication means 509, or from the storage means 508, or from the ROM 502. The above-described functions defined in the methods of the embodiments of the present disclosure are performed when the computer program is executed by the processing device 501.

The electronic device provided by the embodiment of the present disclosure and the method for processing a virtual object provided by the foregoing embodiment belong to the same inventive concept, and technical details not described in detail in the present embodiment may be referred to the foregoing embodiment, and the present embodiment has the same beneficial effects as the foregoing embodiment.

The embodiment of the present disclosure provides a computer storage medium having stored thereon a computer program which, when executed by a processor, implements the method for processing a virtual object provided by the above embodiment.

It should be noted that the computer readable medium described in the present disclosure may be a computer readable signal medium or a computer readable storage medium, or any combination of the two. The computer readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples of the computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this disclosure, a computer-readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In the present disclosure, however, the computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, with the computer-readable program code embodied therein. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, fiber optic cables, RF (radio frequency), and the like, or any suitable combination of the foregoing.

In some implementations, the clients, servers may communicate using any currently known or future developed network protocol, such as HTTP (HyperTextTransfer Protocol ), and may be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), the internet (e.g., the internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future developed networks.

The computer readable medium may be contained in the electronic device; or may exist alone without being incorporated into the electronic device.

The computer readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to: constructing a virtual object based on a target object in the original image; wherein the virtual object is assembled by a plurality of virtual elements; layering the plurality of virtual elements according to the first position information to obtain a multi-layer virtual element group; wherein each layer of virtual element group comprises one or more virtual elements; sorting one or more virtual elements in at least part of the virtual element groups in the multi-layer virtual element groups to obtain a first sorting result; and controlling at least part of the virtual elements in the plurality of virtual elements to sequentially move to a target position in a picture according to the first sequencing result so as to assemble and generate the virtual object.

Computer program code for carrying out operations of the present disclosure may be written in one or more programming languages, including, but not limited to, an object oriented programming language such as Java, smalltalk, C ++ and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (for example, through the Internet using an Internet service provider).

The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

The units involved in the embodiments of the present disclosure may be implemented by means of software, or may be implemented by means of hardware. The name of the unit does not in any way constitute a limitation of the unit itself, for example the first acquisition unit may also be described as "unit acquiring at least two internet protocol addresses".

The functions described above herein may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: a Field Programmable Gate Array (FPGA), an Application Specific Integrated Circuit (ASIC), an Application Specific Standard Product (ASSP), a system on a chip (SOC), a Complex Programmable Logic Device (CPLD), and the like.

In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. The machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

The foregoing description is only of the preferred embodiments of the present disclosure and description of the principles of the technology being employed. It will be appreciated by persons skilled in the art that the scope of the disclosure referred to in this disclosure is not limited to the specific combinations of features described above, but also covers other embodiments which may be formed by any combination of features described above or equivalents thereof without departing from the spirit of the disclosure. Such as those described above, are mutually substituted with the technical features having similar functions disclosed in the present disclosure (but not limited thereto).

Moreover, although operations are depicted in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order. In certain circumstances, multitasking and parallel processing may be advantageous. Likewise, while several specific implementation details are included in the above discussion, these should not be construed as limiting the scope of the present disclosure. Certain features that are described in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment can also be implemented in multiple embodiments separately or in any suitable subcombination.

Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are example forms of implementing the claims.

Claims

1. A method for processing a virtual object, comprising:

constructing a virtual object based on a target object in the original image; wherein the virtual object is assembled by a plurality of virtual elements;

layering the plurality of virtual elements according to the first position information to obtain a multi-layer virtual element group; wherein each layer of virtual element group comprises one or more virtual elements;

sorting one or more virtual elements in at least part of the virtual element groups in the multi-layer virtual element groups to obtain a first sorting result;

and controlling at least part of the virtual elements in the plurality of virtual elements to sequentially move to a target position in a picture according to the first sequencing result so as to assemble and generate the virtual object.

2. The method of claim 1, wherein layering the plurality of virtual elements according to the first location information comprises:

Determining a position interval where the virtual object is located according to the first position information; wherein the location interval is characterized by an interval of a first component of the first location information;

dividing the position interval into a plurality of layers of subintervals according to a first set step length;

dividing the plurality of virtual elements into corresponding subintervals according to the first position information.

3. The method of claim 1, wherein ordering one or more virtual elements of at least a portion of the set of virtual elements in the set of multi-layer virtual elements comprises:

for at least part of the virtual element group, acquiring a second component and a third component in the first position information of one or more virtual elements in the virtual element group;

determining angle information and/or distance information corresponding to the virtual element according to the second component and the third component;

one or more virtual elements in the set of virtual elements are ordered based on the angle information and/or distance information.

4. A method according to claim 3, wherein ordering one or more virtual elements of the set of virtual elements based on the angle information and/or distance information comprises:

Sorting one or more virtual elements in the virtual element group according to the angle information;

and secondly ordering one or more virtual elements in the virtual element group based on the distance information.

5. The method of claim 4, wherein secondarily ordering one or more virtual elements of the set of virtual elements based on the distance information comprises:

determining a distance interval where the virtual element group is located according to the distance information;

dividing the distance interval into a plurality of sub-distance intervals according to a second set step length;

dividing the ordered virtual elements into corresponding sub-distance intervals according to the distance information;

the sub-distance intervals dividing the virtual elements are ordered.

6. The method of claim 1, wherein ordering one or more virtual elements of at least a portion of the set of virtual elements in the set of multi-layer virtual elements comprises:

for at least part of the virtual element groups, generating a random number for one or more virtual elements in the virtual element groups respectively;

and sorting one or more virtual elements in the virtual element group according to the random numbers.

7. The method of claim 1, further comprising, after obtaining the set of multi-layer virtual elements:

sequencing the multi-layer virtual element group to obtain a second sequencing result;

controlling at least part of the virtual elements to move to a target position in the picture in turn according to the first sorting result so as to assemble and generate the virtual object, wherein the method comprises the following steps:

8. The method of claim 7, wherein controlling at least some of the plurality of virtual elements to move to a target location in the frame in order of the first ordering result and/or the second ordering result comprises:

9. The method of claim 7, wherein controlling the plurality of virtual elements to sequentially move to a target position in a frame according to the first ordering result and/or the second ordering result to assemble and generate the virtual object comprises:

for each frame, acquiring a timestamp of the current frame;

determining a virtual element displayed in the current frame according to at least one of the timestamp, the first sorting result and the second sorting result as a target virtual element;

determining second location information of the target virtual element; the second position information is the position information of the target virtual element in a screen;

and rendering the target virtual element according to the second position information.

10. The method of claim 9, wherein determining a virtual element displayed at the current frame as a target virtual element based on at least one of the timestamp, the first ordering result, and the second ordering result, comprises:

Setting time intervals of the incoming pictures of the plurality of virtual elements;

determining the time stamps of the incoming pictures of the virtual elements according to the time interval, the first sorting result and the second sorting result;

and determining the virtual element with the time stamp of the incoming picture earlier than the time stamp of the current frame as a target virtual element.

11. The method of claim 9, wherein the target virtual element comprises a stopped virtual element and a virtual element that does not stop moving, and determining the second location information of the target virtual element comprises:

configuring a desired movement duration of the plurality of virtual elements;

for a virtual element stopped moving, determining a target position of the virtual element as second position information;

for a virtual element that does not stop moving, determining second position information of the virtual element according to at least one of an incoming screen time stamp of the virtual element, a time stamp of the current frame, the expected movement duration, and the target position.

12. A processing apparatus for a virtual object, comprising:

the virtual object construction module is used for constructing a virtual object based on a target object in the original image; wherein the virtual object is assembled by a plurality of virtual elements;

The virtual element layering module is used for layering the plurality of virtual elements according to the first position information to obtain a multi-layer virtual element group; wherein each layer of virtual element group comprises one or more virtual elements;

the virtual element ordering module is used for ordering one or more virtual elements in at least part of the virtual element groups in the multi-layer virtual element groups to obtain a first ordering result;

and the virtual element control module is used for controlling at least part of the virtual elements in the plurality of virtual elements to sequentially move to a target position in a picture according to the first sequencing result so as to assemble and generate the virtual object.

13. An electronic device, the electronic device comprising:

one or more processors;

storage means for storing one or more programs,

the one or more programs, when executed by the one or more processors, cause the one or more processors to implement the method of processing virtual objects of any of claims 1-11.

14. A storage medium containing computer executable instructions which, when executed by a computer processor, are for performing the method of processing a virtual object as claimed in any one of claims 1 to 11.