CN111614967A - Live virtual image broadcasting method and device, electronic equipment and storage medium - Google Patents
Live virtual image broadcasting method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN111614967A CN111614967A CN201911358983.5A CN201911358983A CN111614967A CN 111614967 A CN111614967 A CN 111614967A CN 201911358983 A CN201911358983 A CN 201911358983A CN 111614967 A CN111614967 A CN 111614967A
- Authority
- CN
- China
- Prior art keywords
- live broadcast
- instruction
- target
- terminal
- broadcast terminal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 57
- 238000009877 rendering Methods 0.000 claims abstract description 266
- 230000009471 action Effects 0.000 claims abstract description 203
- 238000004364 calculation method Methods 0.000 claims abstract description 156
- 230000015654 memory Effects 0.000 claims description 7
- 230000004044 response Effects 0.000 claims description 2
- 230000008569 process Effects 0.000 abstract description 13
- 238000010586 diagram Methods 0.000 description 13
- 238000004422 calculation algorithm Methods 0.000 description 3
- 238000004590 computer program Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000006978 adaptation Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000001815 facial effect Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/65—Transmission of management data between client and server
- H04N21/658—Transmission by the client directed to the server
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/81—Monomedia components thereof
- H04N21/8146—Monomedia components thereof involving graphical data, e.g. 3D object, 2D graphics
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Computer Graphics (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The disclosure relates to a live virtual image broadcasting method and device, electronic equipment and a storage medium. The method comprises the following steps: responding to a target virtual image live broadcast request sent by a live broadcast terminal, and receiving performance indexes uploaded by the live broadcast terminal, wherein the performance indexes comprise action calculating capacity and rendering calculating capacity; comparing the performance index of the live broadcast terminal with a target performance index to obtain a comparison result, wherein the target performance index comprises target action calculation capacity and target rendering calculation capacity required by live broadcast of a target virtual image; and sending a corresponding instruction to the live broadcast terminal according to the comparison result, wherein the instruction is used for indicating the live broadcast terminal to carry out target virtual image live broadcast. According to the embodiment of the disclosure, the processing process of action resolving or rendering can be distributed to the live broadcast terminal, the server or the watching terminal for processing according to the performance indexes of the live broadcast terminal and the watching terminal, so that the bandwidth is saved and the calculation power distribution is optimized on the premise of meeting the quality of the virtual image video.
Description
Technical Field
The present disclosure relates to the field of live video technologies, and in particular, to a live virtual image method and apparatus, an electronic device, and a storage medium.
Background
In recent years, live avatars have occupied an increasing proportion of live video services. The live virtual image broadcast is a video broadcast by replacing a real image of a main broadcast with a specific virtual image, specifically, the expression and the limb action of the main broadcast are applied to the specific virtual image in real time, so that the virtual image can synchronously make corresponding expression and limb action and the like along with the expression and the limb action of the main broadcast.
The existing live virtual image broadcasting is to complete the calculation of the main broadcasting action and the rendering of the virtual image at the live broadcasting terminal side at the same time to obtain the video of the virtual image, and then to upload the video of the virtual image to a server, and the server converts the video of the virtual image into the live video to flow to a watching terminal for transmission through a streaming media technology, so as to realize the live virtual image broadcasting.
However, the above-described conventional solutions have the following problems: the quality of the rendered virtual image video is not too high due to the performance of the live broadcast terminal, the server compresses the streaming media of the virtual image video uploaded by the live broadcast terminal and transmits the compressed video to the watching terminal, the quality of the virtual image video is further reduced, and the quality of the virtual image video watched by the audience on the terminal is not high.
Disclosure of Invention
The present disclosure provides a live virtual image broadcasting method, device, electronic device and storage medium, which at least solve the problem in the related art that live virtual image broadcasting is blocked or even interrupted due to unclear video of virtual image and easy influence of fluctuation of network bandwidth. The technical scheme of the disclosure is as follows:
in one aspect, a live virtual image broadcasting method is provided, including:
responding to a target virtual image live broadcast request sent by a live broadcast terminal, and receiving performance indexes uploaded by the live broadcast terminal, wherein the performance indexes comprise action calculating capacity and rendering calculating capacity;
comparing the performance index of the live broadcast terminal with a target performance index to obtain a comparison result, wherein the target performance index comprises target action calculation capacity and target rendering calculation capacity required by live broadcast of a target virtual image;
and sending a corresponding instruction to the live broadcast terminal according to the comparison result, wherein the instruction is used for indicating the live broadcast terminal to carry out target virtual image live broadcast.
In an embodiment of the present disclosure, the sending a corresponding instruction to the live broadcast terminal according to the comparison result, where the instruction is used to instruct the live broadcast terminal to perform live broadcast of the target avatar, includes:
when the action resolving computing capacity of the live broadcast terminal is smaller than the target action resolving computing capacity, sending a first instruction to the live broadcast terminal, wherein the first instruction is used for instructing the live broadcast terminal to upload the collected video data, and when the video data of the live broadcast terminal are received, carrying out action resolving to obtain action data;
and when the action calculation computing capacity of the performance index of the live broadcast terminal is greater than or equal to the target action calculation computing capacity, sending a second instruction to the live broadcast terminal, wherein the second instruction is used for instructing the live broadcast terminal to perform action calculation on the acquired video data.
In an embodiment of the present disclosure, before the sending the first instruction to the live broadcast terminal, the method further includes:
judging whether privacy limitation information exists in the live broadcast terminal;
when privacy limitation information exists in the live broadcast terminal, a resolving instruction is sent to the live broadcast terminal, the resolving instruction is used for indicating the live broadcast terminal to perform action resolving on the collected video indexes, and the resolved action data are uploaded to a live broadcast server;
and when the privacy restriction information does not exist in the live broadcast terminal, sending a first instruction to the live broadcast terminal.
In an embodiment of the present disclosure, before receiving the video data uploaded by the live terminal, the method further includes:
and judging whether the network bandwidth of the live broadcast terminal meets the target condition, and receiving the video data uploaded by the live broadcast terminal when the network bandwidth of the live broadcast terminal meets the target condition.
In an embodiment of the disclosure, when the action calculation capability of the performance index of the live broadcast terminal is greater than or equal to the target action calculation capability, sending a second instruction to the live broadcast terminal, where the second instruction is used to instruct the live broadcast terminal to perform action calculation on the acquired video data, and the method further includes:
when the rendering calculation capacity of the live broadcast terminal is greater than or equal to the target rendering calculation capacity, sending a third instruction to the live broadcast terminal, wherein the third instruction is used for instructing the live broadcast terminal to render a target virtual image according to the action data obtained by resolving;
and when the rendering calculation capacity of the live broadcast terminal is smaller than the target rendering calculation capacity, sending a fourth instruction to the live broadcast terminal, wherein the fourth instruction is used for instructing the live broadcast terminal to upload the calculated action data to a live broadcast server.
In an embodiment of the present disclosure, the live broadcast server performs action calculation on the video data, and after obtaining the action data, the method further includes:
the live broadcast server receives rendering computing capacity and rendering quality requirements uploaded by a viewing terminal, and determines the network bandwidth of the viewing terminal, wherein the rendering quality requirements comprise the rendering computing capacity requirements and the network bandwidth requirements;
and determining the position of the rendering target virtual image according to the rendering calculation capacity of the viewing terminal.
In an embodiment of the present disclosure, the determining the position of the rendering-target avatar according to the rendering calculation capability of the viewing terminal includes:
judging whether the rendering computing capability of the viewing terminal can meet the rendering computing capability of the rendering quality requirement;
if the rendering computing capacity of the viewing terminal meets the rendering computing capacity required by the rendering quality, determining that the viewing terminal renders the target virtual image, and sending a rendering instruction carrying action data to the viewing terminal, wherein the rendering instruction is used for instructing the viewing terminal to render the target virtual image based on the action data;
if the rendering calculation capacity of the viewing terminal cannot meet the rendering calculation capacity of the rendering quality requirement and the network bandwidth of the viewing terminal meets the network bandwidth requirement of the rendering quality requirement, determining that a target avatar is rendered by a live broadcast server, rendering the target avatar by the live broadcast server according to the action data to obtain a target avatar video, and transmitting the target avatar video to the viewing terminal;
if the rendering computing capacity of the viewing terminal cannot meet the rendering computing capacity of the rendering quality requirement and the network bandwidth of the viewing terminal cannot meet the network bandwidth requirement of the rendering quality requirement, determining that the live broadcast server renders the target avatar, rendering the target avatar by the live broadcast server according to the action data, obtaining a target avatar video meeting the network bandwidth requirement of the rendering quality requirement, and transmitting the target avatar video to the viewing terminal.
On one hand, the method for live broadcasting the virtual image is provided, which is applied to a live broadcasting terminal and comprises the following steps:
uploading performance indexes of the live broadcast terminal to a live broadcast server, wherein the performance indexes comprise action calculating capacity and rendering calculation capacity;
receiving an instruction sent by a live broadcast server, wherein the instruction is sent by the live broadcast server correspondingly according to a comparison result after a performance index and a target performance index are compared by the live broadcast server, the target performance index comprises target action calculation capacity and target rendering calculation capacity required by live broadcast of a target virtual image, the instruction comprises one of a first instruction, a second instruction and a third instruction, the first instruction is used for instructing a live broadcast terminal to upload collected video data, the second instruction is used for instructing the live broadcast terminal to perform action calculation on the collected video data and upload calculated action data to the live broadcast server, and the third instruction is used for instructing the live broadcast terminal to render the target virtual image according to the action data calculated in the local image;
and the live broadcast terminal executes corresponding operation based on the received instruction so as to realize the live broadcast of the target virtual image.
In one embodiment of the present disclosure, the method further includes:
when privacy limitation exists in a live broadcast terminal, receiving a resolving instruction sent by a live broadcast server;
the live broadcast terminal carries out action calculation on the collected video indexes according to the calculation instruction and uploads the calculated action data to a live broadcast server;
when the privacy limitation information does not exist in the live broadcast terminal, a first instruction sent by a live broadcast server is received.
In an embodiment of the present disclosure, the live broadcasting terminal executes a corresponding operation based on the received instruction to realize live broadcasting of a target avatar, including:
when the received instruction is a first instruction, uploading network bandwidth information of a live broadcast terminal to a live broadcast server;
after receiving an uploading instruction of the live broadcast server, the uploading instruction is sent when the live broadcast server judges that the network bandwidth of the live broadcast terminal meets the target condition;
and uploading the collected video data to a live broadcast server.
On one hand, the method for live broadcasting of the virtual image is provided and applied to a watching terminal, and comprises the following steps:
uploading the rendering computing capacity and rendering quality requirements of the viewing terminal to a live broadcast server;
receiving a rendering instruction sent by a live broadcast server, wherein the rendering instruction is sent when the live broadcast server judges that the rendering computing capability of a viewing terminal meets the rendering computing capability of the rendering quality requirement, and the rendering instruction comprises action data used for rendering a target virtual image;
and rendering the target virtual image by the viewing terminal based on the action data so as to realize live broadcast of the target virtual image.
In one embodiment of the present disclosure, the method further includes:
if the network bandwidth of the watching terminal meets the network bandwidth requirement of the rendering quality requirement, receiving the target virtual image video transmitted by the live broadcast server, and playing the target virtual image video;
and if the network bandwidth of the watching terminal can not meet the network bandwidth requirement of the rendering quality requirement, receiving the target virtual image video which is transmitted by the live broadcast server and meets the network bandwidth requirement of the rendering quality requirement, and playing the target virtual image video which meets the network bandwidth requirement of the rendering quality requirement.
In one aspect, an avatar live server is provided, which includes:
the receiving unit is configured to respond to a target virtual image live broadcast request sent by a live broadcast terminal and receive performance indexes uploaded by the live broadcast terminal, wherein the performance indexes comprise action calculating capacity and rendering calculating capacity;
the comparison unit is configured to compare the performance index of the live broadcast terminal with a target performance index to obtain a comparison result, wherein the target performance index comprises target action calculation capacity and target rendering calculation capacity required by live broadcast of a target virtual image;
and the sending unit is configured to send a corresponding instruction to the live broadcast terminal according to the comparison result, wherein the instruction is used for indicating the live broadcast terminal to carry out target virtual image live broadcast.
In an embodiment of the present disclosure, the transmitting unit is configured to:
when the action resolving computing capacity of the live broadcast terminal is smaller than the target action resolving computing capacity, sending a first instruction to the live broadcast terminal, wherein the first instruction is used for instructing the live broadcast terminal to upload the collected video data, and when the video data of the live broadcast terminal are received, carrying out action resolving to obtain action data;
and when the action calculation computing capacity of the performance index of the live broadcast terminal is greater than or equal to the target action calculation computing capacity, sending a second instruction to the live broadcast terminal, wherein the second instruction is used for instructing the live broadcast terminal to perform action calculation on the acquired video data.
In an embodiment of the present disclosure, the live server further includes:
the privacy unit is configured to judge whether privacy limitation information exists in the live broadcast terminal; when privacy limitation information exists in the live broadcast terminal, a resolving instruction is sent to the live broadcast terminal, the resolving instruction is used for indicating the live broadcast terminal to perform action resolving on the collected video indexes, and the resolved action data are uploaded to a live broadcast server; and when the privacy restriction information does not exist in the live broadcast terminal, sending a first instruction to the live broadcast terminal.
In an embodiment of the present disclosure, the live server further includes:
and the bandwidth judging unit is configured to judge whether the network bandwidth of the live broadcast terminal meets a target condition, and when the network bandwidth of the live broadcast terminal meets the target condition, the bandwidth judging unit receives the video data uploaded by the live broadcast terminal.
In an embodiment of the present disclosure, the transmitting unit is further configured to:
when the rendering calculation capacity of the live broadcast terminal is greater than or equal to the target rendering calculation capacity, sending a third instruction to the live broadcast terminal, wherein the third instruction is used for instructing the live broadcast terminal to render a target virtual image according to the action data obtained by resolving;
and when the rendering calculation capacity of the live broadcast terminal is smaller than the target rendering calculation capacity, sending a fourth instruction to the live broadcast terminal, wherein the fourth instruction is used for instructing the live broadcast terminal to upload the calculated action data to a live broadcast server.
In an embodiment of the present disclosure, the transmitting unit is configured to:
the live broadcast server receives rendering computing capacity and rendering quality requirements uploaded by a viewing terminal, and determines the network bandwidth of the viewing terminal, wherein the rendering quality requirements comprise the rendering computing capacity requirements and the network bandwidth requirements;
and determining the position of the rendering target virtual image according to the rendering calculation capacity of the viewing terminal.
In an embodiment of the present disclosure, the transmitting unit is configured to:
judging whether the rendering computing capability of the viewing terminal can meet the rendering computing capability of the rendering quality requirement;
if the rendering computing capacity of the viewing terminal meets the rendering computing capacity required by the rendering quality, determining that the viewing terminal renders the target virtual image, and sending a rendering instruction carrying action data to the viewing terminal, wherein the rendering instruction is used for instructing the viewing terminal to render the target virtual image based on the action data;
if the rendering calculation capacity of the viewing terminal cannot meet the rendering calculation capacity of the rendering quality requirement and the network bandwidth of the viewing terminal meets the network bandwidth requirement of the rendering quality requirement, determining that a target avatar is rendered by a live broadcast server, rendering the target avatar by the live broadcast server according to the action data to obtain a target avatar video, and transmitting the target avatar video to the viewing terminal;
if the rendering computing capacity of the viewing terminal cannot meet the rendering computing capacity of the rendering quality requirement and the network bandwidth of the viewing terminal cannot meet the network bandwidth requirement of the rendering quality requirement, determining that the live broadcast server renders the target avatar, rendering the target avatar by the live broadcast server according to the action data, obtaining a target avatar video meeting the network bandwidth requirement of the rendering quality requirement, and transmitting the target avatar video to the viewing terminal.
In one aspect, an avatar live broadcast terminal is provided, including:
the system comprises a sending unit, a processing unit and a display unit, wherein the sending unit is configured to upload performance indexes of a live broadcast terminal to a live broadcast server, and the performance indexes comprise action calculating capacity and rendering calculating capacity;
the receiving unit is configured to receive an instruction sent by a live broadcast server, wherein the instruction is sent by a comparison result obtained after the live broadcast server compares a performance index with a target performance index, the target performance index comprises target action calculation capacity and target rendering calculation capacity required by live broadcast of a target virtual image, the instruction comprises one of a first instruction, a second instruction and a third instruction, the first instruction is used for instructing a live broadcast terminal to upload collected video data, the second instruction is used for instructing the live broadcast terminal to perform action calculation on the collected video data and upload the calculated action data to the live broadcast server, and the third instruction is used for instructing the live broadcast terminal to perform action calculation on the collected video data and render the target virtual image according to the calculated action data;
and the execution unit is configured to execute corresponding operation based on the received instruction by the live broadcast terminal so as to realize the live broadcast of the target virtual image.
In an embodiment of the present disclosure, the avatar live broadcast terminal further includes:
the privacy unit is configured to receive a resolving instruction sent by the live broadcast server when the privacy limit exists in the live broadcast terminal; the live broadcast terminal carries out action calculation on the collected video indexes according to the calculation instruction and uploads the calculated action data to a live broadcast server; when the privacy limitation information does not exist in the live broadcast terminal, a first instruction sent by a live broadcast server is received.
In an embodiment of the present disclosure, the execution unit is configured to:
when the received instruction is a first instruction, uploading network bandwidth information of a live broadcast terminal to a live broadcast server;
after receiving an uploading instruction of the live broadcast server, the uploading instruction is sent when the live broadcast server judges that the network bandwidth of the live broadcast terminal meets the target condition;
and uploading the collected video data to a live broadcast server.
In one aspect, a live viewing terminal for an avatar is provided, including:
a sending unit configured to upload rendering computing power and rendering quality requirements of the viewing terminal to a live broadcast server;
the receiving unit is configured to receive a rendering instruction sent by the live broadcast server, wherein the rendering instruction is sent when the live broadcast server judges that the rendering computing capacity of the viewing terminal meets the rendering computing capacity of the rendering quality requirement, and the rendering instruction comprises action data used for rendering a target virtual image;
and the rendering unit is configured to render the target avatar based on the action data by the viewing terminal so as to realize live broadcast of the target avatar.
In an embodiment of the present disclosure, the receiving unit is further configured to:
if the network bandwidth of the watching terminal meets the network bandwidth requirement of the rendering quality requirement, receiving the target virtual image video transmitted by the live broadcast server, and playing the target virtual image video;
and if the network bandwidth of the watching terminal can not meet the network bandwidth requirement of the rendering quality requirement, receiving the target virtual image video which is transmitted by the live broadcast server and meets the network bandwidth requirement of the rendering quality requirement, and playing the target virtual image video which meets the network bandwidth requirement of the rendering quality requirement.
In one aspect, an electronic device is provided, including:
a processor;
a memory for storing processor-executable instructions;
wherein the processor is configured to execute instructions to implement the avatar live method as in any above.
In one aspect, a storage medium is provided in which instructions, when executed by a processor of an electronic device, enable the electronic device to perform the avatar live method as in any one of the above.
In one aspect, there is provided a computer program product comprising executable instructions which, when executed by a processor of an electronic device, enable the electronic device to perform the avatar live method as in any one of the above.
The technical scheme provided by the embodiment of the disclosure at least brings the following beneficial effects:
according to the embodiment of the disclosure, the processing process of action resolving or rendering can be distributed to the live broadcast terminal, the server or the watching terminal for processing according to the performance indexes of the live broadcast terminal and the watching terminal, so that the bandwidth is saved and the calculation power distribution is optimized on the premise of meeting the quality of the virtual image video.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the disclosure and are not to be construed as limiting the disclosure.
Fig. 1 is a flow diagram illustrating an avatar live method according to an exemplary embodiment.
Fig. 2 is a flowchart illustrating assigning a rendering-target avatar processing position according to an exemplary embodiment.
Fig. 3 is a flow diagram illustrating an avatar live method according to an exemplary embodiment.
Fig. 4 is a flow diagram illustrating an avatar live method according to an exemplary embodiment.
Fig. 5 is a block diagram illustrating an avatar live server according to an exemplary embodiment.
Fig. 6 is a block diagram illustrating an avatar live terminal according to an exemplary embodiment.
Fig. 7 is a block diagram illustrating an avatar viewing terminal according to an exemplary embodiment.
Fig. 8 is a schematic diagram illustrating an avatar live system according to an exemplary embodiment.
FIG. 9 is a block diagram illustrating an electronic device in accordance with an example embodiment.
Detailed Description
In order to make the technical solutions of the present disclosure better understood by those of ordinary skill in the art, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings.
It should be noted that the terms "first," "second," and the like in the description and claims of the present disclosure and in the above-described drawings are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the indices so used are interchangeable under appropriate circumstances such that the embodiments of the disclosure described herein are capable of operation in sequences other than those illustrated or described herein. The implementations described in the exemplary embodiments below are not intended to represent all implementations consistent with the present disclosure. Rather, they are merely examples of terminals and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.
The embodiment of the disclosure mainly relates to a live video system, which comprises a live broadcast terminal, a live broadcast server and a watching terminal, wherein the terminal can be a smart phone, a tablet computer, a notebook computer or a desktop computer, and the like, by taking an avatar live broadcast scene as an example, a live broadcast can be live broadcast on the live broadcast terminal, after the live broadcast terminal detects the live broadcast operation of a user, video data of the live broadcast is obtained through a video acquisition device, after the live broadcast server obtains a target avatar selected by the user and performance indexes of the live broadcast terminal, whether the live broadcast terminal has the ability of resolving the video data and rendering the avatar is judged, the video data is resolved and the position of the rendered avatar is determined according to a judgment result, and finally, a target avatar video is generated and played on the watching terminal. The above scenario is merely illustrative, and the embodiment of the present invention is not limited to this scenario.
The process of generating the avatar video mainly comprises the steps of performing action calculation on video data, rendering an avatar according to the action data calculated by the action calculation, performing action calculation on video data of a main broadcast to obtain action data, rendering the action data to a specific avatar in real time to enable the avatar to perform the same action as the main broadcast, recording according to the action-performed avatar to generate the avatar video and then playing the avatar video. The embodiment of the disclosure decouples the two processes, namely, the action calculating process and the avatar rendering process can be respectively processed in different devices, and resources of each device in the video live broadcast system are flexibly allocated, so as to maximize the quality of the avatar video.
Aiming at the live broadcast scene of the virtual image, in order to improve the video quality of the virtual image, a live broadcast server firstly obtains the computing capacity of a live broadcast terminal, then determines the computing capacity required for rendering the target virtual image, compares the computing capacity of the live broadcast terminal with the computing capacity required for rendering the target virtual image to determine whether the live broadcast terminal can finish the rendering of the target virtual image, and when the computing capacity of the live broadcast terminal cannot meet the computing capacity required for rendering the target virtual image, the process of rendering the target virtual image is distributed to a server or a watching terminal side to be finished. Thus, the quality of the target avatar video can be improved. Fig. 1 is a flowchart illustrating an avatar live broadcasting method according to an exemplary embodiment, applied to a live broadcasting server, as shown in fig. 1, including the steps of:
The performance index of the live broadcast terminal at least comprises action calculating and computing capacity and rendering and computing capacity.
In an embodiment of the present disclosure, the target avatar live broadcast request carries identification information of the target avatar, and the live broadcast server may determine, according to the identification information, which avatar the live broadcast terminal uses for live broadcast, so as to determine a computing capability required for rendering the avatar, so as to compare the computing capability of the live broadcast terminal in subsequent steps with the computing capability required for rendering the target avatar.
And 102, comparing the performance index of the live broadcast terminal with a target performance index to obtain a comparison result.
The target performance index at least includes target action calculation capability and rendering calculation capability required for rendering the target avatar, and specifically, the target action calculation capability and the target rendering calculation capability required for rendering the target avatar may be determined by material data of the target avatar, and the material data may include: mesh data, texture data, etc. designed by the avatar model, and the parts needed to drive the target avatar model, such as: facial parts, limb parts, etc.
In one possible implementation manner, the target action calculation capacity and the target rendering calculation capacity required for rendering the target avatar may be determined according to the size and complexity of the material data volume corresponding to the target avatar. For example, when the material data of the rendering target avatar only includes the material data of the face, but does not include the material data of the limb part, the action calculation of the face is only required when the target avatar is rendered, the required action calculation capability is relatively small, the corresponding face material content data is relatively less, and the corresponding rendering calculation capability is relatively small. The embodiments of the present invention are not limited to the above embodiments, but are only illustrative.
In an embodiment of the present disclosure, the manner of comparing the performance index of the live broadcast terminal with the target performance index may include: comparing the action calculating capability of the live broadcast terminal with the target action calculating capability, and comparing the rendering calculating capability of the live broadcast terminal with the target rendering calculating capability, wherein,
comparing the action calculation capability of the live broadcast terminal with the target action calculation capability required by rendering the target virtual image, the method comprises the following steps:
when the action resolving computing capacity of the live terminal is smaller than the target action resolving computing capacity, a first instruction is sent to the live terminal, the first instruction is used for indicating the live terminal to upload the collected video data, and when the video data of the live terminal are received, action resolving is carried out on the video data to obtain action data.
In a possible implementation manner, after the live terminal sends the first instruction, the live terminal may be limited by privacy control and may not upload anchor video data to the server, and in this case, it is necessary to determine whether the live terminal has privacy limitation information; when privacy limitation information exists in the live broadcast terminal, a resolving instruction is sent to the live broadcast terminal, the resolving instruction is used for indicating the live broadcast terminal to use a target action resolving algorithm to perform action resolving on the acquired video index, the target action resolving algorithm is a degraded resolving algorithm, namely certain action resolving accuracy is lost, the action resolving process can be smoothly completed at the live broadcast terminal, and resolved action data are uploaded to a live broadcast server; after receiving the action data uploaded by the live broadcast terminal, the live broadcast server renders a target virtual image according to the action data, or instructs the watching terminal to render the target virtual image according to the action data; when the privacy limit information does not exist in the live broadcast terminal, a first instruction is sent to the live broadcast terminal, whether the network bandwidth of the live broadcast terminal meets a target condition or not is judged before the first instruction is sent, when the network bandwidth of the live broadcast terminal meets the target condition, video data uploaded by the live broadcast terminal is received, action calculation is carried out on the video data, action data are obtained, a target virtual image is rendered according to the action data, or a watching terminal is instructed to render the target virtual image according to the action data.
And when the action calculation computing capacity of the performance index of the live broadcast terminal is greater than or equal to the target action calculation computing capacity, sending a second instruction to the live broadcast terminal, wherein the second instruction is used for instructing the live broadcast terminal to perform action calculation on the acquired video data.
Comparing the rendering computing capability of the live broadcast terminal with the target rendering computing capability, comprising:
when the rendering calculation capacity of the live broadcast terminal is greater than or equal to the target rendering calculation capacity, sending a third instruction to the live broadcast terminal, wherein the third instruction is used for instructing the live broadcast terminal to render a target virtual image according to the action data obtained by resolving;
and when the rendering calculation capacity of the live broadcast terminal is smaller than the target rendering calculation capacity, sending a fourth instruction to the live broadcast terminal, wherein the fourth instruction is used for instructing the live broadcast terminal to upload the calculated action data to a live broadcast server.
In practical application, for the comparison result, although the live broadcast terminal can render the target avatar, the process of rendering the target avatar is not allocated to the live broadcast terminal for processing, because if the process of rendering the target avatar is allocated to the live broadcast terminal for rendering, the server retransmits the action data to the live broadcast terminal, and after the live broadcast terminal finishes rendering, the server receives the avatar video uploaded by the live broadcast terminal, and these steps can increase the overhead of the live broadcast server.
And 103, sending a corresponding instruction to the live broadcast terminal according to the comparison result, wherein the instruction is used for indicating the live broadcast terminal to carry out target virtual image live broadcast.
In one embodiment of the disclosure, when the action calculation computing capacity of the live broadcast terminal is smaller than the target action calculation computing capacity, sending a first instruction to the live broadcast terminal, wherein the first instruction is used for instructing the live broadcast terminal to upload the acquired video data, and after receiving the video data uploaded by the live broadcast terminal, the live broadcast server performs action calculation on the video data to obtain action data;
and when the action calculation computing capacity of the performance index of the live broadcast terminal is greater than or equal to the target action calculation computing capacity, sending a second instruction to the live broadcast terminal, wherein the second instruction is used for instructing the live broadcast terminal to perform action calculation on the acquired video data.
Before sending a first instruction to a live broadcast terminal, judging whether privacy limitation information exists in the live broadcast terminal;
when privacy limitation information exists in the live broadcast terminal, a resolving instruction is sent to the live broadcast terminal, the resolving instruction is used for indicating the live broadcast terminal to perform action resolving on the collected video indexes, and the resolved action data are uploaded to a live broadcast server;
and when the privacy restriction information does not exist in the live broadcast terminal, sending a first instruction to the live broadcast terminal.
In an embodiment of the present disclosure, before receiving video data uploaded by a live terminal, it is determined whether a network bandwidth of the live terminal meets a target condition, and when the network bandwidth of the live terminal meets the target condition, the video data uploaded by the live terminal is received.
In one embodiment of the disclosure, when the rendering calculation capacity of the live broadcast terminal is greater than or equal to the target rendering calculation capacity, sending a third instruction to the live broadcast terminal, wherein the third instruction is used for instructing the live broadcast terminal to render a target virtual image according to the action data obtained by resolving;
and when the rendering calculation capacity of the live broadcast terminal is smaller than the target rendering calculation capacity, sending a fourth instruction to the live broadcast terminal, wherein the fourth instruction is used for instructing the live broadcast terminal to upload the calculated action data to a live broadcast server.
In one embodiment of the disclosure, a live broadcast server receives rendering computing power and rendering quality requirements uploaded by a viewing terminal, and determines the network bandwidth of the viewing terminal, wherein the rendering quality requirements comprise the rendering computing power requirements and the network bandwidth requirements; and determining the position of the rendering target virtual image according to the rendering calculation capacity of the viewing terminal.
Judging whether the rendering computing capacity of the viewing terminal can meet the rendering computing capacity of the rendering quality requirement;
if the rendering computing capacity of the viewing terminal meets the rendering computing capacity required by the rendering quality, determining that the viewing terminal renders the target virtual image, and sending a rendering instruction carrying action data to the viewing terminal, wherein the rendering instruction is used for instructing the viewing terminal to render the target virtual image based on the action data;
if the rendering calculation capacity of the viewing terminal cannot meet the rendering calculation capacity of the rendering quality requirement and the network bandwidth of the viewing terminal meets the network bandwidth requirement of the rendering quality requirement, determining that a target avatar is rendered by a live broadcast server, rendering the target avatar by the live broadcast server according to the action data to obtain a target avatar video, and transmitting the target avatar video to the viewing terminal;
if the rendering computing capacity of the viewing terminal cannot meet the rendering computing capacity of the rendering quality requirement and the network bandwidth of the viewing terminal cannot meet the network bandwidth requirement of the rendering quality requirement, determining that the live broadcast server renders the target avatar, rendering the target avatar by the live broadcast server according to the action data, obtaining a target avatar video meeting the network bandwidth requirement of the rendering quality requirement, and transmitting the target avatar video to the viewing terminal.
In an embodiment of the present disclosure, when the rendering calculation capability of the live broadcast terminal is smaller than the target rendering calculation capability, the server may allocate the process of rendering the target avatar to the live broadcast server for processing, or to the viewing terminal for processing, where a specific allocation manner is shown with reference to fig. 2, and includes the following steps:
201. and acquiring the rendering computing capacity of the viewing terminal.
202. And comparing the rendering computing capacity of the viewing terminal with the target rendering computing capacity.
203. And sending a corresponding instruction to the watching terminal according to the comparison result, wherein the instruction is used for indicating the watching terminal to render the target virtual image.
And when the comparison result shows that the rendering calculation capacity of the watching terminal is smaller than the target rendering calculation capacity, the live broadcast server renders the target virtual image according to the action data to obtain a target virtual image video, and transmits the target virtual image video to the watching terminal.
And when the comparison result shows that the rendering calculation capacity of the watching terminal is greater than or equal to the target rendering calculation capacity, the live broadcast server sends a rendering instruction carrying action data to the watching terminal, wherein the rendering instruction is used for instructing the watching terminal to render the target virtual image according to the action data and playing the video of the target virtual image obtained after rendering.
Fig. 3 is a flowchart illustrating an avatar live broadcasting method according to an exemplary embodiment, applied to a live broadcasting terminal, as shown in fig. 3, including the steps of:
301. and uploading performance indexes of the live broadcast terminal to a live broadcast server, wherein the performance indexes comprise action calculating capacity and rendering calculation capacity.
302. And receiving an instruction sent by the live broadcast server.
The method comprises the steps of receiving an instruction sent by a live broadcast server, wherein the instruction is sent by the live broadcast server in a way that a comparison result obtained after a performance index and a target performance index are compared by the live broadcast server correspondingly, the target performance index comprises target action calculation capacity and target rendering calculation capacity which are required by live broadcast of a target virtual image, the instruction comprises one of a first instruction, a second instruction and a third instruction, the first instruction is used for instructing a live broadcast terminal to upload collected video data, the second instruction is used for instructing the live broadcast terminal to perform action calculation on the collected video data and upload the calculated action data to the live broadcast server, and the third instruction is used for instructing the live broadcast terminal to perform action calculation on the collected video data and render the target virtual image according to the calculated action data.
303. And the live broadcast terminal executes corresponding operation based on the received instruction so as to realize the live broadcast of the target virtual image.
In one embodiment of the disclosure, when a privacy limit exists in a live broadcast terminal, a resolving instruction sent by a live broadcast server is received; the live broadcast terminal carries out action calculation on the collected video indexes according to the calculation instruction and uploads the calculated action data to a live broadcast server; when the privacy restriction information does not exist in the live broadcast terminal, a first instruction sent by the live broadcast terminal is received.
In one embodiment of the disclosure, when a privacy limit exists in a live broadcast terminal, a resolving instruction sent by a live broadcast server is received; the live broadcast terminal carries out action calculation on the collected video indexes according to the calculation instruction and uploads the calculated action data to a live broadcast server; when the privacy limitation information does not exist in the live broadcast terminal, a first instruction sent by a live broadcast server is received.
In one embodiment of the disclosure, when the instruction received by the live broadcast terminal is a first instruction, uploading network bandwidth information of the live broadcast terminal to a live broadcast server; after receiving an uploading instruction of the live broadcast server, the uploading instruction is sent when the live broadcast server judges that the network bandwidth of the live broadcast terminal meets the target condition; and uploading the collected video data to a live broadcast server.
Fig. 4 shows a flowchart of a live avatar broadcast method according to an exemplary embodiment, which is applied to a viewing terminal, as shown in fig. 4, and includes the following steps:
401. and uploading the rendering computing power and rendering quality requirements of the viewing terminal to a live broadcast server.
402. And receiving a rendering instruction sent by the live broadcast server.
The rendering instruction is sent when the live broadcast server judges that the rendering computing capacity of the viewing terminal meets the rendering computing capacity of the rendering quality requirement, and the rendering instruction comprises action data used for rendering the target virtual image.
403. And rendering the target virtual image by the viewing terminal based on the action data so as to realize live broadcast of the target virtual image.
In one embodiment of the present disclosure, if the network bandwidth of the viewing terminal meets the network bandwidth requirement of the rendering quality requirement, receiving a target avatar video transmitted by a live broadcast server, and playing the target avatar video; and if the network bandwidth of the watching terminal can not meet the network bandwidth requirement of the rendering quality requirement, receiving the target virtual image video which is transmitted by the live broadcast server and meets the network bandwidth requirement of the rendering quality requirement, and playing the target virtual image video which meets the network bandwidth requirement of the rendering quality requirement.
According to the embodiment of the disclosure, the processing process of action resolving or rendering can be distributed to the live broadcast terminal, the server or the watching terminal for processing according to the performance indexes of the live broadcast terminal and the watching terminal, so that the bandwidth is saved and the calculation power distribution is optimized on the premise of meeting the quality of the virtual image video.
All the above optional technical solutions may be combined arbitrarily to form the optional embodiments of the present disclosure, and are not described herein again.
The following are embodiments of the apparatus of the present invention that may be used to perform embodiments of the method of the present invention. For details which are not disclosed in the embodiments of the apparatus of the present invention, reference is made to the embodiments of the method of the present invention.
Fig. 5 is a block diagram illustrating an avatar live server according to an exemplary embodiment. Referring to fig. 5, the avatar live server includes:
the receiving unit 501 is configured to respond to a target avatar live broadcast request sent by a live broadcast terminal, and receive performance indexes uploaded by the live broadcast terminal, wherein the performance indexes include action calculation capacity and rendering calculation capacity;
a comparison unit 502 configured to compare the performance index of the live broadcast terminal with a target performance index, and obtain a comparison result, where the target performance index includes target action calculation capability and target rendering calculation capability required for live broadcast of a target avatar;
and a sending unit 503 configured to send a corresponding instruction to the live broadcast terminal according to the comparison result, where the instruction is used to instruct the live broadcast terminal to perform target avatar live broadcast.
In an embodiment of the present disclosure, the sending unit 503 is configured to:
when the action resolving computing capacity of the live broadcast terminal is smaller than the target action resolving computing capacity, sending a first instruction to the live broadcast terminal, wherein the first instruction is used for instructing the live broadcast terminal to upload the collected video data, and when the video data of the live broadcast terminal are received, carrying out action resolving to obtain action data;
and when the action calculation computing capacity of the performance index of the live broadcast terminal is greater than or equal to the target action calculation computing capacity, sending a second instruction to the live broadcast terminal, wherein the second instruction is used for instructing the live broadcast terminal to perform action calculation on the acquired video data.
In an embodiment of the present disclosure, the live server further includes:
a privacy unit 504 configured to determine whether privacy restriction information exists in the live terminal; when privacy limitation information exists in the live broadcast terminal, a resolving instruction is sent to the live broadcast terminal, the resolving instruction is used for indicating the live broadcast terminal to perform action resolving on the collected video indexes, and the resolved action data are uploaded to a live broadcast server; and when the privacy restriction information does not exist in the live broadcast terminal, sending a first instruction to the live broadcast terminal.
In an embodiment of the present disclosure, the live server further includes:
and a bandwidth judging unit 505 configured to judge whether the network bandwidth of the live terminal meets a target condition, and receive the video data uploaded by the live terminal when the network bandwidth of the live terminal meets the target condition.
In an embodiment of the present disclosure, the sending unit 503 is further configured to:
when the rendering calculation capacity of the live broadcast terminal is greater than or equal to the target rendering calculation capacity, sending a third instruction to the live broadcast terminal, wherein the third instruction is used for instructing the live broadcast terminal to render a target virtual image according to the action data obtained by resolving;
and when the rendering calculation capacity of the live broadcast terminal is smaller than the target rendering calculation capacity, sending a fourth instruction to the live broadcast terminal, wherein the fourth instruction is used for instructing the live broadcast terminal to upload the calculated action data to a live broadcast server.
In an embodiment of the present disclosure, the sending unit 503 is configured to:
the live broadcast server receives rendering computing capacity and rendering quality requirements uploaded by a viewing terminal, and determines the network bandwidth of the viewing terminal, wherein the rendering quality requirements comprise the rendering computing capacity requirements and the network bandwidth requirements;
and determining the position of the rendering target virtual image according to the rendering calculation capacity of the viewing terminal.
In an embodiment of the present disclosure, the sending unit 503 is configured to:
judging whether the rendering computing capability of the viewing terminal can meet the rendering computing capability of the rendering quality requirement;
if the rendering computing capacity of the viewing terminal meets the rendering computing capacity required by the rendering quality, determining that the viewing terminal renders the target virtual image, and sending a rendering instruction carrying action data to the viewing terminal, wherein the rendering instruction is used for instructing the viewing terminal to render the target virtual image based on the action data;
if the rendering calculation capacity of the viewing terminal cannot meet the rendering calculation capacity of the rendering quality requirement and the network bandwidth of the viewing terminal meets the network bandwidth requirement of the rendering quality requirement, determining that a target avatar is rendered by a live broadcast server, rendering the target avatar by the live broadcast server according to the action data to obtain a target avatar video, and transmitting the target avatar video to the viewing terminal;
if the rendering computing capacity of the viewing terminal cannot meet the rendering computing capacity of the rendering quality requirement and the network bandwidth of the viewing terminal cannot meet the network bandwidth requirement of the rendering quality requirement, determining that the live broadcast server renders the target avatar, rendering the target avatar by the live broadcast server according to the action data, obtaining a target avatar video meeting the network bandwidth requirement of the rendering quality requirement, and transmitting the target avatar video to the viewing terminal.
Fig. 6 is a block diagram illustrating an avatar live terminal according to an exemplary embodiment. Referring to fig. 6, the avatar live broadcast terminal includes:
a sending unit 601 configured to upload performance indexes of the live broadcast terminal to a live broadcast server, where the performance indexes include an action calculation capability and a rendering calculation capability;
a receiving unit 602 configured to receive an instruction sent by a live broadcast server, where the instruction is sent by the live broadcast server in correspondence to a comparison result obtained by comparing a performance index with a target performance index, the target performance index includes target action calculation capability and target rendering calculation capability required for live broadcast of a target avatar, the instruction includes one of a first instruction, a second instruction, and a third instruction, the first instruction is used for instructing a live broadcast terminal to upload acquired video data, the second instruction is used for instructing the live broadcast terminal to perform action calculation on the acquired video data and upload calculated action data to the live broadcast server, and the third instruction is used for instructing the live broadcast terminal to render the target avatar according to the locally calculated action data;
and an executing unit 603 configured to execute a corresponding operation based on the received instruction by the live broadcast terminal to realize live broadcast of the target avatar.
In an embodiment of the present disclosure, the avatar live broadcast terminal further includes:
the privacy unit 604 is configured to receive a resolving instruction sent by the live broadcast server when the live broadcast terminal has privacy limitation; the live broadcast terminal carries out action calculation on the collected video indexes according to the calculation instruction and uploads the calculated action data to a live broadcast server; when the privacy limitation information does not exist in the live broadcast terminal, a first instruction sent by a live broadcast server is received.
In an embodiment of the present disclosure, the executing unit 603 is configured to:
when the received instruction is a first instruction, uploading network bandwidth information of a live broadcast terminal to a live broadcast server;
after receiving an uploading instruction of the live broadcast server, the uploading instruction is sent when the live broadcast server judges that the network bandwidth of the live broadcast terminal meets the target condition;
and uploading the collected video data to a live broadcast server.
Fig. 7 is a block diagram illustrating an avatar viewing terminal according to an exemplary embodiment. Referring to fig. 7, the avatar viewing terminal includes:
a sending unit 701 configured to upload rendering computing power and rendering quality requirements of a viewing terminal to a live broadcast server;
a receiving unit 702, configured to receive a rendering instruction sent by a live broadcast server, where the rendering instruction is sent when the live broadcast server determines that a rendering calculation capability of a viewing terminal meets a rendering calculation capability of a rendering quality requirement, and the rendering instruction includes action data for rendering a target avatar;
a rendering unit 703 configured to render the target avatar based on the motion data by the viewing terminal to realize live broadcasting of the target avatar.
In an embodiment of the present disclosure, the receiving unit 702 is further configured to:
if the network bandwidth of the watching terminal meets the network bandwidth requirement of the rendering quality requirement, receiving the target virtual image video transmitted by the live broadcast server, and playing the target virtual image video;
and if the network bandwidth of the watching terminal can not meet the network bandwidth requirement of the rendering quality requirement, receiving the target virtual image video which is transmitted by the live broadcast server and meets the network bandwidth requirement of the rendering quality requirement, and playing the target virtual image video which meets the network bandwidth requirement of the rendering quality requirement.
Fig. 8 shows a schematic diagram of an avatar live system 800 according to an exemplary embodiment, referring to fig. 8, the system 800 comprising:
the live broadcast terminal 801 is configured to upload performance indexes of the live broadcast terminal to a live broadcast server, wherein the performance indexes include action calculation computing capacity and rendering computing capacity; receiving an instruction sent by a live broadcast server, wherein the instruction is sent by the live broadcast server correspondingly according to a comparison result after a performance index and a target performance index are compared by the live broadcast server, the target performance index comprises target action calculation capacity and target rendering calculation capacity required by live broadcast of a target virtual image, the instruction comprises one of a first instruction, a second instruction and a third instruction, the first instruction is used for instructing a live broadcast terminal to upload collected video data, the second instruction is used for instructing the live broadcast terminal to perform action calculation on the collected video data and upload calculated action data to the live broadcast server, and the third instruction is used for instructing the live broadcast terminal to render the target virtual image according to the action data calculated in the local image; and the live broadcast terminal executes corresponding operation based on the received instruction so as to realize the live broadcast of the target virtual image.
A live broadcast server 802 configured to receive performance indexes uploaded by a live broadcast terminal in response to a target avatar live broadcast request sent by the live broadcast terminal, wherein the performance indexes include action calculation capability and rendering calculation capability; comparing the performance index of the live broadcast terminal with a target performance index to obtain a comparison result, wherein the target performance index comprises target action calculation capacity and target rendering calculation capacity required by live broadcast of a target virtual image; and sending a corresponding instruction to the live broadcast terminal according to the comparison result, wherein the instruction is used for indicating the live broadcast terminal to carry out target virtual image live broadcast.
A viewing terminal 803 configured to upload the rendering computing power and rendering quality requirements of the viewing terminal to a live server; receiving a rendering instruction sent by a live broadcast server, wherein the rendering instruction is sent when the live broadcast server judges that the rendering computing capability of a viewing terminal meets the rendering computing capability of the rendering quality requirement, and the rendering instruction comprises action data used for rendering a target virtual image; and rendering the target virtual image by the viewing terminal based on the action data so as to realize live broadcast of the target virtual image.
With regard to the terminal and the system in the above embodiments, the specific manner in which each unit, the terminal and the server perform operations has been described in detail in the embodiments related to the method, and will not be described in detail here.
The embodiment of the invention determines the action calculation capacity of the live broadcast terminal and the calculation capacity of the rendering target virtual image when the anchor broadcasts the virtual image live broadcast, and allocates the corresponding processing process to the server or the watching terminal for processing when any one of the calculation capacities of the live broadcast terminal is insufficient, thereby improving the quality of the virtual image video.
FIG. 9 is a block diagram illustrating an electronic device in accordance with an example embodiment. The electronic device 900 may have a relatively large difference due to different configurations or performances, and may include one or more processors (CPUs) 901 and one or more memories 902, where the memory 902 stores at least one instruction, and the at least one instruction is loaded and executed by the processors 901 to implement the avatar live broadcast method provided by the above-mentioned method embodiments. Of course, the electronic device may further have components such as a wired or wireless network interface, a keyboard, and an input/output interface, so as to perform input/output, and the electronic device may further include other components for implementing the functions of the device, which is not described herein again.
In an exemplary embodiment, a storage medium, such as a memory 902, is also provided that includes a computer program product executable by a processor 901 to perform the above-described method. Alternatively, the storage medium may be a non-transitory computer readable storage medium, which may be, for example, a Read-Only Memory (ROM), a Random Access Memory (RAM), a Compact Disc Read-Only Memory (CD-ROM), a magnetic tape, a floppy disk, an optical data storage device, and the like.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosed invention. This application is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.
Claims (10)
1. A live broadcast method of an avatar is applied to a live broadcast server and comprises the following steps:
responding to a target virtual image live broadcast request sent by a live broadcast terminal, and receiving performance indexes uploaded by the live broadcast terminal, wherein the performance indexes comprise action calculating capacity and rendering calculating capacity;
comparing the performance index of the live broadcast terminal with a target performance index to obtain a comparison result, wherein the target performance index comprises target action calculation capacity and target rendering calculation capacity required by live broadcast of the target virtual image;
and sending a corresponding instruction to the live broadcast terminal according to the comparison result, wherein the instruction is used for indicating the live broadcast terminal to carry out the live broadcast of the target virtual image.
2. The method according to claim 1, wherein the sending a corresponding instruction to the live broadcast terminal according to the comparison result, the instruction being used for instructing the live broadcast terminal to perform live broadcast of the target avatar, includes:
when the action resolving computing capacity of the live terminal is smaller than the target action resolving computing capacity, sending a first instruction to the live terminal, wherein the first instruction is used for instructing the live terminal to upload the collected video data, and when the video data of the live terminal are received, carrying out action resolving to obtain action data;
and when the action calculation capacity of the performance index of the live broadcast terminal is greater than or equal to the target action calculation capacity, sending a second instruction to the live broadcast terminal, wherein the second instruction is used for instructing the live broadcast terminal to perform action calculation on the acquired video data.
3. The method of claim 2, wherein prior to sending the first instruction to the live terminal, the method further comprises:
judging whether privacy limitation information exists in the live broadcast terminal;
when privacy restriction information exists in the live broadcast terminal, a resolving instruction is sent to the live broadcast terminal, and the resolving instruction is used for indicating the live broadcast terminal to perform action resolving on the acquired video indexes and uploading resolved action data to the live broadcast server;
and when the privacy restriction information does not exist in the live broadcast terminal, sending a first instruction to the live broadcast terminal.
4. The method of claim 2, wherein before receiving the video data uploaded by the live terminal, the method further comprises:
and judging whether the network bandwidth of the live broadcast terminal meets a target condition, and receiving the video data uploaded by the live broadcast terminal when the network bandwidth of the live broadcast terminal meets the target condition.
5. The method according to claim 2, wherein when an action calculation capability of a performance index of the live broadcast terminal is greater than or equal to the target action calculation capability, sending a second instruction to the live broadcast terminal, where the second instruction is used to instruct the live broadcast terminal to perform action calculation on the collected video data, and the method further includes:
when the rendering calculation capacity of the live broadcast terminal is greater than or equal to the target rendering calculation capacity, sending a third instruction to the live broadcast terminal, wherein the third instruction is used for instructing the live broadcast terminal to render the target virtual image according to the action data obtained by resolving;
and when the rendering calculation capacity of the live broadcast terminal is smaller than the target rendering calculation capacity, sending a fourth instruction to the live broadcast terminal, wherein the fourth instruction is used for instructing the live broadcast terminal to upload the calculated action data to a live broadcast server.
6. A live method of virtual image is applied to a live terminal and comprises the following steps:
uploading performance indexes of the live broadcast terminal to a live broadcast server, wherein the performance indexes comprise action calculating capacity and rendering calculation capacity;
receiving an instruction sent by the live broadcast server, wherein the instruction is sent by the live broadcast server correspondingly according to a comparison result obtained by comparing the performance index with a target performance index, the target performance indicators include target action calculation and target rendering calculation capabilities required for live broadcasting the target avatar, the instruction comprises one of a first instruction, a second instruction and a third instruction, the first instruction is used for instructing the live broadcast terminal to upload the acquired video data, the second instruction is used for instructing the live broadcast terminal to perform action calculation on the acquired video data and uploading the calculated action data to the live broadcast server, the third instruction is used for instructing the live broadcast terminal to perform action calculation on the collected video data and render the target virtual image according to the calculated action data;
and the live broadcast terminal executes corresponding operation based on the received instruction so as to realize the live broadcast of the target virtual image.
7. An avatar live server, comprising:
the receiving unit is configured to respond to a target virtual image live broadcast request sent by a live broadcast terminal, and receive performance indexes uploaded by the live broadcast terminal, wherein the performance indexes comprise action calculating and rendering calculation capacities;
the comparison unit is configured to compare the performance index of the live broadcast terminal with a target performance index to obtain a comparison result, wherein the target performance index comprises target action calculation capacity and target rendering calculation capacity required by live broadcast of the target virtual image;
and the sending unit is configured to send a corresponding instruction to the live broadcast terminal according to the comparison result, wherein the instruction is used for indicating the live broadcast terminal to carry out the target virtual image live broadcast.
8. An avatar live broadcast terminal, comprising:
the sending unit is configured to upload performance indexes of the live broadcast terminal to a live broadcast server, wherein the performance indexes comprise action calculating and rendering calculation capacities;
a receiving unit configured to receive an instruction sent by the live broadcast server, where the instruction is sent by the live broadcast server in response to a comparison result obtained by comparing the performance index with a target performance index, the target performance indicators include target action calculation and target rendering calculation capabilities required for live broadcasting the target avatar, the instruction comprises one of a first instruction, a second instruction and a third instruction, the first instruction is used for instructing the live broadcast terminal to upload the acquired video data, the second instruction is used for instructing the live broadcast terminal to perform action calculation on the acquired video data and uploading the calculated action data to the live broadcast server, the third instruction is used for instructing the live broadcast terminal to perform action calculation on the collected video data and render the target virtual image according to the calculated action data;
and the execution unit is configured to execute corresponding operation based on the received instruction by the live broadcast terminal so as to realize the live broadcast of the target virtual image.
9. An electronic device, comprising:
a processor;
a memory for storing the processor-executable instructions;
wherein the processor is configured to execute the instructions to implement the avatar live method of any of claims 1-6.
10. A storage medium in which instructions, when executed by a processor of an electronic device, enable the electronic device to perform the avatar live method of any of claims 1-6.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201911358983.5A CN111614967B (en) | 2019-12-25 | 2019-12-25 | Live virtual image broadcasting method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201911358983.5A CN111614967B (en) | 2019-12-25 | 2019-12-25 | Live virtual image broadcasting method and device, electronic equipment and storage medium |
Publications (2)
Publication Number | Publication Date |
---|---|
CN111614967A true CN111614967A (en) | 2020-09-01 |
CN111614967B CN111614967B (en) | 2022-01-25 |
Family
ID=72201155
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201911358983.5A Active CN111614967B (en) | 2019-12-25 | 2019-12-25 | Live virtual image broadcasting method and device, electronic equipment and storage medium |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN111614967B (en) |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112653898A (en) * | 2020-12-15 | 2021-04-13 | 北京百度网讯科技有限公司 | User image generation method, related device and computer program product |
CN113163224A (en) * | 2021-04-27 | 2021-07-23 | 思享智汇(海南)科技有限责任公司 | Method, system and storage medium for issuing virtual image |
CN114363652A (en) * | 2022-01-04 | 2022-04-15 | 阿里巴巴(中国)有限公司 | Video live broadcast method, system and computer storage medium |
WO2023030343A1 (en) * | 2021-09-04 | 2023-03-09 | 华为技术有限公司 | Method, apparatus and system for providing call additional service |
CN116193153A (en) * | 2023-04-19 | 2023-05-30 | 世优(北京)科技有限公司 | Live broadcast data sending method, device and system |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20080231626A1 (en) * | 2007-03-22 | 2008-09-25 | Motorola, Inc. | Method and Apparatus to Facilitate a Differently Configured Virtual Reality Experience for Some Participants in a Communication Session |
US20110248995A1 (en) * | 2010-04-09 | 2011-10-13 | Fuji Xerox Co., Ltd. | System and methods for creating interactive virtual content based on machine analysis of freeform physical markup |
CN107438183A (en) * | 2017-07-26 | 2017-12-05 | 北京暴风魔镜科技有限公司 | A kind of virtual portrait live broadcasting method, apparatus and system |
CN107682729A (en) * | 2017-09-08 | 2018-02-09 | 广州华多网络科技有限公司 | It is a kind of based on live interactive approach and live broadcast system, electronic equipment |
CN109547806A (en) * | 2018-10-23 | 2019-03-29 | 佟志强 | A kind of AR scapegoat's live broadcasting method |
CN110139115A (en) * | 2019-04-30 | 2019-08-16 | 广州虎牙信息科技有限公司 | Virtual image attitude control method, device and electronic equipment based on key point |
CN110557625A (en) * | 2019-09-17 | 2019-12-10 | 北京达佳互联信息技术有限公司 | live virtual image broadcasting method, terminal, computer equipment and storage medium |
-
2019
- 2019-12-25 CN CN201911358983.5A patent/CN111614967B/en active Active
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20080231626A1 (en) * | 2007-03-22 | 2008-09-25 | Motorola, Inc. | Method and Apparatus to Facilitate a Differently Configured Virtual Reality Experience for Some Participants in a Communication Session |
US20110248995A1 (en) * | 2010-04-09 | 2011-10-13 | Fuji Xerox Co., Ltd. | System and methods for creating interactive virtual content based on machine analysis of freeform physical markup |
CN107438183A (en) * | 2017-07-26 | 2017-12-05 | 北京暴风魔镜科技有限公司 | A kind of virtual portrait live broadcasting method, apparatus and system |
CN107682729A (en) * | 2017-09-08 | 2018-02-09 | 广州华多网络科技有限公司 | It is a kind of based on live interactive approach and live broadcast system, electronic equipment |
CN109547806A (en) * | 2018-10-23 | 2019-03-29 | 佟志强 | A kind of AR scapegoat's live broadcasting method |
CN110139115A (en) * | 2019-04-30 | 2019-08-16 | 广州虎牙信息科技有限公司 | Virtual image attitude control method, device and electronic equipment based on key point |
CN110557625A (en) * | 2019-09-17 | 2019-12-10 | 北京达佳互联信息技术有限公司 | live virtual image broadcasting method, terminal, computer equipment and storage medium |
Cited By (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112653898A (en) * | 2020-12-15 | 2021-04-13 | 北京百度网讯科技有限公司 | User image generation method, related device and computer program product |
CN112653898B (en) * | 2020-12-15 | 2023-03-21 | 北京百度网讯科技有限公司 | User image generation method, related device and computer program product |
CN113163224A (en) * | 2021-04-27 | 2021-07-23 | 思享智汇(海南)科技有限责任公司 | Method, system and storage medium for issuing virtual image |
WO2023030343A1 (en) * | 2021-09-04 | 2023-03-09 | 华为技术有限公司 | Method, apparatus and system for providing call additional service |
CN114363652A (en) * | 2022-01-04 | 2022-04-15 | 阿里巴巴(中国)有限公司 | Video live broadcast method, system and computer storage medium |
CN116193153A (en) * | 2023-04-19 | 2023-05-30 | 世优(北京)科技有限公司 | Live broadcast data sending method, device and system |
CN116193153B (en) * | 2023-04-19 | 2023-06-30 | 世优(北京)科技有限公司 | Live broadcast data sending method, device and system |
Also Published As
Publication number | Publication date |
---|---|
CN111614967B (en) | 2022-01-25 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN111614967B (en) | Live virtual image broadcasting method and device, electronic equipment and storage medium | |
CN114501062B (en) | Video rendering coordination method, device, equipment and storage medium | |
CN110381322B (en) | Video stream decoding method and device, terminal equipment and storage medium | |
CN109309842B (en) | Live broadcast data processing method and device, computer equipment and storage medium | |
CN112383777B (en) | Video encoding method, video encoding device, electronic equipment and storage medium | |
EP3691280B1 (en) | Video transmission method, server, vr playback terminal and computer-readable storage medium | |
CN112511849A (en) | Game display method, device, equipment, system and storage medium | |
CN111405312A (en) | Live broadcast stream pushing method, device, terminal, server and storage medium | |
US11601690B2 (en) | Method and apparatus for live streaming, server, system and storage medium | |
WO2024001661A1 (en) | Video synthesis method and apparatus, device, and storage medium | |
CN113766270A (en) | Video playing method, system, server, terminal equipment and electronic equipment | |
CN110784731B (en) | Data stream transcoding method, device, equipment and medium | |
CN114513506A (en) | Service processing method, access edge cloud server and service processing system | |
CN110276404B (en) | Model training method, device and storage medium | |
CN116033189A (en) | Live broadcast interactive video partition intelligent control method and system based on cloud edge cooperation | |
CN113839829A (en) | Cloud game delay testing method, device and system and electronic equipment | |
CN114205359A (en) | Video rendering coordination method, device and equipment | |
RU2662648C1 (en) | Method and device for data processing | |
CN110300118B (en) | Streaming media processing method, device and storage medium | |
US20240056549A1 (en) | Method, computer device, and computer program for providing high-quality image of region of interest by using single stream | |
CN107734278B (en) | Video playback method and related device | |
CN112650596B (en) | Cross-process sharing method, device and equipment for target data and storage medium | |
CN113691815A (en) | Video data processing method, device and computer readable storage medium | |
CN110691256B (en) | Video associated information processing method and device, server and storage medium | |
CN112948046A (en) | Screen capturing method, device, equipment and storage medium |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |