CN108986192A - Data processing method and device for live streaming - Google Patents

Data processing method and device for live streaming Download PDF

Info

Publication number
CN108986192A
CN108986192A CN201810835968.4A CN201810835968A CN108986192A CN 108986192 A CN108986192 A CN 108986192A CN 201810835968 A CN201810835968 A CN 201810835968A CN 108986192 A CN108986192 A CN 108986192A
Authority
CN
China
Prior art keywords
virtual image
user
direct broadcasting
broadcasting room
data processing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201810835968.4A
Other languages
Chinese (zh)
Other versions
CN108986192B (en
Inventor
陈驰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Yunduo Network Technology Co Ltd
Original Assignee
Beijing Yunduo Network Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Yunduo Network Technology Co Ltd filed Critical Beijing Yunduo Network Technology Co Ltd
Priority to CN201810835968.4A priority Critical patent/CN108986192B/en
Publication of CN108986192A publication Critical patent/CN108986192A/en
Application granted granted Critical
Publication of CN108986192B publication Critical patent/CN108986192B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00Animation
    • G06T13/203D [Three Dimensional] animation
    • G06T13/403D [Three Dimensional] animation of characters, e.g. humans, animals or virtual beings
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/174Facial expression recognition

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Multimedia (AREA)
  • Information Transfer Between Computers (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Processing Or Creating Images (AREA)

Abstract

This application discloses a kind of data processing methods and device for live streaming.The data processing method includes the virtual image for generating the first user;Judge the first operation that second user executes the first user;And deliberate action is executed on virtual image according to first operation.Present application addresses the more single technical problems of the interaction mode for live streaming.The application realizes the technical effect for increasing user experience and enhancing user's ornamental value.

Description

Data processing method and device for live streaming
Technical field
This application involves live data process field, in particular to a kind of data processing method for live streaming and Device.
Background technique
Spectators by network direct broadcasting platform can program request or watch main broadcaster network video.
Inventors have found that the interactive mode of main broadcaster and spectators are more single in existing network live streaming, user experience is poor, Lack ornamental value.
For problem more single for the interaction mode of live streaming in the related technology, effective solution is not yet proposed at present Scheme.
Summary of the invention
The main purpose of the application is to provide a kind of data processing method and device for live streaming, to solve for straight The more single problem of the interaction mode broadcast.
To achieve the goals above, according to the one aspect of the application, a kind of data processing side for live streaming is provided Method.
The data processing method for live streaming according to the application includes: the virtual image for generating the first user;Judge The first operation that two users execute the first user;And deliberate action is executed on virtual image according to first operation.
Further, the virtual image for generating the first user includes: binding virtual image direct broadcasting room;According to the virtual shape As direct broadcasting room calls virtual image template;And virtual shape is generated in the virtual image direct broadcasting room according to virtual image template As.
Further, the virtual image for generating the first user includes: binding virtual image direct broadcasting room;In the virtual image Direct broadcasting room acquires and uploads the first user images;And it is raw in the virtual image direct broadcasting room according to first user images At virtual image.
Further, the first operation for judging that second user executes the first user includes: to judge second user to first The first reward instruction operation that user executes;It includes: basis that deliberate action is executed on virtual image according to first operation The first reward instruction operation executes preset reward feedback action on virtual image.
Further, the first operation for judging that second user executes the first user includes: to judge second user to first The first action command operation that user executes;It includes: basis that deliberate action is executed on virtual image according to first operation The first action command operation executes deliberate action feedback action on virtual image.
Further, after judging that second user is operated to the first user executes first further include: judge the first user Facial emotions variation;Changed according to the facial emotions and generates emotional feedback action command;It is acted according to the emotional feedback Instruction executes default emotional feedback movement on virtual image.
To achieve the goals above, according to the another aspect of the application, a kind of data processing dress for live streaming is provided It sets.
It include: generation module according to the data processing equipment for live streaming of the application, for generating the void of the first user Quasi- image;Judgment module, the first operation that the first user is executed for judging second user;And execution module, to root Deliberate action is executed on virtual image according to first operation.
Further, the generation module includes: the first binding unit, for binding virtual image direct broadcasting room;Virtual shape As modular unit, for calling virtual image template according to the virtual image direct broadcasting room;And first generation unit, it is used for root Virtual image is generated in the virtual image direct broadcasting room according to virtual image template.
Further, the generation module includes: the second binding unit, for binding virtual image direct broadcasting room;Image is adopted Collect unit, is acquired in the virtual image direct broadcasting room and upload the first user images;And second generation unit, for according to institute It states the first user images and generates virtual image in the virtual image direct broadcasting room.
Further, the data processing equipment includes: judgment module, and execution module, the judgment module includes: first Judging unit, second judgment unit, the execution module include: the first execution unit, the second execution unit, and the first judgement is single Member, the first reward instruction operation that the first user is executed for judging second user;Second judgment unit, for judging second User operates the first action command that the first user executes;First execution unit, for according to the first reward instruction behaviour Make to execute preset reward feedback action on virtual image;And second execution unit, for according to first action command Operation executes deliberate action feedback action on virtual image.
In the embodiment of the present application, by the way of the virtual image for generating the first user, by judging second user pair The first of first user execution operates, and has achieved the purpose that execute deliberate action on virtual image according to first operation, To realize the technical effect for increasing user experience and enhancing user's ornamental value, and then solves the interaction mode for live streaming More single technical problem.
Detailed description of the invention
The attached drawing constituted part of this application is used to provide further understanding of the present application, so that the application's is other Feature, objects and advantages become more apparent upon.The illustrative examples attached drawing and its explanation of the application is for explaining the application, not Constitute the improper restriction to the application.In the accompanying drawings:
Fig. 1 is the data processing method schematic diagram for live streaming according to the application first embodiment;
Fig. 2 is the data processing method schematic diagram for live streaming according to the application second embodiment;
Fig. 3 is the data processing method schematic diagram for live streaming according to the application 3rd embodiment;
Fig. 4 is the data processing method schematic diagram for live streaming according to the application fourth embodiment;
Fig. 5 is the data processing method schematic diagram for live streaming according to the 5th embodiment of the application;
Fig. 6 is the data processing method schematic diagram for live streaming according to the application sixth embodiment;
Fig. 7 is the data processing equipment schematic diagram for live streaming according to the application first embodiment;
Fig. 8 is the data processing equipment schematic diagram for live streaming according to the application second embodiment;
Fig. 9 is the data processing equipment schematic diagram for live streaming according to the application 3rd embodiment;And
Figure 10 is the data processing equipment schematic diagram for live streaming according to the application fourth embodiment.
Specific embodiment
In order to make those skilled in the art more fully understand application scheme, below in conjunction in the embodiment of the present application Attached drawing, the technical scheme in the embodiment of the application is clearly and completely described, it is clear that described embodiment is only The embodiment of the application a part, instead of all the embodiments.Based on the embodiment in the application, ordinary skill people Member's every other embodiment obtained without making creative work, all should belong to the model of the application protection It encloses.
It should be noted that the description and claims of this application and term " first " in above-mentioned attached drawing, " Two " etc. be to be used to distinguish similar objects, without being used to describe a particular order or precedence order.It should be understood that using in this way Data be interchangeable under appropriate circumstances, so as to embodiments herein described herein.In addition, term " includes " and " tool Have " and their any deformation, it is intended that cover it is non-exclusive include, for example, containing a series of steps or units Process, method, system, product or equipment those of are not necessarily limited to be clearly listed step or unit, but may include without clear Other step or units listing to Chu or intrinsic for these process, methods, product or equipment.
In this application, term " on ", "lower", "left", "right", "front", "rear", "top", "bottom", "inner", "outside", " in ", "vertical", "horizontal", " transverse direction ", the orientation or positional relationship of the instructions such as " longitudinal direction " be orientation based on the figure or Positional relationship.These terms are not intended to limit indicated dress primarily to better describe the application and embodiment Set, element or component must have particular orientation, or constructed and operated with particular orientation.
Also, above-mentioned part term is other than it can be used to indicate that orientation or positional relationship, it is also possible to for indicating it His meaning, such as term " on " also are likely used for indicating certain relations of dependence or connection relationship in some cases.For ability For the those of ordinary skill of domain, the concrete meaning of these terms in this application can be understood as the case may be.
In addition, term " installation ", " setting ", " being equipped with ", " connection ", " connected ", " socket " shall be understood in a broad sense.For example, It may be a fixed connection, be detachably connected or monolithic construction;It can be mechanical connection, or electrical connection;It can be direct phase It even, or indirectly connected through an intermediary, or is two connections internal between device, element or component. For those of ordinary skills, the concrete meaning of above-mentioned term in this application can be understood as the case may be.
It should be noted that in the absence of conflict, the features in the embodiments and the embodiments of the present application can phase Mutually combination.The application is described in detail below with reference to the accompanying drawings and in conjunction with the embodiments.
The data processing method for live streaming in the embodiment of the present application includes: the virtual image for generating the first user;Sentence The first operation that disconnected second user executes the first user;And it is executed on virtual image according to first operation default dynamic Make.Further such that interacting between main broadcaster and spectators not only rests on barrage, ornamental value is increased by virtual image.
Application programming interface (full name in English: Application Programming Interface, referred to as: API)
Software Development Kit (full name in English: Software Development Kit, referred to as: SDK) more usually Software engineer is developing instrument when specific software package, software frame, hardware platform, operating system etc. establish application software Set.
Specifically, this application involves live streaming SDK/API, virtual image SDK/API.
As shown in Figure 1, this method includes the following steps, namely S102 to step S106:
Step S102 generates the virtual image of the first user;
First user is usually the main broadcaster user in live streaming platform, and the virtual image of main broadcaster user is outer with main broadcaster The virtual figure image that looks, posture, makings etc. are consistent.Wherein virtual figure image can using two-dimensional virtual figure image or Three-dimensional figure image is also possible to cartoon character or true man's image etc..If it is intended to the virtual live streaming of viewing can then lead to Virtual image direct broadcasting room is crossed to be watched.
When spectators select main broadcaster to watch live streaming by the client of live streaming platform, first can be generated in the client of spectators and used The virtual image at family.It should be noted that the Rendering logic of virtual image can be live streaming figure layer and rendering figure layer load To the terminal screen of spectators.
The virtual image for generating the first user is usually to bind with virtual image direct broadcasting room, when spectators selected it is different Direct broadcasting room can then generate the different virtual images bound in direct broadcasting room.In addition, main broadcaster can choose to spectators during live streaming Show the virtual image.
It should be noted that when spectators watch be broadcast live when on condition that access live streaming SDK, be broadcast live SDK major function be from Main broadcaster end acquires audio and video data streams, and is distributed to other broadcasting ends.And if it is intended to generating the virtual image of the first user then Need to be allowed to access virtual image SDK.Virtual image SDK is to generate virtual image according to the video data of main broadcaster end acquisition, And forward virtual image and its movement to other broadcasting ends.
Step S104 judges the first operation that second user executes the first user;
After the virtual image for generating the first user, need to judge the first behaviour that second user executes the first user Make.Second user usually live streaming platform in spectators user, and by live streaming platform receive main broadcaster video push and with Other users, main broadcaster carry out text, interactive voice.
Second user can be the action command of second user requirement, such as first to the first operation that the first user executes Operational order is dancing action command, expresses thanks action command etc..
Second user is also possible to second user to the first operation that the first user executes and gives to what the first user carried out Present operation.For example, the first operation is to send flower.
Second user can also be that second user beats reward to what the first user carried out to the first operation that the first user executes Object manipulation.For example, the first operation is to play money reward coin.
Step S106 executes deliberate action according to first operation on virtual image.
According to the first of input the operation when executing deliberate action on virtual image, it can increase between user and main broadcaster It is interactive and can interactive process be become with ornamental value by deliberate action.It operates according to described first virtual When executing deliberate action in image, second user can watch the pre- of the virtual image execution from the first user by client If movement.That is, can all receive the virtual image feedback of the first user when second user has the input of the first operation Deliberate action, further increase user experience.
For example, executing the movement of jazz's dancing on virtual image according to instruction operation of dancing.Spectators pass through client energy Enough watch the dance movement of virtual image.
It should be noted that can be carried out by the virtual image of offer auxiliary main broadcaster be broadcast live, can and non-fully Occur with independent image.The void for main broadcaster only occur can of course be wished according to the developer of different usage scenarios such as client Quasi- image can shield the live streaming crossfire in live streaming SDK to achieve the goal.In this application also not to specifically auxiliary live streaming It is that substitution main broadcaster is broadcast live and is defined.
It can be seen from the above description that the application realizes following technical effect:
In the embodiment of the present application, by the way of the virtual image for generating the first user, by judging second user pair The first of first user execution operates, and has achieved the purpose that execute deliberate action on virtual image according to first operation, To realize the technical effect for increasing user experience and enhancing user's ornamental value, and then solves the interaction mode for live streaming More single technical problem.
By the default feedback of virtual image, interacting for main broadcaster and spectators can be increased, pass through the movement of the default feedback of part The appreciative value that can increase live content is shown by virtual image.In technology realization, client is empty without being concerned about Intend the specific render process of image, only need to activate SDK in the page for needing to render virtual image, and pass through binding direct broadcasting room API adds to obtain rendering figure layer in the page.Then need to be implemented change the outfit, model animation when call it is related This operation can be rendered into automatically in all figure layers for being bundled in same direct broadcasting room by API, SDK.Middle live streaming is different from the prior art Between in by way of beating reward the mode that is interacted, by providing some virtual objects, spectators can be by supplementing with money, exchanging Mode obtains ideal money in these virtual objects of purchase.Feedback in this application can be by deliberate action in virtual shape As showing, especially when main broadcaster is inconvenient to show certain sensitive actions.It is different from the prior art in direct broadcasting room and has The guess function of certain lottery industry property.Guess theme and option are drafted from main broadcaster and issue guess application to platform.In this Shen Please in feedback can be shown by deliberate action in virtual image, can with main broadcaster cooperate for assist live streaming.
According to the embodiment of the present application, as the preferred of the present embodiment, as shown in Fig. 2, generating the virtual image of the first user Include:
Step S202 binds virtual image direct broadcasting room;
The data of virtual image are obtained by binding virtual image direct broadcasting room when the first user generates virtual image.It is preferred that Ground, main broadcaster's client can just get void after must binding virtual image direct broadcasting room when carrying out virtual image live streaming using SDK Intend the data of image.
Preferably, after spectator client must bind virtual image direct broadcasting room when carrying out virtual image viewing using SDK The data of virtual image can just be got.
The virtual shape carried out as unit of it should be noted that needing in access of virtual image SDK by virtual image room As relaying, a mark is so needed when main broadcaster's client is broadcast live and when spectator client plays specify it is specific which One room is relayed and is watched.
Step S204 calls virtual image template according to the virtual image direct broadcasting room;And
Virtual image template can be called in virtual image direct broadcasting room, by generating virtual image template, the first user can Using the vivid template that provides by SDK as the virtual image auxiliary live streaming of oneself or replace live streaming image.
Step S206 generates virtual image in the virtual image direct broadcasting room according to virtual image template.
Virtual image is generated in the corresponding virtual image direct broadcasting room by virtual image template.For example, by tying up The API of direct broadcasting room is determined to obtain the addition of rendering figure layer in live page.In addition, when needing to be implemented the further of virtual image It calls correlation API, virtual image SDK that can move this operation when execution changes the outfit, acts animation and is rendered into all be bundled in together In the figure layer of one direct broadcasting room.
By aforesaid operations step, virtual image direct broadcasting room and client can be bound, so, main broadcaster's client It is being broadcast live or spectator client is when being watched can access SDK and call API therein.
According to the embodiment of the present application, as the preferred of the present embodiment, as shown in figure 3, generating the virtual image of the first user Include:
Step S302 binds virtual image direct broadcasting room;
The data of virtual image are obtained by binding virtual image direct broadcasting room when the first user generates virtual image.It is preferred that Ground, main broadcaster's client can just get void after must binding virtual image direct broadcasting room when carrying out virtual image live streaming using SDK Intend the data of image.
Preferably, after spectator client must bind virtual image direct broadcasting room when carrying out virtual image viewing using SDK The data of virtual image can just be got.
The virtual shape carried out as unit of it should be noted that needing in access of virtual image SDK by virtual image room As relaying, a mark is so needed when main broadcaster's client is broadcast live and when spectator client plays specify it is specific which One room is relayed and is watched.
Step S304 is acquired in the virtual image direct broadcasting room and is uploaded the first user images;And
The first user images of image acquisition device in terminal can be called in virtual image direct broadcasting room, and pass through bat According to mode acquire the real-time imaging of main broadcaster.
Specifically, can be acquired by camera generate main broadcaster enter in the client the acquisition page provided by SDK into Row whole body is taken pictures, and photo upload to background server, background server can be generated void after carrying out intellectual analysis to photo by SDK Quasi- image, and be issued to client and choose whether to assist being broadcast live using the image by main broadcaster.
Step S306 generates virtual image in the virtual image direct broadcasting room according to first user images.
Virtual image is generated in the corresponding virtual image direct broadcasting room by the first user images.For example, by tying up The API of direct broadcasting room is determined to obtain the addition of rendering figure layer in live page.In addition, when needing to be implemented the further of virtual image Called when execution changes the outfit, acts animation correlation API, virtual image SDK can by this operation it is dynamic be rendered into it is all be bundled in together- In the figure layer of direct broadcasting room.
By aforesaid operations step, template can be generated using virtual image, generated and the binding of virtual image direct broadcasting room Virtual image, and the API by binding direct broadcasting room adds to obtain rendering figure layer in live page.
According to the embodiment of the present application, as the preferred of the present embodiment, as shown in figure 4, judging second user to the first user First executed operates
Step S402 judges the first reward instruction operation that second user executes the first user;
Second user instructs operation to can be gift bonus instruction operation the first reward that the first user executes, beats reward void Quasi- article reward instruction operation.
Step S404 executes preset reward feedback action according to the first reward instruction operation on virtual image.
It is instructed according to different rewards and executes related preset reward feedback action on virtual image.Due to having preset difference Reward feedback action, it is possible to which it is dynamic that different preset reward feedbacks is executed on virtual image according to the first reward instruction operation Make.
It should be noted that on virtual image execute preset reward feedback action can according to different actual conditions into Row preset configuration, and fed back when receiving relevant reward instruction operation.In this application not to the specific of feedback Movement or specific reward feedback action are defined.
For example, client developer can in the development phase, for different presents bind different virtual image movements come It expresses and different to present likes degree.For example, virtual image can make eye opening eyeball and open wide simultaneously when spectators give small amount present And the expression of " flashing ".For another example, when spectators give wholesale present, virtual image can dance and make the gesture " than the heart ".
By aforesaid operations step, main broadcaster's real-time image information can be acquired, is generated and the binding of virtual image direct broadcasting room Virtual image, and the API by binding direct broadcasting room adds to obtain rendering figure layer in live page.
According to the embodiment of the present application, as the preferred of the present embodiment, as shown in figure 5, judging second user to the first user First executed operates
Step S502 judges that second user operates the first action command that the first user executes;
The first action command operation that second user executes the first user can be specific action command or in order to Increase the default-action instruction of interaction.
Deliberate action is executed on virtual image according to first operation includes:
Step S504 executes deliberate action feedback action according to first action command operation on virtual image.
According to first action command operation when executing deliberate action feedback action on virtual image, action command behaviour It can be dancing instruction, deliberate action feedback action can be dancing relevant movement, such as jazz, street dance etc..
According to first action command operation when executing deliberate action feedback action on virtual image, action command behaviour It can be interaction instruction, deliberate action feedback action can be the relevant movement of interaction, blink, nods, waves, turn-take.
For example, several fixed movements of the virtual image can be preset: if danced, thank etc..The void can be preset simultaneously Intend several fixed feedback actions of image: if audience is when sending specific present, which can make automatically according to present Feedback.Meanwhile the virtual image can adjust its hair style, clothing etc. in real time.
According to the embodiment of the present application, as the preferred of the present embodiment, as shown in fig. 6, judging second user to the first user After the first operation executed further include:
Step S602 judges the facial emotions variation of the first user;
Can be analyzed the facial picture of the first user by background server can understand and judge the first user Facial emotions variation.Facial emotions variation may include: happiness, anger, grief and joy etc..It should be noted that not right in this application Specific facial emotions variation is defined.
Step S604 changes according to the facial emotions and generates emotional feedback action command;
Changed according to facial emotions and generate emotional feedback action command, those emotional feedback action commands have not only reacted master Real-time mood situation is broadcast, while being needed in loading effect to the virtual image of virtual image direct broadcasting room.
Step S606 executes default emotional feedback movement according to the emotional feedback action command on virtual image.
It is analyzed in real time using the picture that main broadcaster can be broadcast live in virtual image SDK.When the face for detecting main broadcaster have it is bright The moods such as aobvious happiness, anger, grief and joy, virtual image can make the movement of mood consistent with main broadcaster.
It should be noted that step shown in the flowchart of the accompanying drawings can be in such as a group of computer-executable instructions It is executed in computer system, although also, logical order is shown in flow charts, and it in some cases, can be with not The sequence being same as herein executes shown or described step.
According to the embodiment of the present application, additionally provide a kind of for implementing the data of the above-mentioned data processing method for live streaming Processing unit, as shown in fig. 7, the device includes:
Generation module 10, for generating the virtual image of the first user;
The first user is usually the main broadcaster user in live streaming platform, main broadcaster user in the generation module 10 of the present embodiment Virtual image be the virtual figure image being consistent with the appearance of main broadcaster, posture, makings etc..Wherein virtual figure image can be adopted With two-dimensional virtual figure image, perhaps three-dimensional figure image is also possible to cartoon character or true man's image etc..If it is desired to Watching virtual live streaming can then be watched by virtual image direct broadcasting room.
When spectators select main broadcaster to watch live streaming by the client of live streaming platform, first can be generated in the client of spectators and used The virtual image at family.It should be noted that the Rendering logic of virtual image can be live streaming figure layer and rendering figure layer load To the terminal screen of spectators.
The virtual image for generating the first user is usually to bind with virtual image direct broadcasting room, when spectators selected it is different Direct broadcasting room can then generate the different virtual images bound in direct broadcasting room.In addition, main broadcaster can choose to spectators during live streaming Show the virtual image.
It should be noted that when spectators watch be broadcast live when on condition that access live streaming SDK, be broadcast live SDK major function be from Main broadcaster end acquires audio and video data streams, and is distributed to other broadcasting ends.And if it is intended to generating the virtual image of the first user then Need to be allowed to access virtual image SDK.Virtual image SDK is to generate virtual image according to the video data of main broadcaster end acquisition, And forward virtual image and its movement to other broadcasting ends.
Judgment module 20, the first operation that the first user is executed for judging second user;And
In the judgment module 20 of the present embodiment after the virtual image for generating the first user, need to judge second user The first operation that first user is executed.Spectators user of the second user usually in live streaming platform, and connect by the way that platform is broadcast live It receives the video push of main broadcaster and carries out text, interactive voice with other users, main broadcaster.
Second user can be the action command of second user requirement, such as first to the first operation that the first user executes Operational order is dancing action command, expresses thanks action command etc..
Second user is also possible to second user to the first operation that the first user executes and gives to what the first user carried out Present operation.For example, the first operation is to send flower.
Second user can also be that second user beats reward to what the first user carried out to the first operation that the first user executes Object manipulation.For example, the first operation is to play money reward coin.
Execution module 30, to execute deliberate action on virtual image according to first operation.
In the execution module 30 of the present embodiment according to the first of input the operation when executing deliberate action on virtual image, The interactivity between user and main broadcaster can be increased and can interactive process be become with ornamental value by deliberate action. According to first operation, when executing deliberate action on virtual image, second user can be watched by client from the The deliberate action that the virtual image of one user executes.That is, can all be received when second user has the input of the first operation The deliberate action fed back to the virtual image of the first user, further increases user experience.
For example, executing the movement of jazz's dancing on virtual image according to instruction operation of dancing.Spectators pass through client energy Enough watch the dance movement of virtual image.
It should be noted that can be carried out by the virtual image of offer auxiliary main broadcaster be broadcast live, can and non-fully Occur with independent image.The void for main broadcaster only occur can of course be wished according to the developer of different usage scenarios such as client Quasi- image can shield the live streaming crossfire in live streaming SDK to achieve the goal.In this application also not to specifically auxiliary live streaming It is that substitution main broadcaster is broadcast live and is defined.
It can be seen from the above description that the application realizes following technical effect:
In the embodiment of the present application, by the way of the virtual image for generating the first user, by judging second user pair The first of first user execution operates, and has achieved the purpose that execute deliberate action on virtual image according to first operation, To realize the technical effect for increasing user experience and enhancing user's ornamental value, and then solves the interaction mode for live streaming More single technical problem.
By the default feedback of virtual image, interacting for main broadcaster and spectators can be increased, pass through the movement of the default feedback of part The appreciative value that can increase live content is shown by virtual image.In technology realization, client is empty without being concerned about Intend the specific render process of image, only need to activate SDK in the page for needing to render virtual image, and pass through binding direct broadcasting room API adds to obtain rendering figure layer in the page.Then need to be implemented change the outfit, model animation when call it is related This operation can be rendered into automatically in all figure layers for being bundled in same direct broadcasting room by API, SDK.Middle live streaming is different from the prior art Between in by way of beating reward the mode that is interacted, by providing some virtual objects, spectators can be by supplementing with money, exchanging Mode obtains ideal money in these virtual objects of purchase.Feedback in this application can be by deliberate action in virtual shape As showing, especially when main broadcaster is inconvenient to show certain sensitive actions.It is different from the prior art in direct broadcasting room and has The guess function of certain lottery industry property.Guess theme and option are drafted from main broadcaster and issue guess application to platform.In this Shen Please in feedback can be shown by deliberate action in virtual image, can with main broadcaster cooperate for assist live streaming.
According to the embodiment of the present application, a kind of data processing equipment for live streaming is provided, as shown in figure 8, the generation Module 10 includes:
First binding unit 1011, for binding virtual image direct broadcasting room;
When the first user generates virtual image by binding virtual shape in first binding unit 1011 of the present embodiment As direct broadcasting room obtains the data of virtual image.Preferably, main broadcaster's client must be tied up when carrying out virtual image live streaming using SDK Determine the data that virtual image can be just got after virtual image direct broadcasting room.
Preferably, after spectator client must bind virtual image direct broadcasting room when carrying out virtual image viewing using SDK The data of virtual image can just be got.
The virtual shape carried out as unit of it should be noted that needing in access of virtual image SDK by virtual image room As relaying, a mark is so needed when main broadcaster's client is broadcast live and when spectator client plays specify it is specific which One room is relayed and is watched.
Virtual image modular unit 1012, for calling virtual image template according to the virtual image direct broadcasting room;And
Virtual image mould can be called in virtual image direct broadcasting room in the virtual image modular unit 1012 of the present embodiment Plate, by generate virtual image template, the first user can by SDK provide vivid template as oneself virtual image it is auxiliary It helps live streaming or replaces live streaming image.
First generation unit 1013, for generating virtual shape in the virtual image direct broadcasting room according to virtual image template As.
It is straight in the corresponding virtual image by virtual image template in first generation unit 1013 of the present embodiment Middle generation virtual image between broadcasting.It is added in live page for example, obtaining rendering figure layer by the API for binding direct broadcasting room. In addition, calling correlation API, virtual image SDK when the further execution for needing to be implemented virtual image changes the outfit, acts animation This operation can be moved and be rendered into all figure layers for being bundled in same direct broadcasting room.
By aforesaid operations step, virtual image direct broadcasting room and client can be bound, so, main broadcaster's client It is being broadcast live or spectator client is when being watched can access SDK and call API therein.
According to the embodiment of the present application, a kind of data processing equipment for live streaming is provided, as shown in figure 9, the generation Module 10 includes:
Second binding unit 1021, for binding virtual image direct broadcasting room;
When the first user generates virtual image by binding virtual shape in second binding unit 1021 of the present embodiment As direct broadcasting room obtains the data of virtual image.Preferably, main broadcaster's client must be tied up when carrying out virtual image live streaming using SDK Determine the data that virtual image can be just got after virtual image direct broadcasting room.
Preferably, after spectator client must bind virtual image direct broadcasting room when carrying out virtual image viewing using SDK The data of virtual image can just be got.
The virtual shape carried out as unit of it should be noted that needing in access of virtual image SDK by virtual image room As relaying, a mark is so needed when main broadcaster's client is broadcast live and when spectator client plays specify it is specific which One room is relayed and is watched.
Image acquisition units 1022 acquire in the virtual image direct broadcasting room and upload the first user images;And
The image in terminal can be called to adopt in virtual image direct broadcasting room in the image acquisition units 1022 of the present embodiment Acquisition means acquire the first user images, and the real-time imaging of main broadcaster is acquired by way of taking pictures.
Specifically, can be acquired by camera generate main broadcaster enter in the client the acquisition page provided by SDK into Row whole body is taken pictures, and photo upload to background server, background server can be generated void after carrying out intellectual analysis to photo by SDK Quasi- image, and be issued to client and choose whether to assist being broadcast live using the image by main broadcaster.
Second generation unit 1023, for generating void in the virtual image direct broadcasting room according to first user images Quasi- image.
It is straight in the corresponding virtual image by the first user images in second generation unit 1023 of the present embodiment Middle generation virtual image between broadcasting.It is added in live page for example, obtaining rendering figure layer by the API for binding direct broadcasting room. In addition, calling correlation API, virtual image SDK when the further execution for needing to be implemented virtual image changes the outfit, acts animation This operation can be moved and be rendered into all figure layers for being bundled in same direct broadcasting room.
By aforesaid operations step, template can be generated using virtual image, generated and the binding of virtual image direct broadcasting room Virtual image, and the API by binding direct broadcasting room adds to obtain rendering figure layer in live page.
According to the embodiment of the present application, a kind of data processing equipment for live streaming is provided, as shown in Figure 10, for being broadcast live Data processing equipment include: judgment module 20, execution module 30, the judgment module 20 include: the first judging unit 201, Second judgment unit 202, the execution module 30 include: the first execution unit 301, the second execution unit 302,
First judging unit 201, the first reward instruction operation that the first user is executed for judging second user;
The first reward instruction operation that second user executes the first user in first judging unit 201 of the present embodiment It can be gift bonus instruction operation, play reward virtual objects reward instruction operation
Second judgment unit 202, for judging that second user operates the first action command that the first user executes;
Can be analyzed the facial picture of the first user by background server can understand and judge the first user Facial emotions variation.Facial emotions variation may include: happiness, anger, grief and joy etc..It should be noted that not right in this application Specific facial emotions variation is defined.
First execution unit 301, for executing preset reward on virtual image according to the first reward instruction operation Feedback action;And
It is instructed according to different rewards and executes related preset reward feedback action on virtual image.Due to having preset difference Reward feedback action, it is possible to which it is dynamic that different preset reward feedbacks is executed on virtual image according to the first reward instruction operation Make.
It should be noted that on virtual image execute preset reward feedback action can according to different actual conditions into Row preset configuration, and fed back when receiving relevant reward instruction operation.In this application not to the specific of feedback Movement or specific reward feedback action are defined.
For example, client developer can in the development phase, for different presents bind different virtual image movements come It expresses and different to present likes degree.For example, virtual image can make eye opening eyeball and open wide simultaneously when spectators give small amount present And the expression of " flashing ".For another example, when spectators give wholesale present, virtual image can dance and make the gesture " than the heart ".
By aforesaid operations step, main broadcaster's real-time image information can be acquired, is generated and the binding of virtual image direct broadcasting room Virtual image, and the API by binding direct broadcasting room adds to obtain rendering figure layer in live page.
Second execution unit 302, for executing deliberate action on virtual image according to first action command operation Feedback action.
It is executed on virtual image in second execution unit 302 of the present embodiment according to first action command operation When deliberate action feedback action, action command operation can be dancing instruction, and deliberate action feedback action can be dancing correlation Movement, such as jazz, street dance etc..
According to first action command operation when executing deliberate action feedback action on virtual image, action command behaviour It can be interaction instruction, deliberate action feedback action can be the relevant movement of interaction, blink, nods, waves, turn-take.
For example, several fixed movements of the virtual image can be preset: if danced, thank etc..The void can be preset simultaneously Intend several fixed feedback actions of image: if audience is when sending specific present, which can make automatically according to present Feedback.Meanwhile the virtual image can adjust its hair style, clothing etc. in real time.
Obviously, those skilled in the art should be understood that each module of above-mentioned the application or each step can be with general Computing device realize that they can be concentrated on a single computing device, or be distributed in multiple computing devices and formed Network on, optionally, they can be realized with the program code that computing device can perform, it is thus possible to which they are stored Be performed by computing device in the storage device, perhaps they are fabricated to each integrated circuit modules or by they In multiple modules or step be fabricated to single integrated circuit module to realize.In this way, the application be not limited to it is any specific Hardware and software combines.
The foregoing is merely preferred embodiment of the present application, are not intended to limit this application, for the skill of this field For art personnel, various changes and changes are possible in this application.Within the spirit and principles of this application, made any to repair Change, equivalent replacement, improvement etc., should be included within the scope of protection of this application.

Claims (10)

1. a kind of data processing method for live streaming characterized by comprising
Generate the virtual image of the first user;
Judge the first operation that second user executes the first user;And
Deliberate action is executed on virtual image according to first operation.
2. data processing according to claim 1, which is characterized in that the virtual image for generating the first user includes:
Bind virtual image direct broadcasting room;
Virtual image template is called according to the virtual image direct broadcasting room;And
Virtual image is generated in the virtual image direct broadcasting room according to virtual image template.
3. data processing according to claim 1, which is characterized in that the virtual image for generating the first user includes:
Bind virtual image direct broadcasting room;
It is acquired in the virtual image direct broadcasting room and uploads the first user images;And
Virtual image is generated in the virtual image direct broadcasting room according to first user images.
4. data processing according to claim 1, which is characterized in that
Judge that second user includes: to the first operation that the first user executes
Judge the first reward instruction operation that second user executes the first user;
Deliberate action is executed on virtual image according to first operation includes:
Preset reward feedback action is executed on virtual image according to the first reward instruction operation.
5. data processing according to claim 1, which is characterized in that
Judge that second user includes: to the first operation that the first user executes
Judge that second user operates the first action command that the first user executes;
Deliberate action is executed on virtual image according to first operation includes:
Deliberate action feedback action is executed on virtual image according to first action command operation.
6. data processing according to claim 1, which is characterized in that judge second user executes the first user first After operation further include:
Judge the facial emotions variation of the first user;
Changed according to the facial emotions and generates emotional feedback action command;
Default emotional feedback movement is executed on virtual image according to the emotional feedback action command.
7. a kind of data processing equipment for live streaming characterized by comprising
Generation module, for generating the virtual image of the first user;
Judgment module, the first operation that the first user is executed for judging second user;And
Execution module, to execute deliberate action on virtual image according to first operation.
8. data processing equipment according to claim 7, which is characterized in that the generation module includes:
First binding unit, for binding virtual image direct broadcasting room;
Virtual image modular unit, for calling virtual image template according to the virtual image direct broadcasting room;And
First generation unit, for generating virtual image in the virtual image direct broadcasting room according to virtual image template.
9. data processing equipment according to claim 7, which is characterized in that the generation module includes:
Second binding unit, for binding virtual image direct broadcasting room;
Image acquisition units acquire in the virtual image direct broadcasting room and upload the first user images;And
Second generation unit, for generating virtual image in the virtual image direct broadcasting room according to first user images.
10. data processing equipment according to claim 7 characterized by comprising judgment module, execution module are described Judgment module includes: the first judging unit, second judgment unit, and the execution module includes: the first execution unit, the second execution Unit,
First judging unit, the first reward instruction operation that the first user is executed for judging second user;
Second judgment unit, for judging that second user operates the first action command that the first user executes;
First execution unit, it is dynamic for executing preset reward feedback on virtual image according to the first reward instruction operation Make;And
Second execution unit, it is dynamic for executing deliberate action feedback on virtual image according to first action command operation Make.
CN201810835968.4A 2018-07-26 2018-07-26 Data processing method and device for live broadcast Active CN108986192B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810835968.4A CN108986192B (en) 2018-07-26 2018-07-26 Data processing method and device for live broadcast

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810835968.4A CN108986192B (en) 2018-07-26 2018-07-26 Data processing method and device for live broadcast

Publications (2)

Publication Number Publication Date
CN108986192A true CN108986192A (en) 2018-12-11
CN108986192B CN108986192B (en) 2024-01-30

Family

ID=64551111

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810835968.4A Active CN108986192B (en) 2018-07-26 2018-07-26 Data processing method and device for live broadcast

Country Status (1)

Country Link
CN (1) CN108986192B (en)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110087121A (en) * 2019-04-30 2019-08-02 广州虎牙信息科技有限公司 Virtual image display methods, virtual image display device and electronic equipment
CN110691279A (en) * 2019-08-13 2020-01-14 北京达佳互联信息技术有限公司 Virtual live broadcast method and device, electronic equipment and storage medium
CN112135160A (en) * 2020-09-24 2020-12-25 广州博冠信息科技有限公司 Virtual object control method and device in live broadcast, storage medium and electronic equipment
CN113099298A (en) * 2021-04-08 2021-07-09 广州华多网络科技有限公司 Method and device for changing virtual image and terminal equipment
CN113329234A (en) * 2021-05-28 2021-08-31 腾讯科技(深圳)有限公司 Live broadcast interaction method and related equipment
CN113538642A (en) * 2021-07-20 2021-10-22 广州虎牙科技有限公司 Virtual image generation method and device, electronic equipment and storage medium
JP2021170168A (en) * 2020-04-14 2021-10-28 グリー株式会社 Computer program, server apparatus, terminal apparatus, and method
JP2021174283A (en) * 2020-04-27 2021-11-01 グリー株式会社 Computer program, server device, terminal device, and method
JP2021189674A (en) * 2020-05-28 2021-12-13 グリー株式会社 Computer program, server device, terminal device, and method
CN114885199A (en) * 2022-04-18 2022-08-09 北京达佳互联信息技术有限公司 Real-time interaction method, device, electronic equipment, storage medium and system

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120069131A1 (en) * 2010-05-28 2012-03-22 Abelow Daniel H Reality alternate
US20160228771A1 (en) * 2015-02-05 2016-08-11 Sony Computer Entertainment Inc. Motion sickness monitoring and application of supplemental sound to counteract sickness
CN106878820A (en) * 2016-12-09 2017-06-20 北京小米移动软件有限公司 Living broadcast interactive method and device
CN107087217A (en) * 2017-03-10 2017-08-22 北京潘达互娱科技有限公司 Interface alternation method and live client in net cast
CN107438183A (en) * 2017-07-26 2017-12-05 北京暴风魔镜科技有限公司 A kind of virtual portrait live broadcasting method, apparatus and system
CN107682729A (en) * 2017-09-08 2018-02-09 广州华多网络科技有限公司 It is a kind of based on live interactive approach and live broadcast system, electronic equipment
CN107750005A (en) * 2017-09-18 2018-03-02 迈吉客科技(北京)有限公司 Virtual interactive method and terminal
CN108200446A (en) * 2018-01-12 2018-06-22 北京蜜枝科技有限公司 Multimedia interactive system and method on the line of virtual image

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120069131A1 (en) * 2010-05-28 2012-03-22 Abelow Daniel H Reality alternate
US20160228771A1 (en) * 2015-02-05 2016-08-11 Sony Computer Entertainment Inc. Motion sickness monitoring and application of supplemental sound to counteract sickness
CN106878820A (en) * 2016-12-09 2017-06-20 北京小米移动软件有限公司 Living broadcast interactive method and device
CN107087217A (en) * 2017-03-10 2017-08-22 北京潘达互娱科技有限公司 Interface alternation method and live client in net cast
CN107438183A (en) * 2017-07-26 2017-12-05 北京暴风魔镜科技有限公司 A kind of virtual portrait live broadcasting method, apparatus and system
CN107682729A (en) * 2017-09-08 2018-02-09 广州华多网络科技有限公司 It is a kind of based on live interactive approach and live broadcast system, electronic equipment
CN107750005A (en) * 2017-09-18 2018-03-02 迈吉客科技(北京)有限公司 Virtual interactive method and terminal
CN108200446A (en) * 2018-01-12 2018-06-22 北京蜜枝科技有限公司 Multimedia interactive system and method on the line of virtual image

Cited By (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110087121A (en) * 2019-04-30 2019-08-02 广州虎牙信息科技有限公司 Virtual image display methods, virtual image display device and electronic equipment
CN110087121B (en) * 2019-04-30 2021-08-06 广州虎牙信息科技有限公司 Avatar display method, avatar display apparatus, electronic device, and storage medium
CN110691279A (en) * 2019-08-13 2020-01-14 北京达佳互联信息技术有限公司 Virtual live broadcast method and device, electronic equipment and storage medium
JP2021170168A (en) * 2020-04-14 2021-10-28 グリー株式会社 Computer program, server apparatus, terminal apparatus, and method
JP7398655B2 (en) 2020-04-14 2023-12-15 グリー株式会社 Computer program, server device, terminal device, and method
JP2021174283A (en) * 2020-04-27 2021-11-01 グリー株式会社 Computer program, server device, terminal device, and method
JP7329217B2 (en) 2020-04-27 2023-08-18 グリー株式会社 Computer program, server device, terminal device, and method
JP2021189674A (en) * 2020-05-28 2021-12-13 グリー株式会社 Computer program, server device, terminal device, and method
CN112135160A (en) * 2020-09-24 2020-12-25 广州博冠信息科技有限公司 Virtual object control method and device in live broadcast, storage medium and electronic equipment
CN113099298A (en) * 2021-04-08 2021-07-09 广州华多网络科技有限公司 Method and device for changing virtual image and terminal equipment
CN113099298B (en) * 2021-04-08 2022-07-12 广州华多网络科技有限公司 Method and device for changing virtual image and terminal equipment
CN113329234A (en) * 2021-05-28 2021-08-31 腾讯科技(深圳)有限公司 Live broadcast interaction method and related equipment
CN113329234B (en) * 2021-05-28 2022-06-10 腾讯科技(深圳)有限公司 Live broadcast interaction method and related equipment
CN113538642A (en) * 2021-07-20 2021-10-22 广州虎牙科技有限公司 Virtual image generation method and device, electronic equipment and storage medium
CN114885199A (en) * 2022-04-18 2022-08-09 北京达佳互联信息技术有限公司 Real-time interaction method, device, electronic equipment, storage medium and system
CN114885199B (en) * 2022-04-18 2024-02-23 北京达佳互联信息技术有限公司 Real-time interaction method, device, electronic equipment, storage medium and system

Also Published As

Publication number Publication date
CN108986192B (en) 2024-01-30

Similar Documents

Publication Publication Date Title
CN108986192A (en) Data processing method and device for live streaming
CN111163274B (en) Video recording method and display equipment
CN106231368B (en) Main broadcaster's class interaction platform stage property rendering method and its device, client
US20100287529A1 (en) Systems and Methods for Generating Multimedia Applications
CN106210861A (en) The method and system of display barrage
TW201227575A (en) Real-time interaction with entertainment content
CN106792228A (en) A kind of living broadcast interactive method and system
US10289193B2 (en) Use of virtual-reality systems to provide an immersive on-demand content experience
CN112533037B (en) Method for generating Lian-Mai chorus works and display equipment
US9454284B2 (en) Web server for supporting collaborative animation production service and method thereof
CN112399264A (en) Projection hall service management method and application
CN111800661A (en) Live broadcast room display control method, electronic device and storage medium
CN114363653A (en) Interactive method, device, equipment, medium and program product based on event live broadcast
CN110730340A (en) Lens transformation-based virtual auditorium display method, system and storage medium
KR100932675B1 (en) Method of video contents manipulation
US20230341993A1 (en) Moving a digital representation of a video conference participant to a new location in a virtual environment
KR20200004009A (en) Platform for video mixing in studio environment
CN109688347A (en) Multi-screen interaction method, device and electronic equipment
KR20180021623A (en) System and method for providing virtual reality content
KR20130067855A (en) Apparatus and method for providing virtual 3d contents animation where view selection is possible
CN112073826B (en) Method for displaying state of recorded video works, server and terminal equipment
JP7313847B2 (en) Photography system, photography device, management device and photography method
CN112533023B (en) Method for generating Lian-Mai chorus works and display equipment
WO2020248682A1 (en) Display device and virtual scene generation method
KR101153952B1 (en) Animation action experience contents service system and method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant