CN110087128A - Living broadcast interactive method, living broadcast interactive device and live streaming equipment - Google Patents

Living broadcast interactive method, living broadcast interactive device and live streaming equipment Download PDF

Info

Publication number
CN110087128A
CN110087128A CN201910370393.8A CN201910370393A CN110087128A CN 110087128 A CN110087128 A CN 110087128A CN 201910370393 A CN201910370393 A CN 201910370393A CN 110087128 A CN110087128 A CN 110087128A
Authority
CN
China
Prior art keywords
live
live streaming
video stream
living broadcast
broadcast interactive
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910370393.8A
Other languages
Chinese (zh)
Inventor
徐子豪
吴施祈
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou Huya Information Technology Co Ltd
Original Assignee
Guangzhou Huya Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Huya Information Technology Co Ltd filed Critical Guangzhou Huya Information Technology Co Ltd
Priority to CN201910370393.8A priority Critical patent/CN110087128A/en
Publication of CN110087128A publication Critical patent/CN110087128A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/40Support for services or applications
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60Network streaming of media packets
    • H04L65/75Media network packet handling
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/44016Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving splicing one content stream with another content stream, e.g. for substituting a video clip
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/478Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting

Abstract

Living broadcast interactive method, living broadcast interactive device and the live streaming equipment that the disclosure provides, are related to network direct broadcasting technical field.In detail, living broadcast interactive method is applied to provide the live streaming equipment of direct broadcast service, according to the request for the same direct broadcasting room of addition that at least two live streaming originating ends are initiated, obtain live streaming background video stream, and receive the live video stream that each live streaming originating end is sent, it include the video flowing of the corresponding virtual newscaster of the live streaming originating end in the live video stream, and then the live video stream and live streaming background video stream are synthesized, obtain living broadcast interactive video flowing, the living broadcast interactive video stream is enhanced into the interactivity of live streaming to receiving end is broadcast live later.

Description

Living broadcast interactive method, living broadcast interactive device and live streaming equipment
Technical field
This disclosure relates to network direct broadcasting technical field, in particular to a kind of living broadcast interactive method, living broadcast interactive device And live streaming equipment.
Background technique
In network direct broadcasting field, main broadcaster can carry out net cast by live streaming APP (Application), broadcast for spectators Excellent program, spectators can also pass through live streaming APP viewing live streaming.Live streaming APP can also realize that spectators interact with main broadcaster, through grinding Study carefully discovery, during live streaming, interaction mode is more single, and interactivity is to be improved.
Summary of the invention
In view of this, the disclosure provides a kind of living broadcast interactive method, living broadcast interactive device and live streaming equipment, live streaming is promoted Interactivity, enhancing live streaming interactive experience.
On the one hand, the disclosure provides a kind of living broadcast interactive method, applied to the live streaming equipment of offer direct broadcast service, the side Method includes:
According to the request for the same direct broadcasting room of addition that at least two live streaming originating ends are initiated, live streaming background video stream is obtained;
The live video stream that each live streaming originating end is sent is received, includes that the live streaming is initiated in the live video stream Hold the video flowing of corresponding virtual newscaster;
The live video stream and live streaming background video stream are synthesized, obtain living broadcast interactive video flowing, and will be described Living broadcast interactive video stream is to being broadcast live receiving end.
On the other hand, the embodiment of the present disclosure additionally provides a kind of living broadcast interactive device, applied to the straight of offer direct broadcast service Equipment is broadcast, the living broadcast interactive device includes:
Video flowing obtains module, the request of the same direct broadcasting room of addition for being initiated according at least two live streaming originating ends, Obtain live streaming background video stream;
Video flowing receiving module, the live video stream sent for receiving each live streaming originating end, the live streaming view It include the video flowing of the corresponding virtual newscaster of the live streaming originating end in frequency stream;
Video flowing synthesis module is broadcast live for synthesizing the live video stream and live streaming background video stream Interdynamic video stream, and by the living broadcast interactive video stream to receiving end is broadcast live.
On the basis of the above, the embodiment of the present disclosure additionally provides a kind of computer readable storage medium, is stored thereon with meter Calculation machine program, the program are performed the step of realizing above-mentioned living broadcast interactive method.
On the basis of the above, the embodiment of the present disclosure additionally provides a kind of live streaming equipment, including memory, processor and storage It is real when which runs on the processor in the memory and the computer program that can run on the processor The step of showing above-mentioned living broadcast interactive method.
Living broadcast interactive method, living broadcast interactive device and the live streaming equipment that the disclosure provides, are broadcast live originating end at least two When initiating that the request of same direct broadcasting room is added, the live streaming that the live streaming background video stream of direct broadcasting room and each live streaming originating end are initiated is regarded Frequency stream is synthesized, and obtains including the same living broadcast interactive video flowing that the interactive information under background between each virtual newscaster is broadcast live, The interactivity of live streaming is enhanced, to realize that diversified interaction mode provides possibility.
To enable the above objects, features, and advantages of the disclosure to be clearer and more comprehensible, preferred embodiment is cited below particularly, and cooperate Appended attached drawing, is described in detail below.
Detailed description of the invention
Fig. 1 is the application scenarios schematic diagram that the embodiment of the present disclosure provides.
Fig. 2 is the block diagram for the live streaming equipment that the embodiment of the present disclosure provides.
Fig. 3 is the flow diagram for the living broadcast interactive method that the embodiment of the present disclosure provides.
Fig. 4 is another flow diagram for the living broadcast interactive method that the embodiment of the present disclosure provides.
Fig. 5 is a kind of living broadcast interactive interface schematic diagram that the embodiment of the present disclosure provides.
Fig. 6 is the block diagram for the functional module that the living broadcast interactive device that the embodiment of the present disclosure provides includes.
Icon: equipment is broadcast live in 10-;12- memory;13- living broadcast interactive device;14- processor;131- video flowing obtains mould Block;132- video flowing receiving module;133- video flowing synthesis module;Originating end is broadcast live in 20-;Receiving end is broadcast live in 30-.
Specific embodiment
More single in view of the interaction mode during being broadcast live now, interactivity is to be improved, in order to enrich living broadcast interactive Property, it by the virtual newscaster and can be seen in live streaming showing interface virtual newscaster (virtual image of main broadcaster) during live streaming Crowd interacts, and to promote interactivity, and then promotes user experience.However, live streaming process is usually a main broadcaster and multiple sights Crowd interacts, and interaction effect and live streaming atmosphere are weaker.Or multiple main broadcasters positioned at different location access the same direct broadcasting room It is interacted with multiple spectators, however such mode is only simple picture synthesis, in live streaming showing interface during live streaming Each main broadcaster is broadcast live all in respective live streaming background, and for reality image, the live authenticity of shortage, between each main broadcaster Interactivity also has to be hoisted.
For example, in general, spectators may pay close attention to different main broadcasters simultaneously or different main broadcasters may be just identical straight Theme is broadcast to be broadcast live in different direct broadcasting rooms respectively.If spectators want to watch difference of interest respectively in some period The live content of main broadcaster, then need constantly to switch in different direct broadcasting rooms and be just able to achieve.Correspondingly, if different main broadcasters Same topic is broadcast live in different direct broadcasting rooms, can not also allow and same spectators while watch in the live streaming of different direct broadcasting rooms Hold, is all lacking so as to cause the interaction sense of live streaming and experience sense.
In view of this, the disclosure provides a kind of living broadcast interactive method, living broadcast interactive device and live streaming equipment, each main broadcaster's difference A corresponding virtual newscaster, when at least two live streaming originating ends initiate that the request of same direct broadcasting room is added, by the live streaming of direct broadcasting room The live video stream that background video stream and each live streaming originating end are initiated is synthesized, and obtains including each virtual under same live streaming background The living broadcast interactive video flowing of interactive information between main broadcaster accesses after same direct broadcasting room even if each main broadcaster is located at different location, Showing is the live streaming interaction under same live streaming background, the interactivity of live streaming is enhanced, to realize diversified interaction side Formula provides possibility, enhances live streaming interactive experience.
To keep the purposes, technical schemes and advantages of the embodiment of the present disclosure clearer, below in conjunction with the embodiment of the present disclosure In attached drawing, the technical solution in the embodiment of the present disclosure is clearly and completely described, it is clear that described embodiment only It is a part of this disclosure embodiment, instead of all the embodiments.The disclosure being usually described and illustrated herein in the accompanying drawings The component of embodiment can be arranged and be designed with a variety of different configurations.
Therefore, the detailed description of the embodiment of the disclosure provided in the accompanying drawings is not intended to limit below claimed The scope of the present disclosure, but be merely representative of the selected embodiment of the disclosure.Based on the embodiment in the disclosure, this field is common Technical staff's every other embodiment obtained without creative efforts belongs to the model of disclosure protection It encloses.
As shown in Figure 1, the embodiment of the present disclosure provides a kind of application scenarios of living broadcast interactive scheme, wherein live streaming equipment 10 communicate to connect with live streaming originating end 20 and live streaming receiving end 30.Live streaming equipment 10 can be to be connect for live streaming originating end 20 and live streaming The server of the offer direct broadcast service of receiving end 30.It can be the corresponding terminal device in main broadcaster end that originating end 20, which is broadcast live, and main broadcaster can lead to It crosses live streaming originating end 20 and initiates the request that direct broadcasting room is added to live streaming equipment 10, live video stream is sent to live streaming equipment 10. It can be viewer end (user terminal) corresponding terminal device that receiving end 30, which is broadcast live, and spectators can be obtained directly by the way that receiving end 30 is broadcast live The living broadcast interactive video flowing for broadcasting the transmission of equipment 10, to watch live video.
In some implement scenes, live streaming originating end 20 and live streaming receiving end 30 be may be used interchangeably.For example, main broadcaster can be with Live video service is provided for spectators using live streaming originating end 20, live streaming spectators is can also be used as and is checked using live streaming originating end 20 The live video that other main broadcasters provide.In another example live streaming receiving end 30, which can be used, in spectators watches the live video that main broadcaster provides, It can also be used as main broadcaster and provide live video service using live streaming receiving end 30 for other spectators.
In the present embodiment, live streaming originating end 20 and live streaming receiving end 30 can be but not limited to smart phone, tablet computer, Personal computer, laptop, virtual reality terminal device, augmented reality terminal device etc..Wherein, 20 He of originating end is broadcast live Live streaming can be equipped in receiving end 30 for providing the internet product of internet direct broadcast service, for example, internet product can To be application APP relevant to internet direct broadcast service, Web (World Wide used in computer or smart phone Web, global wide area network) webpage, small routine etc..
Live streaming equipment 10 and a live streaming originating end 20 are illustrated only in Fig. 1 and one is broadcast live what receiving end 30 communicated to connect Schematic diagram, it should be understood that the live streaming equipment 10 in the disclosure can be with multiple live streaming originating ends 20 and multiple live streaming receiving ends 30 Communication connection.
Fig. 2 is please referred to, in one implementation, the live streaming equipment 10 may include memory 12, be broadcast live mutually Dynamic device 13 and processor 14.It is directly or indirectly electrically connected between the memory 12 and processor 14, to realize data Transmission or interaction.It is electrically connected for example, can be realized between each other by one or more communication bus or signal wire.It is described straight Broadcasting interactive device 13 includes that at least one can be stored in the memory 12 in the form of software or firmware (firmware) Software function module.The processor 14 is used to execute the executable computer program stored in the memory 12, for example, Software function module and computer program etc. included by the living broadcast interactive device 13, to realize the living broadcast interactive in the disclosure Method.
It is appreciated that structure shown in Fig. 2 is only to illustrate, the live streaming equipment 10 may also include more than shown in Fig. 2 Perhaps less component or with the configuration different from shown in Fig. 2, for example, live streaming equipment 10 can also include be used for and its The communication unit of its equipment progress information exchange.Wherein, each component shown in Fig. 2 can use hardware, software, or its combination It realizes.
Fig. 3 is please referred to, the embodiment of the present disclosure provides a kind of live streaming equipment that can be applied to above-mentioned offer direct broadcast service 10 living broadcast interactive method.Wherein, method and step defined in the related process of the living broadcast interactive method can be by described straight Broadcast the realization of equipment 10.Detailed process shown in Fig. 3 will be described in detail below.
Step S110: it according to the request for the same direct broadcasting room of addition that at least two live streaming originating ends 20 are initiated, is broadcast live Background video stream.
In one implementation, being broadcast live in equipment 10 can store the corresponding direct broadcasting room of different scenes, if it exists At least two live streaming originating ends 20 select Same Scene, then determine that at least two live streamings originating end initiates to be added and the same field The request of the corresponding same direct broadcasting room of scape.
Wherein, the corresponding scene of each direct broadcasting room can flexibly be set, for example, can for interaction play game scene, Interact the scene presided over, scene of interaction match etc..The live streaming background video stream of each direct broadcasting room corresponding with different scenes is distinguished Setting, for example, with interaction play the scene of game corresponding direct broadcasting room background video stream can by simulate object for appreciation game Scene.In another example the background video stream of direct broadcasting room corresponding with the scene that interaction is presided over can be the field presided over simulated Scape may include microphone, band, stage etc. in scene.In another example background video stream can also include background special efficacy etc..Base It can be obtained when there are at least two live streaming originating ends 20 initiating that the request of same direct broadcasting room is added in this and request to be added Direct broadcasting room live streaming background video stream.
It is understood that the live streaming background video stream of each direct broadcasting room can store it is local in live streaming equipment 10, can also be with Be stored in the cloud that is able to access that of live streaming equipment 10, the disclosure to this with no restriction.
Step S120: the live video stream that each live streaming originating end 20 is sent is received, is wrapped in the live video stream Include the video flowing of the corresponding virtual newscaster of the live streaming originating end 20.
In one implementation, each main broadcaster respectively corresponds a virtual image, which constitutes virtual newscaster, each straight Broadcasting the live video data of the available main broadcaster of origin or beginning 20 and being generated according to the live video data of main broadcaster includes virtual newscaster Video flowing live video stream.Equipment 10 is broadcast live and receives the straight of each live streaming originating end 20 transmission for requesting that same direct broadcasting room is added Video flowing is broadcast, video flowing of the corresponding each virtual newscaster of each live streaming originating end 20 in same live streaming background can be obtained.
In the disclosure, live video stream can obtain in several ways, for example, live streaming originating end 20 can obtain in real time The operation of live streaming performed by main broadcaster, such as sound, expression, movement, the live streaming operation based on acquired main broadcaster control virtual main It broadcasts and executes corresponding operation, generate the live video stream of the video flowing including virtual newscaster.
In one implementation, the live streaming operation based on acquired main broadcaster, control virtual newscaster execute corresponding behaviour Make, the live video stream for generating the video flowing including virtual newscaster includes: sound, the table that originating end 20 is broadcast live and obtains main broadcaster in real time Feelings, movement, shape (hair style, clothing type, color etc.), and the sound referring to acquired main broadcaster, expression, movement and shape, The shape of adjust automatically virtual newscaster, and similar expression and movement are executed in conjunction with sound control virtual newscaster, it is outer according to adjustment The sound of expression performed by virtual newscaster after shape and movement and main broadcaster generate the live streaming of the video flowing including virtual newscaster Video flowing.
In another implementation, the live streaming operation based on acquired main broadcaster, control virtual newscaster execute corresponding It operates, the live video stream for generating the video flowing including virtual newscaster includes: that acquisition main broadcaster passes through sound to live streaming originating end 20 in real time The live streamings of the sendings such as sound, movement operates, live streaming operation include the moving direction that virtual image is controlled by sound, gesture etc., Originating end 20 is broadcast live by virtual newscaster according to live streaming in performed movement, expression, the sound issued, the shape shown etc. Shown shape, performed movement and expression are operated, and the sound issued generates the video flowing including virtual newscaster Live video stream.
Step S130: the live video stream and live streaming background video stream being synthesized, living broadcast interactive video flowing is obtained, And receiving end 30 is extremely broadcast live in the living broadcast interactive video stream.
It can obtain in the following manner living broadcast interactive video flowing: at least two live streamings originating end 20 be sent straight The video flowing for broadcasting the virtual newscaster in video flowing synthesizes, and obtains the interdynamic video stream of at least two virtual newscasters.It will be described Interdynamic video stream and live streaming background video stream are synthesized, and living broadcast interactive video flowing is obtained.
Wherein, there are many modes video flowing of virtual newscaster synthesized, for example, the addition direct broadcasting room initiated is asked It may include picture synthetic parameters in asking, picture synthetic parameters include the dimensional parameters and shared area size ginseng of virtual newscaster Number.Correspondingly, the request for the addition direct broadcasting room that live streaming equipment 10 can be initiated according to each live streaming originating end 20, is obtained respectively Picture synthetic parameters, and then according to each picture synthetic parameters of acquisition by the virtual master in each live video stream The video flowing broadcast is synthesized.
Sound in live video stream including expression and movement performed by the virtual newscaster after adjustment shape and main broadcaster In the case where sound, the interdynamic video stream at least two virtual newscasters that each live video stream is synthesized includes: at least two The mutual direction of virtual newscaster, the movement of each virtual newscaster, each virtual newscaster shape and sound.
In one implementation, after live streaming equipment 10 obtains live streaming background video stream, background video can will be broadcast live Stream is respectively sent to initiate to be added each live streaming originating end 20 of the request of same direct broadcasting room and be shown, and each main broadcaster has in displaying The live streaming originating end 20 that background is broadcast live draws dimensional parameters, the size parameter in shared region etc. of the virtual newscaster in live streaming background Face synthetic parameters are adjusted, and the picture synthetic parameters completed after parameter adjusts are sent to live streaming equipment 10, equipment is broadcast live 10 to combine live streaming background and each picture synthetic parameters received to the virtual newscaster in each live video stream received Video flowing synthesized.
Equipment 10 is broadcast live can distribute each virtual newscaster in live streaming background after receiving each picture synthetic parameters automatically In position.There are many position methods of salary distribution, for example, can be automatic distribution.In another example can be according to each main broadcaster grade prestored It is not allocated, the higher main broadcaster of rank is distributed in the more excellent position that will such as define.
Virtual newscaster can also be by each main broadcaster customized setting on live streaming originating end 20 in the position in live streaming background, should In the case of kind, live streaming equipment 10 can select virtual newscaster after the location information in live streaming background in any main broadcaster, by this Other live streaming originating ends 20 of same direct broadcasting room are added to request for the location information Real-Time Sharing of the selected virtual newscaster of main broadcaster, To remind other main broadcasters to select other positions, and so on, until completing to select position of each virtual newscaster in live streaming background It selects.
The living broadcast interactive video flowing of synthesis can be sent to each live streaming originating end 20, so that each master of same direct broadcasting room is added The living broadcast interactive picture for being presented to spectators can accurately be known by broadcasting, and adjust live streaming according to the living broadcast interactive picture for being presented to spectators Operation promotes each main broadcaster to further promote the interaction authenticity between each main broadcaster (each main broadcaster as being located at different location) Interactive experience.
In view of current live streaming process is mainly plane angle, three-dimensional scene can not be switched to for the audience, The visual angle of virtual newscaster can not be adjusted from each angle.In order to improve the problem, in the disclosure, each virtual newscaster and background can be Three-dimensional (Three Dimensions, 3D) picture, to improve live streaming picture three-dimensional sense and the sense of reality, and supports each angle tune The visual angle of whole virtual newscaster meets personalized live streaming viewing visual angle demand.Specifically, in one implementation, the disclosure Live streaming background video stream, live video stream and living broadcast interactive video flowing in embodiment are 3D video flowing.The live streaming background of 3D regards Frequency stream, live video stream and living broadcast interactive video flowing can be generated based on preset 3D model.
Fig. 4 is please referred to, in the case where the living broadcast interactive video flowing showed is 3D video flowing, living broadcast interactive method is also It may comprise steps of.
Step S140: live streaming both view angle adjustment request is received.
Wherein, the request of live streaming both view angle adjustment can be sent by live streaming originating end 20, can also be sent by receiving end 30 is broadcast live. Being broadcast live in both view angle adjustment request may include customized adjusting information, also may include the adjusting information of default.Wherein, it makes by oneself The adjusting information of justice may include the information such as the angle of requesting adjustment, direction.The adjusting information of default can be for by certain time It is spaced the information such as angle, the direction of automatic adjustment.
Step S150: according to it is described live streaming both view angle adjustment request in the living broadcast interactive video flowing virtual newscaster and back The live streaming angle of scape is adjusted, and generates the living broadcast interactive video flowing after adjusting live streaming angle.
When including adjusting information in both view angle adjustment request is broadcast live, the live streaming according to adjusting information to virtual newscaster and background Angle is adjusted, to generate the living broadcast interactive video flowing after adjusting live streaming angle.
Step S160: the living broadcast interactive video flowing adjusted after angle is broadcast live is sent.
Live streaming originating end 20 of the living broadcast interactive video stream after angle is broadcast live to requesting adjustment live streaming visual angle will be adjusted And/or live streaming receiving end 30, to show and adjust in the live streaming originating end 20 at requesting adjustment live streaming visual angle and/or live streaming receiving end 30 Living broadcast interactive picture after section live streaming angle.
In order to more clearly illustrate the implementation of the disclosure, now to the implementation of the disclosure by taking following scenes as an example It is illustrated.
Assuming that main broadcaster A and main broadcaster B is located at different location, main broadcaster A corresponds to virtual newscaster A, and main broadcaster B corresponds to virtual newscaster B. Main broadcaster A selects more than one people's performance scene, and setting screen synthetic parameters by live streaming originating end A, as more people are added in virtual newscaster A Dimensional parameters and shared area size parameter after performance scene.Main broadcaster B selects same more people's performance by live streaming originating end B Scene, and setting screen synthetic parameters, the dimensional parameters after more people's performance scenes are added such as virtual newscaster B and shared region is big Small parameter.More people's performance scenes correspond to same direct broadcasting room C, and the background video stream of direct broadcasting room C is more than one people's performance stage 3D video flowing includes scenery, light, performance equipment such as microphone, band etc. in the 3D video flowing of more people's performance stages. So, live streaming equipment determines live streaming originating end A and originating end B is broadcast live to initiate the request that same direct broadcasting room C is added, thereby executing with Lower operation.
Originating end A is broadcast live and obtains the live streaming operation (sound, expression and the movement of main broadcaster A) that main broadcaster A is executed, is based on main broadcaster A Sound, expression and movement, control virtual newscaster A executes the expression and movement similar with main broadcaster A, and carries out sound rendering, from And the live video stream A of the 3D video flowing including virtual newscaster A is generated, live video stream A is sent to live streaming equipment.
Live streaming originating end B obtains the live streaming operation (virtual image that main broadcaster B is controlled by sound, gesture that main broadcaster B is executed The moving direction of B, performed movement, expression, the sound issued etc.), control virtual newscaster B is operated according to live streaming and executes phase The movement and expression answered, and the sound issued, so that the live video stream B of the 3D video flowing including virtual newscaster B is generated, it will Live video stream B is sent to live streaming equipment.
Be broadcast live equipment obtain direct broadcasting room C background video stream, and receive live streaming originating end A send live video stream A and Receive the live video stream B that live streaming originating end B is sent.Live streaming equipment is according to live streaming originating end A and asking for originating end B initiation is broadcast live The 3D video flowing of virtual newscaster A and virtual newscaster B are synthesized, obtain virtual newscaster A and void by the picture synthetic parameters in asking The 3D interdynamic video stream of quasi- main broadcaster B, include in the 3D interdynamic video stream virtual newscaster A and virtual newscaster B size, shared region, Performed movement, expression, the sound issued etc..Equipment is broadcast live by the 3D interdynamic video stream of virtual newscaster A and virtual newscaster B It is synthesized with the background video stream of direct broadcasting room C, it is same more corresponding to the direct broadcasting room C to obtain virtual newscaster A and virtual newscaster B 3D living broadcast interactive video flowing on people's performance stage.
Equipment is broadcast live by the live streaming receiving end of obtained 3D living broadcast interactive video stream to spectators, spectators can be broadcast live The live streaming picture of virtual newscaster A and virtual newscaster B on the more people's performance stages of same 3D is watched in receiving end.Please refer to figure The live streaming picture signal of 5, a kind of virtual newscaster A and virtual newscaster B provided for the disclosure on the more people's performance stages of same 3D Figure.It is understood that figure image, background for being described in Fig. 5 by geometric figure etc. are only to illustrate.
It is understood that the example above is only to illustrate, living broadcast interactive method can also be realized by other means, example Such as, to live streaming originating end A and originating end B can be broadcast live in obtained 3D living broadcast interactive video flowing Real-Time Sharing by live streaming equipment, from And main broadcaster A and main broadcaster B can adjust live streaming operation based on the 3D living broadcast interactive video flowing of Real-Time Sharing, so that being in different location Main broadcaster A and the live streaming interactive picture that shows of main broadcaster B it is more true.
Picture is broadcast live based on the 3D that above-mentioned 3D living broadcast interactive video flowing is shown, it is any in main broadcaster A, main broadcaster B, spectators When one needs to adjust live streaming picture viewing angle, it need to only be sent by live streaming originating end, live streaming receiving end to live streaming equipment straight Broadcast both view angle adjustment request, the angle of customized setting requesting adjustment, direction.Live streaming equipment receives live streaming both view angle adjustment request Later, according to the angle and direction of requesting adjustment in live streaming both view angle adjustment request to the virtual newscaster in 3D living broadcast interactive video flowing It is adjusted with the live streaming angle of background, that is, produces the 3D living broadcast interactive video flowing after adjusting live streaming angle.Equipment is broadcast live will Living broadcast interactive video stream after adjusting live streaming angle can show institute to corresponding live streaming originating end, live streaming receiving end Need the live streaming picture of viewing angle.
It is understood that the living broadcast interactive method in the disclosure can also have other scalability implementations, for example, main The arrangement that 3D can also be broadcast live in background by broadcasting carries out customized setting.
Fig. 6 is please referred to, the embodiment of the present disclosure also provides a kind of living broadcast interactive device 13, it is straight to can be applied to above-mentioned offer Broadcast the live streaming equipment 10 of service.Wherein, living broadcast interactive device 13 includes that video flowing obtains module 131, video flowing receiving module 132 With video flowing synthesis module 133.
Video flowing obtains asking for the same direct broadcasting room of addition that module 131 is used to initiate according at least two live streaming originating ends It asks, obtains live streaming background video stream.
In the present embodiment, video flowing, which obtains module 131, can be used for executing step S110 shown in Fig. 3, about video flowing The related content for obtaining module 131 is referred to the description to step S110 above.
Video flowing receiving module 132 is used to receive the live video stream that each live streaming originating end 20 is sent, described straight Broadcast the video flowing in video flowing including the corresponding virtual newscaster of the live streaming originating end.
In the present embodiment, video flowing receiving module 132 can be used for executing step S120 shown in Fig. 3, about video flowing The related content of receiving module 132 is referred to the description to step S120 above.
Video flowing synthesis module 133 is used to synthesize the live video stream and live streaming background video stream, obtains straight Broadcast interdynamic video stream, and by the living broadcast interactive video stream to receiving end is broadcast live.
In the present embodiment, video flowing synthesis module 133 can be used for executing step S130 shown in Fig. 3, about video flowing The related content of receiving module 132 is referred to the description to step S130 above.
In the embodiments of the present disclosure, correspond to Fig. 3 and living broadcast interactive method shown in Fig. 4, additionally provide a kind of computer Readable storage medium storing program for executing is stored with computer program in the computer readable storage medium, executes when which runs State each step of living broadcast interactive method.
Wherein, each step executed when aforementioned computer program is run, this is no longer going to repeat them, can refer to above to institute State the explanation of living broadcast interactive method.
In conclusion living broadcast interactive method, living broadcast interactive device 13 and live streaming equipment 10 that the disclosure provides, by straight It broadcasts the live video stream that background video stream and each live streaming originating end are initiated to be synthesized, obtains including each void under same live streaming background The living broadcast interactive video flowing of interactive information between quasi- main broadcaster, enhances the interactivity of live streaming, to realize diversified interaction side Formula provides possibility.Virtual image by the way that request to be added to each main broadcaster of same direct broadcasting room, which is merged into same 3D background, to carry out Living broadcast interactive, to significantly improve the interaction mode between different main broadcasters (main broadcaster as being located at different location) and be presented to spectators Interaction authenticity, to promote live streaming interactivity and playability.
In several embodiments provided by the embodiment of the present disclosure, it should be understood that disclosed device and method, it can also To realize by another way.Device and method embodiment described above is only schematical, for example, in attached drawing Flow chart and block diagram show that the devices of multiple embodiments according to the disclosure, method and computer program product are able to achieve Architecture, function and operation.In this regard, each box in flowchart or block diagram can represent module, a program A part of section or code, a part of the module, section or code include that one or more is patrolled for realizing defined Collect the executable instruction of function.It should also be noted that in some implementations as replacement, function marked in the box It can occur in a different order than that indicated in the drawings.For example, two continuous boxes can actually be held substantially in parallel Row, they can also be executed in the opposite order sometimes, and this depends on the function involved.It is also noted that block diagram and/or The combination of each box in flow chart and the box in block diagram and or flow chart, can the function as defined in executing or dynamic The dedicated hardware based system made is realized, or can be realized using a combination of dedicated hardware and computer instructions.
In addition, each functional module in each embodiment of the disclosure can integrate one independent portion of formation together Point, it is also possible to modules individualism, an independent part can also be integrated to form with two or more modules.
It, can be with if the function is realized and when sold or used as an independent product in the form of software function module It is stored in a computer readable storage medium.Based on this understanding, the technical solution of the disclosure is substantially in other words The part of the part that contributes to existing technology or the technical solution can be embodied in the form of software products, the meter Calculation machine software product is stored in a storage medium, including some instructions are used so that a computer equipment (can be a Equipment or the network equipment etc. is broadcast live in people's computer) execute all or part of step of each embodiment the method for the disclosure Suddenly.And storage medium above-mentioned includes: USB flash disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), deposits at random The various media that can store program code such as access to memory (RAM, Random Access Memory), magnetic or disk. It should be noted that, in this document, the terms "include", "comprise" or its any other variant are intended to the packet of nonexcludability Contain, so that the process, method, article or equipment for including a series of elements not only includes those elements, but also including Other elements that are not explicitly listed, or further include for elements inherent to such a process, method, article, or device. In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that including the element Process, method, article or equipment in there is also other identical elements.
The foregoing is merely preferred embodiment of the present disclosure, are not limited to the disclosure, for the skill of this field For art personnel, the disclosure can have various modifications and variations.It is all within the spirit and principle of the disclosure, it is made any to repair Change, equivalent replacement, improvement etc., should be included within the protection scope of the disclosure.

Claims (11)

1. a kind of living broadcast interactive method, the live streaming equipment applied to offer direct broadcast service, which is characterized in that the described method includes:
According to the request for the same direct broadcasting room of addition that at least two live streaming originating ends are initiated, live streaming background video stream is obtained;
The live video stream that each live streaming originating end is sent is received, includes the live streaming originating end pair in the live video stream The video flowing of the virtual newscaster answered;
The live video stream and live streaming background video stream are synthesized, obtain living broadcast interactive video flowing, and by the live streaming Interdynamic video stream is sent to live streaming receiving end.
2. living broadcast interactive method according to claim 1, which is characterized in that by the live video stream and live streaming background view Frequency stream is synthesized, and living broadcast interactive video flowing is obtained, comprising:
The video flowing of virtual newscaster in the live video stream of at least two live streamings originating end transmission is synthesized, is obtained The interdynamic video stream of at least two virtual newscasters;
The interdynamic video stream and live streaming background video stream are synthesized, living broadcast interactive video flowing is obtained.
3. living broadcast interactive method according to claim 2, which is characterized in that described by at least two live streamings originating end The video flowing of virtual newscaster in the live video stream of transmission synthesizes, comprising:
According to the request for the addition direct broadcasting room that each live streaming originating end is initiated, picture synthetic parameters, the picture are obtained respectively Face synthetic parameters include virtual newscaster dimensional parameters and shared area size parameter;
The video flowing of the virtual newscaster in each live video stream is carried out according to each picture synthetic parameters of acquisition Synthesis.
4. according to claim 1 to living broadcast interactive method described in 3 any one, which is characterized in that the live streaming background video Stream, live video stream and living broadcast interactive video flowing are 3D video flowing.
5. living broadcast interactive method according to claim 4, which is characterized in that the method also includes:
Receive live streaming both view angle adjustment request;
According to the live streaming both view angle adjustment request to the live streaming angle of virtual newscaster and background in the living broadcast interactive video flowing It is adjusted, generates the living broadcast interactive video flowing after adjusting live streaming angle;
The living broadcast interactive video flowing adjusted after angle is broadcast live is sent.
6. living broadcast interactive method according to claim 4, which is characterized in that the interdynamic video stream of at least two virtual newscasters It include: at least two virtual newscasters mutual direction, the movement of each virtual newscaster and the shape of each virtual newscaster.
7. living broadcast interactive method according to claim 4, which is characterized in that the live streaming background video stream, live video Stream and living broadcast interactive video flowing are generated based on preset 3D model.
8. living broadcast interactive method according to claim 1, which is characterized in that be stored with different scenes in the live streaming equipment Corresponding direct broadcasting room, at least two live streaming originating ends select Same Scene if it exists, then determine at least two live streamings hair Origin or beginning initiates the request that same direct broadcasting room corresponding with the Same Scene is added.
9. a kind of live broadcast device, applied to providing the live streaming equipment of direct broadcast service, which is characterized in that the live broadcast device includes:
Video flowing obtains module, and the request of the same direct broadcasting room of addition for being initiated according at least two live streaming originating ends obtains Background video stream is broadcast live;
Video flowing receiving module, the live video stream sent for receiving each live streaming originating end, the live video stream In include the corresponding virtual newscaster of the live streaming originating end video flowing;
Video flowing synthesis module obtains living broadcast interactive for synthesizing the live video stream and live streaming background video stream Video flowing, and by the living broadcast interactive video stream to receiving end is broadcast live.
10. a kind of computer readable storage medium, which is characterized in that be stored thereon with computer program, which is performed The step of realizing living broadcast interactive method described in claim 1 to 8 any one.
11. a kind of live streaming equipment, which is characterized in that including memory, processor and be stored in the memory and can be at this The computer program run on reason device, realizes claim 1 to 8 any one when which runs on the processor The step of described living broadcast interactive method.
CN201910370393.8A 2019-04-30 2019-04-30 Living broadcast interactive method, living broadcast interactive device and live streaming equipment Pending CN110087128A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910370393.8A CN110087128A (en) 2019-04-30 2019-04-30 Living broadcast interactive method, living broadcast interactive device and live streaming equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910370393.8A CN110087128A (en) 2019-04-30 2019-04-30 Living broadcast interactive method, living broadcast interactive device and live streaming equipment

Publications (1)

Publication Number Publication Date
CN110087128A true CN110087128A (en) 2019-08-02

Family

ID=67418562

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910370393.8A Pending CN110087128A (en) 2019-04-30 2019-04-30 Living broadcast interactive method, living broadcast interactive device and live streaming equipment

Country Status (1)

Country Link
CN (1) CN110087128A (en)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110493628A (en) * 2019-08-29 2019-11-22 广州创幻数码科技有限公司 A kind of the main broadcaster's system and implementation method of the same virtual scene interaction of polygonal color
CN110719416A (en) * 2019-09-30 2020-01-21 咪咕视讯科技有限公司 Live broadcast method, communication equipment and computer readable storage medium
CN110719533A (en) * 2019-10-18 2020-01-21 广州虎牙科技有限公司 Live virtual image broadcasting method and device, server and storage medium
CN111030985A (en) * 2019-10-29 2020-04-17 视联动力信息技术股份有限公司 Data packet sending method and device
CN111277845A (en) * 2020-01-15 2020-06-12 网易(杭州)网络有限公司 Game live broadcast control method and device, computer storage medium and electronic equipment
CN111556357A (en) * 2020-04-30 2020-08-18 广州华多网络科技有限公司 Method, device and equipment for playing live video and storage medium
CN111586465A (en) * 2020-04-30 2020-08-25 广州华多网络科技有限公司 Operation interaction method, device and equipment for live broadcast room and storage medium
CN112533017A (en) * 2020-12-01 2021-03-19 广州繁星互娱信息科技有限公司 Live broadcast method, device, terminal and storage medium
CN113448475A (en) * 2021-06-30 2021-09-28 广州博冠信息科技有限公司 Interaction control method and device for virtual live broadcast room, storage medium and electronic equipment

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106231349A (en) * 2015-12-30 2016-12-14 深圳超多维科技有限公司 Main broadcaster's class interaction platform server method for changing scenes and device, server
CN106254916A (en) * 2016-08-09 2016-12-21 乐视控股(北京)有限公司 Live play method and device
US20170026713A1 (en) * 2015-03-26 2017-01-26 Carnegie Mellon University System and Method for Dynamic Adaptive Video Streaming Using Model Predictive Control
CN106507144A (en) * 2016-11-03 2017-03-15 天脉聚源(北京)传媒科技有限公司 A kind of choosing method of the background music based on spectators and system
CN106789991A (en) * 2016-12-09 2017-05-31 福建星网视易信息系统有限公司 A kind of multi-person interactive method and system based on virtual scene
CN107018336A (en) * 2017-04-11 2017-08-04 腾讯科技(深圳)有限公司 The method and apparatus of image procossing and the method and apparatus of Video processing
CN107801083A (en) * 2016-09-06 2018-03-13 星播网(深圳)信息有限公司 A kind of network real-time interactive live broadcasting method and device based on three dimensional virtual technique
CN108900920A (en) * 2018-07-20 2018-11-27 广州虎牙信息科技有限公司 A kind of live streaming processing method, device, equipment and storage medium
CN109660818A (en) * 2018-12-30 2019-04-19 广东彼雍德云教育科技有限公司 A kind of virtual interactive live broadcast system

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170026713A1 (en) * 2015-03-26 2017-01-26 Carnegie Mellon University System and Method for Dynamic Adaptive Video Streaming Using Model Predictive Control
CN106231349A (en) * 2015-12-30 2016-12-14 深圳超多维科技有限公司 Main broadcaster's class interaction platform server method for changing scenes and device, server
CN106254916A (en) * 2016-08-09 2016-12-21 乐视控股(北京)有限公司 Live play method and device
CN107801083A (en) * 2016-09-06 2018-03-13 星播网(深圳)信息有限公司 A kind of network real-time interactive live broadcasting method and device based on three dimensional virtual technique
CN106507144A (en) * 2016-11-03 2017-03-15 天脉聚源(北京)传媒科技有限公司 A kind of choosing method of the background music based on spectators and system
CN106789991A (en) * 2016-12-09 2017-05-31 福建星网视易信息系统有限公司 A kind of multi-person interactive method and system based on virtual scene
CN107018336A (en) * 2017-04-11 2017-08-04 腾讯科技(深圳)有限公司 The method and apparatus of image procossing and the method and apparatus of Video processing
CN108900920A (en) * 2018-07-20 2018-11-27 广州虎牙信息科技有限公司 A kind of live streaming processing method, device, equipment and storage medium
CN109660818A (en) * 2018-12-30 2019-04-19 广东彼雍德云教育科技有限公司 A kind of virtual interactive live broadcast system

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110493628A (en) * 2019-08-29 2019-11-22 广州创幻数码科技有限公司 A kind of the main broadcaster's system and implementation method of the same virtual scene interaction of polygonal color
CN110719416A (en) * 2019-09-30 2020-01-21 咪咕视讯科技有限公司 Live broadcast method, communication equipment and computer readable storage medium
CN110719533A (en) * 2019-10-18 2020-01-21 广州虎牙科技有限公司 Live virtual image broadcasting method and device, server and storage medium
CN111030985A (en) * 2019-10-29 2020-04-17 视联动力信息技术股份有限公司 Data packet sending method and device
CN111277845A (en) * 2020-01-15 2020-06-12 网易(杭州)网络有限公司 Game live broadcast control method and device, computer storage medium and electronic equipment
CN111277845B (en) * 2020-01-15 2022-07-12 网易(杭州)网络有限公司 Game live broadcast control method and device, computer storage medium and electronic equipment
CN111556357A (en) * 2020-04-30 2020-08-18 广州华多网络科技有限公司 Method, device and equipment for playing live video and storage medium
CN111586465A (en) * 2020-04-30 2020-08-25 广州华多网络科技有限公司 Operation interaction method, device and equipment for live broadcast room and storage medium
CN112533017A (en) * 2020-12-01 2021-03-19 广州繁星互娱信息科技有限公司 Live broadcast method, device, terminal and storage medium
CN113448475A (en) * 2021-06-30 2021-09-28 广州博冠信息科技有限公司 Interaction control method and device for virtual live broadcast room, storage medium and electronic equipment

Similar Documents

Publication Publication Date Title
CN110087128A (en) Living broadcast interactive method, living broadcast interactive device and live streaming equipment
US11871085B2 (en) Methods and apparatus for delivering content and/or playing back content
KR102407283B1 (en) Methods and apparatus for delivering content and/or playing back content
US10496358B1 (en) Directional audio for virtual environments
JP7368886B2 (en) Information processing system, information processing method, and information processing program
CN113473159B (en) Digital person live broadcast method and device, live broadcast management equipment and readable storage medium
CN109889855A (en) Intelligent panoramic net cast networked shopping system and method based on mobile APP
CN108701371A (en) It is controlled for the film of virtual reality and augmented reality
CN108616557A (en) A kind of panoramic video transmission method, device, terminal, server and system
US20160330408A1 (en) Method for progressive generation, storage and delivery of synthesized view transitions in multiple viewpoints interactive fruition environments
JP2017056193A (en) Remote rendering server comprising broadcaster
US20210136342A1 (en) Telepresence system and method
JP2020017242A (en) Three-dimensional content distribution system, three-dimensional content distribution method, and computer program
JP2022525412A (en) Crossover between realities of virtual characters
US10289193B2 (en) Use of virtual-reality systems to provide an immersive on-demand content experience
KR20180054377A (en) Interactive virtual reality system
CN115004237A (en) Information processing apparatus, information processing method, and program
JP2023169282A (en) Computer program, server device, terminal device, and method
JP2017117431A (en) System and method transmitting media through network
Doumanoglou et al. A system architecture for live immersive 3D-media transcoding over 5G networks
CN116761009A (en) Video playing method and device in meta-universe panoramic live broadcast scene and live broadcast system
KR20130067855A (en) Apparatus and method for providing virtual 3d contents animation where view selection is possible
KR20190031220A (en) System and method for providing virtual reality content
CN105472299B (en) Video interaction method, system and device
KR20210084248A (en) Method and apparatus for providing a platform for transmitting vr contents

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20190802

RJ01 Rejection of invention patent application after publication