CN106791786B - Live broadcasting method and device - Google Patents

Live broadcasting method and device Download PDF

Info

Publication number
CN106791786B
CN106791786B CN201611250000.2A CN201611250000A CN106791786B CN 106791786 B CN106791786 B CN 106791786B CN 201611250000 A CN201611250000 A CN 201611250000A CN 106791786 B CN106791786 B CN 106791786B
Authority
CN
China
Prior art keywords
rendered
dummy model
rendering
video data
user
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201611250000.2A
Other languages
Chinese (zh)
Other versions
CN106791786A (en
Inventor
张涛
项东涛
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing QIYI Century Science and Technology Co Ltd
Original Assignee
Beijing QIYI Century Science and Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing QIYI Century Science and Technology Co Ltd filed Critical Beijing QIYI Century Science and Technology Co Ltd
Priority to CN201611250000.2A priority Critical patent/CN106791786B/en
Publication of CN106791786A publication Critical patent/CN106791786A/en
Application granted granted Critical
Publication of CN106791786B publication Critical patent/CN106791786B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21Server components or server architectures
    • H04N21/218Source of audio or video content, e.g. local disk arrays
    • H04N21/2187Live feed
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20Image signal generators
    • H04N13/275Image signal generators from 3D object models, e.g. computer-generated stereoscopic image signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/23412Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs for generating or manipulating the scene composition of objects, e.g. MPEG-4 objects

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Processing Or Creating Images (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The embodiment of the invention provides a kind of live broadcasting method and devices.This method comprises: obtaining live video data to be played by server;Live video data is detected, when detecting in live video data comprising preset object to be rendered, according to the corresponding relationship for presetting object to be rendered Yu 3D dummy model, the rendering of 3D dummy model is carried out to object to be rendered;The live video data for completing the rendering of 3D dummy model is distributed to client end of playing back.In this way, so that the object being rendered highlights on the screen, so that user be prompted to pay close attention to important goal, user experience is more preferable by carrying out the rendering of 3D dummy model to preset object to be rendered.

Description

Live broadcasting method and device
Technical field
The present invention relates to video technique fields, more particularly to a kind of live broadcasting method and device.
Background technique
With the continuous development of computer technology, the daily recreation of people is also more and more abundant, much mentions for example, having For the website of Online Video service, user can watch the video or audio section of main broadcaster's offer online by corresponding application program Mesh.
In existing live streaming software, user by hair message or can send small gift and master when watching live video Interaction is broadcast, but stares at screen for a long time, user can generate fatigue, and the target for causing some important can also be ignored, and therefore, need A kind of live broadcasting method that user can be prompted to pay close attention to important goal is provided.
Summary of the invention
The embodiment of the present invention is designed to provide a kind of live broadcasting method and device, can distinguish to preset target It has been shown that, to prompt user to pay close attention to.Specific technical solution is as follows:
A kind of live broadcasting method is applied to server, which comprises
Obtain live video data to be played;
The live video data is detected;
When detecting in the live video data comprising preset object to be rendered, according to preset object to be rendered with The corresponding relationship of 3D dummy model carries out the rendering of 3D dummy model to the object to be rendered;
The live video data for completing the 3D dummy model rendering is distributed to client end of playing back.
Method as described above, wherein the described the step of live video data is detected, comprising:
The fisrt feature information of the object to be rendered is extracted from live video data described in each frame;
The fisrt feature information is matched with preset object features information to be rendered;
If successful match, detect in the live video data comprising the preset object to be rendered;
If it fails to match, detects and do not include the preset object to be rendered in the live video data.
Method as described above, wherein it is described according to the corresponding relationship for presetting object to be rendered Yu 3D dummy model, to institute It states object to be rendered and carries out the rendering of 3D dummy model, comprising:
According to the corresponding relationship for presetting object to be rendered Yu 3D dummy model, obtain corresponding with the object to be rendered 3D dummy model;
According to the 3D dummy model, the rendering of 3D dummy model is carried out to the object to be rendered.
Method as described above, wherein described that the rendering of 3D dummy model is carried out to the object to be rendered, comprising:
Display parameters by changing the object to be rendered carry out the rendering of 3D dummy model to the object to be rendered;Its In, the display parameters include it is following at least one: location parameter, directioin parameter, luminance parameter.
A kind of live broadcasting method is applied to client, comprising:
During live streaming, the render instruction of user's input is obtained, includes user's selection in the render instruction to wash with watercolours Contaminate the 3D dummy model of object and/or user's selection;Wherein, the object to be rendered and the 3D dummy model are stored in advance In the client, and it is shown on client display screen;
It currently needs to render according to user's selection or the corresponding relationship of preset object to be rendered and 3D dummy model, determination The first object to be rendered;
Live video data is detected;
When including first object to be rendered in detecting the live video data, according to described preset to wash with watercolours The corresponding relationship for contaminating object and 3D dummy model carries out the rendering of 3D dummy model to the described first object to be rendered;
The live video data that the 3D dummy model that finishes playing renders.
Method as described above, wherein described the step of live video data is detected, comprising:
The fisrt feature information of the object to be rendered is extracted from live video data described in each frame;
The fisrt feature information is matched with preset object features information to be rendered;
If successful match, detect in the live video data comprising the object to be rendered;
If it fails to match, detects and do not include the object to be rendered in the live video data.
Method as described above, wherein when in the render instruction only including the object to be rendered of user's selection, described According to user's selection or the corresponding relationship of preset object to be rendered and 3D dummy model, determining currently need to render first is to wash with watercolours The step of contaminating object, are as follows: the object to be rendered that user selects is determined as the first object to be rendered for currently needing to render;
The described the step of rendering of 3D dummy model is carried out to the described first object to be rendered, comprising:
According to the corresponding relationship of preset object to be rendered and 3D dummy model, it is corresponding to obtain the described first object to be rendered The first 3D dummy model;
According to the first 3D dummy model, the rendering of 3D dummy model is carried out to the described first object to be rendered.
Method as described above, wherein when in the render instruction only including the 3D dummy model of user's selection, described According to user's selection or the corresponding relationship of preset object to be rendered and 3D dummy model, determining currently need to render first is to wash with watercolours The step of contaminating object, are as follows:
According to the corresponding relationship of preset object to be rendered and 3D dummy model, the determining 3D dummy model with user's selection Corresponding object to be rendered is the first object to be rendered for currently needing to render;
The described the step of rendering of 3D dummy model is carried out to the described first object to be rendered, comprising:
According to the 3D dummy model that the user selects, the rendering of 3D dummy model is carried out to the described first object to be rendered.
Method as described above, wherein object to be rendered and user's selection comprising user's selection in the render instruction 3D dummy model when, it is described according to user selection or preset object to be rendered and 3D dummy model corresponding relationship, determination The step of the first object to be rendered for currently needing to render, are as follows: it is determined as the object to be rendered that user selects currently to need wash with watercolours First object to be rendered of dye;
The described the step of rendering of 3D dummy model is carried out to the described first object to be rendered, comprising:
According to the 3D dummy model that the user selects, it is virtual that 3D is carried out to the first object to be rendered of user selection Model rendering.
Method as described above, wherein described that the rendering of 3D dummy model is carried out to the described first object to be rendered, comprising:
Display parameters by changing first object to be rendered carry out the virtual mould of 3D to the described first object to be rendered Type rendering;Wherein, the display parameters include it is following at least one: location parameter, directioin parameter, luminance parameter.
A kind of live broadcast device, is applied to server, and described device includes:
Module is obtained, for obtaining live video data to be played;
Detection module, for being detected to the live video data;
Rendering module, for detecting in the live video data when the detection module comprising preset object to be rendered When body, according to the corresponding relationship for presetting object to be rendered Yu 3D dummy model, 3D dummy model is carried out to the object to be rendered Rendering;
Distribution module plays client for the live video data for completing the 3D dummy model rendering to be distributed to End.
Device as described above, wherein the detection module is specifically used for:
The fisrt feature information of the object to be rendered is extracted from live video data described in each frame;
The fisrt feature information is matched with preset object features information to be rendered;
If successful match, detect in the live video data comprising the preset object to be rendered;
If it fails to match, detects and do not include the preset object to be rendered in the live video data.
Device as described above, wherein the rendering module is specifically used for:
According to the corresponding relationship for presetting object to be rendered Yu 3D dummy model, obtain corresponding with the object to be rendered 3D dummy model;
According to the 3D dummy model, the rendering of 3D dummy model is carried out to the object to be rendered.
Device as described above, wherein the rendering module is specifically used for:
Display parameters by changing the object to be rendered carry out the rendering of 3D dummy model to the object to be rendered;Its In, the display parameters include it is following at least one: location parameter, directioin parameter, luminance parameter.
A kind of live broadcast device is applied to client, comprising:
Module is obtained, includes to use in the render instruction for during live streaming, obtaining the render instruction of user's input The object to be rendered of family selection and/or the 3D dummy model of user's selection;Wherein, the object to be rendered and the 3D are virtual Model is stored in advance in the client, and is shown on client display screen;
Determining module, for the corresponding relationship according to user's selection or preset object to be rendered and 3D dummy model, really The object to be rendered of need to render before settled first;
Detection module, for being detected to live video data;
Rendering module, it is to be rendered comprising described first in the live video data for being detected in the detection module When object, according to the corresponding relationship of the preset object to be rendered and 3D dummy model, to the described first object to be rendered into The rendering of row 3D dummy model;
Playing module, the live video data for the 3D dummy model rendering that finishes playing.
Device as described above, wherein the detection module is specifically used for:
The fisrt feature information of the object to be rendered is extracted from live video data described in each frame;
The fisrt feature information is matched with preset object features information to be rendered;
If successful match, detect in the live video data comprising the object to be rendered;
If it fails to match, detects and do not include the object to be rendered in the live video data.
Device as described above, wherein described true when in the render instruction only including the object to be rendered of user's selection Cover half block is specifically used for: the object to be rendered that user selects is determined as the first object to be rendered for currently needing to render;
The rendering module is specifically used for: according to the corresponding relationship of preset object to be rendered and 3D dummy model, obtaining The corresponding first 3D dummy model of first object to be rendered;According to the first 3D dummy model, to described first to wash with watercolours It contaminates object and carries out the rendering of 3D dummy model.
Device as described above, wherein described true when in the render instruction only including the 3D dummy model of user's selection Cover half block is specifically used for: according to the corresponding relationship of preset object to be rendered and 3D dummy model, the determining 3D with user's selection The corresponding object to be rendered of dummy model is the first object to be rendered for currently needing to render;
The rendering module is specifically used for: the 3D dummy model selected according to the user, to the described first object to be rendered Body carries out the rendering of 3D dummy model.
Device as described above, wherein object to be rendered and user's selection comprising user's selection in the render instruction 3D dummy model when, the determining module is specifically used for: by user select object to be rendered be determined as currently needing to render The first object to be rendered;
The rendering module is specifically used for: the 3D dummy model selected according to the user, to the of user selection One object to be rendered carries out the rendering of 3D dummy model.
Device as described above, wherein the rendering module is specifically used for: by changing first object to be rendered Display parameters carry out the rendering of 3D dummy model to the described first object to be rendered;Wherein, the display parameters include it is following at least One: location parameter, directioin parameter, luminance parameter.
Live broadcasting method and device provided in an embodiment of the present invention can be obtained live video number to be played by server According to;Live video data is detected, when detecting in live video data comprising preset object to be rendered, according to pre- If the corresponding relationship of object to be rendered and 3D dummy model, the rendering of 3D dummy model is carried out to object to be rendered;It is empty will to complete 3D The live video data of analog model rendering is distributed to client end of playing back.In this way, empty by carrying out 3D to preset object to be rendered Analog model rendering, so that the object being rendered highlights on the screen, so that user be prompted to pay close attention to important goal, user experience More preferably.Certainly, it implements any of the products of the present invention or method must be not necessarily required to reach all the above advantage simultaneously.
Detailed description of the invention
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this Some embodiments of invention for those of ordinary skill in the art without creative efforts, can be with It obtains other drawings based on these drawings.
Fig. 1 is the flow chart for the live broadcasting method that the embodiment of the present invention one provides;
Fig. 2 is the schematic diagram of object to be rendered in the live broadcasting method that provides of the embodiment of the present invention one;
Fig. 3 is the flow chart of live broadcasting method provided by Embodiment 2 of the present invention;
Fig. 4 is the structural schematic diagram for the live broadcast device that the embodiment of the present invention one provides;
Fig. 5 is the structural schematic diagram of live broadcast device provided by Embodiment 2 of the present invention.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete Site preparation description, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.It is based on Embodiment in the present invention, it is obtained by those of ordinary skill in the art without making creative efforts every other Embodiment shall fall within the protection scope of the present invention.
In various embodiments of the present invention, when by including preset object to be rendered in detecting live video data, root According to the corresponding relationship for presetting object to be rendered Yu 3D dummy model, the rendering of 3D dummy model is carried out to object to be rendered, is made by wash with watercolours Dye object highlights on the screen, and user can be prompted to pay close attention to important goal.
Specifically, live broadcasting method provided in an embodiment of the present invention can be divided into two kinds of implementations.
In the first implementation, it is contemplated that the computing capability of partial movement equipment is limited, can distribute in server Before live video data, using the powerful computing capability of server, detect in live video data whether comprising it is preset to Object is rendered, and completes to render the 3D dummy model of object to be rendered by server, client end of playing back is responsible for the 3D that finishes playing The live video data of dummy model rendering.In this implementation, processing of the client end of playing back for live video data Still like the prior art, it does not need to make any change.
And in the second implementation, it is detected in live video data and whether is selected comprising user by client end of playing back Object to be rendered and/or user selection 3D dummy model, that is to say, that by client end of playing back realize the embodiment of the present invention mention When the live broadcasting method of confession, server to the processing of live video data like the prior art, user can by with play visitor The interaction at family end independently selects object to be rendered, and/or selection 3D dummy model, client end of playing back root according to the hobby of oneself According to the selection of user, completion is rendered and is played to the 3D dummy model of object to be rendered, in this implementation, is improved straight Interactivity during broadcasting.
Live broadcasting method provided by the invention is described in detail below by specific embodiment.
Fig. 1 is the flow chart for the live broadcasting method that the embodiment of the present invention one provides.As shown in Figure 1, side provided in this embodiment Method can be executed by server, specifically, method provided in this embodiment includes:
Step 101 obtains live video data to be played.
It should be noted that server from live streaming client receive live video data to be played after, it is necessary first to Transcoding processing is carried out to the live video data to be played, specifically, the present embodiment is based on real-time messages transport protocol (Real Time Messaging Protocol, RTMP) realizes that server turns live video data to be played Like the prior art, details are not described herein for the process of code processing.
Step 102 detects the live video data.
Specifically, extracting the fisrt feature information of the object to be rendered from live video data described in each frame;It will The fisrt feature information is matched with preset object features information to be rendered;If successful match, detect described straight It broadcasts in video data comprising the preset object to be rendered;If it fails to match, detect in the live video data not Include the preset object to be rendered.
For example, in picture, " people " word surrounding black is thick as shown in Fig. 2, object to be rendered is the picture with " people " word Frame surrounds, and preset object features information to be rendered can be dark border, the ratio of width to height of picture and " people " word of picture Lines trend, server extracts from live video data to be played after getting live video data to be played The fisrt feature information of object to be rendered, dark border, the ratio of width to height and lines move towards information, and the fisrt feature extracted is believed Breath is matched with preset object features information to be rendered, if above-mentioned fisrt feature information is special with preset object to be rendered Levy information matches, it is determined that include the preset object to be rendered in the live video data, if mismatching, it is determined that institute It states and does not include the preset object to be rendered in live video data.
Step 103, when detecting in the live video data comprising preset object to be rendered, according to default to wash with watercolours The corresponding relationship for contaminating object and 3D dummy model carries out the rendering of 3D dummy model to the object to be rendered.
In this step, when in the live video data comprising the preset object to be rendered, according to described default The corresponding relationship of object to be rendered and 3D dummy model obtains 3D dummy model corresponding with the object to be rendered;According to institute 3D dummy model is stated, the rendering of 3D dummy model is carried out to the object to be rendered.
For example, default 3D dummy model corresponding with the picture shown in Fig. 2 with " people " word is the hexahedron of rotation, then It is empty with 3D according to object to be rendered is preset comprising " people " word picture as shown in Figure 2 in detecting the live video data The corresponding relationship of analog model gets the hexahedron that 3D dummy model corresponding with " people " word picture is rotation, according to 3D void Analog model, to " people " word picture carry out the rendering of 3D dummy model, play when be presented to the user for six faces with The rotary hexahedral of " people " word.
Specifically, can be virtual to the object progress 3D to be rendered by changing the display parameters of the object to be rendered Model rendering;Wherein, the display parameters include it is following at least one: location parameter, directioin parameter, luminance parameter;For example, to When rendering object is toy, toy can be made in live video by the location parameter and directioin parameter of change toy It runs here and there on picture, or changes luminance parameter, make toy seem to glitter, it is to be understood that actually answering The corresponding relationship of a variety of different objects to be rendered and 3D dummy model can be preset according to different application scenarios in, The present embodiment is not especially limited this.
The live video data for completing the 3D dummy model rendering is distributed to client end of playing back by step 104.
During application live broadcasting method provided in this embodiment, server obtains to be played straight from live streaming client Broadcast video data and carry out transcoding processing, server detect in transcoding treated live video data whether comprising it is preset to Object is rendered, when including preset object to be rendered in detecting live video data, server is according to presetting object to be rendered The corresponding relationship of body and 3D dummy model renders object to be rendered, and the live video data point that will complete the rendering of 3D dummy model It is sent to client end of playing back to play out, so that live video data is when playing, object to be rendered therein shows 3D animation Effect.
Live broadcasting method provided in this embodiment, server obtain live video data to be played;To live video data It is detected, when detecting in live video data comprising preset object to be rendered, according to presetting object and 3D to be rendered The corresponding relationship of dummy model carries out the rendering of 3D dummy model to object to be rendered;It will complete the live streaming of 3D dummy model rendering Video data is distributed to client end of playing back.In this way, by carrying out the rendering of 3D dummy model to preset object to be rendered, so that by The object of rendering highlights on the screen, so that user be prompted to pay close attention to important goal, user experience is more preferable.
Fig. 3 is the flow chart of live broadcasting method provided by Embodiment 2 of the present invention.As shown in figure 3, the present embodiment provides live streamings Method can specifically be executed by client end of playing back, specifically, method provided in this embodiment may include:
Step 201, during live streaming, obtain the render instruction of user's input, selected comprising user in the render instruction The object to be rendered selected and/or the 3D dummy model of user's selection;Wherein, the object to be rendered and the 3D dummy model It is stored in advance in the client, and is shown on client display screen.
It should be noted that different according to the content for including in the render instruction, the present embodiment can be divided into three kinds of differences Application scenarios.Specifically, the first application scenarios is the object to be rendered in the render instruction only comprising user's selection;The Two kinds of application scenarios are the 3D dummy models in the render instruction only comprising user's selection;The third application scenarios is the wash with watercolours Have a finger in every pie the object to be rendered comprising user's selection in enabling and the 3D dummy model of user's selection.
Step 202, according to user selection or preset object to be rendered and 3D dummy model corresponding relationship, determine currently The object to be rendered of need to render first.
In the first application scenarios, when in the render instruction only including the object to be rendered that the user chooses, The object to be rendered that client end of playing back selects user is determined as the first object to be rendered for currently needing to render.
In second of application scenarios, when the 3D dummy model in the render instruction only comprising user's selection, play Corresponding relationship of the client according to preset object to be rendered and 3D dummy model, the determining 3D dummy model pair with user's selection The object to be rendered answered is the first object to be rendered for currently needing to render.
In the third application scenarios, when the object to be rendered and user's selection in the render instruction including user's selection 3D dummy model when, it is to be rendered that the object to be rendered that client end of playing back selects user is determined as currently need to render first Object.
Step 203 detects live video data.
In this step, the client end of playing back is regarded when detecting to live video data from being broadcast live described in each frame Frequency extracts the fisrt feature information of the object to be rendered in;By the fisrt feature information and preset object to be rendered Characteristic information is matched;If successful match, detect in the live video data comprising the object to be rendered;If With failure, then detects and do not include the object to be rendered in the live video data.
For example, in picture, " people " word surrounding black is thick as shown in Fig. 2, object to be rendered is the picture with " people " word Frame surrounds, and preset object features information to be rendered can be dark border, the ratio of width to height of picture and " people " word of picture Lines trend, server extracts from live video data to be played after getting live video data to be played The fisrt feature information of object to be rendered, dark border, the ratio of width to height and lines move towards information, and the fisrt feature extracted is believed Breath is matched with preset object features information to be rendered, if above-mentioned fisrt feature information is special with preset object to be rendered Levy information matches, it is determined that include the preset object to be rendered in the live video data, if mismatching, it is determined that institute It states and does not include the preset object to be rendered in live video data.
Step 204, in detecting the live video data include first object to be rendered when, according to described pre- If object to be rendered and 3D dummy model corresponding relationship, the rendering of 3D dummy model is carried out to the described first object to be rendered.
Specifically, in the first application scenarios, the object to be rendered only selected comprising user in the render instruction is broadcast Put the first object to be rendered that the object to be rendered that client selects user is determined as currently needing to render;It is selected in user After object to be rendered, client end of playing back obtains described the according to the corresponding relationship of preset object to be rendered and 3D dummy model The corresponding first 3D dummy model of one object to be rendered;According to the first 3D dummy model, to the described first object to be rendered Carry out the rendering of 3D dummy model.That is, user can choose different objects to be rendered in this application scenarios, but It cannot select the 3D animation effect for finally asking for presentation.
In second of application scenarios, the 3D dummy model only selected comprising user in the render instruction plays client The corresponding object to be rendered of the 3D dummy model selected with user is determined as the first object to be rendered for currently needing to render by end, After determining the described first object to be rendered, the 3D dummy model that the client end of playing back is selected according to the user, to described First object to be rendered carries out the rendering of 3D dummy model.In this scene, user can choose different 3D dummy models, but Object to be rendered cannot be selected, same object to be rendered can be directed to, is selected according to the difference of different user, is presented not to user Same 3D animation effect.
In the third application scenarios, what object to be rendered and user comprising user's selection in the render instruction selected 3D dummy model, the object to be rendered that client end of playing back selects user are determined as the first object to be rendered for currently needing to render Body, the 3D dummy model that the client end of playing back is selected according to the user, to the first object to be rendered of user selection Carry out the rendering of 3D dummy model.In this scene, user can select the 3D animation for wanting to present effect according to the hobby of oneself Fruit and object to be rendered, substantially increase the interactivity of live streaming.
Specifically, when carrying out the rendering of 3D dummy model to the first object to be rendered, by changing the object to be rendered Display parameters the rendering of 3D dummy model is carried out to the object to be rendered;Wherein, the display parameters include following at least one It is a: location parameter, directioin parameter, luminance parameter;For example, can change object to be rendered by changing location parameter and directioin parameter Position of the body on live video picture changes the brightness of object to be rendered by changing luminance parameter, for example, it is dimmed, brighten, Flashing etc., it is to be understood that can be preset in practical applications according to different application scenarios a variety of different to wash with watercolours The corresponding relationship of object and 3D dummy model is contaminated, the present embodiment is not especially limited this.
The live video data that step 205, the 3D dummy model that finishes playing render.
It should be noted that if the render instruction has not been obtained in the client end of playing back, then normally play described straight Video data is broadcast, does not need to do 3D dummy model rendering processing.
By it is shown in Fig. 2 with the picture of " people " word for the process of this application live broadcasting method provided in this embodiment It is illustrated.
In the first application scenarios, preset 3D dummy model is hexahedron rotation.During live streaming, client end of playing back Get the selected object to be rendered of user for including in the render instruction of user's input: with the picture of " people " word;It will write The first object to be rendered for thering is the picture of " people " word to be determined as currently needing to render, and it is empty according to preset object to be rendered and 3D The corresponding relationship of analog model determines that 3D dummy model corresponding with the picture with " people " word for hexahedron rotation, then plays client End rotates after this 3D dummy model renders the picture with " people " word according to hexahedron, is presented to the user for one The hexahedron rotated is not stopped with " people " word and in six faces.
In second of application scenarios, preset object to be rendered is the picture with " people " word.During live streaming, play Client gets the selected 3D dummy model of user for including in the render instruction that user inputs: hexahedron rotation;According to The corresponding relationship of preset object to be rendered and 3D dummy model, determination are corresponding to be rendered with the 3D dummy model that user selects Object is the picture with " people " word, which is determined as to the first object to be rendered for currently needing to render Afterwards, client end of playing back rotates after this 3D dummy model renders the picture with " people " word according to hexahedron, is presented to User be six faces with " people " word and do not stop rotation hexahedron.
In the third application scenarios, during live streaming, client end of playing back is got in the render instruction of user's input, packet Containing the selected object to be rendered of user: the selected 3D dummy model of picture and user with " people " word: hexahedron rotation Turn;The first object to be rendered that will be determined as currently needing to render with the picture of " people " word, and according to the selected 3D of user Dummy model renders the picture with " people " word, is presented to the user for six faces and with " people " word and does not stop to revolve The hexahedron turned.
Live broadcasting method provided in this embodiment obtains the render instruction of user's input during live streaming, and the rendering refers to The 3D dummy model of object to be rendered and/or user's selection comprising user's selection in order;Wherein, the object to be rendered and The 3D dummy model is stored in advance in the client, and is shown on client display screen;It is selected according to user or default Object to be rendered and 3D dummy model corresponding relationship, determine the first object to be rendered for currently needing to render;Live streaming is regarded Frequency is according to being detected;When including first object to be rendered in detecting the live video data, according to described pre- If object to be rendered and 3D dummy model corresponding relationship, the rendering of 3D dummy model is carried out to the described first object to be rendered; The live video data that the 3D dummy model that finishes playing renders.In this way, the rendering inputted by the user got Instruction carries out the rendering of 3D dummy model to object to be rendered, so that the object being rendered highlights on the screen, improves straight Interactivity during broadcasting, and user can be prompted to pay close attention to important goal, user experience is more preferable.
Fig. 4 is the structural schematic diagram for the live broadcast device that the embodiment of the present invention one provides.As shown in figure 4, the present embodiment provides Live broadcast device can specifically include: obtain module 31, detection module 32, rendering module 33 and distribution module 34.
Wherein, module 31 is obtained, for obtaining live video data to be played;
Detection module 32, for being detected to the live video data;
Rendering module 33, for detecting in the live video data when the detection module 32 comprising preset to wash with watercolours When contaminating object, according to the corresponding relationship for presetting object to be rendered Yu 3D dummy model, it is virtual that 3D is carried out to the object to be rendered Model rendering;
Distribution module 34, for the live video data for completing the 3D dummy model rendering to be distributed to broadcasting visitor Family end.
When whether including preset object to be rendered in detecting the live video data, the detection module 32 is specific For: the fisrt feature information of the object to be rendered is extracted from live video data described in each frame;It is special by described first Reference breath is matched with preset object features information to be rendered;If successful match, the live video data is detected In include the preset object to be rendered;If it fails to match, detect in the live video data not comprising described pre- If object to be rendered.
The rendering module 33 is specifically used for: according to the corresponding relationship for presetting object to be rendered Yu 3D dummy model, Obtain 3D dummy model corresponding with the object to be rendered;According to the 3D dummy model, the object to be rendered is carried out The rendering of 3D dummy model.
When carrying out the rendering of 3D dummy model to the object to be rendered, the rendering module 33 is specifically used for passing through change The display parameters of the object to be rendered carry out the rendering of 3D dummy model to the object to be rendered;Wherein, the display parameters Including it is following at least one: location parameter, directioin parameter, luminance parameter.
Live broadcast device provided in this embodiment can be used for executing the technical solution of above method embodiment, realization principle Similar with technical effect, details are not described herein again.
Fig. 5 is the structural schematic diagram of live broadcast device provided by Embodiment 2 of the present invention.As shown in figure 5, the present embodiment provides Live broadcast device can specifically include: obtain module 41, determining module 42, detection module 43, rendering module 44 and playing module 45。
Wherein, module 41 is obtained, for obtaining the render instruction of user's input, the render instruction during live streaming In comprising user selection object to be rendered and/or user selection 3D dummy model;Wherein, the object to be rendered and institute It states 3D dummy model and is stored in advance in the client, and be shown on client display screen;
Determining module 42, for according to user selection or preset object to be rendered and 3D dummy model corresponding relationship, Determine the first object to be rendered for currently needing to render;
Detection module 43, for being detected to live video data;
Rendering module 44, for the detection module 43 detect in the live video data comprising described first to When rendering object, according to the corresponding relationship of the preset object to be rendered and 3D dummy model, to the described first object to be rendered Body carries out the rendering of 3D dummy model;
Playing module 45, the live video data for the 3D dummy model rendering that finishes playing.
When detecting to the live video data, the detection module 43 is specifically used for: from straight described in each frame Broadcast the fisrt feature information that the object to be rendered is extracted in video data;By the fisrt feature information with it is preset to be rendered Object features information is matched;If successful match, detect in the live video data comprising the object to be rendered; If it fails to match, detects and do not include the object to be rendered in the live video data.
In a kind of feasible embodiment, in the render instruction only comprising user selection object to be rendered when, institute It states determining module 42 to be specifically used for: the object to be rendered that user selects is determined as the first object to be rendered for currently needing to render Body;The rendering module 44 is specifically used for: according to the corresponding relationship of preset object to be rendered and 3D dummy model, described in acquisition The corresponding first 3D dummy model of first object to be rendered;According to the first 3D dummy model, to the described first object to be rendered Body carries out the rendering of 3D dummy model.
In another feasible embodiment, when 3D dummy model in the render instruction only comprising user's selection, The determining module 42 is specifically used for: according to the corresponding relationship of preset object to be rendered and 3D dummy model, determining and user The corresponding object to be rendered of the 3D dummy model selected is the first object to be rendered for currently needing to render;The rendering module 44 Be specifically used for: the 3D dummy model selected according to the user carries out the rendering of 3D dummy model to the described first object to be rendered.
Object to be rendered and user in another feasible embodiment, comprising user's selection in the render instruction When the 3D dummy model of selection, the determining module 42 is specifically used for: the object to be rendered that user selects is determined as currently needing The object to be rendered of to be rendered first;The rendering module 44 is specifically used for: the 3D dummy model selected according to the user, right First object to be rendered of user's selection carries out the rendering of 3D dummy model.
Specifically, the rendering module 44 is specifically used for: the display parameters pair by changing first object to be rendered First object to be rendered carries out the rendering of 3D dummy model;Wherein, the display parameters include it is following at least one: position ginseng Number, directioin parameter, luminance parameter.
Live broadcast device provided in this embodiment can be used for executing the technical solution of above method embodiment, realization principle Similar with technical effect, details are not described herein again.
It should be noted that, in this document, be such as used merely to an entity with second or the like relational terms or Person's operation is distinguished with another entity or operation, is appointed without necessarily requiring or implying existing between these entities or operation What this actual relationship or sequence.Moreover, the terms "include", "comprise" or its any other variant are intended to non-row His property includes, so that the process, method, article or equipment for including a series of elements not only includes those elements, and And further include other elements that are not explicitly listed, or further include for this process, method, article or equipment institute it is intrinsic Element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that including institute State in the process, method, article or equipment of element that there is also other identical elements.
Each embodiment in this specification is all made of relevant mode and describes, same and similar portion between each embodiment Dividing may refer to each other, and each embodiment focuses on the differences from other embodiments.Especially for system reality For applying example, since it is substantially similar to the method embodiment, so being described relatively simple, related place is referring to embodiment of the method Part explanation.
The foregoing is merely illustrative of the preferred embodiments of the present invention, is not intended to limit the scope of the present invention.It is all Any modification, equivalent replacement, improvement and so within the spirit and principles in the present invention, are all contained in protection scope of the present invention It is interior.

Claims (20)

1. a kind of live broadcasting method, which is characterized in that be applied to server, which comprises
Obtain live video data to be played;
The live video data is detected;
It is empty with 3D according to object to be rendered is preset when detecting in the live video data comprising preset object to be rendered The corresponding relationship of analog model carries out the rendering of 3D dummy model to the object to be rendered, and the object to be rendered is picture;
The live video data for completing the 3D dummy model rendering is distributed to client end of playing back.
2. the method according to claim 1, wherein the step detected to the live video data Suddenly, comprising:
The fisrt feature information of the object to be rendered is extracted from live video data described in each frame;
The fisrt feature information is matched with preset object features information to be rendered;
If successful match, detect in the live video data comprising the preset object to be rendered;
If it fails to match, detects and do not include the preset object to be rendered in the live video data.
3. the method according to claim 1, wherein described according to presetting object to be rendered and 3D dummy model Corresponding relationship carries out the rendering of 3D dummy model to the object to be rendered, comprising:
According to the corresponding relationship for presetting object to be rendered Yu 3D dummy model, 3D corresponding with the object to be rendered is obtained Dummy model;
According to the 3D dummy model, the rendering of 3D dummy model is carried out to the object to be rendered.
4. according to the method described in claim 3, it is characterized in that, described carry out 3D dummy model wash with watercolours to the object to be rendered Dye, comprising:
Display parameters by changing the object to be rendered carry out the rendering of 3D dummy model to the object to be rendered;Wherein, The display parameters include it is following at least one: location parameter, directioin parameter, luminance parameter.
5. a kind of live broadcasting method, which is characterized in that be applied to client, comprising:
During live streaming, the render instruction of user's input, the object to be rendered comprising user's selection in the render instruction are obtained Body and/or the 3D dummy model of user's selection;Wherein, the object to be rendered and the 3D dummy model are stored in advance in institute Client is stated, and is shown on client display screen;
According to user's selection or the corresponding relationship of preset object to be rendered and 3D dummy model, determine that current needs render the One object to be rendered;
Live video data is detected;
When including first object to be rendered in detecting the live video data, according to the preset object to be rendered The corresponding relationship of body and 3D dummy model carries out the rendering of 3D dummy model, the object to be rendered to the described first object to be rendered Body is picture;
The live video data that the 3D dummy model that finishes playing renders.
6. according to the method described in claim 5, it is characterized in that, described the step of being detected to live video data, packet It includes:
The fisrt feature information of the object to be rendered is extracted from live video data described in each frame;
The fisrt feature information is matched with preset object features information to be rendered;
If successful match, detect in the live video data comprising the object to be rendered;
If it fails to match, detects and do not include the object to be rendered in the live video data.
7. according to the method described in claim 5, it is characterized in that, only comprising the to be rendered of user's selection in the render instruction It is described currently to be needed according to user's selection or the corresponding relationship of preset object to be rendered and 3D dummy model, determination when object The step of first object to be rendered of rendering, are as follows: the object to be rendered that user selects is determined as currently need to render first Object to be rendered;
The described the step of rendering of 3D dummy model is carried out to the described first object to be rendered, comprising:
According to the corresponding relationship of preset object to be rendered and 3D dummy model, first object to be rendered corresponding the is obtained One 3D dummy model;
According to the first 3D dummy model, the rendering of 3D dummy model is carried out to the described first object to be rendered.
8. according to the method described in claim 5, it is characterized in that, the 3D in the render instruction only comprising user's selection is virtual It is described currently to be needed according to user's selection or the corresponding relationship of preset object to be rendered and 3D dummy model, determination when model The step of first object to be rendered of rendering, are as follows:
According to the corresponding relationship of preset object to be rendered and 3D dummy model, determination is corresponding with the 3D dummy model that user selects Object to be rendered be the first object to be rendered for currently needing to render;
The described the step of rendering of 3D dummy model is carried out to the described first object to be rendered, comprising:
According to the 3D dummy model that the user selects, the rendering of 3D dummy model is carried out to the described first object to be rendered.
9. according to the method described in claim 5, it is characterized in that, the object to be rendered selected in the render instruction comprising user Body and user selection 3D dummy model when, it is described according to user selection or preset object to be rendered and 3D dummy model pair The step of should being related to, determining the first object to be rendered for currently needing to render, are as follows: the object to be rendered that user selects is determined as The first object to be rendered for currently needing to render;
The described the step of rendering of 3D dummy model is carried out to the described first object to be rendered, comprising:
According to the 3D dummy model that the user selects, 3D dummy model is carried out to the first object to be rendered of user selection Rendering.
10. according to the described in any item methods of claim 5-8, which is characterized in that it is described to the described first object to be rendered into The rendering of row 3D dummy model, comprising:
Display parameters by changing first object to be rendered carry out 3D dummy model wash with watercolours to the described first object to be rendered Dye;Wherein, the display parameters include it is following at least one: location parameter, directioin parameter, luminance parameter.
11. a kind of live broadcast device, which is characterized in that be applied to server, described device includes:
Module is obtained, for obtaining live video data to be played;
Detection module, for being detected to the live video data;
Rendering module, for detecting in the live video data when the detection module comprising preset object to be rendered When, according to the corresponding relationship for presetting object to be rendered Yu 3D dummy model, 3D dummy model wash with watercolours is carried out to the object to be rendered Dye, the object to be rendered are picture;
Distribution module, for the live video data for completing the 3D dummy model rendering to be distributed to client end of playing back.
12. device according to claim 11, which is characterized in that the detection module is specifically used for:
The fisrt feature information of the object to be rendered is extracted from live video data described in each frame;
The fisrt feature information is matched with preset object features information to be rendered;
If successful match, detect in the live video data comprising the preset object to be rendered;
If it fails to match, detects and do not include the preset object to be rendered in the live video data.
13. device according to claim 11, which is characterized in that the rendering module is specifically used for:
According to the corresponding relationship for presetting object to be rendered Yu 3D dummy model, 3D corresponding with the object to be rendered is obtained Dummy model;
According to the 3D dummy model, the rendering of 3D dummy model is carried out to the object to be rendered.
14. device according to claim 13, which is characterized in that the rendering module is specifically used for:
Display parameters by changing the object to be rendered carry out the rendering of 3D dummy model to the object to be rendered;Wherein, The display parameters include it is following at least one: location parameter, directioin parameter, luminance parameter.
15. a kind of live broadcast device, which is characterized in that be applied to client, comprising:
Module is obtained, for during live streaming, obtaining the render instruction of user's input, is selected in the render instruction comprising user The object to be rendered selected and/or the 3D dummy model of user's selection;Wherein, the object to be rendered and the 3D dummy model It is stored in advance in the client, and is shown on client display screen;
Determining module, for the corresponding relationship according to user's selection or preset object to be rendered and 3D dummy model, determination is worked as Preceding the first object to be rendered for needing to render;
Detection module, for being detected to live video data;
Rendering module, for detecting in the live video data in the detection module comprising the described first object to be rendered When, according to the corresponding relationship of the preset object to be rendered and 3D dummy model, 3D is carried out to the described first object to be rendered Dummy model rendering, the object to be rendered are picture;
Playing module, the live video data for the 3D dummy model rendering that finishes playing.
16. device according to claim 15, which is characterized in that the detection module is specifically used for:
The fisrt feature information of the object to be rendered is extracted from live video data described in each frame;
The fisrt feature information is matched with preset object features information to be rendered;
If successful match, detect in the live video data comprising the object to be rendered;
If it fails to match, detects and do not include the object to be rendered in the live video data.
17. device according to claim 15, which is characterized in that only comprising user's selection to wash with watercolours in the render instruction When contaminating object, the determining module is specifically used for: the object to be rendered that user selects is determined as currently need to render first Object to be rendered;
The rendering module is specifically used for: according to the corresponding relationship of preset object to be rendered and 3D dummy model, described in acquisition The corresponding first 3D dummy model of first object to be rendered;According to the first 3D dummy model, to the described first object to be rendered Body carries out the rendering of 3D dummy model.
18. device according to claim 15, which is characterized in that the 3D in the render instruction only comprising user's selection is empty When analog model, the determining module is specifically used for: according to the corresponding relationship of preset object to be rendered and 3D dummy model, determining Object to be rendered corresponding with the 3D dummy model that user selects is the first object to be rendered for currently needing to render;
The rendering module is specifically used for: according to the user select 3D dummy model, to the described first object to be rendered into The rendering of row 3D dummy model.
19. device according to claim 15, which is characterized in that include the to be rendered of user's selection in the render instruction When object and the 3D dummy model of user's selection, the determining module is specifically used for: the object to be rendered of user's selection is determined For the first object to be rendered for currently needing to render;
The rendering module is specifically used for: according to the user select 3D dummy model, to the user selection first to It renders object and carries out the rendering of 3D dummy model.
20. the described in any item devices of 5-18 according to claim 1, which is characterized in that the rendering module is specifically used for: passing through The display parameters for changing the described first object to be rendered carry out the rendering of 3D dummy model to the described first object to be rendered;Wherein, The display parameters include it is following at least one: location parameter, directioin parameter, luminance parameter.
CN201611250000.2A 2016-12-29 2016-12-29 Live broadcasting method and device Active CN106791786B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201611250000.2A CN106791786B (en) 2016-12-29 2016-12-29 Live broadcasting method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201611250000.2A CN106791786B (en) 2016-12-29 2016-12-29 Live broadcasting method and device

Publications (2)

Publication Number Publication Date
CN106791786A CN106791786A (en) 2017-05-31
CN106791786B true CN106791786B (en) 2019-04-12

Family

ID=58928223

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201611250000.2A Active CN106791786B (en) 2016-12-29 2016-12-29 Live broadcasting method and device

Country Status (1)

Country Link
CN (1) CN106791786B (en)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108156443A (en) * 2017-12-21 2018-06-12 成都真实维度科技有限公司 A kind of operation VR live streaming platforms and its business model
CN110087121B (en) * 2019-04-30 2021-08-06 广州虎牙信息科技有限公司 Avatar display method, avatar display apparatus, electronic device, and storage medium
CN111640179B (en) * 2020-06-26 2023-09-01 百度在线网络技术(北京)有限公司 Display method, device, equipment and storage medium of pet model
CN112218108B (en) * 2020-09-18 2022-07-08 广州虎牙科技有限公司 Live broadcast rendering method and device, electronic equipment and storage medium
CN114466203A (en) * 2020-11-10 2022-05-10 阿里巴巴集团控股有限公司 Video processing method, device and system
CN114363652A (en) * 2022-01-04 2022-04-15 阿里巴巴(中国)有限公司 Video live broadcast method, system and computer storage medium

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104618797A (en) * 2015-02-06 2015-05-13 腾讯科技(北京)有限公司 Information processing method and device and client
CN106210861A (en) * 2016-08-23 2016-12-07 上海幻电信息科技有限公司 The method and system of display barrage
CN106231415A (en) * 2016-08-18 2016-12-14 北京奇虎科技有限公司 A kind of interactive method and device adding face's specially good effect in net cast

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2012010101A1 (en) * 2010-07-21 2012-01-26 Technicolor (China) Technology Co., Ltd. Method and device for providing supplementary content in 3d communication system
CN104754396B (en) * 2015-03-12 2018-02-23 腾讯科技(北京)有限公司 The display methods and device of barrage data

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104618797A (en) * 2015-02-06 2015-05-13 腾讯科技(北京)有限公司 Information processing method and device and client
CN106231415A (en) * 2016-08-18 2016-12-14 北京奇虎科技有限公司 A kind of interactive method and device adding face's specially good effect in net cast
CN106210861A (en) * 2016-08-23 2016-12-07 上海幻电信息科技有限公司 The method and system of display barrage

Also Published As

Publication number Publication date
CN106791786A (en) 2017-05-31

Similar Documents

Publication Publication Date Title
CN106791786B (en) Live broadcasting method and device
US11863813B2 (en) System and methods for interactive filters in live streaming media
US9656160B2 (en) Massive multi-player online (MMO) games server and methods for executing the same
US20130019184A1 (en) Methods and systems for virtual experiences
CN111711831B (en) Data processing method and device based on interactive behavior and storage medium
CN102591574A (en) Real-time interaction with entertainment content
US11524229B2 (en) Methods, systems, and media for enhancing multiplayer game sessions with asymmetric information
EP2085128A1 (en) Apparatus and method of on-line abuse avoidance
CN109254650B (en) Man-machine interaction method and device
US10467809B2 (en) Methods and systems for presenting a video stream within a persistent virtual reality world
CN109831674A (en) A kind of setting of barrage and rendering method, calculate equipment and storage medium at device
US20220347565A1 (en) Massive Multi-Player Online (MMO) Games Server and Methods for Executing the Same
CN111897483A (en) Live broadcast interaction processing method, device, equipment and storage medium
WO2020072648A1 (en) User interface elements for content selection in 360 video narrative presentations
CN105100930B (en) The method and apparatus that display participates in interactive user information
US20200235954A1 (en) Methods and Systems for Allowing the Generation of Multi-Author Communications
CN110944218B (en) Multimedia information playing system, method, device, equipment and storage medium
CN108271057A (en) Video interaction method, subscription client, server and readable storage medium storing program for executing
CN105307044A (en) Method and apparatus for displaying interaction information on video program
CN105187887A (en) Method and device for displaying lottery animation
US9877067B2 (en) System and method for broadcast-mediated coordination of interactive experiences
AU2020100068A4 (en) The present invention relates to methods and systems for allowing the generation of multi- author communications and composite works.
Chen Augmenting immersive cinematic experience/scene with user body visualization.
CN105578299A (en) Method and device for displaying vote information
CN105578251A (en) Method and device for displaying vote information

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant