CN105959718A - Real-time interaction method and device in video live broadcasting - Google Patents
Real-time interaction method and device in video live broadcasting Download PDFInfo
- Publication number
- CN105959718A CN105959718A CN201610473423.4A CN201610473423A CN105959718A CN 105959718 A CN105959718 A CN 105959718A CN 201610473423 A CN201610473423 A CN 201610473423A CN 105959718 A CN105959718 A CN 105959718A
- Authority
- CN
- China
- Prior art keywords
- information
- interactive
- virtual objects
- audio
- net cast
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/47205—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/475—End-user interface for inputting end-user data, e.g. personal identification number [PIN], preference data
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Databases & Information Systems (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention discloses a real-time interaction method and device in video live broadcasting, and is used for realizing real-time interaction of a video live broadcaster and a virtual object, thereby improving the live broadcasting effect and the watching effect. The real-time interaction method in the video live broadcasting provided by the invention comprises the following steps: a server determines interaction information of the video live broadcaster according to audio/video information sent by a collecting device; the server determines interaction information of the virtual object according to the interaction information of the video live broadcaster and a preset corresponding relationship between the interaction information of the video live broadcaster and the interaction information of the virtual object; the server generates animation image information for the real-time interaction of the virtual object according to the interaction information of the virtual object; the server carries out synthesis on the animation image information for the real-time interaction of the virtual object and current to-be-sent audio/video information; and the server sends the synthesized audio/video information to a client.
Description
Technical field
The present embodiments relate to communication technical field, particularly relate to the side of real-time interactive in a kind of net cast
Method and device.
Background technology
Net cast refers to utilize the Internet and stream media technology to carry out live, and video is because having merged image, literary composition
The abundant element such as word, sound, excellent both in sound and shape, excellent, it is increasingly becoming the main flow expression way of the Internet.
During existing net cast, if wanting to add some full animation expression or especial sound in live video, then
Need to use the animation stored or sound, and cannot accomplish that net cast person is the most mutual with virtual objects
Dynamic, such as: if net cast person wants to do an action stroking virtual little house pet, then can only play and make
The animation stroking virtual little house pet performed, and cannot be real-time make the action stroking virtual little house pet, with
Time this virtual little house pet make corresponding reaction.
In sum, in the prior art, it is impossible to realize net cast person and virtual objects real-time interactive, from
And affect live effect and viewing effect.
Summary of the invention
Embodiments provide the method and device of real-time interactive in a kind of net cast, regard in order to realizing
The most live person and virtual objects real-time interactive, thus improve live effect and viewing effect.
In a kind of net cast that the embodiment of the present invention provides, the method for real-time interactive includes:
The audio/video information that server sends according to collecting device, determines the interactive information of net cast person；
Described server is according to the interactive information of described net cast person, and the net cast person's preset is mutual
Dynamic information and the corresponding relation of the interactive information of virtual objects, determine the interactive information of virtual objects；
Described server, according to the interactive information of described virtual objects, generates the real-time interactive of this virtual objects
Animated image information；
Described server by the animated image information of the real-time interactive of described virtual objects with the most to be sent
Audio/video information synthesizes；
Audio/video information after described synthesis is sent to client by described server.
With it, according to the audio/video information received, determine the interactive information of net cast person, so
Afterwards according to the interactive information of this net cast person, and the interactive information of the net cast person preset is right with virtual
The corresponding relation of the interactive information of elephant, determines the interactive information of virtual objects, further according to the interaction of virtual objects
Information, generates the animated image information of the real-time interactive of this virtual objects, by the real-time interactive of virtual objects
Animated image information synthesizes with audio/video information the most to be sent, and by the audio/video information after synthesis
Be sent to client, so, client just can show the animated image information of the real-time interactive of virtual objects with
Audio/video information after audio/video information synthesis the most to be sent, such that it is able to realize net cast person with empty
Intend object real-time interactive, and then improve live effect and viewing effect.
It is preferred that the audio/video information that server sends according to collecting device, determine the interaction of net cast person
Information, specifically includes:
The audio/video information that server sends according to collecting device, extracts the audio/video information of net cast person；
Described server is carried out according to the audio/video information of the pre-defined rule described net cast person to extracting
Identify, determine the interactive information of this net cast person.
In the embodiment of the present invention, first extract the audio/video information of net cast person due to server, then from carrying
The audio/video information of the net cast person got determines the interactive information of this net cast person, as such, it is possible to
Reduce amount of calculation, such that it is able to improve real-time response.
It is preferred that described server is according to the interactive information of described virtual objects, generate the reality of this virtual objects
Time interactive animated image information, specifically include:
Described server, according to the interactive information of described virtual objects, controls this virtual objects and makes virtual with this
The interactive information of object interactive action accordingly and/or send corresponding with the interactive information of this virtual objects mutual
Dynamic sound, generates the animated image information of the real-time interactive of this virtual objects.
It is preferred that described interactive information includes at least one following information: action message, voice messaging.
It is preferred that the audio/video information sent according to collecting device at server, determine that net cast person's is mutual
Before dynamic information, the method also includes:
The startup order of the described virtual objects that described server sends according to described collecting device, generates this void
Intend the animated image information of the non-interaction of object；
Described server is by the animated image information of the non-interaction of described virtual objects and sound the most to be sent
Video information synthesizes；
Audio/video information after described synthesis is sent to client by described server.
In a kind of net cast that the embodiment of the present invention provides, the device of real-time interactive includes:
The interactive information of net cast person determines unit, for the audio/video information sent according to collecting device,
Determine the interactive information of net cast person；
The interactive information of virtual objects determines unit, is used for the interactive information according to described net cast person, with
And the corresponding relation of the interactive information of the interactive information of the net cast person preset and virtual objects, determine virtual
The interactive information of object；
Animated image information generating unit, for the interactive information according to described virtual objects, generates this virtual
The animated image information of the real-time interactive of object；
Synthesis unit, is used for the animated image information of the real-time interactive of described virtual objects with the most to be sent
Audio/video information synthesize；
Transmitting element, for being sent to client by the audio/video information after described synthesis.
By this device, the interactive information of net cast person can be determined according to the audio/video information received,
Then according to the interactive information of this net cast person, and the interactive information of the net cast person preset is with virtual
The corresponding relation of the interactive information of object, determines the interactive information of virtual objects, mutual further according to virtual objects
Dynamic information, generates the animated image information of the real-time interactive of this virtual objects, by the real-time interactive of virtual objects
Animated image information synthesize with audio/video information the most to be sent, and will synthesis after audio frequency and video letter
Breath is sent to client, and so, client just can show the animated image information of the real-time interactive of virtual objects
With the audio/video information after the audio/video information synthesis the most to be sent, such that it is able to realize net cast person with
Virtual objects real-time interactive, and then improve live effect and viewing effect.
It is preferred that the interactive information of described net cast person determine unit specifically for:
The audio/video information sent according to collecting device, extracts the audio/video information of net cast person；
It is identified according to the audio/video information of the pre-defined rule described net cast person to extracting, determines this
The interactive information of net cast person.
Due to the embodiment of the present invention provide device, first extract net cast person audio/video information, then from
The audio/video information of the net cast person extracted determines the interactive information of this net cast person, so, can
To reduce amount of calculation, such that it is able to improve real-time response.
It is preferred that described animated image information generating unit specifically for:
According to the interactive information of described virtual objects, control this virtual objects and make the interaction with this virtual objects
Information interactive action accordingly and/or send interactive sound corresponding with the interactive information of this virtual objects, generates
The animated image information of the real-time interactive of this virtual objects.
It is preferred that at the audio/video information sent according to collecting device, determine the interactive information of net cast person
Before,
Described animated image information generating unit be additionally operable to according to described collecting device send described virtual right
The startup order of elephant, generates the animated image information of the non-interaction of this virtual objects；
Described synthesis unit be additionally operable to by the animated image information of the non-interaction of described virtual objects with currently treat
The audio/video information sent synthesizes；
Audio/video information after described transmitting element is additionally operable to described synthesis is sent to client.
Accompanying drawing explanation
The flow process signal of the method for real-time interactive in a kind of net cast that Fig. 1 provides for the embodiment of the present invention
Figure；
The overall flow schematic diagram of real-time interactive in the net cast that Fig. 2 provides for the embodiment of the present invention；
The structural representation of the device of real-time interactive in a kind of net cast that Fig. 3 provides for the embodiment of the present invention
Figure.
Detailed description of the invention
Embodiments provide the method and device of real-time interactive in a kind of net cast, regard in order to realizing
The most live person and virtual objects real-time interactive, thus improve live effect and viewing effect.
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clearly
Chu, be fully described by, it is clear that described embodiment be only a part of embodiment of the present invention rather than
Whole embodiments.Based on the embodiment in the present invention, those of ordinary skill in the art obtained all its
His embodiment, broadly falls into the scope of protection of the invention.
Seeing Fig. 1, the method for real-time interactive in a kind of net cast that the embodiment of the present invention provides, including step
Rapid:
The audio/video information that S101, server send according to collecting device, determines the interactive letter of net cast person
Breath；
Wherein, collecting device can be such as picture pick-up device, image information same obtaining net cast person
Time, it is also possible to gather the voice messaging relevant to net cast person.
Audio/video information can include image information and/or the voice messaging of net cast person.
People in net cast person, i.e. live video, such as: the host in live television programming.
S102, described server are according to the interactive information of described net cast person, and the net cast preset
The interactive information of person and the corresponding relation of the interactive information of virtual objects, determine the interactive information of virtual objects；
Wherein, virtual objects can be any animating image, such as: little house pet, Disney cartoon character,
Tree, stone etc., the animation model of virtual objects prestores in the server.
S103, described server, according to the interactive information of described virtual objects, generate the real-time of this virtual objects
Interactive animated image information；
S104, described server by the animated image information of the real-time interactive of described virtual objects with the most pending
The audio/video information sent synthesizes；
Audio/video information after described synthesis is sent to client by S105, described server.
Wherein, client refers to the broadcasting end of live video.
It is preferred that interactive information includes at least one following information: action message, voice messaging.
In one preferably embodiment, the sound that the server in step S101 sends according to collecting device
Video information, determines the interactive information of net cast person, specifically includes:
After server receives the audio/video information that collecting device sends, can be first from the audio frequency and video letter received
In breath, first extract the audio/video information of net cast person, then according to the video that pre-defined rule is to extracting is straight
The audio/video information of the person of broadcasting is identified, and determines the interactive information of this net cast person；It is of course also possible to press
From the audio/video information received, the interactive information of net cast person is directly determined, now according to pre-defined rule
Amount of calculation is bigger.Wherein, the interactive information of net cast person, such as, service are determined according to pre-defined rule
Device recognizes the audio/video information received and includes voice interactive between net cast person and virtual objects
Information, then can be using this voice messaging as the interactive information of this net cast person；Server can also basis
The image information of the net cast person that collecting device sends, carries out coordinate to the image information of this net cast person
Conversion, can be straight according to distance between net cast person and virtual objects in the coordinate system after conversion, video
The movement locus of the person of broadcasting, identifies action interactive between net cast person and virtual objects, obtains net cast
Action message interactive between person and virtual objects, as the interactive information of this net cast person；Server is also
Voice messaging interactive between net cast person and virtual objects and action message can be regarded together as this
The interactive information of the most live person.
In one preferably embodiment, the interactive information of the net cast person preset in step S102
Setting the most in the server with the corresponding relation of the interactive information of virtual objects, such as, video is straight
The a certain action of the person of broadcasting is corresponding with a certain action of virtual objects and/or sound, a certain language of net cast person
Sound is corresponding with a certain action of virtual objects and/or sound.
In one preferably embodiment, the described server in step S103 is according to described virtual objects
Interactive information, generate the animated image information of the real-time interactive of this virtual objects, specifically include:
Described server, according to the interactive information of described virtual objects, controls this virtual objects and makes virtual with this
The interactive information of object interactive action accordingly and/or send corresponding with the interactive information of this virtual objects mutual
Dynamic sound, generates the animated image information of the real-time interactive of this virtual objects.
It is preferred that when not actuated virtual objects, at the audio/video information that server sends according to collecting device,
Before determining the interactive information of net cast person, the method also includes:
The startup order of the described virtual objects that described server sends according to described collecting device, generates this void
Intend the animated image information of the non-interaction of object；
Described server is by the animated image information of the non-interaction of described virtual objects and sound the most to be sent
Video information synthesizes；
Audio/video information after described synthesis is sent to client by described server.
After starting virtual objects, it is possible to carry out net cast person by the step shown in Fig. 1 right with virtual
As real-time interactive, and when not carrying out real-time interactive between net cast person and virtual objects, this is virtual right
As can be as the background patterns in live interface.
It is pointed out that collecting device collection net cast person's information can be there to be a variety of mode.
Such as: can be gathered the expression data of net cast person by following method, collecting device can shoot bag
Include the image of net cast person's face, and analyze this image, position the face of net cast person on this image special
Levy position, then according to facial features location determine net cast person respectively express one's feelings moving cell motion amplitude i.e.
Expression data, wherein, facial features location can include at least one of: the position of face overall profile,
The position of eyes, the position of pupil, the position of nose, the position of mouth and the position of eyebrow.
Can by following method obtain net cast person action data: arrange with net cast person to
A few sensing device, gathers the sensing data of sensing device output, calculates video according to this sensing data straight
The action data of the person of broadcasting, wherein, action data includes the position of the world coordinates of the current action of net cast person
Put and the anglec of rotation.
It addition, while obtaining the action data of net cast person, it is also possible to gather and net cast person's phase
The voice data closed.
To sum up, below in conjunction with Fig. 2, net cast person and virtual objects real-time interactive in the embodiment of the present invention are described
Overall flow:
First, the virtual objects corresponding with the interactive information of net cast person it is previously provided with in the server
Interactive information, thus set up the interactive information of net cast person corresponding with the interactive information of virtual objects close
System；
When not actuated virtual objects:
S201, collecting device, when receiving the startup order of virtual objects, send the startup of this virtual objects
Order is to server；
Wherein, collecting device can be such as picture pick-up device.
Virtual objects can be any animating image, such as: little house pet, Disney cartoon character, tree, stone
First-class, the animation model of virtual objects prestores in the server.
The startup order of the virtual objects that S202, server send according to collecting device, generates this virtual objects
The animated image information of non-interaction；
The animated image information of the non-interaction of this virtual objects is regarded by S203, server with sound the most to be sent
Frequently information synthesizes；
Audio/video information after this synthesis is sent to client by S204, server；
Wherein, client refers to the broadcasting end of live video.
S205, client show that the animated image information of the non-interaction of virtual objects regards with sound the most to be sent
Frequently the audio/video information after information synthesis；
After starting virtual objects:
S206, collecting device gather audio/video information and are sent to server；
Wherein, audio/video information can include image information and/or the voice messaging of net cast person；
The audio/video information that S207, server send according to collecting device, extracts the audio frequency and video of net cast person
Information, is identified according to the audio/video information of pre-defined rule this net cast person to extracting, determines and regard
The interactive information of the most live person；
Wherein, the people in net cast person, i.e. live video, such as: the host in live television programming.
S208, server are according to the interactive information of net cast person, and the interaction of the net cast person preset
Information and the corresponding relation of the interactive information of virtual objects, determine the interactive information of virtual objects；
Wherein, interactive information includes at least one following information: action message, voice messaging.
S209, server according to the interactive information of virtual objects, control this virtual objects make virtual right with this
The interactive information of elephant interactive action accordingly and/or send corresponding with the interactive information of this virtual objects interactive
Sound, generates the animated image information of the real-time interactive of this virtual objects；
S210, server are by the animated image information of the real-time interactive of this virtual objects and sound the most to be sent
Video information synthesizes；
Audio/video information after this synthesis is sent to client by S211, server；
S212, client show the animated image information of the real-time interactive of virtual objects and sound the most to be sent
Audio/video information after video information synthesis.
When proceeding net cast person with virtual objects real-time interactive, it is no need for performing step S201 extremely
S205, can perform and virtual objects real-time interactive step from S206.
The embodiment of the present invention is illustrated as a example by virtual doggie real-time interactive by net cast person below:
Pre-set when net cast person makes and strokes doggie action in the server, doggie make shake the head dynamic
Making, when net cast person makes the action beating doggie, doggie is made and hides action and send toot sound；Then
In net cast, after starting virtual doggie, collecting device gathers audio/video information and is sent to server,
If server identifies the action that net cast person is made that dozen doggie from the audio/video information received
(such as: can be according to the distance between net cast person and doggie, net cast person's hands close to the speed of doggie
Degree and angle etc. are identified), then server controls doggie is made and hides action and send toot sound, and
Generating the animated image information of the real-time interactive of this doggie, then, server is by the real-time interactive of this doggie
Animated image information synthesizes with audio/video information the most to be sent, and by the audio/video information after synthesis
Being sent to client, client shows that net cast person plays the action of doggie, and doggie is made and hides action
And send toot sound.
See Fig. 3, based on same inventive concept, in a kind of net cast that the embodiment of the present invention provides in real time
Interactive device includes:
The interactive information of net cast person determines unit 11, for the audio frequency and video letter sent according to collecting device
Breath, determines the interactive information of net cast person；
The interactive information of virtual objects determines unit 12, for the interactive information according to described net cast person,
And the corresponding relation of the interactive information of the interactive information of the net cast person preset and virtual objects, determine void
Intend the interactive information of object；
Animated image information generating unit 13, for the interactive information according to described virtual objects, generates this void
Intend the animated image information of the real-time interactive of object；
Synthesis unit 14, is used for the animated image information of the real-time interactive of described virtual objects with the most pending
The audio/video information sent synthesizes；
Transmitting element 15, for being sent to client by the audio/video information after described synthesis.
It is preferred that the interactive information of net cast person determine unit 11 specifically for:
The audio/video information sent according to collecting device, extracts the audio/video information of net cast person；
It is identified according to the audio/video information of the pre-defined rule described net cast person to extracting, determines this
The interactive information of net cast person.
It is preferred that animated image information generating unit 13 specifically for:
According to the interactive information of described virtual objects, control this virtual objects and make the interaction with this virtual objects
Information interactive action accordingly and/or send interactive sound corresponding with the interactive information of this virtual objects, generates
The animated image information of the real-time interactive of this virtual objects.
It is preferred that at the audio/video information sent according to collecting device, determine the interactive information of net cast person
Before, animated image information generating unit 13 be additionally operable to according to described collecting device send described virtual right
The startup order of elephant, generates the animated image information of the non-interaction of this virtual objects；
Synthesis unit 14 is additionally operable to the animated image information of the non-interaction of described virtual objects with the most pending
The audio/video information sent synthesizes；
Audio/video information after transmitting element 15 is additionally operable to described synthesis is sent to client.
In sum, the technical scheme that the embodiment of the present invention provides, collecting device gathers audio/video information, and
Being sent to server, server, according to the audio/video information received, determines the interactive information of net cast person,
Then according to the interactive information of this net cast person, and the interactive information of the net cast person preset is with virtual
The corresponding relation of the interactive information of object, determines the interactive information of virtual objects, mutual further according to virtual objects
Dynamic information, generates the animated image information of the real-time interactive of this virtual objects, by the real-time interactive of virtual objects
Animated image information synthesize with audio/video information the most to be sent, and will synthesis after audio frequency and video letter
Breath is sent to client, and so, client just can show the animated image information of the real-time interactive of virtual objects
With the audio/video information after the audio/video information synthesis the most to be sent, such that it is able to realize net cast person with
Virtual objects real-time interactive, and then improve live effect and viewing effect.
Those skilled in the art are it should be appreciated that embodiments of the invention can be provided as method, system or meter
Calculation machine program product.Therefore, the present invention can use complete hardware embodiment, complete software implementation or knot
The form of the embodiment in terms of conjunction software and hardware.And, the present invention can use and wherein wrap one or more
Computer-usable storage medium containing computer usable program code (include but not limited to disk memory and
Optical memory etc.) form of the upper computer program implemented.
The present invention is with reference to method, equipment (system) and computer program product according to embodiments of the present invention
The flow chart of product and/or block diagram describe.It should be understood that can by computer program instructions flowchart and
/ or block diagram in each flow process and/or flow process in square frame and flow chart and/or block diagram and/
Or the combination of square frame.These computer program instructions can be provided to general purpose computer, special-purpose computer, embedding
The processor of formula datatron or other programmable data processing device is to produce a machine so that by calculating
The instruction that the processor of machine or other programmable data processing device performs produces for realizing at flow chart one
The device of the function specified in individual flow process or multiple flow process and/or one square frame of block diagram or multiple square frame.
These computer program instructions may be alternatively stored in and computer or the process of other programmable datas can be guided to set
In the standby computer-readable memory worked in a specific way so that be stored in this computer-readable memory
Instruction produce and include the manufacture of command device, this command device realizes in one flow process or multiple of flow chart
The function specified in flow process and/or one square frame of block diagram or multiple square frame.
These computer program instructions also can be loaded in computer or other programmable data processing device, makes
Sequence of operations step must be performed to produce computer implemented place on computer or other programmable devices
Reason, thus the instruction performed on computer or other programmable devices provides for realizing flow chart one
The step of the function specified in flow process or multiple flow process and/or one square frame of block diagram or multiple square frame.
Obviously, those skilled in the art can carry out various change and modification without deviating from this to the present invention
Bright spirit and scope.So, if the present invention these amendment and modification belong to the claims in the present invention and
Within the scope of its equivalent technologies, then the present invention is also intended to comprise these change and modification.
Claims (10)
1. the method for real-time interactive in a net cast, it is characterised in that the method includes:
The audio/video information that server sends according to collecting device, determines the interactive information of net cast person；
Described server is according to the interactive information of described net cast person, and the net cast person's preset is mutual
Dynamic information and the corresponding relation of the interactive information of virtual objects, determine the interactive information of virtual objects；
Described server, according to the interactive information of described virtual objects, generates the real-time interactive of this virtual objects
Animated image information；
Described server by the animated image information of the real-time interactive of described virtual objects with the most to be sent
Audio/video information synthesizes；
Audio/video information after described synthesis is sent to client by described server.
2. the method for claim 1, it is characterised in that server sends according to collecting device
Audio/video information, determines the interactive information of net cast person, specifically includes:
The audio/video information that server sends according to collecting device, extracts the audio/video information of net cast person；
Described server is carried out according to the audio/video information of the pre-defined rule described net cast person to extracting
Identify, determine the interactive information of this net cast person.
3. the method for claim 1, it is characterised in that described server is according to described virtual right
The interactive information of elephant, generates the animated image information of the real-time interactive of this virtual objects, specifically includes:
Described server, according to the interactive information of described virtual objects, controls this virtual objects and makes virtual with this
The interactive information of object interactive action accordingly and/or send corresponding with the interactive information of this virtual objects mutual
Dynamic sound, generates the animated image information of the real-time interactive of this virtual objects.
4. the method for claim 1, it is characterised in that described interactive information includes at least one
Following information: action message, voice messaging.
5. the method as described in claim as arbitrary in Claims 1 to 4, it is characterised in that at server according to adopting
The audio/video information that collection equipment sends, before determining the interactive information of net cast person, the method also includes:
The startup order of the described virtual objects that described server sends according to described collecting device, generates this void
Intend the animated image information of the non-interaction of object；
Described server is by the animated image information of the non-interaction of described virtual objects and sound the most to be sent
Video information synthesizes；
Audio/video information after described synthesis is sent to client by described server.
6. the device of real-time interactive in a net cast, it is characterised in that this device includes:
The interactive information of net cast person determines unit, for the audio/video information sent according to collecting device,
Determine the interactive information of net cast person；
The interactive information of virtual objects determines unit, is used for the interactive information according to described net cast person, with
And the corresponding relation of the interactive information of the interactive information of the net cast person preset and virtual objects, determine virtual
The interactive information of object；
Animated image information generating unit, for the interactive information according to described virtual objects, generates this virtual
The animated image information of the real-time interactive of object；
Synthesis unit, is used for the animated image information of the real-time interactive of described virtual objects with the most to be sent
Audio/video information synthesize；
Transmitting element, for being sent to client by the audio/video information after described synthesis.
7. device as claimed in claim 6, it is characterised in that the interactive information of described net cast person
Determine unit specifically for:
The audio/video information sent according to collecting device, extracts the audio/video information of net cast person；
It is identified according to the audio/video information of the pre-defined rule described net cast person to extracting, determines this
The interactive information of net cast person.
8. device as claimed in claim 6, it is characterised in that described animated image information generating unit
Specifically for:
According to the interactive information of described virtual objects, control this virtual objects and make the interaction with this virtual objects
Information interactive action accordingly and/or send interactive sound corresponding with the interactive information of this virtual objects, generates
The animated image information of the real-time interactive of this virtual objects.
9. device as claimed in claim 6, it is characterised in that described interactive information includes at least one
Following information: action message, voice messaging.
10. the device as described in the arbitrary claim of claim 6～9, it is characterised in that according to collecting device
The audio/video information sent, before determining the interactive information of net cast person,
Described animated image information generating unit be additionally operable to according to described collecting device send described virtual right
The startup order of elephant, generates the animated image information of the non-interaction of this virtual objects；
Described synthesis unit be additionally operable to by the animated image information of the non-interaction of described virtual objects with currently treat
The audio/video information sent synthesizes；
Audio/video information after described transmitting element is additionally operable to described synthesis is sent to client.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610473423.4A CN105959718A (en) | 2016-06-24 | 2016-06-24 | Real-time interaction method and device in video live broadcasting |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610473423.4A CN105959718A (en) | 2016-06-24 | 2016-06-24 | Real-time interaction method and device in video live broadcasting |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105959718A true CN105959718A (en) | 2016-09-21 |
Family
ID=56903996
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610473423.4A Pending CN105959718A (en) | 2016-06-24 | 2016-06-24 | Real-time interaction method and device in video live broadcasting |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105959718A (en) |
Cited By (27)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106878820A (en) * | 2016-12-09 | 2017-06-20 | 北京小米移动软件有限公司 | Living broadcast interactive method and device |
| CN106937154A (en) * | 2017-03-17 | 2017-07-07 | 北京蜜枝科技有限公司 | Process the method and device of virtual image |
| CN106993195A (en) * | 2017-03-24 | 2017-07-28 | 广州创幻数码科技有限公司 | Virtual portrait role live broadcasting method and system |
| CN107124664A (en) * | 2017-05-25 | 2017-09-01 | 百度在线网络技术（北京）有限公司 | Exchange method and device applied to net cast |
| CN107124658A (en) * | 2017-05-02 | 2017-09-01 | 北京小米移动软件有限公司 | Net cast method and device |
| CN107360160A (en) * | 2017-07-12 | 2017-11-17 | 广州华多网络科技有限公司 | live video and animation fusion method, device and terminal device |
| CN107423809A (en) * | 2017-07-07 | 2017-12-01 | 北京光年无限科技有限公司 | The multi-modal exchange method of virtual robot and system applied to net cast platform |
| CN107682656A (en) * | 2017-09-11 | 2018-02-09 | 广东欧珀移动通信有限公司 | Background image processing method, electronic equipment and computer-readable recording medium |
| CN107707839A (en) * | 2017-09-11 | 2018-02-16 | 广东欧珀移动通信有限公司 | Image processing method and device |
| CN107750005A (en) * | 2017-09-18 | 2018-03-02 | 迈吉客科技（北京）有限公司 | Virtual interactive method and terminal |
| CN108076391A (en) * | 2016-12-23 | 2018-05-25 | 北京市商汤科技开发有限公司 | For the image processing method, device and electronic equipment of live scene |
| CN108134964A (en) * | 2017-11-22 | 2018-06-08 | 上海掌门科技有限公司 | Net cast stage property stacking method, computer equipment and storage medium |
| CN108462883A (en) * | 2018-01-08 | 2018-08-28 | 平安科技（深圳）有限公司 | A kind of living broadcast interactive method, apparatus, terminal device and storage medium |
| CN108683954A (en) * | 2018-05-30 | 2018-10-19 | 广州华多网络科技有限公司 | Pop-up animation producing method and device, pop-up animation, network direct broadcasting server |
| WO2018210136A1 (en) * | 2017-05-18 | 2018-11-22 | 腾讯科技（深圳）有限公司 | Method and apparatus for realizing content playback control in video session, and electronic device |
| CN110351575A (en) * | 2019-07-12 | 2019-10-18 | 广州华多网络科技有限公司 | A kind of processing method and relevant device of virtual pet |
| CN110675477A (en) * | 2019-09-26 | 2020-01-10 | 南宁峰值文化传播有限公司 | Animation display method |
| CN110850983A (en) * | 2019-11-13 | 2020-02-28 | 腾讯科技（深圳）有限公司 | Virtual object control method and device in video live broadcast and storage medium |
| WO2020042786A1 (en) * | 2018-08-27 | 2020-03-05 | 阿里巴巴集团控股有限公司 | Interactive method and device based on augmented reality |
| CN111343473A (en) * | 2020-02-25 | 2020-06-26 | 北京达佳互联信息技术有限公司 | Data processing method and device for live application, electronic equipment and storage medium |
| CN111918073A (en) * | 2020-06-30 | 2020-11-10 | 北京百度网讯科技有限公司 | Management method and device of live broadcast room |
| CN111935491A (en) * | 2020-06-28 | 2020-11-13 | 百度在线网络技术（北京）有限公司 | Live broadcast special effect processing method and device and server |
| CN111954063A (en) * | 2020-08-24 | 2020-11-17 | 北京达佳互联信息技术有限公司 | Content display control method and device for video live broadcast room |
| CN113490063A (en) * | 2021-08-26 | 2021-10-08 | 上海盛付通电子支付服务有限公司 | Method, device, medium and program product for live broadcast interaction |
| CN114915853A (en) * | 2021-02-08 | 2022-08-16 | 中国电信股份有限公司 | Interactive information processing method, device, terminal and storage medium |
| CN115314749A (en) * | 2022-06-15 | 2022-11-08 | 网易（杭州）网络有限公司 | Interactive information response method and device and electronic equipment |
| CN116033175A (en) * | 2022-12-27 | 2023-04-28 | 南京汇智互娱网络科技有限公司 | Live broadcast interactive service method and system based on virtual image |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1696923A (en) * | 2004-05-10 | 2005-11-16 | 北京大学 | Networked, multimedia synchronous composed storage and issuance system, and method for implementing the system |
| CN101930284A (en) * | 2009-06-23 | 2010-12-29 | 腾讯科技（深圳）有限公司 | Method, device and system for implementing interaction between video and virtual network scene |
| CN102129346A (en) * | 2011-03-03 | 2011-07-20 | 亿度慧达教育科技（北京）有限公司 | Video interaction method and device |
| CN103390287A (en) * | 2012-05-11 | 2013-11-13 | 索尼电脑娱乐欧洲有限公司 | Apparatus and method for augmented reality |
| US20140087877A1 (en) * | 2012-09-27 | 2014-03-27 | Sony Computer Entertainment Inc. | Compositing interactive video game graphics with pre-recorded background video content |
| CN104780338A (en) * | 2015-04-16 | 2015-07-15 | 美国掌赢信息科技有限公司 | Method and electronic equipment for loading expression effect animation in instant video |
| CN104866101A (en) * | 2015-05-27 | 2015-08-26 | 世优（北京）科技有限公司 | Real-time interactive control method and real-time interactive control device of virtual object |
| CN105261041A (en) * | 2015-10-19 | 2016-01-20 | 联想(北京)有限公司 | Information processing method and electronic device |
| CN105306468A (en) * | 2015-10-30 | 2016-02-03 | 广州华多网络科技有限公司 | Method for real-time sharing of synthetic video data and anchor client side |
-
2016
- 2016-06-24 CN CN201610473423.4A patent/CN105959718A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1696923A (en) * | 2004-05-10 | 2005-11-16 | 北京大学 | Networked, multimedia synchronous composed storage and issuance system, and method for implementing the system |
| CN101930284A (en) * | 2009-06-23 | 2010-12-29 | 腾讯科技（深圳）有限公司 | Method, device and system for implementing interaction between video and virtual network scene |
| CN102129346A (en) * | 2011-03-03 | 2011-07-20 | 亿度慧达教育科技（北京）有限公司 | Video interaction method and device |
| CN103390287A (en) * | 2012-05-11 | 2013-11-13 | 索尼电脑娱乐欧洲有限公司 | Apparatus and method for augmented reality |
| US20140087877A1 (en) * | 2012-09-27 | 2014-03-27 | Sony Computer Entertainment Inc. | Compositing interactive video game graphics with pre-recorded background video content |
| CN104780338A (en) * | 2015-04-16 | 2015-07-15 | 美国掌赢信息科技有限公司 | Method and electronic equipment for loading expression effect animation in instant video |
| CN104866101A (en) * | 2015-05-27 | 2015-08-26 | 世优（北京）科技有限公司 | Real-time interactive control method and real-time interactive control device of virtual object |
| CN105261041A (en) * | 2015-10-19 | 2016-01-20 | 联想(北京)有限公司 | Information processing method and electronic device |
| CN105306468A (en) * | 2015-10-30 | 2016-02-03 | 广州华多网络科技有限公司 | Method for real-time sharing of synthetic video data and anchor client side |
Non-Patent Citations (2)
| Title |
|---|
| 丁海洋: "基于计算机视觉的增强现实演示系统", 《北京印刷学院学报》 * |
| 梁尚韬: "交互式网络视频直播系统关键技术研究与实现", 《中国优秀硕士学位论文全文数据库 (信息科技辑)》 * |
Cited By (39)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106878820A (en) * | 2016-12-09 | 2017-06-20 | 北京小米移动软件有限公司 | Living broadcast interactive method and device |
| CN108076391A (en) * | 2016-12-23 | 2018-05-25 | 北京市商汤科技开发有限公司 | For the image processing method, device and electronic equipment of live scene |
| CN106937154A (en) * | 2017-03-17 | 2017-07-07 | 北京蜜枝科技有限公司 | Process the method and device of virtual image |
| CN106993195A (en) * | 2017-03-24 | 2017-07-28 | 广州创幻数码科技有限公司 | Virtual portrait role live broadcasting method and system |
| CN107124658A (en) * | 2017-05-02 | 2017-09-01 | 北京小米移动软件有限公司 | Net cast method and device |
| CN108966031A (en) * | 2017-05-18 | 2018-12-07 | 腾讯科技（深圳）有限公司 | Method and device, the electronic equipment of broadcasting content control are realized in video session |
| WO2018210136A1 (en) * | 2017-05-18 | 2018-11-22 | 腾讯科技（深圳）有限公司 | Method and apparatus for realizing content playback control in video session, and electronic device |
| CN107124664A (en) * | 2017-05-25 | 2017-09-01 | 百度在线网络技术（北京）有限公司 | Exchange method and device applied to net cast |
| CN107423809A (en) * | 2017-07-07 | 2017-12-01 | 北京光年无限科技有限公司 | The multi-modal exchange method of virtual robot and system applied to net cast platform |
| CN107423809B (en) * | 2017-07-07 | 2021-02-26 | 北京光年无限科技有限公司 | Virtual robot multi-mode interaction method and system applied to video live broadcast platform |
| CN107360160A (en) * | 2017-07-12 | 2017-11-17 | 广州华多网络科技有限公司 | live video and animation fusion method, device and terminal device |
| CN107682656A (en) * | 2017-09-11 | 2018-02-09 | 广东欧珀移动通信有限公司 | Background image processing method, electronic equipment and computer-readable recording medium |
| CN107707839A (en) * | 2017-09-11 | 2018-02-16 | 广东欧珀移动通信有限公司 | Image processing method and device |
| CN107682656B (en) * | 2017-09-11 | 2020-07-24 | Oppo广东移动通信有限公司 | Background image processing method, electronic device, and computer-readable storage medium |
| CN107750005A (en) * | 2017-09-18 | 2018-03-02 | 迈吉客科技（北京）有限公司 | Virtual interactive method and terminal |
| CN107750005B (en) * | 2017-09-18 | 2020-10-30 | 迈吉客科技（北京）有限公司 | Virtual interaction method and terminal |
| WO2019052451A1 (en) * | 2017-09-18 | 2019-03-21 | 迈吉客科技（北京）有限公司 | Virtual interaction method and terminal |
| CN108134964A (en) * | 2017-11-22 | 2018-06-08 | 上海掌门科技有限公司 | Net cast stage property stacking method, computer equipment and storage medium |
| WO2019134235A1 (en) * | 2018-01-08 | 2019-07-11 | 平安科技（深圳）有限公司 | Live broadcast interaction method and apparatus, and terminal device and storage medium |
| CN108462883A (en) * | 2018-01-08 | 2018-08-28 | 平安科技（深圳）有限公司 | A kind of living broadcast interactive method, apparatus, terminal device and storage medium |
| CN108683954A (en) * | 2018-05-30 | 2018-10-19 | 广州华多网络科技有限公司 | Pop-up animation producing method and device, pop-up animation, network direct broadcasting server |
| WO2020042786A1 (en) * | 2018-08-27 | 2020-03-05 | 阿里巴巴集团控股有限公司 | Interactive method and device based on augmented reality |
| CN110351575A (en) * | 2019-07-12 | 2019-10-18 | 广州华多网络科技有限公司 | A kind of processing method and relevant device of virtual pet |
| CN110351575B (en) * | 2019-07-12 | 2021-06-11 | 广州方硅信息技术有限公司 | Virtual pet processing method and related equipment |
| CN110675477A (en) * | 2019-09-26 | 2020-01-10 | 南宁峰值文化传播有限公司 | Animation display method |
| CN110850983A (en) * | 2019-11-13 | 2020-02-28 | 腾讯科技（深圳）有限公司 | Virtual object control method and device in video live broadcast and storage medium |
| CN111343473A (en) * | 2020-02-25 | 2020-06-26 | 北京达佳互联信息技术有限公司 | Data processing method and device for live application, electronic equipment and storage medium |
| CN111935491A (en) * | 2020-06-28 | 2020-11-13 | 百度在线网络技术（北京）有限公司 | Live broadcast special effect processing method and device and server |
| US11722727B2 (en) * | 2020-06-28 | 2023-08-08 | Baidu Online Network Technology (Beijing) Co., Ltd. | Special effect processing method and apparatus for live broadcasting, and server |
| US20210321157A1 (en) * | 2020-06-28 | 2021-10-14 | Baidu Online Network Technology (Beijing) Co., Ltd. | Special effect processing method and apparatus for live broadcasting, and server |
| CN111918073B (en) * | 2020-06-30 | 2022-11-04 | 北京百度网讯科技有限公司 | Live broadcast room management method and device |
| CN111918073A (en) * | 2020-06-30 | 2020-11-10 | 北京百度网讯科技有限公司 | Management method and device of live broadcast room |
| CN111954063A (en) * | 2020-08-24 | 2020-11-17 | 北京达佳互联信息技术有限公司 | Content display control method and device for video live broadcast room |
| CN111954063B (en) * | 2020-08-24 | 2022-11-04 | 北京达佳互联信息技术有限公司 | Content display control method and device for video live broadcast room |
| CN114915853A (en) * | 2021-02-08 | 2022-08-16 | 中国电信股份有限公司 | Interactive information processing method, device, terminal and storage medium |
| CN113490063A (en) * | 2021-08-26 | 2021-10-08 | 上海盛付通电子支付服务有限公司 | Method, device, medium and program product for live broadcast interaction |
| CN115314749A (en) * | 2022-06-15 | 2022-11-08 | 网易（杭州）网络有限公司 | Interactive information response method and device and electronic equipment |
| CN115314749B (en) * | 2022-06-15 | 2024-03-22 | 网易（杭州）网络有限公司 | Response method and device of interaction information and electronic equipment |
| CN116033175A (en) * | 2022-12-27 | 2023-04-28 | 南京汇智互娱网络科技有限公司 | Live broadcast interactive service method and system based on virtual image |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105959718A (en) | Real-time interaction method and device in video live broadcasting | |
| US10460512B2 (en) | 3D skeletonization using truncated epipolar lines | |
| CN111641844B (en) | Live broadcast interaction method and device, live broadcast system and electronic equipment | |
| CN110390704B (en) | Image processing method, image processing device, terminal equipment and storage medium | |
| CN110465097B (en) | Character vertical drawing display method and device in game, electronic equipment and storage medium | |
| CN112379812B (en) | Simulation 3D digital human interaction method and device, electronic equipment and storage medium | |
| CN111968207B (en) | Animation generation method, device, system and storage medium | |
| CN107464291B (en) | Face image processing method and device | |
| US20160110922A1 (en) | Method and system for enhancing communication by using augmented reality | |
| CN107197385A (en) | A kind of real-time virtual idol live broadcasting method and system | |
| US20230047858A1 (en) | Method, apparatus, electronic device, computer-readable storage medium, and computer program product for video communication | |
| TW201210663A (en) | Natural user input for driving interactive stories | |
| WO2020024692A1 (en) | Man-machine interaction method and apparatus | |
| EP3791573A1 (en) | Puppeteering a remote avatar by facial expressions | |
| CN112652041B (en) | Virtual image generation method and device, storage medium and electronic equipment | |
| CN107248185A (en) | A kind of virtual emulation idol real-time live broadcast method and system | |
| WO2018139203A1 (en) | Information processing device, information processing method, and program | |
| KR20180080783A (en) | Live social media system for using virtual human awareness and real-time synthesis technology, server for augmented synthesis | |
| CN111383642B (en) | Voice response method based on neural network, storage medium and terminal equipment | |
| CN113709543A (en) | Video processing method and device based on virtual reality, electronic equipment and medium | |
| CN116437137B (en) | Live broadcast processing method and device, electronic equipment and storage medium | |
| CN117391122A (en) | 3D digital human-assisted chat method established in meta universe | |
| CN114222076A (en) | Face changing video generation method, device, equipment and storage medium | |
| CN113411537A (en) | Video call method, device, terminal and storage medium | |
| CN106502401B (en) | Image control method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20160921 |
|
| WD01 | Invention patent application deemed withdrawn after publication |