CN107124664A - Exchange method and device applied to net cast - Google Patents
Exchange method and device applied to net cast Download PDFInfo
- Publication number
- CN107124664A CN107124664A CN201710380173.4A CN201710380173A CN107124664A CN 107124664 A CN107124664 A CN 107124664A CN 201710380173 A CN201710380173 A CN 201710380173A CN 107124664 A CN107124664 A CN 107124664A
- Authority
- CN
- China
- Prior art keywords
- interactive
- client
- live video
- video
- live
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 37
- 230000002452 interceptive effect Effects 0.000 claims abstract description 169
- 230000005540 biological transmission Effects 0.000 claims description 11
- 230000003993 interaction Effects 0.000 claims description 10
- 230000008569 process Effects 0.000 claims description 4
- 238000004590 computer program Methods 0.000 claims 2
- 230000003287 optical effect Effects 0.000 description 3
- 238000013527 convolutional neural network Methods 0.000 description 2
- 239000000284 extract Substances 0.000 description 2
- 230000005291 magnetic effect Effects 0.000 description 2
- 230000006399 behavior Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000005611 electricity Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 230000000644 propagated effect Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
- H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/85—Assembly of content; Generation of multimedia applications
- H04N21/854—Content authoring
- H04N21/8547—Content authoring involving timestamps for synchronizing content
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Theoretical Computer Science (AREA)
- Computer Security & Cryptography (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
This application discloses the exchange method and device applied to net cast.One embodiment of this method includes：The live video that main broadcaster's client is sent is received, live video is generated by main broadcaster's client real-time recording, and live video includes：Video flowing, audio stream；Identify the interactive object in the image in video flowing, the interactive action of user of the interactive object based on main broadcaster's client and generate；The corresponding interactive instruction of interactive object is determined, and live video and interactive instruction are sent to subscription client, so that live video and the corresponding displaying object of interactive instruction to be presented in the live interface of subscription client.On the one hand, the operation of main broadcaster in the interacting of main broadcaster and user is simplified, on the other hand, without suspending current live, the fluency of net cast is kept.
Description
Technical field
The application is related to computer realm, and in particular to network technique field, more particularly to the friendship applied to net cast
Mutual method and apparatus.
Background technology
In net cast, main broadcaster needs to interact with user.At present, interacting between main broadcaster and user needs main broadcaster
Complete manually.Main broadcaster's input picture, expression etc. are interacted with user to be needed to suspend current live.On the one hand, cause
Main broadcaster and interacting for user are relatively complicated, on the other hand, when main broadcaster needs to interact with user, it is necessary to suspend current straight
Broadcast, influence live fluency.
The content of the invention
This application provides the exchange method and device applied to net cast, deposited for solving above-mentioned background section
Technical problem.
In a first aspect, this application provides the exchange method applied to net cast, this method includes：Receive main broadcaster client
The live video sent is held, live video is generated by main broadcaster's client real-time recording, and live video includes：Video flowing, audio
Stream；Identify the interactive object in the image in video flowing, the interactive action of user of the interactive object based on main broadcaster's client and
Generation；Determine the corresponding interactive instruction of interactive object, and live video and interactive instruction sent to subscription client, with
Live video and the corresponding displaying object of interactive instruction are presented in the live interface of subscription client.
Second aspect, this application provides the exchange method applied to net cast, this method includes：The reception server is sent out
The live video sent and interactive instruction, live video are generated by main broadcaster's client real-time recording, and live video includes：Video
Stream, audio stream, interactive instruction are determined based on the interactive object that server is identified from the image in video flowing；It is determined that interaction
Corresponding displaying object is instructed, and live video is presented in live interface and object is shown.
The third aspect, this application provides the interactive device applied to net cast, the device includes：Video reception list
Member, is configured to receive the live video that main broadcaster's client is sent, live video is generated by main broadcaster's client real-time recording, directly
Broadcasting video includes：Video flowing, audio stream；Image identification unit, is configured to identify the interaction pair in the image in video flowing
Generated as, the interactive action of user of the interactive object based on main broadcaster's client；Information process unit, is configured to determine interaction
The corresponding interactive instruction of object, and live video and interactive instruction are sent to subscription client, with subscription client
Live video and the corresponding displaying object of interactive instruction are presented in live interface.
Fourth aspect, this application provides the interactive device applied to net cast, the device includes：Information receives single
Member, is configured to live video and the interactive instruction of the reception server transmission, live video is by main broadcaster's client real-time recording
Generation, live video includes：Video flowing, audio stream, interactive instruction are identified based on server from the image in video flowing
Interactive object and determine；Information presenting unit, is configured to determine the corresponding displaying object of interactive instruction, and at live interface
Middle presentation live video and displaying object.
The exchange method and device applied to net cast that the application is provided, by receiving the straight of main broadcaster's client transmission
Video is broadcast, live video is generated by main broadcaster's client real-time recording, and live video includes：Video flowing, audio stream；Identify and regard
Frequency flow in image in interactive object, the interactive action of user of the interactive object based on main broadcaster's client and generate；It is determined that handing over
The corresponding interactive instruction of mutual object, and live video and interactive instruction are sent to subscription client, with subscription client
Live interface in live video and the corresponding displaying object of interactive instruction is presented.On the one hand, the friendship of main broadcaster and user are simplified
The operation of main broadcaster in mutually, on the other hand, without suspending current live, keeps the fluency of net cast.
Brief description of the drawings
By reading the detailed description made to non-limiting example made with reference to the following drawings, the application's is other
Feature, objects and advantages will become more apparent upon：
Fig. 1 shows the exemplary system architecture that can apply to the exchange method applied to net cast of the application；
Fig. 2 shows the flow chart of one embodiment of the exchange method applied to net cast according to the application；
Fig. 3 shows the flow chart of another embodiment of the exchange method applied to net cast according to the application；
Fig. 4 shows main broadcaster's client of the application, server, an interactive schematic diagram of subscription client；
Fig. 5 shows the structural representation of one embodiment of the interactive device applied to net cast according to the application
Figure；
Fig. 6 shows the structural representation of another embodiment of the interactive device applied to net cast according to the application
Figure.
Embodiment
The application is described in further detail with reference to the accompanying drawings and examples.It is understood that this place is retouched
The specific embodiment stated is used only for explaining related invention, rather than the restriction to the invention.It also should be noted that, in order to
Be easy to description, illustrate only in accompanying drawing to about the related part of invention.
It should be noted that in the case where not conflicting, the feature in embodiment and embodiment in the application can phase
Mutually combination.Describe the application in detail below with reference to the accompanying drawings and in conjunction with the embodiments.
Fig. 1 shows the exemplary system architecture that can apply to the exchange method applied to net cast of the application.
As shown in figure 1, system architecture can include main broadcaster's client 101, server 102, subscription client 103.
Medium of the network 104 to provide transmission link between main broadcaster's client 101 and server 102.Network 104 can
With including various wired, wireless transmission links.Network 105 between server 102 and subscription client 103 to provide transmission
The medium of link.Network 105 can include various wired, wireless transmission links.
The user (also referred to as network main broadcaster) of main broadcaster's client 101 can be using the end where main broadcaster's client 101
Equipment such as camera, microphone on end gather live image, voice, real-time recording live video in real time.Main broadcaster client
End 101 can send the live video of real-time recording to server 102.Server 102 can receive main broadcaster's client 101 and send out
The live video sent, live video is sent to subscription client 103.Subscription client 103 is received after live video, can be with
Play live video.
Fig. 2 is refer to, it illustrates one embodiment of the exchange method applied to net cast according to the application
Flow.It should be noted that the exchange method applied to net cast that the embodiment of the present application is provided can be by server example
Server 102 in such as Fig. 1 is performed, and correspondingly, the interactive device applied to net cast can be arranged at server such as Fig. 1
In server 102 in.This method comprises the following steps：
Step 201, the live video that main broadcaster's client is sent is received.
In the present embodiment, the user (also referred to as network main broadcaster) of main broadcaster's client, can when recording live video
To utilize the camera collection image of the terminal where main broadcaster's client, it is possible to use the Mike of the terminal where main broadcaster's client
Elegance collection voice (such as voice of network main broadcaster).Main broadcaster's client, can be by image harmony after collection image and voice
Sound is encoded, and obtains the live video comprising video flowing and audio stream.
Step 202, the interactive object in the image in video flowing is identified.
In the present embodiment, after the live video that main broadcaster's client is sent is received by step 201, extract live
Video flowing in video.Live video can be solved according to the video flowing and the coded system of audio stream in live video
Code, extracts the video flowing in live video.
In the present embodiment, after video flowing is extracted, image recognition, identification can be carried out to the image in video flowing
The interactive object gone out in image.Interactive object can the interactive action based on the user of main broadcaster's client and generate.For example, can be with
Image recognition is carried out to each two field picture in video flowing, when including interactive object in a two field picture, then this can be identified
Interactive object in image.
So that interactive action is the heart-shaped gesture that the user of main broadcaster's client makes in net cast as an example, in main broadcaster client
The heart can be included in the image of the camera collection of terminal when the user at end makes heart-shaped gesture where main broadcaster's client
The corresponding interactive object of gesture is heart-shaped gesture object.Heart-shaped gesture is gathered in the camera of the terminal where main broadcaster's client
The figure formed of corresponding pixel is heart in image, then interactive object heart-shaped gesture object is shaped as heart.
The image of the camera collection of terminal where main broadcaster's client when the user of main broadcaster's client makes heart-shaped gesture is carried out
After image recognition, the heart-shaped gesture object in the image can be identified.
For example, the camera collection of the terminal when the user of main broadcaster's client makes heart-shaped gesture where main broadcaster's client
Image in, such as RCNN of the convolutional neural networks for target identification (Regions with can be passed through
Convolutional Neural Network) hand object in the image is identified, it is then possible to determine that hand object exists
The region occupied in the image, the shape in the region occupied i.e. it is heart-shaped can as the corresponding interactive object of gesture shape, then
Can the shape determine that interactive object is heart-shaped gesture object, the heart-shaped gesture object is identified from the image.
In some optional implementations of the present embodiment, in order to identify the interaction pair in the image in video flowing
As that can obtain the key frame images in video flowing first, key frame images are calculated respectively with multiple comprising default interactive object
Pre-set image matching degree.In multiple pre-set images comprising default interactive object, the default friendship in each pre-set image
Mutual object is different.Matched when existing to be more than with the matching degree of key frame images in multiple pre-set images comprising default interactive object
When spending the pre-set image of threshold value, it will can be more than with the matching degree of key frame images default in the pre-set image of matching degree threshold value
Interactive object is used as interactive object.Each key frame images in video flowing can be directed to, each key frame is calculated respectively
The matching degree of image and multiple pre-set images comprising default interactive object.
So that interactive action is the heart-shaped gesture that the user of main broadcaster's client makes in net cast as an example, multiple key frames
In image, one of key frame images are the end when the user of main broadcaster's client makes heart-shaped gesture where main broadcaster's client
The image for including the corresponding interactive object of heart-shaped gesture of the camera collection at end.Each pre-set image in multiple pre-set images
Can be different images of gestures, each pre-set image includes the hand in different gesture objects, i.e. each pre-set image
The shape of gesture object is different.The key frame images and each gesture of the corresponding interactive object of heart-shaped gesture are included in calculating respectively
After the matching degree of image, it may be determined that the matching degree of the key frame images and the images of gestures comprising heart-shaped gesture object is more than
Matching degree threshold value, the then images of gestures comprising heart-shaped gesture object is the pre-set image matched with the key frame images, and this is preset
Heart-shaped gesture object in image is interactive object, so that, from the key frame figure for including the corresponding interactive object of heart-shaped gesture
Heart-shaped gesture object is identified as in.
Step 203, the corresponding interactive instruction of interactive object is determined, and live video and interactive instruction are sent to user
Client.
In the present embodiment, after the interactive object during the image of video flowing is identified by step 202, it may be determined that
The corresponding interactive instruction of interactive object., can be by interactive instruction and live it is determined that after the corresponding interactive instruction of interactive object
Video is sent to subscription client.So that, can be live after subscription client receives interactive instruction and live video
Live video and the corresponding displaying object of interactive instruction are presented in interface.The corresponding displaying object of interactive instruction can be included but not
It is limited to：The corresponding animation of the corresponding interactive object of the interactive instruction, picture, emoticon.
So that interactive action is the heart-shaped gesture that the user of main broadcaster's client makes in net cast as an example, in main broadcaster client
The heart can be included in the image of the camera collection of terminal when the user at end makes heart-shaped gesture where main broadcaster's client
The corresponding interactive object of gesture is heart-shaped gesture object.Identified in main broadcaster's client heart-shaped gesture object in the image it
Afterwards, it may be determined that the corresponding interactive instruction of the heart-shaped gesture object.The corresponding interactive instruction of the heart-shaped gesture object can be used for
The corresponding displaying object of heart-shaped gesture object, such as heart-shaped gesture object pair is presented in triggering in the live interface of subscription client
The displaying object answered is heart-shaped picture., can be by the heart-shaped gesture it is determined that after the corresponding interactive instruction of heart-shaped gesture object
The corresponding interactive instruction of object and live video are sent to subscription client.So as to receive the heart-shaped hand in subscription client
After the corresponding interactive instruction of gesture object and live video, live video and heart-shaped gesture object can be presented in live video
Corresponding animation, picture, emoticon.
In some optional implementations of the present embodiment, interactive object is being identified from the image in video flowing
Simultaneously, it may be determined that the time point that the image belonging to interactive object occurs in live video.It can generate comprising the time point
Timestamp information be sent to subscription client.So as to which subscription client, can after interactive instruction and live video is received
According to the timestamp information, the time point that the image belonging to interactive object occurs in live video is determined, at live interface
In live video in the time point the corresponding displaying object of interactive object is presented.
Fig. 3 is refer to, it illustrates another embodiment of the exchange method applied to net cast according to the application
Flow.It should be noted that the exchange method applied to net cast that the embodiment of the present application is provided can be in Fig. 1
Subscription client 103 is performed, correspondingly, and the interactive device applied to net cast can be arranged in subscription client 103.Should
Method comprises the following steps：
Step 301, the reception server is sent live video and interactive instruction.
In the present embodiment, live video is generated by main broadcaster's client real-time recording, and live video includes：Video flowing,
Audio stream.
In the present embodiment, when using subscription client watching video live broadcast, the straight of server transmission can be received
Broadcast video and interactive instruction.What interactive instruction can be identified based on server from the image in the video flowing in live video
Interactive object and determine.
So that interactive action is the heart-shaped gesture that the user of main broadcaster's client makes in net cast as an example, in main broadcaster client
The heart can be included in the image of the camera collection of terminal when the user at end makes heart-shaped gesture where main broadcaster's client
The corresponding interactive object of gesture is heart-shaped gesture object.Master when making heart-shaped gesture from the user of main broadcaster's client on the server
, on the server can be with after identifying the heart-shaped gesture object in the image for the camera collection for broadcasting the terminal where client
Determine the corresponding interactive instruction of the heart-shaped gesture object.The corresponding interactive instruction of the heart-shaped gesture object can be used for triggering with
The corresponding displaying object of heart-shaped gesture object is presented in the live interface of family client, for example, displaying object is heart-shaped picture.So
Afterwards, the corresponding interactive instruction of the heart-shaped gesture object of server transmission can be received.
Step 302, the corresponding displaying object of interactive instruction, and presentation live video and interaction in live interface are determined
Object.
In the present embodiment, can be with after the live video and interactive instruction sent by step 301 the reception server
The corresponding displaying object of interactive instruction is determined, live video and the corresponding displaying object of interactive instruction are presented in live interface.
The corresponding displaying object of interactive instruction can include but is not limited to：The corresponding animation of the corresponding interactive object of the interactive instruction, figure
Piece, emoticon.
For example, the user of main broadcaster's client is making a heart with the user of subscription client in the interacting of net cast
Shape gesture, so that interactive action is the heart-shaped gesture that the user of main broadcaster's client makes in net cast as an example, in main broadcaster client
The heart can be included in the image of the camera collection of terminal when the user at end makes heart-shaped gesture where main broadcaster's client
The corresponding interactive object of gesture is heart-shaped gesture object.The heart-shaped gesture object identified in server from the image, connects
After the corresponding interactive instruction of the heart-shaped gesture object for receiving server transmission, interactive instruction can be presented in live interface
Corresponding displaying object.The corresponding displaying object of the interactive instruction can be the corresponding animation of heart-shaped gesture object, picture, expression
Symbol.
In some optional implementations of the present embodiment, the timestamp information that can be sent with the reception server should
The time point that timestamp information occurs comprising the image belonging to interactive object in live video, then can be according to interactive object institute
Interaction pair is presented in the time point in the time point that the image of category occurs in live video, the live video in live interface
As corresponding displaying object.
Fig. 4 is refer to, is illustrated it illustrates an interaction of main broadcaster's client of the application, server, subscription client
Figure.
Main broadcaster's client gathers image and voice, records live video.Main broadcaster's client can gather live content in real time
Corresponding image and voice, real-time recording live video.Main broadcaster's client sends live video to server.Server is from straight
Broadcast and video flowing is extracted in video, interactive object is identified from the image of video flowing, determine that the corresponding interaction of interactive object refers to
Order.Each interactive object can correspond to an interactive instruction, and each interactive instruction can correspond to a displaying object.Service
Device sends interactive instruction and live video to subscription client.Subscription client can play live regard in live interface
Frequently, the corresponding displaying object of interactive instruction and in live video is presented.
Fig. 5 is refer to, it illustrates one embodiment of the interactive device applied to net cast according to the application
Structural representation.
As shown in figure 5, the interactive device applied to net cast includes：Video reception unit 501, image identification unit
502, information process unit 503.Wherein, video reception unit 501 is configured to receive the live video that main broadcaster's client is sent,
Live video is generated by main broadcaster's client real-time recording, and live video includes：Video flowing, audio stream；Image identification unit 502
It is configured to identify the interactive object in the image in video flowing, the interaction of user of the interactive object based on main broadcaster's client is moved
Make and generate；Information process unit 503 is configured to determine the corresponding interactive instruction of interactive object, and by live video and friendship
Mutually instruction is sent to subscription client, live video is presented in the live interface of subscription client and interactive instruction is corresponding
Show object.
In some optional implementations of the present embodiment, image identification unit 502 includes：Interactive object identification is single
First (not shown), is configured to obtain the key frame images in video flowing；Determine multiple default figures for including default interactive object
The pre-set image that is matched with key frame images as in, and default in the pre-set image that will be matched with key frame images interact pair
As interactive object, wherein, the default interactive object that each pre-set image is included in multiple pre-set images is differed.
Fig. 6 is refer to, it illustrates another embodiment of the interactive device applied to net cast according to the application
Structural representation.
As shown in fig. 6, the interactive device applied to net cast includes：Information receiving unit 601, information presenting unit
602.Wherein, information receiving unit 601 be configured to the reception server transmission live video and interactive instruction, live video by
Main broadcaster's client real-time recording and generate, live video includes：Video flowing, audio stream, interactive instruction are based on server from video
The interactive object that is identified in image in stream and determine；Information presenting unit 602 is configured to determine that interactive instruction is corresponding
Object is shown, and live video is presented in live interface and object is shown.
Present invention also provides a kind of server, the server can include the net cast that is applied to described by Fig. 5
Interactive device.The server can be configured with one or more processors；Memory, for storing one or more programs, one
The instruction to perform the operation described in above-mentioned steps 201-203 can be included in individual or multiple programs.When one or more
When program is executed by one or more processors so that one or more processors are performed described in above-mentioned steps 201-203
Operation.
Present invention also provides a kind of subscription client, the subscription client can include being applied to described by Fig. 6 and regard
Frequently live interactive device.Terminal where the subscription client can be configured with one or more processors；Memory, is used for
Storing in one or more programs, one or more programs to include to perform the behaviour described in above-mentioned steps 301-302
The instruction of work.When one or more programs are executed by one or more processors so that on one or more processors are performed
State the operation described in step 301-302.
Present invention also provides a kind of non-volatile computer-readable medium, the computer-readable medium can be server
In it is included；Can also be individualism, without in supplying server.The non-volatile computer-readable medium carries one
Individual or multiple programs, when one or more program is performed by the server so that the server：
Present invention also provides a kind of non-volatile computer-readable medium, the non-volatile computer-readable medium can be with
It is included in the terminal where subscription client；Can also be individualism, the end where unassembled access customer client
In end.The non-volatile computer-readable medium carries one or more program, when one or more program is by user
When terminal where client is performed so that the subscription client.
It should be noted that above-mentioned non-volatile computer-readable medium can be computer-readable signal media or non-
Volatile computer readable storage medium storing program for executing either the two any combination.Computer-readable recording medium for example can be
The including but not limited to system of electricity, magnetic, optical, electromagnetic, infrared ray or semiconductor, device or device, or any group above
Close.The more specifically example of non-volatile computer readable storage medium storing program for executing can include but is not limited to：Led with one or more
The electrical connection of line, portable computer diskette, hard disk, random access storage device (RAM), read-only storage (ROM), erasable type can
Program read-only memory (EPROM or flash memory), optical fiber, portable compact disc read-only storage (CD-ROM), light storage device,
Magnetic memory device or above-mentioned any appropriate combination.In this application, non-volatile computer readable storage medium storing program for executing can be with
Be it is any including or storage program tangible medium, the program can be commanded execution system, device or device use or
It is in connection.And in this application, computer-readable signal media can include in a base band or be used as carrier wave one
The data-signal that part is propagated, wherein carrying computer-readable program code.The data-signal of this propagation can be many
The form of kind, including but not limited to electromagnetic signal, optical signal or above-mentioned any appropriate combination.Computer-readable signal media
Any non-volatile computer-readable medium beyond non-volatile computer readable storage medium storing program for executing is can also be, the computer can
Read medium can send, propagate or transmit for by instruction execution system, device or device using or in connection make
Program.The program code included on computer-readable medium can be transmitted with any appropriate medium, be included but is not limited to：
Wirelessly, electric wire, optical cable, RF etc., or above-mentioned any appropriate combination.
Above description is only the preferred embodiment of the application and the explanation to institute's application technology principle.People in the art
Member should be appreciated that invention scope involved in the application, however it is not limited to the technology of the particular combination of above-mentioned technical characteristic
Scheme, while should also cover in the case where not departing from inventive concept, is carried out any by above-mentioned technical characteristic or its equivalent feature
Other technical schemes formed by combination.Such as features described above has similar functions with (but not limited to) disclosed herein
Technical characteristic carries out technical scheme formed by replacement mutually.
Claims (10)
1. a kind of exchange method applied to net cast, it is characterised in that methods described includes：
The live video that main broadcaster's client is sent is received, the live video is generated by main broadcaster's client real-time recording, described
Live video includes：Video flowing, audio stream；
Identify the interactive object in the image in the video flowing, the friendship of user of the interactive object based on main broadcaster's client
Mutually act and generate；
The corresponding interactive instruction of the interactive object is determined, and the live video and interactive instruction are sent to user client
End, so that live video and the corresponding displaying object of interactive instruction to be presented in the live interface of subscription client.
2. according to the method described in claim 1, it is characterised in that identify the interactive object in the image in the video flowing
Including：
Obtain the key frame images in video flowing；
The pre-set image matched in multiple pre-set images comprising default interactive object with key frame images is determined, and will be with pass
Default interactive object in the pre-set image of key two field picture matching as the interactive object, wherein, it is every in multiple pre-set images
The default interactive object that one pre-set image is included is differed.
3. method according to claim 2, it is characterised in that methods described also includes：
Determine the time point that the image belonging to interactive object occurs in live video；
Generation includes the timestamp information at the time point；
The timestamp information is sent to subscription client.
4. a kind of exchange method applied to net cast, it is characterised in that methods described includes：
Live video and interactive instruction that the reception server is sent, the live video are given birth to by main broadcaster's client real-time recording
Into live video includes：Video flowing, audio stream, the interactive instruction are identified based on server from the image in video flowing
Interactive object and determine；
The corresponding displaying object of interactive instruction is determined, and live video is presented in live interface and object is shown.
5. method according to claim 4, it is characterised in that methods described also includes：
The timestamp information that the reception server is sent, timestamp information is comprising the image belonging to the interactive object in live video
At the time point of middle appearance, the displaying object is presented with time point described in the live video in live interface.
6. a kind of interactive device applied to net cast, it is characterised in that described device includes：
Video reception unit, is configured to receive the live video that main broadcaster's client is sent, the live video is by main broadcaster client
Hold real-time recording and generate, the live video includes：Video flowing, audio stream；
Image identification unit, is configured to identify the interactive object in the image in the video flowing, the interactive object base
Generated in the interactive action of the user of main broadcaster's client；
Information process unit, is configured to determine the corresponding interactive instruction of the interactive object, and by the live video and
Interactive instruction is sent to subscription client, corresponding with interactive instruction so that live video to be presented in the live interface of subscription client
Displaying object.
7. device according to claim 6, it is characterised in that image identification unit includes：
Interactive object recognizes subelement, is configured to obtain the key frame images in video flowing；Determine multiple comprising default interaction
In the pre-set image matched in the pre-set image of object with key frame images, and the pre-set image that will be matched with key frame images
Default interactive object as the interactive object, wherein, the default friendship that each pre-set image is included in multiple pre-set images
Mutual object is differed.
8. a kind of interactive device applied to net cast, it is characterised in that described device also includes：
Information receiving unit, is configured to live video and the interactive instruction of the reception server transmission, the live video is by leading
Broadcast client real-time recording and generate, live video includes：Video flowing, audio stream, the interactive instruction be based on server from regarding
Frequency flow in image in the interactive object that identifies and determine；
Information presenting unit, is configured to determine the corresponding displaying object of interactive instruction, and be presented live in live interface
Video and displaying object.
9. a kind of readable computer storage medium, it is characterised in that be stored thereon with computer program, it is characterised in that the journey
The method as described in any in claim 1-3 is realized when sequence is executed by processor.
10. a kind of readable computer storage medium, it is characterised in that be stored thereon with computer program, it is characterised in that the journey
The method as described in any in claim 4-5 is realized when sequence is executed by processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710380173.4A CN107124664A (en) | 2017-05-25 | 2017-05-25 | Exchange method and device applied to net cast |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710380173.4A CN107124664A (en) | 2017-05-25 | 2017-05-25 | Exchange method and device applied to net cast |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107124664A true CN107124664A (en) | 2017-09-01 |
Family
ID=59730239
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710380173.4A Pending CN107124664A (en) | 2017-05-25 | 2017-05-25 | Exchange method and device applied to net cast |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107124664A (en) |
Cited By (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108024134A (en) * | 2017-11-08 | 2018-05-11 | 北京密境和风科技有限公司 | It is a kind of based on live data analysing method, device and terminal device |
| CN109068181A (en) * | 2018-07-27 | 2018-12-21 | 广州华多网络科技有限公司 | Football game exchange method, system, terminal and device based on net cast |
| CN109460171A (en) * | 2018-10-26 | 2019-03-12 | 北京达佳互联信息技术有限公司 | Information interacting method, device, terminal and storage medium |
| CN109660818A (en) * | 2018-12-30 | 2019-04-19 | 广东彼雍德云教育科技有限公司 | A kind of virtual interactive live broadcast system |
| CN109922352A (en) * | 2019-02-26 | 2019-06-21 | 李钢江 | A kind of data processing method, device, electronic equipment and readable storage medium storing program for executing |
| CN110703913A (en) * | 2019-09-27 | 2020-01-17 | 腾讯科技（深圳）有限公司 | Object interaction method and device, storage medium and electronic device |
| CN110989910A (en) * | 2019-11-28 | 2020-04-10 | 广州虎牙科技有限公司 | Interaction method, system, device, electronic equipment and storage medium |
| CN111064987A (en) * | 2019-12-14 | 2020-04-24 | 北京字节跳动网络技术有限公司 | Information display method and device and electronic equipment |
| CN111385595A (en) * | 2018-12-29 | 2020-07-07 | 阿里巴巴集团控股有限公司 | Network live broadcast method, live broadcast replenishment processing method and device, live broadcast server and terminal equipment |
| EP3726843A4 (en) * | 2017-12-14 | 2020-10-21 | Tencent Technology (Shenzhen) Company Limited | Animation implementation method, terminal and storage medium |
| CN111986700A (en) * | 2020-08-28 | 2020-11-24 | 广州繁星互娱信息科技有限公司 | Method, device, equipment and storage medium for triggering non-contact operation |
| CN112135152A (en) * | 2019-06-24 | 2020-12-25 | 腾讯科技（深圳）有限公司 | Information processing method and device |
| CN112969093A (en) * | 2019-12-13 | 2021-06-15 | 腾讯科技（北京）有限公司 | Interactive service processing method, device, equipment and storage medium |
| WO2021114845A1 (en) * | 2019-12-13 | 2021-06-17 | 腾讯科技（深圳）有限公司 | Interactive service processing method, system and device, and storage medium |
| CN113448475A (en) * | 2021-06-30 | 2021-09-28 | 广州博冠信息科技有限公司 | Interaction control method and device for virtual live broadcast room, storage medium and electronic equipment |
| CN114765691A (en) * | 2021-01-13 | 2022-07-19 | 北京字节跳动网络技术有限公司 | Live video function component loading method, data processing method and equipment |
| CN115883814A (en) * | 2023-02-23 | 2023-03-31 | 阿里巴巴（中国）有限公司 | Method, device and equipment for playing real-time video stream |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102122350A (en) * | 2011-02-24 | 2011-07-13 | 浙江工业大学 | Skeletonization and template matching-based traffic police gesture identification method |
| US20140059613A1 (en) * | 2012-08-17 | 2014-02-27 | Flextronics Ap, Llc | Live television application on top of live feed |
| CN104463250A (en) * | 2014-12-12 | 2015-03-25 | 广东工业大学 | Sign language recognition translation method based on Davinci technology |
| US20150172599A1 (en) * | 2013-12-13 | 2015-06-18 | Blake Caldwell | System and method for interactive animations for enhanced and personalized video communications |
| CN104793738A (en) * | 2015-03-17 | 2015-07-22 | 上海海洋大学 | Non-contact type computer operating method based on Leap Motion |
| CN105959718A (en) * | 2016-06-24 | 2016-09-21 | 乐视控股（北京）有限公司 | Real-time interaction method and device in video live broadcasting |
| WO2016154834A1 (en) * | 2015-03-28 | 2016-10-06 | Intel Corporation | Gesture matching mechanism |
| CN106303662A (en) * | 2016-08-29 | 2017-01-04 | 网易（杭州）网络有限公司 | Image processing method in net cast and device |
| CN106658038A (en) * | 2016-12-19 | 2017-05-10 | 广州虎牙信息科技有限公司 | Live broadcast interaction method based on video stream and corresponding device thereof |
-
2017
- 2017-05-25 CN CN201710380173.4A patent/CN107124664A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102122350A (en) * | 2011-02-24 | 2011-07-13 | 浙江工业大学 | Skeletonization and template matching-based traffic police gesture identification method |
| US20140059613A1 (en) * | 2012-08-17 | 2014-02-27 | Flextronics Ap, Llc | Live television application on top of live feed |
| US20150172599A1 (en) * | 2013-12-13 | 2015-06-18 | Blake Caldwell | System and method for interactive animations for enhanced and personalized video communications |
| CN104463250A (en) * | 2014-12-12 | 2015-03-25 | 广东工业大学 | Sign language recognition translation method based on Davinci technology |
| CN104793738A (en) * | 2015-03-17 | 2015-07-22 | 上海海洋大学 | Non-contact type computer operating method based on Leap Motion |
| WO2016154834A1 (en) * | 2015-03-28 | 2016-10-06 | Intel Corporation | Gesture matching mechanism |
| CN105959718A (en) * | 2016-06-24 | 2016-09-21 | 乐视控股（北京）有限公司 | Real-time interaction method and device in video live broadcasting |
| CN106303662A (en) * | 2016-08-29 | 2017-01-04 | 网易（杭州）网络有限公司 | Image processing method in net cast and device |
| CN106658038A (en) * | 2016-12-19 | 2017-05-10 | 广州虎牙信息科技有限公司 | Live broadcast interaction method based on video stream and corresponding device thereof |
Non-Patent Citations (1)
| Title |
|---|
| 极限元: "极限元：浅谈手势识别在直播中的运用", 《极限元：浅谈手势识别在直播中的运用》 * |
Cited By (26)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108024134A (en) * | 2017-11-08 | 2018-05-11 | 北京密境和风科技有限公司 | It is a kind of based on live data analysing method, device and terminal device |
| CN108024134B (en) * | 2017-11-08 | 2020-01-21 | 北京密境和风科技有限公司 | Live broadcast-based data analysis method and device and terminal equipment |
| EP3726843A4 (en) * | 2017-12-14 | 2020-10-21 | Tencent Technology (Shenzhen) Company Limited | Animation implementation method, terminal and storage medium |
| CN109068181A (en) * | 2018-07-27 | 2018-12-21 | 广州华多网络科技有限公司 | Football game exchange method, system, terminal and device based on net cast |
| CN109068181B (en) * | 2018-07-27 | 2020-11-13 | 广州华多网络科技有限公司 | Football game interaction method, system, terminal and device based on live video |
| CN109460171A (en) * | 2018-10-26 | 2019-03-12 | 北京达佳互联信息技术有限公司 | Information interacting method, device, terminal and storage medium |
| CN111385595A (en) * | 2018-12-29 | 2020-07-07 | 阿里巴巴集团控股有限公司 | Network live broadcast method, live broadcast replenishment processing method and device, live broadcast server and terminal equipment |
| CN109660818A (en) * | 2018-12-30 | 2019-04-19 | 广东彼雍德云教育科技有限公司 | A kind of virtual interactive live broadcast system |
| CN109922352A (en) * | 2019-02-26 | 2019-06-21 | 李钢江 | A kind of data processing method, device, electronic equipment and readable storage medium storing program for executing |
| CN112135152B (en) * | 2019-06-24 | 2022-07-12 | 腾讯科技（深圳）有限公司 | Information processing method and device |
| CN112135152A (en) * | 2019-06-24 | 2020-12-25 | 腾讯科技（深圳）有限公司 | Information processing method and device |
| CN110703913A (en) * | 2019-09-27 | 2020-01-17 | 腾讯科技（深圳）有限公司 | Object interaction method and device, storage medium and electronic device |
| CN110703913B (en) * | 2019-09-27 | 2023-09-26 | 腾讯科技（深圳）有限公司 | Object interaction method and device, storage medium and electronic device |
| CN110989910A (en) * | 2019-11-28 | 2020-04-10 | 广州虎牙科技有限公司 | Interaction method, system, device, electronic equipment and storage medium |
| CN112969093A (en) * | 2019-12-13 | 2021-06-15 | 腾讯科技（北京）有限公司 | Interactive service processing method, device, equipment and storage medium |
| WO2021114845A1 (en) * | 2019-12-13 | 2021-06-17 | 腾讯科技（深圳）有限公司 | Interactive service processing method, system and device, and storage medium |
| US11736749B2 (en) | 2019-12-13 | 2023-08-22 | Tencent Technology (Shenzhen) Company Limited | Interactive service processing method and system, device, and storage medium |
| CN112969093B (en) * | 2019-12-13 | 2023-09-08 | 腾讯科技（北京）有限公司 | Interactive service processing method, device, equipment and storage medium |
| CN111064987B (en) * | 2019-12-14 | 2021-06-25 | 北京字节跳动网络技术有限公司 | Information display method and device and electronic equipment |
| CN111064987A (en) * | 2019-12-14 | 2020-04-24 | 北京字节跳动网络技术有限公司 | Information display method and device and electronic equipment |
| CN111986700A (en) * | 2020-08-28 | 2020-11-24 | 广州繁星互娱信息科技有限公司 | Method, device, equipment and storage medium for triggering non-contact operation |
| CN114765691A (en) * | 2021-01-13 | 2022-07-19 | 北京字节跳动网络技术有限公司 | Live video function component loading method, data processing method and equipment |
| CN114765691B (en) * | 2021-01-13 | 2024-05-28 | 北京字节跳动网络技术有限公司 | Video live broadcasting functional component loading method, data processing method and device |
| CN113448475A (en) * | 2021-06-30 | 2021-09-28 | 广州博冠信息科技有限公司 | Interaction control method and device for virtual live broadcast room, storage medium and electronic equipment |
| CN113448475B (en) * | 2021-06-30 | 2024-06-07 | 广州博冠信息科技有限公司 | Interactive control method and device for virtual live broadcasting room, storage medium and electronic equipment |
| CN115883814A (en) * | 2023-02-23 | 2023-03-31 | 阿里巴巴（中国）有限公司 | Method, device and equipment for playing real-time video stream |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107124664A (en) | Exchange method and device applied to net cast | |
| CN106303658A (en) | It is applied to exchange method and the device of net cast | |
| CN106454481B (en) | A kind of method and device of live broadcast of mobile terminal interaction | |
| CN108010037B (en) | Image processing method, device and storage medium | |
| CN107147939A (en) | Method and apparatus for adjusting net cast front cover | |
| CN106303354B (en) | Face special effect recommendation method and electronic equipment | |
| US10820131B1 (en) | Method and system for creating binaural immersive audio for an audiovisual content | |
| US10834456B2 (en) | Intelligent masking of non-verbal cues during a video communication | |
| CN109922377A (en) | Control method for playing back and device, storage medium and electronic device | |
| CN105142000B (en) | Information-pushing method and system based on content of televising | |
| JP2016527791A (en) | Image processing method and apparatus | |
| JP6236875B2 (en) | Content providing program, content providing method, and content providing apparatus | |
| CN108462883A (en) | A kind of living broadcast interactive method, apparatus, terminal device and storage medium | |
| US20160065791A1 (en) | Sound image play method and apparatus | |
| CN104125488B (en) | The player method and device of a kind of program | |
| US20180063572A1 (en) | Methods, systems, and media for synchronizing media content using audio timecodes | |
| CN104488278A (en) | Data boundary manager for addressable advertising | |
| CN110933485A (en) | Video subtitle generating method, system, device and storage medium | |
| CN108605150A (en) | Computing system with the triggering feature based on content character | |
| CN108574878A (en) | Data interactive method and device | |
| KR102313309B1 (en) | Personalized live broadcasting system | |
| CN113031756A (en) | Method, device and system for evaluating VR experience presence | |
| CN106982375A (en) | Information-pushing method, system and TV | |
| CN105872631A (en) | Statistic method and device for interactive activities in programs | |
| CN108495163B (en) | Video barrage reading device, system, method and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170901 |