CN107438200A - The method and apparatus of direct broadcasting room present displaying - Google Patents
The method and apparatus of direct broadcasting room present displaying Download PDFInfo
- Publication number
- CN107438200A CN107438200A CN201710804566.3A CN201710804566A CN107438200A CN 107438200 A CN107438200 A CN 107438200A CN 201710804566 A CN201710804566 A CN 201710804566A CN 107438200 A CN107438200 A CN 107438200A
- Authority
- CN
- China
- Prior art keywords
- present
- video
- frame
- displaying
- application program
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 44
- 230000001815 facial effect Effects 0.000 claims abstract description 95
- 230000015572 biosynthetic process Effects 0.000 claims abstract description 30
- 238000003786 synthesis reaction Methods 0.000 claims abstract description 30
- 230000005540 biological transmission Effects 0.000 claims description 12
- 238000005516 engineering process Methods 0.000 abstract description 6
- 230000001747 exhibiting effect Effects 0.000 abstract description 6
- 238000012545 processing Methods 0.000 description 19
- 230000006870 function Effects 0.000 description 11
- 238000010586 diagram Methods 0.000 description 9
- 230000006854 communication Effects 0.000 description 5
- 238000004891 communication Methods 0.000 description 4
- 238000007726 management method Methods 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 241000282326 Felis catus Species 0.000 description 3
- 238000001514 detection method Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 230000009471 action Effects 0.000 description 2
- 210000005069 ears Anatomy 0.000 description 2
- 230000005484 gravity Effects 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 230000007774 longterm Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000001133 acceleration Effects 0.000 description 1
- 230000004888 barrier function Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 239000003795 chemical substances by application Substances 0.000 description 1
- 238000005314 correlation function Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000006837 decompression Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000005611 electricity Effects 0.000 description 1
- 210000004709 eyebrow Anatomy 0.000 description 1
- 239000004744 fabric Substances 0.000 description 1
- 210000004209 hair Anatomy 0.000 description 1
- 238000012905 input function Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000008054 signal transmission Effects 0.000 description 1
- 230000005236 sound signal Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000010897 surface acoustic wave method Methods 0.000 description 1
- 230000002194 synthesizing effect Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/475—End-user interface for inputting end-user data, e.g. personal identification number [PIN], preference data
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
- H04N21/25866—Management of end-user data
- H04N21/25875—Management of end-user data involving end-user authentication
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44016—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving splicing one content stream with another content stream, e.g. for substituting a video clip
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
- H04N21/4782—Web browsing, e.g. WebTV
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/85—Assembly of content; Generation of multimedia applications
- H04N21/858—Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot
- H04N21/8586—Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot by using a URL
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Human Computer Interaction (AREA)
- Computer Security & Cryptography (AREA)
- Computer Graphics (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses a kind of method and apparatus of direct broadcasting room present displaying, belong to field of computer technology.Methods described includes：The present that the reception server is sent gives notice, wherein, the present gives the displaying content link that target present is carried in notice and displaying duration, the target present is to sprout face present, according to the displaying content link, obtain the present animation data of the target present, the relative display location information of the target present and facial image, it is determined that in the frame of video of the video flowing currently collected facial image positional information, according to the positional information of facial image in the frame of video, relative display location information and the displaying duration, each frame animation in the present animation data is synthesized with the facial image in the frame of video after the frame of video and the frame of video respectively according to playing sequence, the video flowing after synthesis is sent to the server.Using the present invention, there is provided a kind of methods of exhibiting for sprouting face present.
Description
Technical field
The present invention relates to field of computer technology, more particularly to a kind of method and apparatus of direct broadcasting room present displaying.
Background technology
With the development of computer technology and network technology, network direct broadcasting has obtained extensive popularization, and user can log in
The application program of network direct broadcasting, into direct broadcasting room interested, watch the programme televised live of main broadcaster, it is seen that the main broadcaster liked can be with
Based on broadcast present.
In the prior art, present generally comprises common present and sprouts face present, and common present refers to the present of article class, such as swims
Ship, fresh flower etc., sprout face present and refer to the present relevant with facial image, such as beard, lip, but in the prior art only for general
Common etiquette thing gives methods of exhibiting, is not provided with sprouting the methods of exhibiting of face present.
The content of the invention
In order to solve problem of the prior art, the embodiments of the invention provide the method and dress of a kind of direct broadcasting room present displaying
Put.The technical scheme is as follows：
First aspect, there is provided a kind of method of direct broadcasting room present displaying, methods described include：
The present that the reception server is sent gives notice, wherein, the present is given in notice and carries target present
Content link and displaying duration are shown, the target present is to sprout face present；
According to the displaying content link, the present animation data, the target present and people of the target present are obtained
The relative display location information of face image；
It is determined that in the frame of video of the video flowing currently collected facial image positional information；
During according to the positional information of facial image in the frame of video, relative display location information and the displaying
It is long, by each frame animation in the present animation data according to playing sequence respectively with the frame of video and the frame of video it
The facial image in frame of video afterwards is synthesized；
The video flowing after synthesis is sent to the server.
Optionally, the present that the reception server is sent gives notice, including：By the live application program of webpage, connect
Receive the present that server is sent and give notice；Gift is sent to audio-video collection application program by the live application program of the webpage
Thing gives notice；
It is described according to the displaying content link, obtain the present animation data of the target present, the target present
The relative display location information with facial image, including：By the audio-video collection application program according to the displaying content
Link, obtain the relative display location information of the present animation data of the target present, the target present and facial image；
The positional information of facial image in the frame of video of the video flowing for determining currently to collect, including：By described
The positional information of facial image in the frame of video for the video flowing that the determination of audio-video collection application program currently collects；
It is described according to the positional information of facial image in the frame of video, relative display location information and the displaying
Duration, by each frame animation in the present animation data according to playing sequence respectively with the frame of video and the frame of video
The facial image in frame of video afterwards is synthesized, including：By the audio-video collection application program according to the video
The positional information of facial image, relative display location information and the displaying duration in frame, by the present animation data
In each frame animation according to playing sequence respectively with the face figure in the frame of video after the frame of video and the frame of video
As being synthesized；
Video flowing after from the transmission synthesis to the server, including：By the audio-video collection application program to
The server sends the video flowing after synthesis.
Optionally, it is described by the live application program of the webpage to audio-video collection application program send present give it is logical
Know, including：
Present is sent to flash plug-in units by the live application program of the webpage and gives notice；
Present is sent to the audio-video collection application program by the flash plug-in units and gives notice.
Optionally, methods described also includes：
By the live application program of the webpage, the present of the target present is identified, queue is shown added to present
Foremost.
So, it can timely play and sprout face present.
Optionally, institute's method also includes：
When the duration of the first frame animation and the generated time of facial image in frame of video in the present animation data
When reaching the displaying duration, carried by the audio-video collection application program in the video flowing sent to the server
End notification is played, and is sent to the flash plug-in units and plays end notification；
When receiving the broadcasting end notification by the flash plug-in units, play in present displaying queue with
The present of the target present identifies present animation corresponding to adjacent next present mark.
Optionally, methods described also includes：
Not by the flash in preset duration after present is received by the flash plug-in units and gives notice
When plug-in unit receives the broadcasting end notification that the audio-video collection application program is sent, send broadcasting to the server and terminate
Notice, and it is corresponding to play next present mark adjacent with the present mark of the target present in the present displaying queue
Present animation, wherein, the preset duration be more than displaying duration.
So, the delay of present displaying can be reduced.
Second aspect, there is provided a kind of device of direct broadcasting room present displaying, described device include：
Receiving module, the present sent for the reception server give notice, wherein, the present is given in notice and carried
There are the displaying content link and displaying duration of target present, the target present is to sprout face present；
Acquisition module, for according to the displaying content link, obtaining the present animation data, described of the target present
The relative display location information of target present and facial image；
Determining module, the positional information for facial image in the frame of video for the video flowing for determining currently to collect；
Synthesis module, for according to the positional information of facial image, the relative display location information in the frame of video
With the displaying duration, by each frame animation in the present animation data according to playing sequence respectively with the frame of video and
The facial image in frame of video after the frame of video is synthesized；
Sending module, for sending the video flowing after synthesis to the server.
Optionally, the receiving module includes：
Receiving submodule, for by the live application program of webpage, the present that the reception server is sent to give notice；
Sending submodule, given for sending present to audio-video collection application program by the live application program of the webpage
Send notice；
The acquisition module, for, according to the displaying content link, being obtained by the audio-video collection application program
The relative display location information of the present animation data of the target present, the target present and facial image；
The determining module, the video flowing for determining currently to collect by the audio-video collection application program regard
The positional information of facial image in frequency frame；
The synthesis module, for by the audio-video collection application program according to facial image in the frame of video
Positional information, relative display location information and the displaying duration, each frame animation in the present animation data is pressed
Synthesized respectively with the facial image in the frame of video after the frame of video and the frame of video according to playing sequence；
The sending module, for regarding after sending synthesis to the server by the audio-video collection application program
Frequency flows.
Optionally, the sending submodule, is used for：
Present is sent to flash plug-in units by the live application program of the webpage and gives notice；
Present is sent to the audio-video collection application program by the flash plug-in units and gives notice.
Optionally, described device also includes：
Add module, for by the live application program of the webpage, the present of the target present being identified, is added to
Present shows the foremost of queue.
Optionally, transmitted module, is additionally operable to：
When the duration of the first frame animation and the generated time of facial image in frame of video in the present animation data
When reaching the displaying duration, carried by the audio-video collection application program in the video flowing sent to the server
End notification is played, and is sent to the flash plug-in units and plays end notification；
Described device also includes：
Playing module, for when receiving the broadcasting end notification by the flash plug-in units, playing the present
Show in queue and the corresponding present animation of adjacent next present mark is identified with the present of the target present.
Optionally, the sending module, is additionally operable to：
Not by the flash in preset duration after present is received by the flash plug-in units and gives notice
When plug-in unit receives the broadcasting end notification that the audio-video collection application program is sent, send broadcasting to the server and terminate
Notice；
The playing module, it is additionally operable to play adjacent with the present mark of the target present in the present displaying queue
Next present mark corresponding to present animation, wherein, the preset duration be more than displaying duration.
The beneficial effect that technical scheme provided in an embodiment of the present invention is brought is：
In the embodiment of the present invention, the present that the reception server is sent gives notice, wherein, present is given in notice and carried
The displaying content link and displaying duration of target present, target present, according to displaying content link, obtain target to sprout face present
The relative display location information of the present animation data of present, target present and facial image, it is determined that the video currently collected
The positional information of facial image in the frame of video of stream, believed according to the positional information of facial image, relative display location in frame of video
Breath and displaying duration, by each frame animation in present animation data according to playing sequence respectively with after frame of video and frame of video
Frame of video in facial image synthesized, to server send synthesis after video flowing.So, do not only give and sprout face gift
The methods of exhibiting of thing, and face present will be sprouted and synthesized with the facial image in frame of video, the exhibition for sprouting face present can be reached
Show effect.
Brief description of the drawings
Technical scheme in order to illustrate the embodiments of the present invention more clearly, make required in being described below to embodiment
Accompanying drawing is briefly described, it should be apparent that, drawings in the following description are only some embodiments of the present invention, for
For those of ordinary skill in the art, on the premise of not paying creative work, other can also be obtained according to these accompanying drawings
Accompanying drawing.
Fig. 1 is a kind of method flow diagram of direct broadcasting room present displaying provided in an embodiment of the present invention；
Fig. 2 is a kind of displaying schematic diagram for sprouting face present provided in an embodiment of the present invention；
Fig. 3 is a kind of schematic diagram of present displaying queue provided in an embodiment of the present invention；
Fig. 4 is a kind of method flow diagram of direct broadcasting room present displaying provided in an embodiment of the present invention；
Fig. 5 is a kind of apparatus structure schematic diagram of direct broadcasting room present displaying provided in an embodiment of the present invention；
Fig. 6 is a kind of apparatus structure schematic diagram of direct broadcasting room present displaying provided in an embodiment of the present invention；
Fig. 7 is a kind of apparatus structure schematic diagram of direct broadcasting room present displaying provided in an embodiment of the present invention；
Fig. 8 is a kind of apparatus structure schematic diagram of direct broadcasting room present displaying provided in an embodiment of the present invention；
Fig. 9 is a kind of structural representation of terminal provided in an embodiment of the present invention.
Embodiment
To make the object, technical solutions and advantages of the present invention clearer, below in conjunction with accompanying drawing to embodiment party of the present invention
Formula is described in further detail.
The embodiments of the invention provide a kind of method of direct broadcasting room present displaying, the executive agent of this method is whole for main broadcaster
End, i.e. the main broadcaster used terminal when live.Wherein, main broadcaster's terminal can be mobile phone, computer etc., can be with main broadcaster's terminal
Processor, memory, transceiver, video acquisition part and audio collection part etc. are provided with, processor can be used for direct broadcasting room
The processing of present displaying, memory can be used for during the displaying of direct broadcasting room present the data needed and caused data, receive
Hair device can be used for receiving and send message etc., and video acquisition part can be used for gathering video data, video acquisition part
Can be camera, audio collection part can be used for recording audio data, and audio collection part can be microphone.Main broadcaster is whole
The input-output equipment such as screen are also provided with end, screen is displayed for live video broadcast interface etc..This implementation
In example so that main broadcaster's terminal is computer as an example, the detailed description of scheme is carried out, other situations are similar therewith, and the present embodiment is no longer tired
State.
Before being implemented, it is live in the live process of direct broadcasting room, and spectators viewing main broadcaster that main broadcaster is introduced first
Processing, main broadcaster wants to carry out live, can input oneself in the main interface of the live application program of webpage or live application program
Oneself account (can subsequently turn into main broadcaster's account) and password is logged in, and then clicks on the option that started broadcasting in main interface, and main broadcaster is whole
End can then receive the click commands of live option, then prompt main broadcaster to open video acquisition part and audio collection part, main
Broadcast can start it is live.Main broadcaster's terminal can send the audio/video flow of recording to the background server of the live application program of webpage
(can subsequently be referred to as server), server can determine each account in addition to main broadcaster's account in direct broadcasting room, then by sound
Video stream, can after the registration terminal of each account receives the audio/video flow of server transmission to the registration terminal of each account
With playing audio-video stream.Above-mentioned each account is that the live spectators' (being subsequently properly termed as user) of main broadcaster are watched in direct broadcasting room
Account used in registration terminal.
As shown in figure 1, when main broadcaster carries out live using the live application program of webpage, the handling process of this method can include
The steps：
In step 101, by the live application program of webpage, the present that the reception server is sent gives notice.
In force, terminal used in user shows when playing the audio/video flow being currently received in live interface
It is shown with present option, messages option, shares some other options such as option.User wants to sprout to currently just sending in live main broadcaster
Face present, user can click on present option, and triggering terminal shows at least one present icon, and user can click on the gift to be sent
Thing icon (herein for sprout the present icon of face present), then click on and give button, terminal can then detect the point for giving button
Instruction is hit, at this moment, triggering terminal generates present Comp Requests, and the present mark of the present is added in present Comp Requests
(the present mark for being subsequently properly termed as target present), then can send present Comp Requests to server.
After server receives the present Comp Requests of terminal transmission, target gift can be got from present Comp Requests
The present mark of thing.Pair of the present mark, displaying content link of each present with showing duration has been prestored in server
It should be related to, server can use the mark of target present, and the present mark that target present is searched from the corresponding relation is corresponding
Displaying content link and displaying duration, then generate present and give notice, notice is given to main broadcaster's terminal transmission present, and
Present gives the displaying content link that target present is carried in notice and displaying duration.
The present that main broadcaster's terminal can be sent by the live application program the reception server of webpage gives notice, and the present is given
Send the displaying content link that target present is carried in notice and displaying duration.
In addition, server can also be into direct broadcasting room in addition to main broadcaster's account each account registration terminal send present give
Send notice.
Optionally, show that content link can be URL (Uniform Resource Locator, URL)
Information.
Optionally, server determines the displaying content link of target present and shows that the method for duration can also be as follows：Clothes
The corresponding relation of the present mark and displaying content link of each present, and account levels and each gift can be stored in business device
The corresponding relation of the displaying duration of the present mark of thing, general account levels are higher, during the displaying of the present of each present mark
It is longer.Server can use the present of target present to identify, and corresponding displaying content link be found, it is then determined that sending
The account that the terminal of present Comp Requests logs in, the grade of the account is determined, then using the present mark and account of target present
The grade at family, determine the displaying duration of target present.
It should be noted that displaying duration can be more than or equal to the playing duration of the present animation data of target present,
A length of 0.5 second when such as showing, present animation playing duration is 0.1 second, and a length of 0.2 second during displaying, present animation playing duration is
0.2 second etc..
In step 102, present is sent to audio-video collection application program by the live application program of webpage and gives notice.
In force, main broadcaster's terminal by the live application program of webpage receive server send present give notice
Afterwards, present can be sent to audio-video collection application program by the live application program of webpage and gives notice, main broadcaster's terminal can be with
Present is received by audio-video collection application program and gives notice.
It should be noted that audio-video collection application program is only for controlling audio-video collection part collection audio frequency and video
Stream.
Optionally, present can be given to notice by flash plug-in units to send to audio-video collection application program, corresponding step
Rapid 102 processing can be as follows：
Present is sent to flash plug-in units by the live application program of webpage and gives notice；By flash plug-in units to audio frequency and video
Acquisition applications program sends present and gives notice.
In force, main broadcaster's terminal can load flash plug-in units, be sent out by the live application program of webpage to flash plug-in units
Thing of giving a present gives notice, is received after present gives notice, can be adopted by flash plug-in units to audio frequency and video by flash plug-in units
Collection application program sends present and gives notice, and main broadcaster's terminal can be given logical by audio-video collection application program reception present
Know.
In step 103, by audio-video collection application program according to displaying content link, the present for obtaining target present moves
Draw the relative display location information of data, target present and facial image.
In force, main broadcaster's terminal is received after present gives notice by audio-video collection application program, can be passed through
Audio-video collection application program gives parsing in notice from present and obtains showing content link and displaying duration, if for the first time
Target present is shown, content link can be shown by audiovisual applications routine access, download the showing resource bag of target present,
Then showing resource bag is decompressed, obtains present animation data, the phase of target present and facial image of target present
To display location information.
Relative display location information mentioned above is display location of the target present in facial image, for example, target
Present is cat ear, and two ears in cat ear should be established in the both sides of brows, be then brows with respect to display location information
Both sides, target present is beard, and beard should be shown in the both sides of lip, with respect to display location information then be lip two
Side.
Optionally, the showing resource that main broadcaster's terminal can also be by audiovisual applications program to the target present after decompression
Bag is stored, and so, when next time shows target present again, then need not download the showing resource bag of target present.
In addition, main broadcaster's terminal detect it is live at the end of, the showing resource bag of download can be deleted, so, can be with
Storage resource is saved, is started broadcasting next time, then re-start download.
In step 104, face in the frame of video for the video flowing for determining currently to collect by audio-video collection application program
The positional information of image.
In force, main broadcaster's terminal by audio-video collection application program get target present present animation data,
After the relative display location information of target present and facial image, it may be determined that the video flowing that current video acquisition component collects
Frame of video, then by audio-video collection application call recognition of face SDK (Software Development Kit,
SDK), facial image identification is carried out to the frame of video, determines the position letter of facial image in the frame of video
Cease, the position of eyes, the position of lip, the position of nose, ear can be included in the positional information for the facial image determined
Position, the position etc. of eyebrow.
In step 105, by audio-video collection application program according to the positional information of facial image, relative exhibition in frame of video
Show positional information and displaying duration, by each frame animation in present animation data according to playing sequence respectively with frame of video and regarding
The facial image in frame of video after frequency frame is synthesized.
In force, main broadcaster's terminal can pass through positional information of the audiovisual applications program using facial image and target gift
The relative display location information of the positional information of thing and facial image, the first frame animation of present animation data and current are regarded
Facial image in frequency frame is synthesized, and by frame animation and face image synthesis into a frame of video, is then moved the second frame
Picture is synthesized with the facial image in first frame of video after current frame of video, is moved according to the frame of present animation data
Playing sequence is drawn, can be by the frame of video of each frame animation of present animation data respectively with current frame of video and afterwards
Facial image is synthesized, if each frame animation in present animation data does not arrive displaying duration also when all synthesis finishes,
Can continue by present animation data the first frame move animation start successively with the people in the frame of video of the video flowing collected
Face image is synthesized, until reaching displaying duration, the video flowing after being synthesized, if each frame in present animation data moves
Draw just to displaying duration when all synthesis finishes, then the processing no longer synthesized to the frame animation of present animation data.
For example, as shown in Fig. 2 target present is cat ear, two ears can be synthesized to the top of the brows in facial image, Fig. 2
In illustrate only face part.
It should be noted that because the displaying time length ratio for typically sprouting face present is shorter, so above-mentioned only determine currently is adopted
The positional information of the facial image of the frame of video of the video flowing collected, and the frame for the positional information being defined as and being sprouted face present moves
The positional information of the facial image in all frame of video synthesized is drawn, so, handling duration can be saved.If sprout face gift
The displaying duration of thing is long, equally, in the embodiment of the present invention, the position of facial image can also be all determined to each frame of video
Information.
In step 106, the video flowing after synthesis is sent to server by audio-video collection application program.
In force, main broadcaster's terminal can send the video after synthesis to server by audio-video collection application program
Stream, in addition, the audio stream collected can be also sent, can after server receives the video flowing and audio stream of the transmission of main broadcaster's terminal
With the registration terminal for each account video flowing and audio stream being forwarded in direct broadcasting room in addition to main broadcaster's account.The login of each account
After terminal receives video flowing and audio stream, it can play out.
Carried out in addition, main broadcaster's terminal obtains the video flowing after synthesis from audio-video collection application program by flash plug-in units
Send.
It should be noted that main broadcaster's terminal to server mentioned above, which sends video flowing, to be transmitted after synthesizing,
Rather than just it is transmitted after whole frame animations in present animation data are synthesized with frame of video.
Optionally, in the embodiment of the present invention, the scheme of present displaying queue is additionally provided, corresponding processing can be as follows：
By the live application program of webpage, the present of target present is identified, added to the foremost of present displaying queue.
Wherein, show and include multiple presents mark that spectators send in queue, multiple present marks are entered according to displaying order
Row sequence, come foremost present mark corresponding to present be demonstrated first.
In force, main broadcaster's terminal every time receive server transmission present give notice after, it can be determined that present
It is to sprout face present, or common present, common present refer to present not related to facial image, if sprouting face present, and work as
The present of preceding displaying is common present, stops showing current present immediately, then by Web page application program, by target present
Mark, added to present displaying queue foremost, if common present, then by the mark of present added to present displaying
Queue backmost, so, can make to sprout face present and preferentially show.For example, as shown in figure 3, present displaying list in, present mark
Putting in order for knowing identifies A for present, present identifies B, present identifies C, present identifies C, present identifies B, present identifies F, gift
Thing identifies N, after the present mark of target present is added, is changed into mark, present mark A, the present mark of target present
B, present mark C, present mark C, present mark B, present mark F, present mark N.
In addition, for the registration terminal of each account in direct broadcasting room in addition to main broadcaster's terminal, server is sent out to main broadcaster's terminal
When thing of giving a present gives notice, the registration terminal of each account that also can be into direct broadcasting room in addition to main broadcaster's terminal send present give it is logical
Know, the registration terminal of each account is received after present gives notice, can therefrom parse to obtain the present mark of target present, so
After may determine that present is to sprout face present, or common present, common present refer to present not related to facial image, such as swim
Ship, fresh flower etc., if sprouting face present, by Web page application program, by the mark of target present, queue is shown added to present
Foremost, if common present, then by present mark added to present displaying queue backmost.In addition, each account
Registration terminal it is determined that target present is to sprout face present, and when the present of current presentation is common present, stop displaying immediately
The present of current presentation.
Optionally, the scheme that present plays end notification that sends is additionally provided in the embodiment of the present invention, corresponding processing can
With as follows：
When the duration of the first frame animation and the generated time of facial image in frame of video in present animation data reaches
When showing duration, carried by audio-video collection application program in the video flowing sent to server and play end notification, and
And sent to flash plug-in units and play end notification；When receiving broadcasting end notification by flash plug-in units, present exhibition is played
Show in queue and the corresponding present animation of adjacent next present mark is identified with the present of target present.
Wherein, play the present that end notification can be used in notice displaying present displaying queue with target present and identify phase
Present animation corresponding to adjacent next present mark.
In force, main broadcaster's terminal by audio-video collection application program to the first frame animation in present animation data with regarding
, can be by audio-video collection application program launching timer when face image synthesis in frequency frame is complete, and record startup timing
Time point, when by timer determine apart from the time point duration reach displaying duration when, determine that target present plays
Into, it can be carried by audio-video collection application program in the video flowing sent to server and play end notification, and to
Flash plug-in units, which are sent, plays end notification.
After server receives the broadcasting end notification of main broadcaster's terminal transmission, it can will play end notification and send to live
Between in each account in addition to main broadcaster's account registration terminal, the registration terminal of each account receives when playing end notification, can
To determine that identifying adjacent next present with the present of target present in present displaying queue identifies, and then plays the present mark
Present animation corresponding to knowledge.
When main broadcaster's terminal is resolved to broadcasting end notification by flash plug-in units from video flowing, it may be determined that present is shown
Adjacent next present is identified with the present of target present in queue to identify, then play present mark corresponding to present move
Draw.
Optionally, in order to prevent the registration terminal of each account and flash plug-in units from not receiving broadcasting end notification always, and
Delay the displaying of other presents, timeout mechanism is provided in the embodiment of the present invention, corresponding processing can be as follows：
Do not received in preset duration after present is received by flash plug-in units and gives notice by flash plug-in units
During the broadcasting end notification sent to audio-video collection application program, sent to server and play end notification, and play present
Show in queue and the corresponding present animation of adjacent next present mark is identified with the present of target present.
Wherein, preset duration can be preset by technical staff, and be stored into main broadcaster's terminal, and preset duration is more than displaying
Duration, if preset duration is 0.6 second, a length of 0.3 second etc. during displaying.
In force, when main broadcaster's terminal receives present by flash plug-in units and gives notice, flash plug-in units can be passed through
Start timer, and determine start when time point, if apart from the duration of current point in time reach preset duration when, do not connect also
The broadcasting end notification of audio-video collection application program transmission is received, can be sent to server and play end notification.
After server receives the broadcasting end notification of main broadcaster's terminal transmission, it can will play end notification and send to live
Between in each account in addition to main broadcaster's account registration terminal, the registration terminal of each account receives when playing end notification, can
To determine that identifying adjacent next present with the present of target present in present displaying queue identifies, and then plays the present mark
Present animation corresponding to knowledge.
Main broadcaster's terminal by flash plug-in units receive play end notification when, it may be determined that present displaying queue in mesh
The present for marking present identifies adjacent next present mark, then plays present animation corresponding to present mark.
It should be noted that in the embodiment of the present invention, flash plug-in units and audio-video collection application program are to use socket
What connection was communicated.
As shown in figure 4, when main broadcaster carries out live using live application program, the handling process of this method can include as follows
The step of：
In step 401, the present that main broadcaster's terminal is sent by live application program the reception server gives notice.
In force, journey is applied by live with step 101, the main broadcaster's terminal that differs only in of step 102 in step 401
Sequence can directly receive present and give notice, and step 102 and step 103 are shown in other processing, and here is omitted.
In step 402, by live application program according to displaying content link, the present animation number of acquisition target present
According to the relative display location information of, target present and facial image.
In force, the difference of step 402 and step 103 is, main broadcaster's terminal is to go to download by live application program
Step is shown in the relative display location information of the present animation data of target present, target present and facial image, other processing
103, here is omitted.
In step 403, facial image in the frame of video for the video flowing for determining currently to collect by live application program
Positional information.
In force, the difference of step 403 and step 104 is, main broadcaster's terminal is by live application call people
Face identifies SDK, and to determine the positional information of facial image in the frame of video of video flowing currently collected, step is shown in other processing
104, here is omitted.
In step 404, by live application program according to the positional information of facial image, relative display location in frame of video
Information and displaying duration, by each frame animation in present animation data according to playing sequence respectively with frame of video and frame of video it
The facial image in frame of video afterwards is synthesized.
In force, the difference of step 404 and step 105 is, main broadcaster's terminal is closed by live application program
Into step 105 is shown in other processing, and here is omitted.
In step 405, the video flowing after synthesis is sent to server by live application program.
In force, the difference of step 405 and step 106 is, main broadcaster's terminal is to send to close by live application program
Step 106 is shown in video flowing after, other processing, and here is omitted.
In the embodiment of the present invention, the present that the reception server is sent gives notice, wherein, present is given in notice and carried
The displaying content link and displaying duration of target present, target present, according to displaying content link, obtain target to sprout face present
The relative display location information of the present animation data of present, target present and facial image, it is determined that the video currently collected
The positional information of facial image in the frame of video of stream, believed according to the positional information of facial image, relative display location in frame of video
Breath and displaying duration, by each frame animation in present animation data according to playing sequence respectively with after frame of video and frame of video
Frame of video in facial image synthesized, to server send synthesis after video flowing.So, do not only give and sprout face gift
The methods of exhibiting of thing, and face present will be sprouted and synthesized with the facial image in frame of video, the exhibition for sprouting face present can be reached
Show effect.
Based on identical technical concept, the embodiment of the present invention additionally provides a kind of device of direct broadcasting room present displaying, such as Fig. 5
Shown, the device includes：
Receiving module 510, the present sent for the reception server give notice, wherein, the present is given in notice
The displaying content link and displaying duration of target present are carried, the target present is to sprout face present；
Acquisition module 520, for according to the displaying content link, obtain the target present present animation data,
The relative display location information of the target present and facial image；
Determining module 530, the positional information for facial image in the frame of video for the video flowing for determining currently to collect；
Synthesis module 540, for being believed according to the positional information of facial image, the relative display location in the frame of video
Breath and the displaying duration, by each frame animation in the present animation data according to playing sequence respectively with the frame of video with
And the facial image in the frame of video after the frame of video is synthesized；
Sending module 550, for sending the video flowing after synthesis to the server.
Optionally, as shown in fig. 6, the receiving module 510 includes：
Receiving submodule 511, for by the live application program of webpage, the present that the reception server is sent to give notice；
Sending submodule 512, for sending gift to audio-video collection application program by the live application program of the webpage
Thing gives notice；
The acquisition module 520, for, according to the displaying content link, being obtained by the audio-video collection application program
Take the relative display location information of the present animation data of the target present, the target present and facial image；
The determining module 530, for the video flowing for determining currently to collect by the audio-video collection application program
Frame of video in facial image positional information；
The synthesis module 540, for by the audio-video collection application program according to face figure in the frame of video
The positional information of picture, relative display location information and the displaying duration, each frame in the present animation data is moved
Picture is synthesized with the facial image in the frame of video after the frame of video and the frame of video respectively according to playing sequence；
The sending module 550, after sending synthesis to the server by the audio-video collection application program
Video flowing.
Optionally, the sending submodule 512, is used for：
Present is sent to flash plug-in units by the live application program of the webpage and gives notice；
Present is sent to the audio-video collection application program by the flash plug-in units and gives notice.
Optionally, as shown in fig. 7, described device also includes：
Add module 560, for by the live application program of the webpage, the present of the target present being identified, added
Add to the foremost of present displaying queue.
Optionally, transmitted module 550, is additionally operable to：
When the duration of the first frame animation and the generated time of facial image in frame of video in the present animation data
When reaching the displaying duration, broadcasting is carried in the video flowing sent to server by the audio-video collection application program
End notification, and sent to the flash plug-in units and play end notification；
As shown in figure 8, described device also includes：
Playing module 570, for when receiving the broadcasting end notification by the flash plug-in units, described in broadcasting
The corresponding present animation of adjacent next present mark is identified with the present of the target present in present displaying queue.
Optionally, the sending module 550, is additionally operable to：
Not by the flash in preset duration after present is received by the flash plug-in units and gives notice
When plug-in unit receives the broadcasting end notification that the audio-video collection application program is sent, send broadcasting to the server and terminate
Notice；
The playing module 570, the present for being additionally operable to play in the present displaying queue with the target present identify
Present animation corresponding to adjacent next present mark, wherein, the preset duration is more than displaying duration.
In the embodiment of the present invention, the present that the reception server is sent gives notice, wherein, present is given in notice and carried
The displaying content link and displaying duration of target present, target present, according to displaying content link, obtain target to sprout face present
The relative display location information of the present animation data of present, target present and facial image, it is determined that the video currently collected
The positional information of facial image in the frame of video of stream, believed according to the positional information of facial image, relative display location in frame of video
Breath and displaying duration, by each frame animation in present animation data according to playing sequence respectively with after frame of video and frame of video
Frame of video in facial image synthesized, to server send synthesis after video flowing.So, do not only give and sprout face gift
The methods of exhibiting of thing, and face present will be sprouted and synthesized with the facial image in frame of video, the exhibition for sprouting face present can be reached
Show effect.
It should be noted that：The device for the direct broadcasting room present displaying that above-described embodiment provides is carrying out direct broadcasting room present displaying
When, only with the division progress of above-mentioned each functional module for example, in practical application, above-mentioned function can be divided as needed
With by different functional module completions, i.e., the internal structure of device is divided into different functional modules, to complete above description
All or part of function.In addition, the device for the direct broadcasting room present displaying that above-described embodiment provides carries out present with direct broadcasting room
Embodiment of the method belong to same design, its specific implementation process refers to embodiment of the method, repeats no more here.
Fig. 9 is refer to, should it illustrates the terminal structure schematic diagram with touch sensitive surface involved by the embodiment of the present invention
The method that the direct broadcasting room present that terminal can be used for implementing to provide in above-described embodiment is shown.Specifically：
Terminal 900 can include RF (Radio Frequency, radio frequency) circuit 110, include one or more meters
The memory 120 of calculation machine readable storage medium storing program for executing, input block 130, display unit 140, sensor 150, voicefrequency circuit 160,
WiFi (wireless fidelity, Wireless Fidelity) module 170, include one or the processing of more than one processing core
The part such as device 180 and power supply 190.It will be understood by those skilled in the art that the terminal structure shown in Fig. 9 is not formed pair
The restriction of terminal, it can include than illustrating more or less parts, either combine some parts or different part cloth
Put.Wherein：
RF circuits 110 can be used for receive and send messages or communication process in, the reception and transmission of signal, especially, by base station
After downlink information receives, transfer to one or more than one processor 180 is handled；In addition, it is sent to up data are related to
Base station.Generally, RF circuits 110 include but is not limited to antenna, at least one amplifier, tuner, one or more oscillators, use
Family identity module (SIM) card, transceiver, coupler, LNA (Low Noise Amplifier, low-noise amplifier), duplex
Device etc..In addition, RF circuits 110 can also be communicated by radio communication with network and other equipment.The radio communication can make
With any communication standard or agreement, and including but not limited to GSM (Global System of Mobile communication, entirely
Ball mobile communcations system), GPRS (General Packet Radio Service, general packet radio service), CDMA (Code
Division Multiple Access, CDMA), WCDMA (Wideband Code Division Multiple
Access, WCDMA), LTE (Long Term Evolution, Long Term Evolution), Email, SMS (Short
Messaging Service, Short Message Service) etc..
Memory 120 can be used for storage software program and module, and processor 180 is stored in memory 120 by operation
Software program and module, so as to perform various function application and data processing.Memory 120 can mainly include storage journey
Sequence area and storage data field, wherein, storing program area can storage program area, the application program (ratio needed at least one function
Such as sound-playing function, image player function) etc.；Storage data field can store uses created number according to terminal 900
According to (such as voice data, phone directory etc.) etc..In addition, memory 120 can include high-speed random access memory, can also wrap
Include nonvolatile memory, a for example, at least disk memory, flush memory device or other volatile solid-state parts.
Correspondingly, memory 120 can also include Memory Controller, to provide processor 180 and input block 130 to memory
120 access.
Input block 130 can be used for the numeral or character information for receiving input, and generation is set with user and function
Control relevant keyboard, mouse, action bars, optics or the input of trace ball signal.Specifically, input block 130 may include to touch
Sensitive surfaces 131 and other input equipments 132.Touch sensitive surface 131, also referred to as touch display screen or Trackpad, collect and use
Family on or near it touch operation (such as user using any suitable object or annex such as finger, stylus in touch-sensitive table
Operation on face 131 or near touch sensitive surface 131), and corresponding attachment means are driven according to formula set in advance.It is optional
, touch sensitive surface 131 may include both touch detecting apparatus and touch controller.Wherein, touch detecting apparatus detection is used
The touch orientation at family, and the signal that touch operation is brought is detected, transmit a signal to touch controller；Touch controller is from touch
Touch information is received in detection means, and is converted into contact coordinate, then gives processor 180, and can reception processing device 180
The order sent simultaneously is performed.Furthermore, it is possible to using polytypes such as resistance-type, condenser type, infrared ray and surface acoustic waves
Realize touch sensitive surface 131.Except touch sensitive surface 131, input block 130 can also include other input equipments 132.Specifically,
Other input equipments 132 can include but is not limited to physical keyboard, function key (such as volume control button, switch key etc.),
One or more in trace ball, mouse, action bars etc..
Display unit 140 can be used for display by the information of user's input or be supplied to the information and terminal 900 of user
Various graphical user interface, these graphical user interface can be made up of figure, text, icon, video and its any combination.
Display unit 140 may include display panel 141, optionally, can use LCD (Liquid Crystal Display, liquid crystal
Show device), the form such as OLED (Organic Light-Emitting Diode, Organic Light Emitting Diode) configure display panel
141.Further, touch sensitive surface 131 can cover display panel 141, when touch sensitive surface 131 detects touching on or near it
After touching operation, processor 180 is sent to determine the type of touch event, is followed by subsequent processing type of the device 180 according to touch event
Corresponding visual output is provided on display panel 141.Although in fig.9, touch sensitive surface 131 and display panel 141 are conducts
Two independent parts come realize input and input function, but in some embodiments it is possible to by touch sensitive surface 131 with display
Panel 141 is integrated and realizes input and output function.
Terminal 900 may also include at least one sensor 150, such as optical sensor, motion sensor and other sensings
Device.Specifically, optical sensor may include ambient light sensor and proximity transducer, wherein, ambient light sensor can be according to environment
The light and shade of light adjusts the brightness of display panel 141, and proximity transducer can close display when terminal 900 is moved in one's ear
Panel 141 and/or backlight.As one kind of motion sensor, gravity accelerometer can detect in all directions (generally
Three axles) acceleration size, size and the direction of gravity are can detect that when static, available for identification mobile phone posture application (ratio
Such as horizontal/vertical screen switching, dependent game, magnetometer pose calibrating), Vibration identification correlation function (such as pedometer, tap)；Extremely
The other sensors such as the gyroscope that can also configure in terminal 900, barometer, hygrometer, thermometer, infrared ray sensor, herein
Repeat no more.
Voicefrequency circuit 160, loudspeaker 161, microphone 162 can provide the COBBAIF between user and terminal 900.Audio
Electric signal after the voice data received conversion can be transferred to loudspeaker 161, sound is converted to by loudspeaker 161 by circuit 160
Sound signal exports；On the other hand, the voice signal of collection is converted to electric signal by microphone 162, after being received by voicefrequency circuit 160
Voice data is converted to, then after voice data output processor 180 is handled, through RF circuits 110 to be sent to such as another end
End, or voice data is exported to memory 120 further to handle.Voicefrequency circuit 160 is also possible that earphone jack,
To provide the communication of peripheral hardware earphone and terminal 900.
WiFi belongs to short range wireless transmission technology, and terminal 900 can help user's transceiver electronicses by WiFi module 170
Mail, browse webpage and access streaming video etc., it has provided the user wireless broadband internet and accessed.Although Fig. 9 is shown
WiFi module 170, but it is understood that, it is simultaneously not belonging to must be configured into for terminal 900, can exist as needed completely
Do not change in the essential scope of invention and omit.
Processor 180 is the control centre of terminal 900, utilizes various interfaces and each portion of connection whole mobile phone
Point, by running or performing the software program and/or module that are stored in memory 120, and call and be stored in memory 120
Interior data, the various functions and processing data of terminal 900 are performed, so as to carry out integral monitoring to mobile phone.Optionally, processor
180 may include one or more processing cores；Preferably, processor 180 can integrate application processor and modem processor,
Wherein, application processor mainly handles operating system, user interface and application program etc., and modem processor mainly handles nothing
Line communicates.It is understood that above-mentioned modem processor can not also be integrated into processor 180.
Terminal 900 also includes the power supply 190 (such as battery) to all parts power supply, it is preferred that power supply can pass through electricity
Management system and processor 180 are logically contiguous, so as to realize management charging, electric discharge and power consumption by power-supply management system
The functions such as management.Power supply 190 can also include one or more direct current or AC power, recharging system, power supply event
The random component such as barrier detection circuit, power supply changeover device or inverter, power supply status indicator.
Although being not shown, terminal 900 can also include camera, bluetooth module etc., will not be repeated here.Specifically in this reality
Apply in example, the display unit of terminal 900 is touch-screen display, and terminal 900 also includes memory, and one or one
More than program, one of them or more than one program storage in memory, and be configured to by one or one with
Upper computing device states the instruction of the method for one or the progress direct broadcasting room present displaying containing terminal of more than one program bag.
In the exemplary embodiment, a kind of non-transitorycomputer readable storage medium including instructing, example are additionally provided
Such as include the memory of instruction, above-mentioned instruction can be completed the side of above-mentioned direct broadcasting room present displaying by the computing device of terminal
Method.For example, the non-transitorycomputer readable storage medium can be ROM, RAM, CD-ROM, tape, floppy disk and light data
Storage device etc..
One of ordinary skill in the art will appreciate that hardware can be passed through by realizing all or part of step of above-described embodiment
To complete, by program the hardware of correlation can also be instructed to complete, described program can be stored in a kind of computer-readable
In storage medium, storage medium mentioned above can be read-only storage, disk or CD etc..
The foregoing is only presently preferred embodiments of the present invention, be not intended to limit the invention, it is all the present invention spirit and
Within principle, any modification, equivalent substitution and improvements made etc., it should be included in the scope of the protection.
Claims (12)
- A kind of 1. method of direct broadcasting room present displaying, it is characterised in that methods described is applied to main broadcaster's terminal, methods described bag Include：The present that the reception server is sent gives notice, wherein, the present gives the displaying that target present is carried in notice Content link and displaying duration, the target present are to sprout face present；According to the displaying content link, the present animation data, the target present and face figure of the target present are obtained The relative display location information of picture；It is determined that in the frame of video of the video flowing currently collected facial image positional information；, will according to the positional information of facial image, relative display location information and the displaying duration in the frame of video Each frame animation in the present animation data according to playing sequence respectively with after the frame of video and the frame of video Facial image in frame of video is synthesized；The video flowing after synthesis is sent to the server.
- 2. according to the method for claim 1, it is characterised in that the present that the reception server is sent gives notice, wraps Include：By the live application program of webpage, the present that the reception server is sent gives notice；Pass through the live application program of the webpage Present, which is sent, to audio-video collection application program gives notice；It is described according to the displaying content link, obtain the present animation data, the target present and people of the target present The relative display location information of face image, including：By the audio-video collection application program according to the displaying content link, Obtain the relative display location information of the present animation data of the target present, the target present and facial image；The positional information of facial image in the frame of video of the video flowing for determining currently to collect, including：Regarded by the sound The positional information of facial image in the frame of video for the video flowing that the determination of frequency acquisition applications program currently collects；It is described according to the positional information of facial image in the frame of video, relative display location information and the displaying when It is long, by each frame animation in the present animation data according to playing sequence respectively with the frame of video and the frame of video it The facial image in frame of video afterwards is synthesized, including：By the audio-video collection application program according to the frame of video The positional information of middle facial image, relative display location information and the displaying duration, by the present animation data Each frame animation according to playing sequence respectively with the facial image in the frame of video after the frame of video and the frame of video Synthesized；Video flowing after from the transmission synthesis to the server, including：By the audio-video collection application program to described Server sends the video flowing after synthesis.
- 3. according to the method for claim 2, it is characterised in that it is described by the live application program of the webpage to audio frequency and video Acquisition applications program sends present and gives notice, including：Present is sent to flash plug-in units by the live application program of the webpage and gives notice；Present is sent to the audio-video collection application program by the flash plug-in units and gives notice.
- 4. according to the method for claim 3, it is characterised in that methods described also includes：By the live application program of the webpage, the present of the target present is identified, added to present displaying queue most Above.
- 5. according to the method for claim 4, it is characterised in that institute's method also includes：When the duration of the first frame animation and the generated time of facial image in frame of video in the present animation data reaches During the displaying duration, broadcasting is carried in the video flowing sent to the server by the audio-video collection application program End notification, and sent to the flash plug-in units and play end notification；When receiving the broadcasting end notification by the flash plug-in units, play in present displaying queue with it is described The present of target present identifies present animation corresponding to adjacent next present mark.
- 6. according to the method for claim 5, it is characterised in that methods described also includes：Not by the flash plug-in units in preset duration after present is received by the flash plug-in units and gives notice When receiving the broadcasting end notification that the audio-video collection application program is sent, send to play to the server and terminate to lead to Know, and it is corresponding to play next present mark adjacent with the present mark of the target present in the present displaying queue Present animation, wherein, the preset duration is more than displaying duration.
- 7. a kind of device of direct broadcasting room present displaying, it is characterised in that described device is applied to main broadcaster's terminal, described device bag Include：Receiving module, the present sent for the reception server give notice, wherein, the present is given in notice and carries mesh The displaying content link and displaying duration of present are marked, the target present is to sprout face present；Acquisition module, for according to the displaying content link, obtaining the present animation data of the target present, the target The relative display location information of present and facial image；Determining module, the positional information for facial image in the frame of video for the video flowing for determining currently to collect；Synthesis module, for according to the positional information of facial image, relative display location information and the institute in the frame of video State displaying duration, by each frame animation in the present animation data according to playing sequence respectively with the frame of video and described The facial image in frame of video after frame of video is synthesized；Sending module, for sending the video flowing after synthesis to the server.
- 8. device according to claim 7, it is characterised in that the receiving module includes：Receiving submodule, for by the live application program of webpage, the present that the reception server is sent to give notice；Sending submodule, it is logical for being given by the live application program of the webpage to audio-video collection application program transmission present Know；The acquisition module, for by the audio-video collection application program according to the displaying content link, described in acquisition The relative display location information of the present animation data of target present, the target present and facial image；The determining module, for the frame of video for the video flowing for determining currently to collect by the audio-video collection application program The positional information of middle facial image；The synthesis module, for the position by the audio-video collection application program according to facial image in the frame of video Information, relative display location information and the displaying duration, by each frame animation in the present animation data according to broadcasting Sequence is put forward to be synthesized with the facial image in the frame of video after the frame of video and the frame of video respectively；The sending module, for sending the video after synthesis to the server by the audio-video collection application program Stream.
- 9. device according to claim 8, it is characterised in that the sending submodule, be used for：Present is sent to flash plug-in units by the live application program of the webpage and gives notice；Present is sent to the audio-video collection application program by the flash plug-in units and gives notice.
- 10. device according to claim 9, it is characterised in that described device also includes：Add module, for by the live application program of the webpage, the present of the target present being identified, added to present Show the foremost of queue.
- 11. device according to claim 10, it is characterised in that transmitted module, be additionally operable to：When the duration of the first frame animation and the generated time of facial image in frame of video in the present animation data reaches During the displaying duration, broadcasting is carried in the video flowing sent to the server by the audio-video collection application program End notification, and sent to the flash plug-in units and play end notification；Described device also includes：Playing module, for when receiving the broadcasting end notification by the flash plug-in units, playing the present displaying The corresponding present animation of adjacent next present mark is identified with the present of the target present in queue.
- 12. device according to claim 11, it is characterised in that the sending module, be additionally operable to：Not by the flash plug-in units in preset duration after present is received by the flash plug-in units and gives notice When receiving the broadcasting end notification that the audio-video collection application program is sent, send to play to the server and terminate to lead to Know；The playing module, be additionally operable to play it is adjacent with the present mark of the target present in the present displaying queue under Present animation corresponding to one present mark, wherein, the preset duration is more than displaying duration.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710804566.3A CN107438200A (en) | 2017-09-08 | 2017-09-08 | The method and apparatus of direct broadcasting room present displaying |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710804566.3A CN107438200A (en) | 2017-09-08 | 2017-09-08 | The method and apparatus of direct broadcasting room present displaying |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107438200A true CN107438200A (en) | 2017-12-05 |
Family
ID=60461596
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710804566.3A Pending CN107438200A (en) | 2017-09-08 | 2017-09-08 | The method and apparatus of direct broadcasting room present displaying |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107438200A (en) |
Cited By (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108093307A (en) * | 2017-12-29 | 2018-05-29 | 广州酷狗计算机科技有限公司 | Obtain the method and system of played file |
| CN108289234A (en) * | 2018-01-05 | 2018-07-17 | 武汉斗鱼网络科技有限公司 | A kind of virtual present special efficacy animated show method, apparatus and equipment |
| CN108391153A (en) * | 2018-01-29 | 2018-08-10 | 北京潘达互娱科技有限公司 | Virtual present display methods, device and electronic equipment |
| CN108401179A (en) * | 2018-04-02 | 2018-08-14 | 广州荔支网络技术有限公司 | A kind of animation playing method, device and mobile terminal based on virtual objects |
| CN108965977A (en) * | 2018-06-13 | 2018-12-07 | 广州虎牙信息科技有限公司 | Methods of exhibiting, device, storage medium, terminal and the system of present is broadcast live |
| CN109191544A (en) * | 2018-08-21 | 2019-01-11 | 北京潘达互娱科技有限公司 | A kind of paster present methods of exhibiting, device, electronic equipment and storage medium |
| CN109391851A (en) * | 2018-01-09 | 2019-02-26 | 深圳市珍爱网信息技术有限公司 | Net cast method, apparatus, computer equipment and storage medium |
| CN110012334A (en) * | 2018-01-04 | 2019-07-12 | 武汉斗鱼网络科技有限公司 | A kind of animation playing method, device and electronic equipment |
| CN110933454A (en) * | 2019-12-06 | 2020-03-27 | 广州酷狗计算机科技有限公司 | Method, device, equipment and storage medium for processing live broadcast budding gift |
| CN110958463A (en) * | 2019-12-06 | 2020-04-03 | 广州华多网络科技有限公司 | Method, device and equipment for detecting and synthesizing virtual gift display position |
| CN111147880A (en) * | 2019-12-30 | 2020-05-12 | 广州华多网络科技有限公司 | Interaction method, device and system for live video, electronic equipment and storage medium |
| CN111246232A (en) * | 2020-01-17 | 2020-06-05 | 广州华多网络科技有限公司 | Live broadcast interaction method and device, electronic equipment and storage medium |
| CN111970533A (en) * | 2020-08-28 | 2020-11-20 | 北京达佳互联信息技术有限公司 | Interaction method and device for live broadcast room and electronic equipment |
| CN112087655A (en) * | 2020-08-07 | 2020-12-15 | 广州华多网络科技有限公司 | Method and device for presenting virtual gift and electronic equipment |
| CN112770128A (en) * | 2020-12-31 | 2021-05-07 | 百果园技术(新加坡)有限公司 | Playing system, method and device of live gift and server |
| CN113163220A (en) * | 2021-02-26 | 2021-07-23 | 广州方硅信息技术有限公司 | Virtual gift positioning display method and device, equipment and medium thereof |
| CN113596596A (en) * | 2021-07-27 | 2021-11-02 | 百果园技术(新加坡)有限公司 | Gift rewarding system, method, device and medium for live broadcast application |
| CN114125325A (en) * | 2021-11-30 | 2022-03-01 | 维沃移动通信有限公司 | Video shooting method and device and electronic equipment |
| CN114827703A (en) * | 2021-01-29 | 2022-07-29 | 武汉斗鱼网络科技有限公司 | View queuing playing method, device, equipment and medium |
| CN115484489A (en) * | 2022-09-14 | 2022-12-16 | 抖音视界有限公司 | Resource processing method, resource processing device, electronic device, storage medium, and program product |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105334963A (en) * | 2015-10-29 | 2016-02-17 | 广州华多网络科技有限公司 | Method and system for displaying virtual article |
| CN105872442A (en) * | 2016-03-30 | 2016-08-17 | 宁波三博电子科技有限公司 | Instant bullet screen gift giving method and instant bullet screen gift giving system based on face recognition |
| CN106101736A (en) * | 2016-06-28 | 2016-11-09 | 广州华多网络科技有限公司 | The methods of exhibiting of a kind of virtual present and system |
| CN106658035A (en) * | 2016-12-09 | 2017-05-10 | 武汉斗鱼网络科技有限公司 | Dynamic display method and device for special effect gift |
| CN107071580A (en) * | 2017-03-20 | 2017-08-18 | 北京潘达互娱科技有限公司 | Data processing method and device |
| CN107085540A (en) * | 2017-03-22 | 2017-08-22 | 北京潘达互娱科技有限公司 | virtual gift display method and device |
-
2017
- 2017-09-08 CN CN201710804566.3A patent/CN107438200A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105334963A (en) * | 2015-10-29 | 2016-02-17 | 广州华多网络科技有限公司 | Method and system for displaying virtual article |
| CN105872442A (en) * | 2016-03-30 | 2016-08-17 | 宁波三博电子科技有限公司 | Instant bullet screen gift giving method and instant bullet screen gift giving system based on face recognition |
| CN106101736A (en) * | 2016-06-28 | 2016-11-09 | 广州华多网络科技有限公司 | The methods of exhibiting of a kind of virtual present and system |
| CN106658035A (en) * | 2016-12-09 | 2017-05-10 | 武汉斗鱼网络科技有限公司 | Dynamic display method and device for special effect gift |
| CN107071580A (en) * | 2017-03-20 | 2017-08-18 | 北京潘达互娱科技有限公司 | Data processing method and device |
| CN107085540A (en) * | 2017-03-22 | 2017-08-22 | 北京潘达互娱科技有限公司 | virtual gift display method and device |
Cited By (29)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108093307B (en) * | 2017-12-29 | 2021-01-01 | 广州酷狗计算机科技有限公司 | Method and system for acquiring playing file |
| CN108093307A (en) * | 2017-12-29 | 2018-05-29 | 广州酷狗计算机科技有限公司 | Obtain the method and system of played file |
| CN110012334A (en) * | 2018-01-04 | 2019-07-12 | 武汉斗鱼网络科技有限公司 | A kind of animation playing method, device and electronic equipment |
| CN108289234A (en) * | 2018-01-05 | 2018-07-17 | 武汉斗鱼网络科技有限公司 | A kind of virtual present special efficacy animated show method, apparatus and equipment |
| CN109391851A (en) * | 2018-01-09 | 2019-02-26 | 深圳市珍爱网信息技术有限公司 | Net cast method, apparatus, computer equipment and storage medium |
| CN109391851B (en) * | 2018-01-09 | 2020-04-07 | 深圳市珍爱网信息技术有限公司 | Video live broadcast method and device, computer equipment and storage medium |
| CN108391153B (en) * | 2018-01-29 | 2020-10-16 | 北京潘达互娱科技有限公司 | Virtual gift display method and device and electronic equipment |
| CN108391153A (en) * | 2018-01-29 | 2018-08-10 | 北京潘达互娱科技有限公司 | Virtual present display methods, device and electronic equipment |
| CN108401179A (en) * | 2018-04-02 | 2018-08-14 | 广州荔支网络技术有限公司 | A kind of animation playing method, device and mobile terminal based on virtual objects |
| CN108965977A (en) * | 2018-06-13 | 2018-12-07 | 广州虎牙信息科技有限公司 | Methods of exhibiting, device, storage medium, terminal and the system of present is broadcast live |
| CN108965977B (en) * | 2018-06-13 | 2021-08-20 | 广州虎牙信息科技有限公司 | Method, device, storage medium, terminal and system for displaying live gift |
| CN109191544A (en) * | 2018-08-21 | 2019-01-11 | 北京潘达互娱科技有限公司 | A kind of paster present methods of exhibiting, device, electronic equipment and storage medium |
| CN110933454A (en) * | 2019-12-06 | 2020-03-27 | 广州酷狗计算机科技有限公司 | Method, device, equipment and storage medium for processing live broadcast budding gift |
| CN110958463A (en) * | 2019-12-06 | 2020-04-03 | 广州华多网络科技有限公司 | Method, device and equipment for detecting and synthesizing virtual gift display position |
| CN110933454B (en) * | 2019-12-06 | 2021-11-02 | 广州酷狗计算机科技有限公司 | Method, device, equipment and storage medium for processing live broadcast budding gift |
| CN111147880A (en) * | 2019-12-30 | 2020-05-12 | 广州华多网络科技有限公司 | Interaction method, device and system for live video, electronic equipment and storage medium |
| CN111246232A (en) * | 2020-01-17 | 2020-06-05 | 广州华多网络科技有限公司 | Live broadcast interaction method and device, electronic equipment and storage medium |
| CN112087655A (en) * | 2020-08-07 | 2020-12-15 | 广州华多网络科技有限公司 | Method and device for presenting virtual gift and electronic equipment |
| CN111970533A (en) * | 2020-08-28 | 2020-11-20 | 北京达佳互联信息技术有限公司 | Interaction method and device for live broadcast room and electronic equipment |
| WO2022042089A1 (en) * | 2020-08-28 | 2022-03-03 | 北京达佳互联信息技术有限公司 | Interaction method and apparatus for live broadcast room |
| CN112770128A (en) * | 2020-12-31 | 2021-05-07 | 百果园技术(新加坡)有限公司 | Playing system, method and device of live gift and server |
| CN112770128B (en) * | 2020-12-31 | 2023-04-07 | 百果园技术(新加坡)有限公司 | Playing system, method and device of live gift and server |
| CN114827703A (en) * | 2021-01-29 | 2022-07-29 | 武汉斗鱼网络科技有限公司 | View queuing playing method, device, equipment and medium |
| CN114827703B (en) * | 2021-01-29 | 2024-02-20 | 鹰皇文化传媒有限公司 | Queuing playing method, device, equipment and medium for views |
| CN113163220A (en) * | 2021-02-26 | 2021-07-23 | 广州方硅信息技术有限公司 | Virtual gift positioning display method and device, equipment and medium thereof |
| CN113163220B (en) * | 2021-02-26 | 2023-02-28 | 广州方硅信息技术有限公司 | Virtual gift positioning display method and device, equipment and medium thereof |
| CN113596596A (en) * | 2021-07-27 | 2021-11-02 | 百果园技术(新加坡)有限公司 | Gift rewarding system, method, device and medium for live broadcast application |
| CN114125325A (en) * | 2021-11-30 | 2022-03-01 | 维沃移动通信有限公司 | Video shooting method and device and electronic equipment |
| CN115484489A (en) * | 2022-09-14 | 2022-12-16 | 抖音视界有限公司 | Resource processing method, resource processing device, electronic device, storage medium, and program product |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107438200A (en) | The method and apparatus of direct broadcasting room present displaying | |
| US10841661B2 (en) | Interactive method, apparatus, and system in live room | |
| CN106101736B (en) | A kind of methods of exhibiting and system of virtual present | |
| CN106101756B (en) | Barrage display methods, barrage adding method, apparatus and system | |
| CN105338368B (en) | A kind of method, apparatus and system of the live stream turning point multicast data of video | |
| CN106454404B (en) | A kind of methods, devices and systems playing live video | |
| CN103905885B (en) | Net cast method and device | |
| CN106331826B (en) | A kind of methods, devices and systems of setting live streaming template and video mode | |
| CN105828145B (en) | Interactive approach and device | |
| CN104822090B (en) | The methods, devices and systems of video playback | |
| CN104519404B (en) | The player method and device of graphic interchange format file | |
| CN105808060B (en) | A kind of method and apparatus of playing animation | |
| CN105183296B (en) | interactive interface display method and device | |
| CN106488296B (en) | A kind of method and apparatus showing video barrage | |
| CN106686396A (en) | Method and system for switching broadcasting rooms | |
| CN106791958A (en) | Position marker information generation method and device | |
| CN104159140B (en) | A kind of methods, devices and systems of Video processing | |
| CN104935955B (en) | A kind of methods, devices and systems transmitting live video stream | |
| CN104036536B (en) | The generation method and device of a kind of stop-motion animation | |
| CN105094513B (en) | User's head portrait setting method, device and electronic equipment | |
| CN106254910B (en) | Method and device for recording image | |
| CN106504303B (en) | A kind of method and apparatus playing frame animation | |
| CN107396193B (en) | The method and apparatus of video playing | |
| CN103886198B (en) | Method, terminal, server and the system that a kind of data process | |
| CN107333162A (en) | A kind of method and apparatus for playing live video |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: 510660 Guangzhou City, Guangzhou, Guangdong, Whampoa Avenue, No. 315, self - made 1-17 Applicant after: Guangzhou KuGou Networks Co., Ltd. Address before: 510000 B1, building, No. 16, rhyme Road, Guangzhou, Guangdong, China 13F Applicant before: Guangzhou KuGou Networks Co., Ltd. |
|
| CB02 | Change of applicant information | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20171205 |
|
| RJ01 | Rejection of invention patent application after publication |