CN108965977A - Methods of exhibiting, device, storage medium, terminal and the system of present is broadcast live - Google Patents

Methods of exhibiting, device, storage medium, terminal and the system of present is broadcast live Download PDF

Info

Publication number
CN108965977A
CN108965977A CN201810608492.0A CN201810608492A CN108965977A CN 108965977 A CN108965977 A CN 108965977A CN 201810608492 A CN201810608492 A CN 201810608492A CN 108965977 A CN108965977 A CN 108965977A
Authority
CN
China
Prior art keywords
paster
present
live streaming
live
video stream
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201810608492.0A
Other languages
Chinese (zh)
Other versions
CN108965977B (en
Inventor
许扬
陈运强
吴晓东
吴昊
林映芳
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou Huya Information Technology Co Ltd
Original Assignee
Guangzhou Huya Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Huya Information Technology Co Ltd filed Critical Guangzhou Huya Information Technology Co Ltd
Priority to CN201810608492.0A priority Critical patent/CN108965977B/en
Publication of CN108965977A publication Critical patent/CN108965977A/en
Application granted granted Critical
Publication of CN108965977B publication Critical patent/CN108965977B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/172—Classification, e.g. identification
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/235—Processing of additional data, e.g. scrambling of additional data or processing content descriptors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • H04N21/25866—Management of end-user data
    • H04N21/25891—Management of end-user data being end-user preferences
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/435—Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/482—End-user interface for program selection

Abstract

The present invention provides the methods of exhibiting of live streaming present, comprising the following steps: the displaying instruction for receiving live streaming present obtains the first paster that the live streaming present carries；The picture frame in live video stream is obtained, identifies the face image in described image frame；First paster is set to the corresponding position of face image in described image frame, forms the live video stream with paster bandwagon effect.The live video stream with paster bandwagon effect is formed when the present invention is by showing live streaming present, enriches present is shown in live streaming present diversity and interest.The present invention also provides displaying device, storage medium, terminal and the systems of live streaming present.

Description

Methods of exhibiting, device, storage medium, terminal and the system of present is broadcast live
Technical field
The present invention relates to Internet technical fields, specifically, the present invention relates to a kind of methods of exhibiting that present is broadcast live, dress It sets, storage medium, terminal and system.
Background technique
With the fast development of Internet technology, people are more and more stronger to the dependence of terminal, the application journey accordingly generated The type of sequence is also more and more.Wherein, the application program of class is broadcast live due to having had feature intuitive, quick, that interactivity is strong As a kind of common application program.In the application program of live streaming class, present is the important component of live content, wherein The consumer behavior of payment present can produce positive incentive action to live content, and present display form abundant more can effectively promote Into the output of high-quality live content.The ever more important in this regard, interactive effect of present seems.
Currently, the displaying of present generally plays present to cover type using on the public screen region of chat or live streaming picture in real time Animation and the mode for giving quantity.The mode that it shows is more single, it is difficult to promote viewing to interact with main broadcaster, be unable to satisfy user The entertainment requirements of diversification.
Summary of the invention
The purpose of the present invention is intended to provide a kind of methods of exhibiting that present is broadcast live, and solves the problems, such as above-mentioned at least one, especially It is to solve the problems, such as that live streaming present exhibition method is more single.
In a first aspect, the present invention provides a kind of methods of exhibiting that present is broadcast live, comprising the following steps: receive live streaming present It shows instruction, obtains the first paster that the live streaming present carries；The picture frame in live video stream is obtained, identifies described image Face image in frame；First paster is set to the corresponding position of face image in described image frame, being formed has patch The live video stream of paper bandwagon effect.
With reference to first aspect, the present invention is described to set first paster in the first embodiment of first aspect It is placed in the corresponding position of face image in described image frame, forms the live video stream with paster bandwagon effect, including following Step: when detect showing first paster in the live video stream when；It removes in the live video stream First paster shown；First paster is relocated onto the corresponding position of face image, shape in described image frame At the live video stream of the bandwagon effect shown again with first paster.
The first embodiment with reference to first aspect, the present invention are described in second of embodiment of first aspect First paster is set to the corresponding position of face image in described image frame, forms the live streaming with paster bandwagon effect Video flowing, comprising the following steps:
The second paster is being shown in the live video stream when detecting, and second paster is associated with the first paster When the live streaming present of same type, first paster is set to the corresponding position of face image, shape in described image frame At the live video stream of the bandwagon effect shown simultaneously with first paster and the second paster.
Second of embodiment of the first embodiment or first aspect with reference to first aspect, the present invention is in first party It is described that first paster is set to the corresponding position of face image in described image frame in the third embodiment in face, Form the live video stream with paster bandwagon effect, comprising the following steps: opening up when detecting in the live video stream Show third paster, and when the third paster and the first paster are associated with different types of live streaming present；According to each live streaming of acquisition Present carries the time point sequencing of paster, is ranked up to paster；When other patches before first paster that sort At the end of paper has shown that, first paster is set to the corresponding position of face image in described image frame, being formed has institute State the live video stream of the first paster bandwagon effect.
The third embodiment with reference to first aspect, the present invention are described in the 4th kind of embodiment of first aspect It include at least two in first paster；It is described that first paster is set to the corresponding position of face image in described image frame It sets, forms the live video stream with paster bandwagon effect, comprising the following steps: according to the paster attribute of first paster, Determine the paster to be shown in face recognition point and first paster；According to face image recognition result and face recognition point, Determine the display position in described image frame；The paster to be shown is set to the display position in described image frame.
The 4th kind of embodiment with reference to first aspect, the present invention are described in the 5th kind of embodiment of first aspect According to face image recognition result and face recognition point, the display position in described image frame is determined, further comprising the steps of: According to the paster attribute of first paster, the circulation frame number being pre-configured and crucial frame number are determined；According to the circulation frame number and Crucial frame number determines first paster corresponding admission picture frame, appearance picture frame and admission in the live video stream Intermediate image frame between picture frame and appearance picture frame；According to the corresponding face image recognition result of each picture frame and the face Portion's identification point determines the display position in the admission picture frame, appearance picture frame and admission picture frame.
With reference to first aspect, for the present invention in the 6th kind of embodiment of first aspect, first paster is that dynamic is pasted Paper；It is described that first paster is set to the corresponding position of face image in described image frame, comprising the following steps: according to face Distance of the face apart from camera lens in portion's image recognition result adjusts the size dimension of first paster.
Second aspect, the present invention provide it is a kind of be broadcast live present methods of exhibiting, comprising the following steps: server determine it is pre- under The live streaming present of hair is configured with paster；The first paster is extracted from the associated paster list of live streaming present；To under live streaming end Hair carries the live streaming present of first paster；The displaying instruction of the live streaming present is issued to the live streaming end；Live streaming termination The displaying instruction for receiving live streaming present obtains the first paster that the live streaming present carries；The picture frame in live video stream is obtained, Identify the face image in described image frame；First paster is set to the corresponding position of face image in described image frame It sets, forms the live video stream with paster bandwagon effect.
In conjunction with second aspect, the present invention is described to close from the live streaming present in the first embodiment of second aspect The first paster is extracted in the paster list of connection, comprising the following steps: obtains the associated paster list of live streaming present, the patch Paper list is provided with each part paster and its corresponding displaying probability；According to each part paster and its corresponding displaying probability, from The first paster is extracted in paster list.
In conjunction with the first embodiment of second aspect, the present invention is described in second of embodiment of second aspect Paster list is provided with each part paster and its corresponding displaying probability, comprising the following steps: obtains the user's for sending live streaming present Grade；The corresponding displaying probability of pasters at different levels is arranged according to the grade of user in the rank for obtaining each part paster.
The third aspect, the present invention provide a kind of displaying device that present is broadcast live, comprise the following modules: obtaining module, be used for The displaying instruction for receiving live streaming present obtains the first paster that the live streaming present carries；Identification module, for obtaining live streaming view Picture frame in frequency stream, identifies the face image in described image frame；Display module, for first paster to be set to institute The corresponding position of face image in picture frame is stated, the live video stream with paster bandwagon effect is formed.
Fourth aspect, the present invention provide a kind of displaying device that present is broadcast live, including server and live streaming end；The service Device includes issuing module, determines the live streaming present issued in advance configured with paster for server；It is associated from the live streaming present The first paster is extracted in paster list；The live streaming present for carrying first paster is issued to live streaming end；To under the live streaming end Send out described live streaming present displaying instruction；The live streaming end includes receiving module, and the displaying of live streaming present is received for end to be broadcast live Instruction obtains the first paster that the live streaming present carries；The picture frame in live video stream is obtained, is identified in described image frame Face image；First paster is set to the corresponding position of face image in described image frame, being formed has paster exhibition Show the live video stream of effect.
5th aspect, the present invention provides a kind of computer-readable storage medium, is stored thereon with computer program, described The methods of exhibiting of live streaming present as described in relation to the first aspect is realized when computer program is executed by processor；And/or the calculating The methods of exhibiting of the live streaming present as described in second aspect is realized when machine program is executed by processor.
6th aspect, the present invention provide a kind of terminal, comprising: one or more processors；Memory；One or more meter Calculation machine program, one or more of computer program storages are in the memory；One or more of computer programs The methods of exhibiting of live streaming present as described in relation to the first aspect is realized when being executed by one or more of processors.
7th aspect, the present invention provide a kind of system, including server and live streaming end: the server include: one or Multiple processors；Memory；One or more computer programs, one or more of computer programs are stored in the storage In device；Following operation is realized when one or more of computer programs are executed by one or more of processors: being determined pre- The live streaming present issued is configured with paster；The first paster is extracted from the associated paster list of live streaming present；To live streaming end Issue the live streaming present for carrying first paster；The displaying instruction of the live streaming present is issued to the live streaming end；It is described straight Broadcasting end includes: one or more processors；Memory；One or more computer programs, one or more of computer journeys Sequence stores in the memory；One or more of computer programs are realized when being executed by one or more of processors Following operation: receiving the displaying instruction of live streaming present, obtains the first paster that the live streaming present carries；Obtain live video stream In picture frame, identify described image frame in face image；First paster is set to described image Zheng Zhong face figure As corresponding position, the live video stream with paster bandwagon effect is formed.
Compared with the existing technology, present invention has the advantage that
(1) in the methods of exhibiting of live streaming present provided by the invention, device, storage medium and terminal, by receiving After the displaying instruction of present is broadcast live, the first paster that the live streaming present carries is obtained, and obtain live video stream in direct broadcasting room In picture frame, identify the face image in described image frame, first paster be set to face in described image frame In the corresponding position of portion's image, the live video stream with paster bandwagon effect is formed.Wherein, by the way that present carrying will be broadcast live First paster combination face detection will show in the live video stream of the first paster insertion direct broadcasting room, form and show Live video stream with paster bandwagon effect when present is broadcast live enriches diversity and interest that live streaming present is shown, has Conducive to the enthusiasm for improving main broadcaster and viewing user in direct broadcasting room, promotes viewing user mutually to interact with main broadcaster, sought in direct broadcasting room Make more positive active atmosphere.
(2) in the methods of exhibiting of live streaming present provided by the invention, device, storage medium and system, when server determines When the live streaming present issued in advance is configured with paster, the first paster will be extracted from the associated paster list of live streaming present. When server issues the live streaming present for carrying first paster to live streaming end, the displaying for issuing the live streaming present refers to It enables.It will acquire first paster that present is broadcast live and carries when instruction when live streaming termination receives described show, and face combined to know Other technology identifies the face image of the picture frame in direct broadcasting room in live video stream, first paster is set to the figure As in frame on the corresponding position of face image, to be formed with paster bandwagon effect when carrying out the live streaming present and showing Live video stream.Wherein, the live streaming present and the first paster have incidence relation, include at least a in the paster list Paster, and first paster is at least a in paster list.The first paster as entrained by the live streaming present by Server extracts, and non-viewing user or main broadcaster user are triggered, and the interest of paster bandwagon effect is further increased, The being not fixed property of shown paster is more advantageous to the output for inspiring high-quality live content.
The additional aspect of the present invention and advantage will be set forth in part in the description, these will become from the following description Obviously, or practice through the invention is recognized.
Detailed description of the invention
Above-mentioned and/or additional aspect and advantage of the invention will become from the following description of the accompanying drawings of embodiments Obviously and it is readily appreciated that, in which:
Fig. 1 is the first flow chart for the methods of exhibiting that present is broadcast live in the embodiment of the present invention one；
Fig. 2 is second of flow chart of the methods of exhibiting that present is broadcast live in the embodiment of the present invention one；
Fig. 3 is the third flow chart for the methods of exhibiting that present is broadcast live in the embodiment of the present invention one；
Fig. 4 is the 4th kind of flow chart of the methods of exhibiting that present is broadcast live in the embodiment of the present invention one；
Fig. 5 is the 5th kind of flow chart of the methods of exhibiting that present is broadcast live in the embodiment of the present invention one；
Fig. 6 is the 6th kind of flow chart of the methods of exhibiting that present is broadcast live in the embodiment of the present invention one；
Fig. 7 is the 7th kind of flow chart of the methods of exhibiting that present is broadcast live in the embodiment of the present invention one；
Fig. 8 is the first flow chart for the methods of exhibiting that present is broadcast live in the embodiment of the present invention two；
Fig. 9 is second of flow chart of the methods of exhibiting that present is broadcast live in the embodiment of the present invention two；
Figure 10 is the third flow chart for the methods of exhibiting that present is broadcast live in the embodiment of the present invention two；
Figure 11 is the first module frame chart for the displaying device that present is broadcast live in the embodiment of the present invention three；
Figure 12 is second of module frame chart of the displaying device that present is broadcast live in the embodiment of the present invention three；
Figure 13 is the third module frame chart for the displaying device that present is broadcast live in the embodiment of the present invention three；
Figure 14 is the 4th kind of module frame chart of the displaying device that present is broadcast live in the embodiment of the present invention three；
Figure 15 is the 5th kind of module frame chart of the displaying device that present is broadcast live in the embodiment of the present invention three；
Figure 16 is the 6th kind of module frame chart of the displaying device that present is broadcast live in the embodiment of the present invention three；
Figure 17 is the 7th kind of module frame chart of the displaying device that present is broadcast live in the embodiment of the present invention three；
Figure 18 is the first module frame chart for the displaying device that present is broadcast live in the embodiment of the present invention four；
Figure 19 is second of module frame chart of the displaying device that present is broadcast live in the embodiment of the present invention four；
Figure 20 is the third module frame chart for the displaying device that present is broadcast live in the embodiment of the present invention four；And
Figure 21 is the block diagram for the displaying terminal that present is broadcast live in the embodiment of the present invention six.
Specific embodiment
The embodiment of the present invention is described below in detail, examples of the embodiments are shown in the accompanying drawings, wherein from beginning to end Same or similar label indicates same or similar element or element with the same or similar functions.Below with reference to attached The embodiment of figure description is exemplary, and for explaining only the invention, and is not construed as limiting the claims.
Those skilled in the art of the present technique are appreciated that unless expressly stated, singular " one " used herein, " one It is a ", " described " and "the" may also comprise plural form.It is to be further understood that being arranged used in specification of the invention Diction " comprising " refer to that there are the feature, integer, step, operation, element and/or component, but it is not excluded that in the presence of or addition Other one or more features, integer, step, operation, element, component and/or their group.It should be understood that when we claim member Part is " connected " or when " coupled " to another element, it can be directly connected or coupled to other elements, or there may also be Intermediary element.In addition, " connection " used herein or " coupling " may include being wirelessly connected or wirelessly coupling.It is used herein to arrange Diction "and/or" includes one or more associated wholes for listing item or any cell and all combinations.
Those skilled in the art of the present technique are appreciated that unless otherwise defined, all terms used herein (including technology art Language and scientific term), there is meaning identical with the general understanding of those of ordinary skill in fields of the present invention.Should also Understand, those terms such as defined in the general dictionary, it should be understood that have in the context of the prior art The consistent meaning of meaning, and unless idealization or meaning too formal otherwise will not be used by specific definitions as here To explain.
Those skilled in the art of the present technique are appreciated that " terminal " used herein above, " terminal device " both include wireless communication The equipment of number receiver, only has the equipment of the wireless signal receiver of non-emissive ability, and including receiving and emitting hardware Equipment, have on both-way communication chain road, can execute both-way communication reception and emit hardware equipment.This equipment It may include: honeycomb or other communication apparatus, shown with single line display or multi-line display or without multi-line The honeycomb of device or other communication apparatus；PCS (Personal Communications Service, person communication system), can With combine voice, data processing, fax and/or data communication capabilities；PDA (Personal Digital Assistant, it is personal Digital assistants), it may include radio frequency receiver, pager, the Internet/intranet access, web browser, notepad, day It goes through and/or GPS (Global Positioning System, global positioning system) receiver；Conventional laptop and/or palm Type computer or other equipment, have and/or the conventional laptop including radio frequency receiver and/or palmtop computer or its His equipment." terminal " used herein above, " terminal device " can be it is portable, can transport, be mounted on the vehicles (aviation, Sea-freight and/or land) in, or be suitable for and/or be configured in local runtime, and/or with distribution form, operate in the earth And/or any other position operation in space." terminal " used herein above, " terminal device " can also be communicating terminal, on Network termination, music/video playback terminal, such as can be PDA, MID (Mobile Internet Device, mobile Internet Equipment) and/or mobile phone with music/video playing function, it is also possible to the equipment such as smart television, set-top box.
Those skilled in the art of the present technique are appreciated that remote network devices used herein above comprising but be not limited to count The cloud that calculation machine, network host, single network server, multiple network server collection or multiple servers are constituted.Here, Yun Youji It is constituted in a large number of computers or network servers of cloud computing (Cloud Computing), wherein cloud computing is distributed computing One kind, a super virtual computer consisting of a loosely coupled set of computers.In the embodiment of the present invention, distal end It can be realized and be communicated by any communication modes between the network equipment, terminal device and WNS server, including but not limited to, is based on The mobile communication of 3GPP, LTE, WIMAX, based on TCP/IP, the computer network communication of udp protocol and based on bluetooth, infrared The low coverage wireless transmission method of transmission standard.
Noun involved by the embodiment of the present invention:
Live streaming platform: internet video live broadcasting is to be led to for social demand in real time using internet and multimedia communication technology Cross on network construct one integrate audio, video, Desktop Share, document sharing, interaction link multifunctional network it is straight It broadcasts platform, enterprise or personal can use that this live streaming platform carries out voice online, video, the comprehensive of data exchange and interact.
Direct broadcasting room: being a Virtual Space (or virtual room) based on the creation of network direct broadcasting platform between network direct broadcasting, directly It is generally created by main broadcaster's client between broadcasting and is connected with multiple viewing clients, i.e., include main broadcaster and multiple sights in direct broadcasting room Crowd, the viewing client in the Virtual Space can watch the live content of main broadcaster's client, while main broadcaster's client User and watch client user, watch client user and watch client user between can also carry out voice, The interaction of picture or text.
Live streaming end: predominantly main broadcaster is broadcast live the terminal used, and main broadcaster is responsible for participating in one in internet at live streaming end Shelves program or activity, from a series of activities such as planning, editor, recording, production, audience interactions, and take on hosting work.
Viewing end: the live video stream mainly formed by entering direct broadcasting room viewing by end is broadcast live, it can be by sending present etc. Mode is interacted with the user main broadcaster at live streaming end.
Server: a management resource simultaneously provides the computer of service for user, its in the present invention can record and assist down Hair viewing user is sent to the live streaming present of main broadcaster.
Embodiment one
In conjunction with Fig. 1, the embodiment of the present invention provides a kind of methods of exhibiting that present is broadcast live, the executing subject of the embodiment of the present invention The live streaming end that predominantly terminal, specially main broadcaster use, comprising the following steps:
S11 receives the displaying instruction of live streaming present, obtains the first paster that the live streaming present carries；
Wherein, live streaming present refers to that in direct broadcasting room, viewing end subscriber gives the present of main broadcaster by the way that platform is broadcast live, generally For, live streaming present is present of paying, and viewing end subscriber gives appreciation of main broadcaster's expression to main broadcaster by the purchase of live streaming platform Or thank.In embodiments of the present invention, a few money live streaming present configuration pasters are specified, paster is used to receive live streaming in live streaming termination It when present, is shown in main broadcaster face, reaches the live streaming present being currently received with the bandwagon effect expression main broadcaster of paster.It is configured with The live streaming present of paster is associated with paster list, includes at least a paster in paster list, includes at least one in a paster Put up paper.Paster is concretely described in detail the relationship between live streaming present and paster below by the citing of table 1:
The relation list between present and paster is broadcast live in table 1
It is specific as it can be seen that representing current live platform including live streaming present A to N in table 1 and being supplied to live streaming referring to table 1 Between the live streaming present that uses.
Wherein, live streaming present A is associated with paster list a, and paster list a includes the first to the n-th part of paster, terminates in live streaming Receive live streaming present A displaying instruction when, obtain it is described live streaming present A carry the first paster in may include a copy of it or More parts of pasters include such as first part of paster a1 or first part of paster a1 and n-th part of paster an, first described in the embodiment of the present invention Paster is not the restriction to paster quantity, is only named as term.Wherein, first part of paster a1 includes multiple pasters, and n-th part Paster an only includes putting up paper 1.
Wherein, live streaming present B does not have associated paster list, i.e., when live streaming termination receives the displaying instruction of live streaming present B When, paster entrained by the live streaming present B that obtains is empty.
Wherein, live streaming present C be associated with paster list c1, with live streaming present A be distinguished as live streaming the associated paster of present C Only include first part of paster c1 in list c1, and in first part of paster c1 includes multiple pasters.
Wherein, live streaming present N be associated with paster list n, with live streaming present A, C be distinguished as live streaming the associated patch of present N Paper list n only includes first part of paster n1, and only puts up paper including one in first part of paster n1.
Specifically, in embodiments of the present invention, the relationship between above-mentioned live streaming present and paster can be configured by backstage, In paster material can update at any time, free operational readiness is larger.Further, paster, which can be, is dynamically also possible to static state , when in a paster including multiple pasters, admission picture frame paster can be configured as, intermediate image frame paster, gone out Field picture frame paster, i.e., every a paster has corresponding displaying duration, and each timing node in the displaying duration is corresponding Picture frame have paster of its phase in requisition for displaying.When in a paster only include one put up paper when, show duration in will Show this it is same put up paper, and preferably configure minimum value for the displaying duration of this part of paster.
Specifically, when main broadcaster it is currently used live streaming termination receive live streaming present displaying instruction when, will acquire with it is described Present, which is broadcast live, has incidence relation, and current the first paster with carrying relationship.
S12 obtains the picture frame in live video stream, identifies the face image in described image frame；
Wherein, the picture frame in live video stream be main broadcaster end output video flowing in include picture frame.The face Image includes facial image, animal face image etc., and preferably facial image that is, in this step will in embodiments of the present invention In conjunction with face recognition technology, recognition of face is carried out to described image frame.
First paster is set to the corresponding position of face image in described image frame by S13, and being formed has paster exhibition Show the live video stream of effect.
First paster of acquisition is set when identification obtains the face image in described image frame in conjunction with step S12 The live streaming view in the corresponding position of face image, being equivalent to and the first paster being inserted in live streaming end output is placed in described image frame It is shown in frequency stream, forms the live video stream with paster bandwagon effect.When the first paster is shown, characterize corresponding Live streaming present is sent to, and shows the first paster simultaneously in the recorded broadcast picture at live streaming end at this time, and main broadcaster is imitated in combination with the displaying of paster Fruit enriches current live content, promotes main broadcaster and viewing user interaction, even more enriches the interest of live content.
Further, in conjunction with Fig. 2, step S13 is described that first paster is set to face image in described image frame Corresponding position forms the live video stream with paster bandwagon effect, comprising the following steps:
S21 when detect showing first paster in the live video stream when, remove the live video stream In first paster that is showing；
First paster is relocated onto the corresponding position of face image in described image frame by S22, and being formed has institute State the live video stream for the bandwagon effect that the first paster is shown again.
It is inserted into live video stream before first paster, live streaming end will test in live video stream whether have The paster of displaying, when detect showing first paster in live video stream when, that is, the paster that is showing and current The associated live streaming present of the first paster for needing to show is the same, and when paster material is consistent, removes described first shown Paster, and first paster got in step s 11 is set in the corresponding position of face image, being formed has institute State the live video stream for the bandwagon effect that the first paster is shown again.
Specifically, since every a paster has corresponding displaying duration in live video stream, on same time point, When detecting same paster (be associated with the live streaming present of same type, and belong to identical paster material) shown, By the paster shown remove, i.e., live play this showing the appearance picture frame paster of paster so that currently getting Paster light and be shown from the time for removing operation, form the effect for showing paster again.
Further, it after step S21 is detected and shown first paster in the live video stream, also wraps Include step:
Extend the time that first paster is being shown in the live video stream, until first paster shows the time Twice；The displaying time is determined by the first paster attribute；
The first paster that the live streaming present carries is labeled as having shown that.
Specifically, in embodiments of the present invention, when detect showing first paster in live video stream when, i.e., The paster shown prolongs as the associated live streaming present of the first paster for currently needing to show, and when paster material is consistent The long time for showing first paster, until the displaying time of first paster shown is normal exhibition Show twice of time, i.e. the first paster for once showing of circularly exhibiting.
Further, in conjunction with Fig. 3, step S13 is described that first paster is set to face image in described image frame Corresponding position forms the live video stream with paster bandwagon effect, comprising the following steps:
S31, which ought be detected, is showing the second paster in the live video stream, and second paster and the first paster When being associated with the live streaming present of same type, first paster is set to the corresponding position of face image in described image frame It sets, forms the live video stream for the bandwagon effect that there is first paster and the second paster to show simultaneously.
It is inserted into live video stream before first paster, live streaming end will test in live video stream whether have The paster of displaying is showing the second paster when detecting in live video stream, and the second paster is associated with phase with the first paster When the live streaming present of same type, that is, the paster shown and the associated live streaming present one of the first paster for currently needing to show Sample, but when paster material difference, first paster got in step s 11 is set to the corresponding position of face image In, form the live video stream for the bandwagon effect that there is first paster and the second paster to show simultaneously.At this point, multiple pasters The bandwagon effect shown simultaneously is conducive to abundant live streaming picture, further strengthens interest.
Further, in conjunction with Fig. 4, step S13 is described that first paster is set to described image Zheng Zhong face figure As corresponding position, the live video stream with paster bandwagon effect is formed, comprising the following steps:
S41, which ought be detected, is showing third paster in the live video stream, and the third paster and the first paster When being associated with different types of live streaming present, according to the time point sequencing for obtaining each live streaming present carrying paster, to paster It is ranked up；
First paster is arranged at the end of other pasters of sequence before first paster have shown that by S42 The corresponding position of face image in described image frame forms the live video stream with the first paster bandwagon effect.
It is inserted into live video stream before first paster, live streaming end will test in live video stream whether have The paster of displaying is showing third paster when detecting in live video stream, and third paster and the first paster are associated with not When the live streaming present of same type, that is, the paster shown is different from the associated live streaming present of the first paster for currently needing to show (judgment rule at this time only needs to judge whether to be associated with the live streaming present of same type, not to whether belonging to same paster Material limits) when, paster is arranged for according to the chronological order for obtaining each live streaming present carrying paster in live streaming end Sequence has first shown the preceding paster of timing node sequence.
Specifically, since every a paster has corresponding displaying duration in live video stream, on same time point, Detect that the paster shown is associated with different types of live streaming present with the paster for currently needing to be inserted into live video stream When, by according to the timing node for obtaining paster, need the paster shown to be ranked up to each, and according to the successive suitable of timing node Sequence sorts displaying one by one.
It illustrates below with reference to table 2, the displaying logic that above-mentioned steps S13 includes is described:
2 paster of table shows logic
Reference table 2, it is seen then that when the first paster A1 of the received live streaming present A of current time node needs to be shown, The case where detection is currently being shown includes four kinds:
The first: having the first paster of the received live streaming present A of the upper timing node shown in live video stream (the first paster A1 and the received live streaming present A of current time node of the upper received live streaming present A of a timing node belongs to phase to A1 The live streaming present of same type, and paster material is identical), then it is received straight to trigger the upper timing node for removing and currently showing The first paster A1 of present A is broadcast, and shows the first paster A1 of the received live streaming present A of current time node again.It is quite It reinserts and is shown after it will be removed with a paster.
Second, there is the second paster of the received live streaming present A of the upper timing node shown in live video stream (the first paster A2 and the received live streaming present A of current time node of the upper received live streaming present A of a timing node belongs to phase to A2 The live streaming present of same type, but paster material is different), then directly by the first patch of the received live streaming present A of current time node Paper A1 is inserted into live video stream, forms the bandwagon effect that the first paster A1 and the second paster A2 is shown simultaneously.
The third: having the third paster B1 for showing the received live streaming present B of a timing node in live video stream, But the live streaming present of same type is not belonging to the received live streaming present A of current time node, then triggering is according to each paster of acquisition Timing node be ranked up, and successively sorted according to the time point sequencing of sequence and show each paster.
4th kind: there is no the paster shown in live video stream, then directly show that current time node is received straight Broadcast the first paster A1 of present A.
Further, since every a paster has its corresponding displaying duration, in the above-mentioned removal referred to, again show, It shows simultaneously, in the operation of sort displaying and direct displaying etc., will combine the displaying duration progress of every a paster.
It preferably, include at least two in first paster；In embodiments of the present invention, in every a paster at least One puts up paper, following preferably in combination with including the case where that at least two are described in every a paster: in conjunction with Fig. 5, step S13, Described that first paster is set to the corresponding position of face image in described image frame, being formed has paster bandwagon effect Live video stream, comprising the following steps:
S51 is determined to be shown in face recognition point and first paster according to the paster attribute of first paster Paster；
S52 determines the display position in described image frame according to face image recognition result and face recognition point；
The paster to be shown is set to the display position in described image frame by S53.
In embodiments of the present invention, every a paster is corresponding with the paster attribute of its own, and paster attribute includes face Identification point.When it is current to carry out the identification to face when, face recognition point be the crown, left eye, right eye, nose, cheek, mouth or Ear etc., is used to determine paster to need to be arranged in which position of face image in the picture frame of identification.Further, due to It may include more than one in first paster and put up paper, need to determine about the sequence of each paster to aobvious according in paster attribute at this time Show paster.
Further, in conjunction with Fig. 6, step S52 is further comprising the steps of:
S61 determines the circulation frame number being pre-configured and crucial frame number according to the paster attribute of first paster；
S62 determines that first paster is corresponding in the live video stream according to the circulation frame number and crucial frame number Admission picture frame, the intermediate image frame between appearance picture frame and admission picture frame and appearance picture frame；
S63 is determined according to the corresponding face image recognition result of each picture frame and the face recognition point in the admission Display position in picture frame, appearance picture frame and intermediate image frame.
Specifically, in embodiments of the present invention, paster attribute further includes following for pre-configuration other than including face recognition point Ring frame number, the circulation frame number of the pre-configuration corresponds to intermediate image frame frame number can for controlling the displaying duration of the first paster It is configured with specific reference to the paster number for including in the first paster.Further, paster attribute further includes key frame frame number, should Key frame frame number corresponds to admission picture frame frame number, appearance picture frame frame number, for combining cycle frame number to control the first paster Show duration.In conjunction with above-mentioned steps S62 as it can be seen that in embodiments of the present invention, by the paster attribute of the first paster, can determine The circulation frame number of first paster and crucial frame number out, and when can determine the displaying of the first paster by circulation frame number and key frame number It is long that (circulation frame number+key frame number=always shows frame number, total displaying time=first paster for showing each picture frame of frame number * Show duration) and paster to be shown and admission picture frame, intermediate image frame and appearance picture frame corresponding relationship, form the The whole bandwagon effect of one paster.
Further, first paster is dynamic paster；In conjunction with Fig. 7, step S13 is described to set first paster It is placed in the corresponding position of face image in described image frame, comprising the following steps:
S71 adjusts the size ruler of first paster according to distance of the face apart from camera lens in face image recognition result It is very little.
In embodiments of the present invention, a kind of special efficacy for being shown as combination face detection of first paster is shown, When the paster for including in the first paster is still image, text and/or symbol, single display static state in duration can be being shown Paster also showed in the transition by multiple static pasters and is formed in Dynamically Announce multiple static pasters in displaying duration； When the paster for including in the first paster is dynamic image, text and/or when symbol, can show in duration according to paster attribute, It is formed in and shows Dynamically Announce dynamic paster in duration.
Embodiment two
In conjunction with Fig. 8, the methods of exhibiting that the embodiment of the present invention also provides a kind of live streaming present is held in embodiments of the present invention Capable main body includes server and terminal, and wherein terminal is live streaming end, comprising the following steps:
S81 server determines the live streaming present issued in advance configured with paster；From the associated paster list of live streaming present The first paster of middle extraction；The live streaming present for carrying first paster is issued to live streaming end；It is issued to the live streaming end described straight Broadcast the displaying instruction of present；
In embodiments of the present invention, when server detects that preparation issues live streaming present, live streaming present will be sentenced It is disconnected, determine whether the live streaming present issued in advance is configured with paster.When determining the live streaming present issued in advance configured with paster, service Device will acquire and extract the first paster in the associated paster list of live streaming present that issues in advance, and issue carrying first to live streaming end The displaying instruction of the live streaming present of paster and the corresponding live streaming present.
The displaying instruction that end receives live streaming present is broadcast live in S82, obtains the first paster that the live streaming present carries；It obtains straight The picture frame in video flowing is broadcast, identifies the face image in described image frame；First paster is set to described image frame The middle corresponding position of face image forms the live video stream with paster bandwagon effect.
Further, in conjunction with Fig. 9, step S81, first patch of the extraction from the live streaming present associated paster list Paper, comprising the following steps:
S91 obtains the associated paster list of live streaming present, and the paster list is provided with each part paster and its correspondence Displaying probability；
S92 extracts the first paster according to each paster and its corresponding displaying probability from paster list.
Specifically, described to show probability according to the paster attribute and/or product structure configuration of each part paster.
Step S92 is illustrated below with reference to table 3:
The extraction logic of 3 each parts of pasters of table
Reference table 3, table 3 are each part paster in current displaying, the extraction result of generation.As it can be seen that in table 3, Being broadcast live in the associated paster list of present includes two parts of pasters, first part of paster and second part of paster.Wherein, first part of paster Displaying probability be 90%, the displaying probability of the second paster is 10%.In the extraction process of server, every portion was once extracted The corresponding count numerical value of the paster crossed will add 1, the displaying number of performance such as table 3.The displaying number of first part of paster is in table 3 8, first part of paster is represented in the case where live streaming present is issued 9 times, is had 8 times and has been extracted first part of paster as live streaming present The first paster carried；The displaying number of second part of paster is 1, represents the feelings that second part of paster is issued 9 times in live streaming present Under condition, has 1 time and extracted the first paster that second part of paster is carried as live streaming present.In the case of showing to this, server is needed When will be to the first paster for extracting its carrying for the live streaming present, first part of paster will be extracted as the first paster.Specifically, working as Preceding extract is extracted for the 10th time, i.e., always shows that number will become 10, and in order to meet pre-set displaying probability, server will be selected The first paster that first part of paster is carried as live streaming present is selected, so that first part of paster is always showing the case where number is 10 Under, the displaying number of first part of paster is 9.
Further, in conjunction with Figure 10, step S91, the paster list, which is provided with each paster and its corresponds to, shows probability, The following steps are included:
S101 obtains the grade for sending the user of live streaming present；
S102 obtains the rank of each paster, and the corresponding displaying probability of pasters at different levels is arranged according to the grade of user.
Specifically, the grade of the user for sending live streaming present is grade of the user in current live platform.By In live streaming present generally payment present, and correspondingly, if the user for sending live streaming present is the advanced use of current live platform When family, the time and monetary cost typically taken from is higher, in order to improve user experience, will send the user's of live streaming present The displaying probability for each part paster for including in grade and each live streaming associated paster list of present is matched.Below with reference to table 4 It is illustrated:
Table 4 shows the logic of probability according to the grade for sending live streaming present user and the setting of each part paster
Reference table 4, it is seen then that in table 4, being broadcast live in the associated paster list of present includes first part of paster and second part of patch Paper, wherein first part of paster includes dynamic paster, and second part of paster includes static paster.Assuming that the displaying effect of first part of paster Fruit is better than the bandwagon effect of second part of paster.Wherein, user gradation is that the displaying probability of advanced first part of paster of correspondence is 90%, the displaying probability of corresponding second part of paster is 10%.By user gradation from when high to low sequence, the exhibition of first part of paster Showing probability mutually should be from high to low sequence, and the displaying probability of second part of paster is to sort from down to height.
The mainly exhibition to each part paster configuration for including in the live streaming associated paster list of present in embodiments of the present invention Show that probability carries out detailed narration.By showing the setting of probability, it can effectively plan the scheme that paster is shown, be conducive to according to user Demand optimization, more increase technical solution operation freedom degree.
Embodiment three
In conjunction with Figure 11, in order to be further illustrated to the methods of exhibiting that present is broadcast live described in the embodiment of the present invention one, Modularization explanation is carried out to it, the displaying device of live streaming present is provided, is comprised the following modules:
Module 111 is obtained, for receiving the displaying instruction of live streaming present, obtains the first patch that the live streaming present carries Paper；
Identification module 112 identifies the face image in described image frame for obtaining the picture frame in live video stream；
Display module 113, for first paster to be set to the corresponding position of face image, shape in described image frame At the live video stream with paster bandwagon effect.
Further, in conjunction with Figure 12, the display module 113, including with lower unit:
Remove unit 121, for when detect showing first paster in the live video stream when, remove institute State first paster shown in live video stream；
First display unit 122, it is corresponding for first paster to be relocated onto face image in described image frame Position, form the live video stream of bandwagon effect that there is first paster to show again.
Further, in conjunction with Figure 13, the display module 113, including with lower unit:
Second display unit 131, for showing the second paster in the live video stream when detecting, and described the When two pasters and the first paster are associated with the live streaming present of same type, first paster is set to face in described image frame Image corresponding position in portion's forms the live video for the bandwagon effect that there is first paster and the second paster to show simultaneously Stream.
Further, in conjunction with Figure 14, the display module 113, including with lower unit:
Sequencing unit 141 is showing third paster for that ought detect in the live video stream, and the third is pasted When paper and the first paster are associated with different types of live streaming present, according to obtaining, the time point that each live streaming present carries paster is successive Sequentially, paster is ranked up；
Third display unit 142 will at the end of having shown that for working as other pasters of sequence before first paster First paster is set to the corresponding position of face image in described image frame, and being formed has the first paster bandwagon effect Live video stream.
It preferably, include at least two in first paster in conjunction with Figure 15；The display module 103 includes to place an order Member:
First determination unit 151 determines face recognition point and described for the paster attribute according to first paster Paster to be shown in one paster；
Second determination unit 152, for determining in described image frame according to face image recognition result and face recognition point In display position；
Setting unit 153, the display position for being set to the paster to be shown in described image frame.
Further, in conjunction with Figure 16, second determination unit 152, including following subelement:
First determines subelement 161, for the paster attribute according to first paster, determines the circulation frame number being pre-configured With crucial frame number；
Second determines subelement 162, for determining first paster in institute according to the circulation frame number and crucial frame number State the middle graph in live video stream between corresponding admission picture frame, appearance picture frame and admission picture frame and appearance picture frame As frame；
Third determines subelement 163, for being known according to the corresponding face image recognition result of each picture frame and the face It is other, determine the display position in the admission picture frame, appearance picture frame and admission picture frame.
Further, in conjunction with Figure 17, first paster is dynamic paster；The display module 113, including to place an order Member:
Adjustment unit 171, for according to distance of the face apart from camera lens in face image recognition result, adjustment described first The size dimension of paster.
Example IV
In conjunction with Figure 18, in order to be further illustrated to the methods of exhibiting that present is broadcast live described in the embodiment of the present invention two, Modularization explanation is carried out to it, the displaying device of live streaming present, including server and live streaming end are provided:
The server includes issuing module 181, determines the live streaming present issued in advance configured with paster for server；From The first paster is extracted in the associated paster list of live streaming present；The live streaming gift for carrying first paster is issued to live streaming end Object；The displaying instruction of the live streaming present is issued to the live streaming end；
The live streaming end includes receiving module 182, and the displaying instruction of live streaming present is received for end to be broadcast live, and is obtained described straight Broadcast the first paster of present carrying；The picture frame in live video stream is obtained, identifies the face image in described image frame；By institute It states the first paster and is set to the corresponding position of face image in described image frame, form the live video with paster bandwagon effect Stream.
Further, described to issue module 181 in conjunction with Figure 19, including with lower unit:
Acquiring unit 191, for obtaining the associated paster list of live streaming present, the paster list is provided with each part Paster and its corresponding displaying probability；
Extracting unit 192, for according to each part paster and its corresponding displaying probability, extracting the from paster list One paster.
Further, in conjunction with Figure 20, the acquiring unit 191, including following subelement:
First obtains subelement 201, for obtaining the grade for sending the user of live streaming present；
Second obtains subelement 202, and for obtaining the rank of each part paster, patches at different levels are arranged according to the grade of user The corresponding displaying probability of paper.
Embodiment five
The embodiment of the present invention provides a kind of computer-readable storage medium, is stored thereon with computer program:
The methods of exhibiting of the live streaming present as described in embodiment one is realized when the computer program is executed by processor； And/or
The methods of exhibiting of the live streaming present as described in embodiment two is realized when the computer program is executed by processor.
Wherein, the storage medium include but is not limited to any kind of disk (including floppy disk, hard disk, CD, CD-ROM, And magneto-optic disk), ROM (Read-Only Memory, read-only memory), (Random AcceSS Memory, stores RAM immediately Device), EPROM (EraSable Programmable Read-Only Memory, Erarable Programmable Read only Memory), (Electrically EraSable Programmable Read-Only Memory, electric erazable programmable is read-only to be deposited EEPROM Reservoir), flash memory, magnetic card or light card.It is, storage medium includes by equipment (for example, computer) can read Form storage or transmission information any medium.It can be read-only memory, disk or CD etc..
Embodiment six
The embodiment of the invention also provides terminals, comprising:
One or more processors；
Memory；
One or more computer programs, one or more of computer program storages are in the memory；It is described The live streaming present as described in embodiment one is realized when one or more computer programs are executed by one or more of processors Methods of exhibiting.
As shown in figure 21, for ease of description, only parts related to embodiments of the present invention are shown, particular technique details It does not disclose, please refers to present invention method part.The terminal can be include mobile phone, tablet computer, PDA (Personal Digital Assistant, personal digital assistant), POS (Point of Sales, point-of-sale terminal), vehicle mounted electric Any terminal device such as brain, taking the terminal as an example:
Figure 21 shows the block diagram of the part-structure of mobile phone relevant to terminal provided in an embodiment of the present invention.With reference to figure 21, mobile phone includes: radio frequency (Radio Frequency, RF) circuit 2110, memory 2120, input unit 2130, display unit 2140, sensor 2150, voicefrequency circuit 2160, Wireless Fidelity (wireless fidelity, Wi-Fi) module 2170, processor The components such as 2180 and power supply 2190.It will be understood by those skilled in the art that handset structure shown in Figure 21 is not constituted pair The restriction of mobile phone may include perhaps combining certain components or different component cloth than illustrating more or fewer components It sets.
It is specifically introduced below with reference to each component parts of the Figure 21 to mobile phone:
RF circuit 2110 can be used for receiving and sending messages or communication process in, signal sends and receivees, particularly, by base station After downlink information receives, handled to processor 2180；In addition, the data for designing uplink are sent to base station.In general, RF circuit 2110 include but is not limited to antenna, at least one amplifier, transceiver, coupler, low-noise amplifier (Low Noise Amplifier, LNA), duplexer etc..In addition, RF circuit 2110 can also be logical with network and other equipment by wireless communication Letter.Any communication standard or agreement, including but not limited to global system for mobile communications (Global can be used in above-mentioned wireless communication System of Mobile communication, GSM), general packet radio service (General Packet Radio Service, GPRS), CDMA (Code Division Multiple Access, CDMA), wideband code division multiple access (Wideband Code Division Multiple Access, WCDMA), long term evolution (Long Term Evolution, LTE), Email, short message service (Short Messaging Service, SMS) etc..
Memory 2120 can be used for storing software program and module, and processor 2180 is stored in memory by operation 2120 software program and module, thereby executing the various function application and data processing of mobile phone.Memory 2120 can be led It to include storing program area and storage data area, wherein storing program area can be needed for storage program area, at least one function Application program (such as vocal print playing function, image player function etc.) etc.；Storage data area, which can be stored, uses institute according to mobile phone Data (such as audio data, phone directory etc.) of creation etc..In addition, memory 2120 may include high random access storage Device, can also include nonvolatile memory, and a for example, at least disk memory, flush memory device or other volatibility are solid State memory device.
Input unit 2130 can be used for receiving the number or character information of input, and generate with the user setting of mobile phone with And the related key signals input of function control.Specifically, input unit 2130 may include touch panel 2131 and other inputs Equipment 2132.Touch panel 2131, also referred to as touch screen collect touch operation (such as the user of user on it or nearby Use the behaviour of any suitable object or attachment such as finger, stylus on touch panel 2131 or near touch panel 2131 Make), and corresponding attachment device is driven according to preset formula.Optionally, touch panel 2131 may include touch detection Two parts of device and touch controller.Wherein, the touch orientation of touch detecting apparatus detection user, and detect touch operation band The signal come, transmits a signal to touch controller；Touch controller receives touch information from touch detecting apparatus, and by it It is converted into contact coordinate, then gives processor 2180, and order that processor 2180 is sent can be received and executed.In addition, Touch panel 2131 can be realized using multiple types such as resistance-type, condenser type, infrared ray and surface acoustic waves.In addition to touch surface Plate 2131, input unit 2130 can also include other input equipments 2132.Specifically, other input equipments 2132 may include But in being not limited to physical keyboard, function key (such as volume control button, switch key etc.), trace ball, mouse, operating stick etc. It is one or more.
Display unit 2140 can be used for showing information input by user or be supplied to user information and mobile phone it is each Kind menu.Display unit 2140 may include display panel 2141, optionally, can use liquid crystal display (Liquid Crystal Display, LCD), the forms such as Organic Light Emitting Diode (Organic Light-Emitting Diode, OLED) To configure display panel 2141.Further, touch panel 2131 can cover display panel 2141, when touch panel 2131 detects After arriving touch operation on it or nearby, processor 2180 is sent to determine the type of touch event, is followed by subsequent processing device 2180 provide corresponding visual output according to the type of touch event on display panel 2141.Although in Figure 21, touch surface Plate 2131 and display panel 2141 are the input and input function for realizing mobile phone as two independent components, but certain In embodiment, can be integrated by touch panel 2131 and display panel 2141 and that realizes mobile phone output and input function.
Mobile phone may also include at least one sensor 2150, such as optical sensor, motion sensor and other sensors. Specifically, optical sensor may include ambient light sensor and proximity sensor, wherein ambient light sensor can be according to ambient light Light and shade adjust the brightness of display panel 2141, proximity sensor can close display panel when mobile phone is moved in one's ear 2141 and/or backlight.As a kind of motion sensor, accelerometer sensor can detect in all directions (generally three axis) and add The size of speed can detect that size and the direction of gravity when static, can be used to identify application (such as the horizontal/vertical screen of mobile phone posture Switching, dependent game, magnetometer pose calibrating), Vibration identification correlation function (such as pedometer, tap) etc.；Also as mobile phone The other sensors such as configurable gyroscope, barometer, hygrometer, thermometer, infrared sensor, details are not described herein.
Voicefrequency circuit 2160, loudspeaker 2161, microphone 2162 can provide the audio interface between user and mobile phone.Audio Electric signal after the audio data received conversion can be transferred to loudspeaker 2161, be converted by loudspeaker 2161 by circuit 2160 For the output of vocal print signal；On the other hand, the vocal print signal of collection is converted to electric signal by microphone 2162, by voicefrequency circuit 2160 Audio data is converted to after reception, then by after the processing of audio data output processor 2180, through RF circuit 2110 to be sent to ratio Such as another mobile phone, or audio data is exported to memory 2120 to be further processed.
Wi-Fi belongs to short range wireless transmission technology, and mobile phone can help user's transceiver electronics by Wi-Fi module 2170 Mail, browsing webpage and access streaming video etc., it provides wireless broadband internet access for user.Although Figure 21 is shown Wi-Fi module 2170, but it is understood that, and it is not belonging to must be configured into for mobile phone, it can according to need completely Do not change in the range of the essence of invention and omits.
Processor 2180 is the control centre of mobile phone, using the various pieces of various interfaces and connection whole mobile phone, By running or execute the software program and/or module that are stored in memory 2120, and calls and be stored in memory 2120 Interior data execute the various functions and processing data of mobile phone, to carry out integral monitoring to mobile phone.Optionally, processor 2180 may include one or more processing units；Preferably, processor 2180 can integrate application processor and modulation /demodulation processing Device, wherein the main processing operation system of application processor, user interface and application program etc., modem processor is mainly located Reason wireless communication.It is understood that above-mentioned modem processor can not also be integrated into processor 2180.
Mobile phone further includes the power supply 2190 (such as battery) powered to all parts, it is preferred that power supply can pass through power supply Management system and processor 2180 are logically contiguous, to realize management charging, electric discharge and power consumption pipe by power-supply management system The functions such as reason.
Although being not shown, mobile phone can also include camera, bluetooth module etc., and details are not described herein.
In embodiments of the present invention, processor 2180 included by the terminal, which has, executes described in the above embodiments one The function of the methods of exhibiting of present is broadcast live, details are not described herein.
Embodiment seven
The embodiment of the present invention provides a kind of system, including server and live streaming end:
The server includes: one or more processors；Memory；One or more computer programs, it is one Or multiple computer program storages are in the memory；One or more of computer programs are by one or more of places Reason device realizes following operation when executing: determining the live streaming present issued in advance configured with paster；From the associated patch of the live streaming present The first paster is extracted in paper list；The live streaming present for carrying first paster is issued to live streaming end；It is issued to the live streaming end The displaying instruction of the live streaming present；
The live streaming end includes: one or more processors；Memory；One or more computer programs, it is one Or multiple computer program storages are in the memory；One or more of computer programs are by one or more of places It manages and realizes following operation when device executes: receiving the displaying instruction of live streaming present, obtain the first paster that the live streaming present carries； The picture frame in live video stream is obtained, identifies the face image in described image frame；First paster is set to described The corresponding position of face image in picture frame forms the live video stream with paster bandwagon effect.
Shown in the specific structure of terminal such as embodiment six describes, details are not described herein.
It should be understood that although each step in the flow chart of attached drawing is successively shown according to the instruction of arrow, These steps are not that the inevitable sequence according to arrow instruction successively executes.Unless expressly stating otherwise herein, these steps Execution there is no stringent sequences to limit, can execute in the other order.Moreover, at least one in the flow chart of attached drawing Part steps may include that perhaps these sub-steps of multiple stages or stage are not necessarily in synchronization to multiple sub-steps Completion is executed, but can be executed at different times, execution sequence, which is also not necessarily, successively to be carried out, but can be with other At least part of the sub-step or stage of step or other steps executes in turn or alternately.
The above is only some embodiments of the invention, it is noted that for the ordinary skill people of the art For member, various improvements and modifications may be made without departing from the principle of the present invention, these improvements and modifications are also answered It is considered as protection scope of the present invention.

Claims (15)

1. a kind of methods of exhibiting that present is broadcast live, which comprises the following steps:
The displaying instruction for receiving live streaming present obtains the first paster that the live streaming present carries；
The picture frame in live video stream is obtained, identifies the face image in described image frame；
First paster is set to the corresponding position of face image in described image frame, being formed has paster bandwagon effect Live video stream.
2. the methods of exhibiting of live streaming present according to claim 1, which is characterized in that described that first paster is arranged The corresponding position of face image in described image frame forms the live video stream with paster bandwagon effect, including following step It is rapid:
When detect showing first paster in the live video stream when, remove and opened up in the live video stream First paster shown；
First paster is relocated onto the corresponding position of face image in described image frame, being formed has first patch The live video stream for the bandwagon effect that paper is shown again.
3. the methods of exhibiting of live streaming present according to claim 2, which is characterized in that described that first paster is arranged The corresponding position of face image in described image frame forms the live video stream with paster bandwagon effect, including following step It is rapid:
The second paster is being shown in the live video stream when detecting, and second paster is associated with phase with the first paster When the live streaming present of same type, first paster is set to the corresponding position of face image in described image frame, forms tool There is the live video stream of first paster and the second paster while the bandwagon effect of displaying.
4. the methods of exhibiting of live streaming present according to claim 2 or 3, which is characterized in that described by first paster It is set to the corresponding position of face image in described image frame, forms the live video stream with paster bandwagon effect, including with Lower step:
Third paster is being shown in the live video stream when detecting, and the third paster and the first paster are associated with not When the live streaming present of same type, according to the time point sequencing for obtaining each live streaming present carrying paster, paster is ranked up；
At the end of other pasters before first paster that sort have shown that, first paster is set to the figure As the corresponding position of face image in frame, the live video stream with the first paster bandwagon effect is formed.
5. the methods of exhibiting of live streaming present according to claim 4, which is characterized in that include at least in first paster Two；Described that first paster is set to the corresponding position of face image in described image frame, being formed, there is paster to show The live video stream of effect, comprising the following steps:
According to the paster attribute of first paster, the paster to be shown in face recognition point and first paster is determined；
According to face image recognition result and face recognition point, the display position in described image frame is determined；
The paster to be shown is set to the display position in described image frame.
6. the methods of exhibiting of live streaming present according to claim 5, which is characterized in that described identified according to face image is tied Fruit and face recognition point determine the display position in described image frame, further comprising the steps of:
According to the paster attribute of first paster, the circulation frame number being pre-configured and crucial frame number are determined；
According to the circulation frame number and crucial frame number, first paster corresponding admission figure in the live video stream is determined As the intermediate image frame between frame, appearance picture frame and admission picture frame and appearance picture frame；
According to the corresponding face image recognition result of each picture frame and the face recognition point, determine the admission picture frame, Display position in appearance picture frame and intermediate image frame.
7. the methods of exhibiting of live streaming present according to claim 1, which is characterized in that first paster is that dynamic is pasted Paper；It is described that first paster is set to the corresponding position of face image in described image frame, comprising the following steps:
According to distance of the face apart from camera lens in face image recognition result, the size dimension of first paster is adjusted.
8. a kind of methods of exhibiting that present is broadcast live, which comprises the following steps:
Server determines the live streaming present issued in advance configured with paster；Is extracted from the associated paster list of live streaming present One paster；The live streaming present for carrying first paster is issued to live streaming end；The live streaming present is issued to the live streaming end Show instruction；
The displaying instruction that end receives live streaming present is broadcast live, obtains the first paster that the live streaming present carries；Obtain live video Picture frame in stream identifies the face image in described image frame；First paster is set to described image Zheng Zhong face The corresponding position of image forms the live video stream with paster bandwagon effect.
9. the methods of exhibiting of live streaming present according to claim 8, which is characterized in that described to be associated with from the live streaming present Paster list in extract the first paster, comprising the following steps:
The associated paster list of live streaming present is obtained, the paster list is provided with each part paster and its corresponding displaying is general Rate；
According to each part paster and its corresponding displaying probability, the first paster is extracted from paster list.
10. the methods of exhibiting of live streaming present according to claim 9, which is characterized in that the paster list is provided with respectively Part paster and its corresponding displaying probability, comprising the following steps:
Obtain the grade for sending the user of live streaming present；
The corresponding displaying probability of pasters at different levels is arranged according to the grade of user in the rank for obtaining each part paster.
11. a kind of displaying device that present is broadcast live, which is characterized in that comprise the following modules:
Module is obtained, for receiving the displaying instruction of live streaming present, obtains the first paster that the live streaming present carries；
Identification module identifies the face image in described image frame for obtaining the picture frame in live video stream；
Display module has for first paster to be set to the corresponding position of face image, formation in described image frame The live video stream of paster bandwagon effect.
12. a kind of displaying device that present is broadcast live, which is characterized in that including server and live streaming end；
The server includes issuing module, determines the live streaming present issued in advance configured with paster for server；From described straight It broadcasts in the associated paster list of present and extracts the first paster；The live streaming present for carrying first paster is issued to live streaming end；To The live streaming end issues the displaying instruction of the live streaming present；
The live streaming end includes receiving module, and the displaying instruction of live streaming present is received for end to be broadcast live, obtains the live streaming present The first paster carried；The picture frame in live video stream is obtained, identifies the face image in described image frame；By described first Paster is set to the corresponding position of face image in described image frame, forms the live video stream with paster bandwagon effect.
13. a kind of computer-readable storage medium, is stored thereon with computer program, it is characterised in that:
The exhibition of the live streaming present as described in any one of claim 1-7 is realized when the computer program is executed by processor Show method；And/or
Realizing the live streaming present as described in any one of claim 8-10 when the computer program is executed by processor Methods of exhibiting.
14. a kind of terminal characterized by comprising
One or more processors；
Memory；
One or more computer programs, one or more of computer program storages are in the memory；It is one Or multiple computer programs are realized as described in any one of claim 1-7 when being executed by one or more of processors The methods of exhibiting of present is broadcast live.
15. a kind of system, which is characterized in that including server and live streaming end:
The server includes: one or more processors；Memory；One or more computer programs, it is one or more A computer program storage is in the memory；One or more of computer programs are by one or more of processors Following operation is realized when execution: determining the live streaming present issued in advance configured with paster；From the associated paster column of the live streaming present The first paster is extracted in table；The live streaming present for carrying first paster is issued to live streaming end；It is issued to the live streaming end described The displaying instruction of present is broadcast live；
The live streaming end includes: one or more processors；Memory；One or more computer programs, it is one or more A computer program storage is in the memory；One or more of computer programs are by one or more of processors Following operation is realized when execution: receiving the displaying instruction of live streaming present, obtains the first paster that the live streaming present carries；It obtains Picture frame in live video stream identifies the face image in described image frame；First paster is set to described image The corresponding position of face image in frame forms the live video stream with paster bandwagon effect.
CN201810608492.0A 2018-06-13 2018-06-13 Method, device, storage medium, terminal and system for displaying live gift Active CN108965977B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810608492.0A CN108965977B (en) 2018-06-13 2018-06-13 Method, device, storage medium, terminal and system for displaying live gift

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810608492.0A CN108965977B (en) 2018-06-13 2018-06-13 Method, device, storage medium, terminal and system for displaying live gift

Publications (2)

Publication Number Publication Date
CN108965977A true CN108965977A (en) 2018-12-07
CN108965977B CN108965977B (en) 2021-08-20

Family

ID=64488433

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810608492.0A Active CN108965977B (en) 2018-06-13 2018-06-13 Method, device, storage medium, terminal and system for displaying live gift

Country Status (1)

Country Link
CN (1) CN108965977B (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109889858A (en) * 2019-02-15 2019-06-14 广州酷狗计算机科技有限公司 Information processing method, device and the computer readable storage medium of virtual objects
CN110418155A (en) * 2019-08-08 2019-11-05 腾讯科技（深圳）有限公司 Living broadcast interactive method, apparatus, computer readable storage medium and computer equipment
CN110933454A (en) * 2019-12-06 2020-03-27 广州酷狗计算机科技有限公司 Method, device, equipment and storage medium for processing live broadcast budding gift
CN111147880A (en) * 2019-12-30 2020-05-12 广州华多网络科技有限公司 Interaction method, device and system for live video, electronic equipment and storage medium
CN111314718A (en) * 2020-01-16 2020-06-19 广州酷狗计算机科技有限公司 Settlement method, device, equipment and medium for live broadcast battle

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120020568A1 (en) * 2010-07-23 2012-01-26 Casio Computer Co., Ltd. Image processor and image processing method
WO2014138280A1 (en) * 2013-03-05 2014-09-12 Vtm, Llc Medical telecommunications system
CN104571820A (en) * 2014-12-30 2015-04-29 广州酷狗计算机科技有限公司 Speaking frame display method, equipment and system
CN106339201A (en) * 2016-09-14 2017-01-18 北京金山安全软件有限公司 Map processing method and device and electronic equipment
CN106709762A (en) * 2016-12-26 2017-05-24 乐蜜科技有限公司 Virtual gift recommendation method, virtual gift recommendation device used in direct broadcast room, and mobile terminal
CN106845400A (en) * 2017-01-19 2017-06-13 南京开为网络科技有限公司 A kind of brand show method realized special efficacy and produce based on the tracking of face key point
CN107071580A (en) * 2017-03-20 2017-08-18 北京潘达互娱科技有限公司 Data processing method and device
CN107277632A (en) * 2017-05-12 2017-10-20 武汉斗鱼网络科技有限公司 A kind of method and apparatus for showing virtual present animation
CN107438200A (en) * 2017-09-08 2017-12-05 广州酷狗计算机科技有限公司 The method and apparatus of direct broadcasting room present displaying
CN107682729A (en) * 2017-09-08 2018-02-09 广州华多网络科技有限公司 It is a kind of based on live interactive approach and live broadcast system, electronic equipment

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120020568A1 (en) * 2010-07-23 2012-01-26 Casio Computer Co., Ltd. Image processor and image processing method
WO2014138280A1 (en) * 2013-03-05 2014-09-12 Vtm, Llc Medical telecommunications system
CN104571820A (en) * 2014-12-30 2015-04-29 广州酷狗计算机科技有限公司 Speaking frame display method, equipment and system
CN106339201A (en) * 2016-09-14 2017-01-18 北京金山安全软件有限公司 Map processing method and device and electronic equipment
CN106709762A (en) * 2016-12-26 2017-05-24 乐蜜科技有限公司 Virtual gift recommendation method, virtual gift recommendation device used in direct broadcast room, and mobile terminal
CN106845400A (en) * 2017-01-19 2017-06-13 南京开为网络科技有限公司 A kind of brand show method realized special efficacy and produce based on the tracking of face key point
CN107071580A (en) * 2017-03-20 2017-08-18 北京潘达互娱科技有限公司 Data processing method and device
CN107277632A (en) * 2017-05-12 2017-10-20 武汉斗鱼网络科技有限公司 A kind of method and apparatus for showing virtual present animation
CN107438200A (en) * 2017-09-08 2017-12-05 广州酷狗计算机科技有限公司 The method and apparatus of direct broadcasting room present displaying
CN107682729A (en) * 2017-09-08 2018-02-09 广州华多网络科技有限公司 It is a kind of based on live interactive approach and live broadcast system, electronic equipment

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109889858A (en) * 2019-02-15 2019-06-14 广州酷狗计算机科技有限公司 Information processing method, device and the computer readable storage medium of virtual objects
CN109889858B (en) * 2019-02-15 2021-06-11 广州酷狗计算机科技有限公司 Information processing method and device for virtual article and computer readable storage medium
CN110418155A (en) * 2019-08-08 2019-11-05 腾讯科技（深圳）有限公司 Living broadcast interactive method, apparatus, computer readable storage medium and computer equipment
CN110933454A (en) * 2019-12-06 2020-03-27 广州酷狗计算机科技有限公司 Method, device, equipment and storage medium for processing live broadcast budding gift
CN111147880A (en) * 2019-12-30 2020-05-12 广州华多网络科技有限公司 Interaction method, device and system for live video, electronic equipment and storage medium
CN111314718A (en) * 2020-01-16 2020-06-19 广州酷狗计算机科技有限公司 Settlement method, device, equipment and medium for live broadcast battle
CN111314718B (en) * 2020-01-16 2022-03-22 广州酷狗计算机科技有限公司 Settlement method, device, equipment and medium for live broadcast battle

Also Published As

Publication number Publication date
CN108965977B (en) 2021-08-20

Similar Documents

Publication Publication Date Title
CN106101736B (en) A kind of methods of exhibiting and system of virtual present
CN104967900B (en) A kind of method and apparatus generating video
CN108965977A (en) Methods of exhibiting, device, storage medium, terminal and the system of present is broadcast live
CN106531149B (en) Information processing method and device
CN105049423B (en) Rights Management System, device and method
CN109194973A (en) A kind of more main broadcaster's direct broadcasting rooms give the methods of exhibiting, device and equipment of virtual present
CN105828145B (en) Interactive approach and device
CN107438200A (en) The method and apparatus of direct broadcasting room present displaying
CN109195001A (en) Methods of exhibiting, device, storage medium and the terminal of present is broadcast live
CN106791958A (en) Position marker information generation method and device
CN110472145A (en) A kind of content recommendation method and electronic equipment
CN110166828A (en) A kind of method for processing video frequency and device
CN104796743A (en) Content item display system, method and device
CN110096611A (en) A kind of song recommendations method, mobile terminal and computer readable storage medium
CN109189953A (en) A kind of selection method and device of multimedia file
CN110113666A (en) A kind of method for broadcasting multimedia file, device, equipment and storage medium
CN110166848A (en) A kind of method of living broadcast interactive, relevant apparatus and system
CN110237536A (en) Personalized game service providing method and device, electronic equipment and storage medium
CN107766455A (en) Lyrics building sequence method, apparatus and computer-readable recording medium
CN108320148A (en) A kind of resource transfers method and relevant device
CN110430475A (en) A kind of interactive approach and relevant apparatus
CN110147496B (en) Content pushing method and device
CN109379617A (en) Multimedia file synchronous broadcast method, terminal and medium based on data processing
CN107864408A (en) Information displaying method, apparatus and system
CN107870799A (en) Utilize the method, apparatus and terminal of widget control audio player

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant