CN107911708A - Barrage display methods, live broadcasting method and relevant apparatus - Google Patents

Barrage display methods, live broadcasting method and relevant apparatus Download PDF

Info

Publication number
CN107911708A
CN107911708A CN201711100419.4A CN201711100419A CN107911708A CN 107911708 A CN107911708 A CN 107911708A CN 201711100419 A CN201711100419 A CN 201711100419A CN 107911708 A CN107911708 A CN 107911708A
Authority
CN
China
Prior art keywords
live
barrage
application
game
data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201711100419.4A
Other languages
Chinese (zh)
Other versions
CN107911708B (en
Inventor
向晨宇
李论
范保成
张俊辉
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tencent Cyber Tianjin Co Ltd
Original Assignee
Tencent Cyber Tianjin Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tencent Cyber Tianjin Co Ltd filed Critical Tencent Cyber Tianjin Co Ltd
Priority to CN201711100419.4A priority Critical patent/CN107911708B/en
Publication of CN107911708A publication Critical patent/CN107911708A/en
Application granted granted Critical
Publication of CN107911708B publication Critical patent/CN107911708B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/218—Source of audio or video content, e.g. local disk arrays
    • H04N21/2187—Live feed
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H04N21/4314—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for fitting data in a restricted space on the screen, e.g. EPG data in a rectangular grid
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/485—End-user interface for client configuration
    • H04N21/4854—End-user interface for client configuration for modifying image parameters, e.g. image brightness, contrast
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/485—End-user interface for client configuration
    • H04N21/4858—End-user interface for client configuration for modifying screen layout parameters, e.g. fonts, size of the windows
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/488—Data services, e.g. news ticker
    • H04N21/4884—Data services, e.g. news ticker for displaying subtitles
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/643—Communication protocols
    • H04N21/64322—IP

Abstract

The embodiment of the invention discloses a kind of barrage display methods, live broadcasting method and relevant apparatus, wherein, barrage display methods is applied to the game application in the live barrage display device of game, and barrage display methods includes：Start game in live application, the game picture of the game application is carried out using the live application live；Private communication passage is established between the live application；The barrage data of the live application acquirement are obtained by the private communication passage, the barrage data are directed to the comment data just delivered in live game picture for the corresponding user of each terminal；The barrage data are rendered in graphics processor GPU, and the barrage data investigation after rendering is shown in current game picture.The embodiment of the present invention can be realized shows barrage when playing live, strengthens the interaction between user.

Description

Barrage display methods, live broadcasting method and relevant apparatus
Technical field
The present embodiments relate to multimedia display field, and in particular to a kind of barrage display methods, live broadcasting method and phase Close device.
Background technology
With the hardware advances of the mobile equipment such as smart mobile phone, tablet computer and the development of communication network, one has been expedited the emergence of A new industry-" game is live ".In the video pictures of broadcasting, by subtitle form from picture sail display comment in a manner of, Referred to as barrage.If will play it is live combine with barrage, a kind of new experience certainly will be provided to the user, and use can be strengthened Interaction between family, and the prior art lacks relevant implementation.
The content of the invention
In view of this, an embodiment of the present invention provides a kind of barrage display methods, live broadcasting method and relevant apparatus, Neng Goushi Barrage is shown when playing live now, strengthens the interaction between user.
Barrage display methods provided in an embodiment of the present invention, should applied to the game in live barrage display device of playing With the barrage display methods includes：
Start game in live application, the game picture of the game application is carried out using the live application straight Broadcast；
Private communication passage is established between the live application；
The barrage data of the live application acquirement are obtained by the private communication passage, the barrage data are each end Corresponding user is held to be directed to the comment data just delivered in live game picture；
The barrage data are rendered in graphics processor GPU, and the barrage data investigation after rendering is in current trip Shown in play picture.
Live broadcasting method provided in an embodiment of the present invention, applied to the live application in the live barrage display device of playing, The live broadcasting method includes：
Start direct broadcast function, the game picture progress to game application is live；
Private communication passage is established between the game application；
Barrage data are obtained, the barrage data are directed to for the corresponding user of each terminal and are just delivered in live game picture Comment data；
The barrage data are sent to the game application by the private communication passage, so that the game should Shown with will be superimposed upon after the barrage data render in current game picture.
The embodiment of the present invention additionally provides a kind of barrage display device, including：
First start unit, for starting game in live application, using the live application to the game application Game picture carry out it is live；
First establishes unit, for establishing private communication passage between the live application；
First acquisition unit, for obtaining the barrage data of the live application acquirement by the private communication passage, The barrage data are directed to the comment data just delivered in live game picture for the corresponding user of each terminal；
Render processing unit, for rendering the barrage data in graphics processor GPU, and the barrage number after rendering Shown according to being superimposed upon in current game picture.
The embodiment of the present invention additionally provides a kind of live broadcast device, including：
Second start unit, for starting direct broadcast function, the game picture progress to game application is live；
Second establishes unit, for establishing private communication passage between the game application；
Second acquisition unit, for obtaining barrage data, the barrage data are the corresponding user of each terminal for The comment data that live game picture is delivered；
Transmitting element, for the barrage data to be sent to the game application by the private communication passage, with Shown so that the game application will be superimposed upon in current game picture after the barrage data render.
The embodiment of the present invention additionally provides a kind of live barrage display device of playing, including above-mentioned barrage display device, And above-mentioned live broadcast device.
In the embodiment of the present invention, game application starts game in live application, using the live application to the trip The game picture progress of play application is live, then private communication passage is established between the live application, by described special Communication port obtains the barrage data that the live application obtains, and the barrage data are finally rendered in GPU, and after rendering Barrage data investigation shown in current game picture.I.e. in the embodiment of the present invention, by using multi-process (more applications) Communication, realizes and shows barrage when playing live, brand-new experience is brought to user, enhances the interaction between user.
In addition, transmitting barrage data by establishing private communication passage, barrage data can be prevented to be ravesdropping, ensure that Data safety.
Further, since the installation kit increment of game application is limited, realize that logic is placed on by the part for showing barrage Live application end, the whole that can avoid showing barrage realize logic be placed on game application end caused by game application installation kit The problem of volume is excessive.
Brief description of the drawings
To describe the technical solutions in the embodiments of the present invention more clearly, make required in being described below to embodiment Attached drawing is briefly described, it should be apparent that, drawings in the following description are only some embodiments of the present invention, for For those skilled in the art, without creative efforts, it can also be obtained according to these attached drawings other attached Figure.
Fig. 1 is the application scenarios schematic diagram for the barrage display methods that the embodiment of the present invention is provided；
Fig. 2 a are the flow diagrams for the barrage display methods that the embodiment of the present invention is provided；
Fig. 2 b are a rendering pipeline schematic diagrames of the embodiment of the present invention；
Fig. 3 a are the flow diagrams for the live broadcasting method that the embodiment of the present invention is provided；
Fig. 3 b are the method schematic diagrams of broadcast service information of the embodiment of the present invention；
Fig. 4 is the flow diagram that display barrage is realized when playing live that the embodiment of the present invention is provided；
Fig. 5 is the structure diagram for the barrage display device that the embodiment of the present invention is provided；
Fig. 6 is another structure diagram for the barrage display device that the embodiment of the present invention is provided；
Fig. 7 is the structure diagram for the live broadcast device that the embodiment of the present invention is provided；
Fig. 8 is another structure diagram for the live broadcast device that the embodiment of the present invention is provided；
Fig. 9 is the structure diagram for the live barrage display device of playing that the embodiment of the present invention is provided；
Figure 10 is the structure diagram for the electronic equipment that the embodiment of the present invention is provided.
Embodiment
Below in conjunction with the attached drawing in the embodiment of the present invention, the technical solution in the embodiment of the present invention is carried out clear, complete Site preparation describes, it is clear that described embodiment is only part of the embodiment of the present invention, instead of all the embodiments.It is based on Embodiment in the present invention, the every other implementation that those skilled in the art are obtained without creative efforts Example, belongs to the scope of protection of the invention.
An embodiment of the present invention provides a kind of barrage display methods, live broadcasting method and relevant apparatus, it can realize and play Barrage is shown when live.The barrage display methods and live broadcasting method of the embodiment of the present invention are used to live main broadcaster end, i.e. main broadcaster The electronic equipment at end, the electronic equipment is for example：The mobile phone at main broadcaster end, tablet computer, computer etc., it is live that main broadcaster carries out this User, game player, that is, main broadcaster during game is live.Specifically in embodiments of the present invention, it is provided with the electronic equipment at main broadcaster end It is live application (such as：Live assistant, live companion) and game application (such as：Fighting landlord, king's honor).One specifically should It can be opened live application as shown in Figure 1, when main broadcaster needs to carry out playing live using live application, passed through with scene Live application starts game, i.e. game application starts in live application, after startup, game application and described live applies it Between establish private communication passage, the private communication passage that game application passes through foundation obtains the barrage data that live application obtains (live application can obtain barrage data from background server, and background server can be barrage server or game application Background server), which can be the user (i.e. spectators) of each terminal to just being commented what live game picture was delivered By data, the barrage data then are rendered in graphics processor (Graphics Processing Unit, GPU), by wash with watercolours Barrage data investigation after dye shows that final main broadcaster end will show the game picture with barrage in current game picture Face, main broadcaster can be based on the barrage and carry out interaction with spectators.
It will be described in detail respectively below, the description sequencing of each embodiment is not formed to specific implementation below The restriction of sequencing.
The present embodiment will describe barrage display methods from the angle of barrage display device, is provided with the barrage display device Game application, the barrage display device can be specifically integrated in the electronic equipment at main broadcaster end.
As shown in Figure 2 a, the barrage display methods of the present embodiment comprises the following steps：
Step S201, game, the game picture using the live application to the game application are started in live application Face carries out live.
Live application, refers to for carrying out live software, such as live assistant, live companion etc..Game application, refers to Be software for playing, such as fighting landlord, king's honor etc..
The method of the present embodiment, is mainly used in main broadcaster end, and main broadcaster end can install live application and game application at the same time, Main broadcaster using live application play live while game is played using game application.
Specifically, main broadcaster can first start live application, and direct-seeding is selected in the live application, then live at this Start game application in, i.e. the game application starts in the live application, to be answered using the live application the game Game picture carries out live.
In the present embodiment, it can be carried out by the way of record screen is live live.For example, live application can gather main broadcaster end Screen mirror image and audio signal, after screen mirror image and audio signal to collection encode, be sent to direct broadcast server, by Live data is sent to by direct broadcast server to be needed to watch live each terminal, realizes that record screen is live with this.Certainly, in practice Other modes can also be used to carry out live, such as：Window is live, is not especially limited herein.
Step S202, private communication passage is established between the live application.
During game application is run, game application can establish private communication passage between the live application, To obtain barrage data.Specifically, which can be established by specific IP address and port numbers.
I.e. live application upon actuation, can open the zero configuration networking Bonjour services of live application, live broadcasting should Information on services, comprising the host for running the live application in the information on services IP address and identification information (such as： Hostname, model etc.), the other informations such as service type, port numbers port can also be included certainly, do not do specific limit herein It is fixed.
Since Bonjour is to utilize the form issuing service information broadcasted, all electronic equipments in LAN (including the machine) can receive the information on services.Equally, when the live application on other electronic equipments utilizes Bonjour issue clothes During information of being engaged in, the machine can also receive.The machine mentioned by the present embodiment, refers to running the host of the game application.
Therefore, in order to identify the live application run in the machine, game application is receiving the service of live application broadcast After information, it can be determined that the IP address and identification information included in the information on services whether the IP address and mark with the machine Information corresponds to unanimously, if corresponding consistent, illustrates the game application and the live application operation in same host, then the game should With passage can be linked based on socket is established between the consistent IP address and identification information and the live application.If It is inconsistent, then illustrate that the game application does not run on same host with the live application, then believe the service of the live application Breath is lost.
Since the private communication passage established is for obtaining barrage data, by using consistent IP address and end Slogan establishes private communication passage, it is possible to achieve under same WLAN (WIFI), opening other the live players that play Data filtering, improve data-handling efficiency.
Step S203, the barrage data of the live application acquirement are obtained by the private communication passage.
The barrage data are directed to the comment data just delivered in live game picture for the corresponding user of each terminal.
When watching live, can be made comments the corresponding user of each terminal data by corresponding terminal, and each terminal will The comment data that corresponding user delivers is sent to background server, which can be barrage server or game application Background server.During live, live application can send barrage to background server and obtain request, background service Device can obtain request according to the barrage and feed back barrage data to live application, and game application can be by between live application The private communication passage of foundation obtains the barrage data.
When game application obtains the barrage data by the private communication passage, preset protocol can be used, presets association View includes but not limited to transmission control protocol (Transmission Control Protocol, TCP) agreement, user datagram Agreement (User Datagram Protocol, UDP) agreement.Preferably, Transmission Control Protocol can be used, compared to udp protocol, TCP Consultation is safer, and data loss rate is lower.
Step S204, the barrage data are rendered in GPU, and the barrage data investigation after rendering is in current game Shown in picture.
Specifically, game application can call open graphic library embedded system OpenGL ES in GPU, and according to master The barrage display mode that broadcasting user is set renders barrage data.The barrage display mode includes：When barrage data are shown Font style, font size, font color and display effect.
Font style, font size, font color and display effect can voluntarily be set according to the actual requirements.Font sample Formula is for example：Regular script, the Song typeface, black matrix etc..Font size is for example：The size for the screen that electronic equipment can be combined is configured.Word Body color is for example：The color that game picture can be combined be configured, when picture for white when, font is arranged to black, red Color etc..Display effect is for example：Plane display effect, at the uniform velocity stereo display effect, display etc..
In addition, can also include other guide in the barrage display mode, such as display location etc., does not do specific limit herein It is fixed.
For OpenGL ES in order to lift the performance rendered, the data exchange between two region of memory defines buffering area (buffers) concept.Buffering area refers to continuous random access memory (the random access that GPU can be controlled and managed Memory, RAM).The memory of program from central processing unit (Central Processing Unit, CPU) copy data to The buffering area of OpenGL ES.By monopolizing buffering area, GPU being capable of read/write memory in an efficient way as far as possible.GPU is at it The ability of reason data is asynchronously applied on buffering area, it is meant that while GPU uses the datamation in buffering area, is operated in Program in CPU can continue to execute.GPU needs to know where memory to store the image pixel number for rendering and According to the buffering area for receiving rendering result is known as frame buffer zone (frame buffer).Render instruction can be replaced in due course Content in frame buffer zone, OpenGL ES can be according to particular platform hardware configurations and function setting data type and offset.Usually For, rendering result is possibly stored in any number of frame buffer zone.
Specifically in this embodiment, rendering pipeline can as shown in Figure 2 b, and render process can be as follows：
Vertical array (Vertex Array) or Buffer object (Buffer objects)：Connect by application programming Mouth (Application Programming Interface, API) acquisition vertex data (barrage data i.e. to be rendered, In OpenGL ES, all objects, geometric element are finally all stated in the form of an apex, and in general, these vertex will Triangle, straight line or point can be produced), vertex data is loaded into vertical array (Vertex Array) or Buffer object (Buffer objects)。
Vertex shader (Vertex Shader)：Programmable mode is passed through by vertex shader (Vertex Shader) Realize the operation of the vertex data in opposite vertexes array or Buffer object, such as carry out coordinate space conversion, calculate texture coordinate Deng.
Pel assembles (Primitive Assembly)：Vertex data after being handled by tinter is assembled in pel (Primitive Assembly) stage fitted to be element figure, and OpenGL ES support three kinds of element figures：Point, line and three Angular, they can be rendered by OpenGL ES.It is alternatively possible to be cut (clip) to the pel assembled, retain Pel in view frustums entirely, abandons pel completely not in view frustums, to half half not pel cut； Then rejecting processing (cull) is carried out to the pel in view frustums again, this process codified come determine be reject front, the back of the body Face or all rejecting.
Rasterize (Rasterization)：In rasterisation (Rasterization) stage, element figure is converted into two The piece of dimension is first (fragment), and piece member (fragment) represents the pixel that can be rendered on screen, it includes position, face The information such as color, texture coordinate, these values are to carry out interpolation calculation by the vertex information of pel to obtain.
Piece member tinter (Fragment Shader)：Piece member tinter realizes the behaviour to piece member by programmable mode Make.Piece member after it receives rasterization process in this stage, color, depth value, stencil value is as input.
Every atom operation (Per-Fragment Operation)：In each that this stage exports piece member tinter Piece member carries out a series of tests and processing, so as to determine eventually for the pixel rendered.
Frame buffer zone (Frame Buffer)：Final result writes into frame buffer zone (Frame Buffer).
It should be noted that barrage display methods provided in this embodiment, can be by the installation kit of game application Embedded software development kit (Software Development Kit, SDK) is realized.
In the present embodiment, game application starts game in live application, should to the game using the live application Game picture progress is live, then establishes private communication passage between the live application, passes through the private communication Passage obtains the barrage data that the live application obtains, and finally renders the barrage data in GPU, and by the bullet after rendering Curtain data investigation is shown in current game picture.I.e. in the embodiment of the present invention, communicate by using multi-process (more applications), Realize and show barrage when playing live, brand-new experience is brought to user, enhances the interaction between user.
In addition, transmitting barrage data by establishing private communication passage between applications, barrage data quilt can be prevented Eavesdropping.
Further, since the installation kit increment of game application is limited, realize that logic is placed on by the part for showing barrage Live application end, the whole that can avoid showing barrage realize logic be placed on game application end caused by game application installation kit The problem of volume is excessive.
The present embodiment will describe live broadcasting method from the angle of live broadcast device, and live application is provided with the live broadcast device, should Live broadcast device can be specifically integrated in the electronic equipment at main broadcaster end.
As shown in Figure 3a, the live broadcasting method of the present embodiment includes the following steps：
Step S301, direct broadcast function is started, the game picture progress to game application is live.
The method of the present embodiment, is mainly used in main broadcaster end, and main broadcaster end can install live application and game application at the same time, Main broadcaster using live application play live while game is played using game application.
In the specific implementation, when main broadcaster needs to carry out playing live, live application can start straight according to the operation of main broadcaster Multicast function, the game picture progress to game application are live.In the present embodiment, live application can be by the way of record screen be live Carry out live.For example live application can gather the screen mirror image and audio signal at main broadcaster end, to the screen mirror image and sound of collection After frequency signal is encoded, be sent to direct broadcast server, live data is sent to by direct broadcast server need to watch this it is live Each terminal, with this realize record screen it is live.Certainly, other modes progress can also be used live in practice, such as：Window is straight Broadcast, be not especially limited herein.
Hereafter, live application can open the zero configuration networking Bonjour services of itself, broadcast the information on services of itself, Comprising the host for running the live application in the information on services IP address and identification information (such as：Hostname, model Deng), the other informations such as service type, port numbers port can also be included certainly, be not specifically limited herein.
Zero configuration networking Bonjour, is that Apple Inc. is based on multicast domain name service (multicast Domain Name System opening zero) sets the name that network standard rises, be it is a kind of can inquire about automatically access equipment in network or The agreement of application.Using Bonjour equipment or application in a network automatic spread themselves information on services and listen to it Its equipment or the information on services of application, as greeting between equipment or application, Bonjour makes equipment in LAN or should With in the case of no network administrator, being also easy to be found.
The course of work of Bonjour can be summarized as：Notice and inquiry.Notice：Any one equipment or application access net Network, will notice the information of the whole network itself, such as IP address, port numbers, service type etc..Inquiry：Inquire about whole network in whether There is oneself desired service, or whether have the service accessed for oneself, inquire about in network with the presence or absence of conflict, inquire about purpose The IP address of host, port numbers etc..
After the information on services of itself is broadcasted, live application can be resided using predetermined manner in backstage carry out process, In order to avoid losing network connection, predetermined manner includes but not limited to following several：
(1) audio frequency control, can be in backstage lasting broadcast or recording.
(2) location updating is received, persistently obtains the geographical location and renewal of the machine.
(3) task of finite length is performed.
(4) magazine is downloaded, magazine class application special case, can download on backstage.
(5) network telephone service is provided.
Preferably, audio frequency control, i.e., the player module that live application can be provided on backstage using system, nothing can be used Limit cyclically plays an audio file, this audio file can be no sound, such as an empty or false audio File.
Step S302, private communication passage is established between the game application.
Since Bonjour is to utilize the form issuing service information broadcasted, all electronic equipments in LAN (including the machine) can receive the information on services.Such as there is n mobile phone carrying out live, hand shown in Fig. 3 b, such as in LAN After live application broadcast service information on machine 1, the game application on mobile phone 1 can receive the information on services, equally, mobile phone Game application on 2- mobile phones n can all receive the information on services.After each game application receives the information on services, all can Judge whether the live application is that live application in respective the machine (judges to carry in information on services based on the information on services Whether IP address is corresponding consistent with identification information with the IP address on identification information and respective the machine), if not each in the machine Live application, then corresponding information on services is lost.
Specifically in the above example, the game application in mobile phone 2- mobile phones n can all lose the information on services, in mobile phone 1 Game application retain the information on services, the live application on mobile phone 1 can be based on the IP address and mark carried in the information on services Socket, which is established, between knowledge information and the game application on mobile phone 1 links passage.After socket link Path Setups, Live application can close the Bonjour services of itself.
Step S303, barrage data are obtained, the barrage data are directed to just in live trip for the corresponding user of each terminal The comment data that play picture is delivered.
Live application carries out the game picture of currently running game application live, and the corresponding user of each terminal watches directly Broadcast, when watching, can be made comments data by corresponding terminal, and each terminal sends the comment data that corresponding user delivers To background server, which can be barrage server or the background server of game application.
During live, live application can send barrage to background server and obtain request, then receive backstage Server obtains the barrage data of request feedback according to the barrage.Alternatively, each terminal can also received by background server What is sent is directed to after the live barrage data using live game picture, directly answers the barrage data sending to live With live application receives the barrage data that background server is sent.
Step S304, the barrage data are sent to the game application by the private communication passage, so that The game application will be superimposed upon in current game picture after the barrage data render and show
Obtained barrage data are sent to trip by live application by the private communication passage established between game application Play application.During transmission, preset protocol can be used, preset protocol includes but not limited to transmission control protocol (Transmission Control Protocol, TCP) agreement, User Datagram Protocol (User Datagram Protocol, UDP) agreement.It is preferred that Ground, can use Transmission Control Protocol, compared to udp protocol, Transmission Control Protocol can be safer, and data loss rate is lower.
Game application can render the barrage data after barrage data are received in GPU, and after rendering Barrage data investigation is shown in current game picture.
After the game is over, live application can be from exiting from the background.
In the present embodiment, live application starts direct broadcast function, the game picture of game application is carried out it is live, then with institute State and private communication passage is established between game application, obtain barrage data, the barrage data are led to by the private communication Road is sent to the game application, so that the game application will be superimposed upon current game picture after the barrage data render Shown in face, the present embodiment realizes live barrage of playing and show, brought to user by using the mode of multiprocess communication Brand-new experience, enhances the interaction between user.
In addition, transmitting barrage data by establishing private communication passage, barrage data can be prevented to be ravesdropping, ensure that Data safety.
Further, since the installation kit increment of game application is limited, live application end has shared the reality that a part of barrage is shown Existing logic, the whole that can avoid showing barrage realize logic be placed on game application end caused by game application installation kit volume The problem of excessive.
The present embodiment will be described from the angle for live barrage display device of playing, and the live barrage of the game is shown Game application and live application are installed, the live barrage display device of the game can specifically be integrated in main broadcaster end in device In electronic equipment.
As shown in figure 4, the method for the present embodiment includes：
Step S401, live application starts direct broadcast function.
The method of the present embodiment, is mainly used in main broadcaster end, and main broadcaster end can install live application and game application at the same time, Main broadcaster using live application play live while game is played using game application.When main broadcaster needs play directly Sowing time, live application can start direct broadcast function according to the operation of main broadcaster.
Step S402, game application starts game in live application.
I.e. game application starts game according to the operation of main broadcaster user in live application.
Step S403, Bonjour services, the information on services of live broadcasting application are opened in live application.
Comprising the host for running the live application in the information on services IP address and identification information (such as：Host Title, model etc.), the other informations such as service type, port numbers port can also be included certainly, be not specifically limited herein.
Hereafter, the player module that live application can be provided on backstage using system, plays to Infinite Cyclic an audio File, this audio file can be no sound, such as an empty or false audio file, be carried out with realizing on backstage Process is resided, until game over.
Step S404, game application judges the IP address included in the information on services that receives and identification information and the machine Whether IP address is consistent with identification information, if unanimously, performing step S405, otherwise, performs step S409, abandons service letter Breath.
In order to identify the live application run in the machine, game application receive live application broadcast information on services it Afterwards, it can be determined that the IP address and identification information included in the information on services whether with the machine the host of operation (game application) IP address corresponded to identification information consistent, if corresponding consistent, illustrate the game application with the live application operation in same Host, then the game application can be based on establishing socket between the consistent IP address and identification information and the live application Socket links passage.If inconsistent, illustrate that the game application does not run on same host with the live application, then should The information on services of live application is lost.
Since the private communication passage established is for obtaining barrage data, by using consistent IP address and end Slogan establishes private communication passage, it is possible to achieve under same WLAN (WIFI), opening other the live players that play Data filtering, improve data-handling efficiency.
Step S405, game application establishes private communication using between consistent IP address and identification information and live application Passage.
The game application can be based on establishing socket between the consistent IP address and identification information and the live application Socket links passage.
Step S406, live application obtains barrage data.
Live application carries out the game picture of currently running game application live, and the corresponding user of each terminal watches directly Broadcast, when watching, can be made comments data by corresponding terminal, and each terminal sends the comment data that corresponding user delivers To background server, which can be barrage server or the background server of game application.
During live, live application can send barrage to background server and obtain request, then receive backstage Server obtains the barrage data of request feedback according to the barrage.
Step S407, game application obtains the barrage data of live application acquirement by private communication passage.
Step S408, game application renders the barrage data in GPU, and the barrage data investigation after rendering is being worked as Shown in preceding game picture.
Specifically, game application can call open graphic library embedded system OpenGL ES in GPU, and according to master The barrage display mode that broadcasting user is set renders barrage data.The barrage display mode includes：When barrage data are shown Font style, font size, font color and display effect.After barrage renders completion, the barrage data investigation after rendering Shown in current game picture.
After game over, live application from exiting from the background.
In the present embodiment, by using multi-process (more applications) communication, realize and show barrage when playing live, to use Family brings brand-new experience, enhances the interaction between user；Barrage data, energy are transmitted by establishing private communication passage Enough prevent barrage data to be ravesdropping, ensure that data safety；Further, since the installation kit increment of game application is limited, lead to Cross the part for showing barrage and realize that logic is placed on live application end, the whole that can avoid showing barrage realizes that logic is put Game application installation kit volume is excessive caused by game application end the problem of.
The embodiment of the present invention additionally provides a kind of barrage display device, as shown in figure 5, the present embodiment barrage display device bag Include：First start unit 501, first establish unit 502, first acquisition unit 503 and render processing unit 504, as follows：
First start unit 501, should to the game using the live application for starting game in live application Game picture carries out live；
First establishes unit 502, for establishing private communication passage between the live application；
First acquisition unit 503, for obtaining the barrage number of the live application acquirement by the private communication passage According to the barrage data are directed to the comment data just delivered in live game picture for the corresponding user of each terminal；
Render processing unit 504, for rendering the barrage data in graphics processor GPU, and by the bullet after rendering Curtain data investigation is shown in current game picture.
In certain embodiments, as shown in fig. 6, the barrage display device further includes：
Receiving unit 505, for receiving the information on services of the live application broadcast, operation is included in the information on services The Internet protocol address IP address and identification information of the host of the live application；
Judging unit 506, for Internet protocol address and identification information and this for judging to include in the information on services It is consistent whether the Internet protocol address of machine corresponds to identification information；
Described first, which establishes unit 502, is used for, and the Internet protocol address included in the information on services and mark are believed When breath is corresponding consistent with the Internet protocol address and identification information of the machine, perform establishing special lead between the live application The step of believing passage.
In certain embodiments, described first establish unit 502 and be specifically used for：
Socket is established using between the consistent Internet protocol address and identification information and the live application Socket links passage.
In certain embodiments, the render processing unit 504 is specifically used for：
The barrage data are rendered in graphics processor according to the barrage display mode of main broadcaster's user setting.
In certain embodiments, the barrage display mode includes：Font style, font when barrage data are shown is big Small, font color and display effect.
From the foregoing, it will be observed that in the present embodiment, using in barrage display device, by the first start unit 501 in live application It is middle to start game, it is live to the game picture progress of the game application using the live application, then established by first single Private communication passage is established between member 502 and the live application, first acquisition unit 503 is obtained by the private communication passage The barrage data for taking the live application to obtain, finally render the barrage data by render processing unit 504 in GPU, and Barrage data investigation after rendering is shown in current game picture.I.e. in the embodiment of the present invention, by using multi-process (more application) communication, realizes and shows barrage when playing live, brand-new experience is brought to user, enhances between user Interaction.
In addition, transmitting barrage data by establishing private communication passage, barrage data can be prevented to be ravesdropping, ensure that Data safety.
Further, since the installation kit increment of game application is limited, realize that logic is placed on by the part for showing barrage Live application end, the whole that can avoid showing barrage realize logic be placed on game application end caused by game application installation kit The problem of volume is excessive.
It when it is implemented, above modules can be realized as independent entity, can also be combined, be made Realized for same or several entities, the specific implementation of above modules can be found in embodiment of the method above, herein not Repeat again.
The embodiment of the present invention additionally provides a kind of live broadcast device, as shown in fig. 7, the present embodiment live broadcast device includes：Second Start unit 601, second establish unit 602, second acquisition unit 603 and transmitting element 604, as follows：
Second start unit 601, screen direct broadcast function is recorded for starting, and the game picture progress to game application is live；
Second establishes unit 602, for establishing private communication passage between the game application；
Second acquisition unit 603, for obtaining barrage data, the barrage data are the corresponding user of each terminal for just In the comment data that live game picture is delivered；
Transmitting element 604, for the barrage data to be sent to the game application by the private communication passage, Shown so that the game application will be superimposed upon in current game picture after the barrage data render.
In certain embodiments, as shown in figure 8, the live broadcast device further includes：
Radio unit 605, for opening zero configuration networking Bonjour services, broadcasts the information on services of the live application, The Internet protocol address IP address and identification information for the host for running the live application are included in the information on services.
In certain embodiments, described second establish unit 602 and be specifically used for：
Socket is established using between the Internet protocol address IP address and identification information and the game application Socket links passage.
In certain embodiments, as shown in figure 8, the second acquisition unit 603 includes：
Transmission sub-unit 6031, request is obtained for sending barrage to background server；
Receiving subelement 6032, the bullet for asking to feed back is obtained for receiving the background server according to the barrage Curtain data.
In certain embodiments, as shown in figure 8, the live broadcast device further includes：
Backstage resident element 606, for being resided using predetermined manner in backstage carry out process, until game over.
From the foregoing, it will be observed that in the present embodiment, using in live broadcast device, record is started by the second start unit 601 and shields live work( Can, the game picture progress to game application is live, is then established between unit 602 and the game application and is established specially by second With communication port, barrage data are obtained by second acquisition unit 603, are finally passed through the barrage data by transmitting element 604 The private communication passage is sent to the game application, so that the game application will be superimposed after the barrage data render Shown in current game picture, by using the mode of multiprocess communication, realize live barrage of playing and show, to use Family brings brand-new experience, enhances the interaction between user.
In addition, transmitting barrage data by establishing private communication passage, barrage data can be prevented to be ravesdropping, ensure that Data safety.
Further, since the installation kit increment of game application is limited, live application end has shared the reality that a part of barrage is shown Existing logic, the whole that can avoid showing barrage realize logic be placed on game application end caused by game application installation kit volume The problem of excessive.
It when it is implemented, above modules can be realized as independent entity, can also be combined, be made Realized for same or several entities, the specific implementation of above modules can be found in embodiment of the method above, herein not Repeat again.
Correspondingly, the embodiment of the present invention additionally provides a kind of live barrage display device of playing, as shown in figure 9, the trip The barrage display device 700 for playing live includes barrage display device 701 and live broadcast device 702.Wherein, the live bullet of the game Curtain display device 700 can be the electronic equipment at main broadcaster end, and the barrage display device 701 can be a game application client End, the live broadcast device 702 can be a live applications client, the game application client and the live applications client It is installed in the electronic equipment.
The barrage display device 701 and the live broadcast device 702 see the description of preceding embodiment, herein Repeat no more.
The embodiment of the present invention additionally provides a kind of electronic equipment, and as shown in Figure 10, it illustrates involved by the embodiment of the present invention And electronic equipment structure diagram, specifically：
The electronic equipment can include radio frequency (RF, Radio Frequency) circuit 801, include one or one with Memory 802, input unit 803, display unit 804, sensor 805, the voicefrequency circuit of upper computer-readable recording medium 806th, Wireless Fidelity (WiFi, Wireless Fidelity) module 807, include one or more than one processing core The component such as processor 808 and power supply 809.It will be understood by those skilled in the art that the structure of the electronic equipment shown in Figure 10 Do not form the restriction to electronic equipment, can include than illustrating more or fewer components, either combine some components or Different component arrangements.Wherein：
RF circuits 801 can be used for receive and send messages or communication process in, the reception and transmission of signal, especially, by base station After downlink information receives, transfer to one or more than one processor 808 is handled；In addition, will be related to the data sending of uplink to Base station.In general, RF circuits 801 include but not limited to antenna, at least one amplifier, tuner, one or more oscillators, use Family identity module (SIM, Subscriber Identity Module) card, transceiver, coupler, low-noise amplifier (LNA, Low Noise Amplifier), duplexer etc..In addition, RF circuits 801 can also pass through wireless communication and network and its His equipment communication.The wireless communication can use any communication standard or agreement, include but not limited to global system for mobile telecommunications system Unite (GSM, Global System of Mobile communication), general packet radio service (GPRS, General Packet Radio Service), CDMA (CDMA, Code Division Multiple Access), wideband code division it is more Location (WCDMA, Wideband Code Division Multiple Access), Long Term Evolution (LTE, Long Term Evolution), Email, Short Message Service (SMS, Short Messaging Service) etc..
Memory 802 can be used for storage software program and module, and processor 808 is stored in memory 802 by operation Software program and module, so as to perform various functions application and data processing.Memory 802 can mainly include storage journey Sequence area and storage data field, wherein, storing program area can storage program area, the application program (ratio needed at least one function Such as sound-playing function, image player function) etc.；Storage data field can be stored uses created number according to electronic equipment According to (such as voice data, phone directory etc.) etc..In addition, memory 802 can include high-speed random access memory, can also wrap Include nonvolatile memory, a for example, at least disk memory, flush memory device or other volatile solid-state parts. Correspondingly, memory 802 can also include Memory Controller, to provide processor 808 and input unit 803 to memory 802 access.
Input unit 803 can be used for the numeral or character information for receiving input, and produce and user setting and function Control related keyboard, mouse, operation lever, optics or the input of trace ball signal.Specifically, in a specific embodiment In, input unit 803 may include touch sensitive surface and other input equipments.Touch sensitive surface, also referred to as touch display screen or tactile Control plate, collect user on it or neighbouring touch operation (such as user using any suitable object such as finger, stylus or Operation of the annex on touch sensitive surface or near touch sensitive surface), and corresponding connection dress is driven according to formula set in advance Put.Optionally, touch sensitive surface may include both touch detecting apparatus and touch controller.Wherein, touch detecting apparatus is examined The touch orientation of user is surveyed, and detects the signal that touch operation is brought, transmits a signal to touch controller；Touch controller from Touch information is received on touch detecting apparatus, and is converted into contact coordinate, then gives processor 808, and can reception processing Order that device 808 is sent simultaneously is performed.It is furthermore, it is possible to a variety of using resistance-type, condenser type, infrared ray and surface acoustic wave etc. Type realizes touch sensitive surface.Except touch sensitive surface, input unit 803 can also include other input equipments.Specifically, other are defeated Enter equipment and can include but is not limited to physical keyboard, function key (such as volume control button, switch key etc.), trace ball, mouse One or more in mark, operation lever etc..
Display unit 804 is available for the information and electronic equipment for showing by information input by user or being supplied to user Various graphical user interface, these graphical user interface can be made of figure, text, icon, video and its any combination. Display unit 804 may include display panel, optionally, can use liquid crystal display (LCD, Liquid Crystal Display), the form such as Organic Light Emitting Diode (OLED, Organic Light-Emitting Diode) configures display surface Plate.Further, touch sensitive surface can cover display panel, when touch sensitive surface is detected on it or after neighbouring touch operation, Processor 808 is sent to determine the type of touch event, is followed by subsequent processing device 808 according to the type of touch event in display panel It is upper that corresponding visual output is provided.Although in Fig. 10, touch sensitive surface is that the component independent as two comes in fact with display panel Now input and input function, but in some embodiments it is possible to by touch sensitive surface and display panel integrate and realize input and Output function.
Electronic equipment may also include at least one sensor 805, such as optical sensor, motion sensor and other sensings Device.Specifically, optical sensor may include ambient light sensor and proximity sensor, wherein, ambient light sensor can be according to environment The light and shade of light adjusts the brightness of display panel, proximity sensor can when terminal is moved in one's ear, close display panel and/ Or backlight.As one kind of motion sensor, gravity accelerometer can detect in all directions (generally three axis) and accelerate The size of degree, can detect that size and the direction of gravity when static, the application available for identification electronic equipment posture is (such as vertical and horizontal Shield switching, dependent game, magnetometer pose calibrating), Vibration identification correlation function (such as pedometer, percussion) etc.；As for electronics The other sensors such as gyroscope that equipment can also configure, barometer, hygrometer, thermometer, infrared ray sensor, it is no longer superfluous herein State.
Voicefrequency circuit 806, loudspeaker, microphone can provide the audio interface between user and terminal.Voicefrequency circuit 806 can By the transformed electric signal of the voice data received, loudspeaker is transferred to, voice signal output is converted to by loudspeaker；It is another The voice signal of collection is converted to electric signal by aspect, microphone, and voice data is converted to after being received by voicefrequency circuit 806, then After voice data output processor 808 is handled, through RF circuits 801 to be sent to such as another electronic equipment, or by audio Data are exported to memory 802 further to handle.Voicefrequency circuit 806 is also possible that earphone jack, to provide peripheral hardware ear The communication of machine and electronic equipment.
WiFi belongs to short range wireless transmission technology, and electronic equipment can help user to receive and dispatch electricity by WiFi module 807 Sub- mail, browse webpage and access streaming video etc., it has provided wireless broadband internet to the user and has accessed.Although Figure 10 shows Go out WiFi module 807, but it is understood that, it is simultaneously not belonging to must be configured into for electronic equipment, completely can be according to need To be omitted in the essential scope for do not change invention.
Processor 808 is the control centre of electronic equipment, utilizes various interfaces and each portion of connection whole device Point, by running or performing the software program and/or module that are stored in memory 802, and call and be stored in memory 802 Interior data, perform the various functions and processing data of electronic equipment, so as to carry out integral monitoring to electronic equipment.Optionally, Processor 808 may include one or more processing cores；Preferably, processor 808 can integrate application processor and modulation /demodulation Processor, wherein, application processor mainly handles operating system, user interface and application program etc., modem processor master Handle wireless communication.It is understood that above-mentioned modem processor can not also be integrated into processor 808.
Electronic equipment further includes the power supply 809 (such as battery) to all parts power supply, it is preferred that power supply can pass through electricity Management system and processor 808 are logically contiguous, so as to realize management charging, electric discharge and power consumption by power-supply management system The functions such as management.Power supply 809 can also include one or more direct current or AC power, recharging system, power supply event Hinder the random components such as detection circuit, power supply changeover device or inverter, power supply status indicator.
Although being not shown, electronic equipment can also include camera, bluetooth module etc., and details are not described herein.
Specifically in the present embodiment, processor 808 in electronic equipment can according to following instruction, by one or one with On the corresponding executable file of process of application program be loaded into memory 802, and be stored in by processor 808 to run Application program in memory 802, so as to fulfill following various functions：
Start game in live application, the game picture of the game application is carried out using the live application straight Broadcast；
Private communication passage is established between the live application；
The barrage data of the live application acquirement are obtained by the private communication passage, the barrage data are each end Corresponding user is held to be directed to the comment data just delivered in live game picture；
The barrage data are rendered in graphics processor GPU, and the barrage data investigation after rendering is in current trip Shown in play picture.
In some embodiments, before establishing private communication passage between the live application, processor 808 is also For performing following steps：
The information on services of the live application broadcast is received, the master for running the live application is included in the information on services The Internet protocol address IP address and identification information of machine；
With judging the Internet protocol address and the Internet protocol of identification information and the machine that are included in the information on services It is consistent whether location corresponds to identification information；
If corresponding consistent, the step of establishing private communication passage between the live application is performed.
In some embodiments, when establishing private communication passage between the live application, processor 808 is specific For performing following steps：
Socket is established using between the consistent Internet protocol address and identification information and the live application Socket links passage.
In some embodiments, when the barrage data are rendered in graphics processor, processor 808 is specifically used for holding Row following steps：
The barrage data are rendered in graphics processor according to the barrage display mode of main broadcaster's user setting.
In some embodiments, the barrage display mode includes：Font style, font when barrage data are shown Size, font color and display effect.
Specifically in the present embodiment, the processor 808 in electronic equipment can also be according to following instruction, by one or one The corresponding executable file of process of application program above is loaded into memory 802, and runs storage by processor 808 Application program in memory 802, so as to fulfill following various functions：
Start direct broadcast function, the game picture progress to game application is live；
Private communication passage is established between the game application；
Barrage data are obtained, the barrage data are directed to for the corresponding user of each terminal and are just delivered in live game picture Comment data；
The barrage data are sent to the game application by the private communication passage, so that the game should Shown with will be superimposed upon after the barrage data render in current game picture.
In some embodiments, established between the game application before private communication passage, processor 808 is also For performing following steps：
Zero configuration networking Bonjour services are opened, the information on services of the live application is broadcasted, is wrapped in the information on services Internet protocol address IP address and identification information containing the host for running the live application.
In some embodiments, when private communication passage is established between the game application, processor 808 is specific For performing following steps：
Socket is established using between the Internet protocol address IP address and identification information and the game application Socket links passage.
In some embodiments, when obtaining barrage data, processor 808 is specifically used for performing following steps：
Barrage, which is sent, to background server obtains request；
Receive the barrage data that the background server obtains request feedback according to the barrage.
In some embodiments, record screen direct broadcast function starting, the game picture of game application is carried out it is live after, Processor 808 is additionally operable to perform following steps：
Resided using predetermined manner in backstage carry out process, until game over.
The present embodiment in the electronic device, by using multi-process (more applications) communication, is realized and shown when playing live Show barrage, brand-new experience is brought to user, enhance the interaction between user；Transmitted by establishing private communication passage Barrage data, can prevent barrage data to be ravesdropping, ensure that data safety；Further, due to the installation kit of game application Increment is limited, realizes that logic is placed on live application end by the part for showing barrage, can avoid showing barrage complete Portion realize logic be placed on game application end caused by game application installation kit volume it is excessive the problem of.
In several embodiments provided herein, it should be understood that disclosed system, apparatus and method can be with Realize by another way.For example, device embodiment described above is only schematical, for example, the unit Division, is only a kind of division of logic function, can there is other dividing mode, such as multiple units or component when actually realizing Another system can be combined or be desirably integrated into, or some features can be ignored, or do not perform.It is another, it is shown or The mutual coupling, direct-coupling or communication connection discussed can be the indirect coupling by some interfaces, device or unit Close or communicate to connect, can be electrical, machinery or other forms.The unit illustrated as separating component can be or It may not be physically separate, physical location may or may not be as the component that unit is shown, you can with Positioned at a place, or can also be distributed in multiple network unit.Part therein can be selected according to the actual needs Or whole units realize the purpose of this embodiment scheme.
In addition, each functional unit in each embodiment of the present invention can be integrated in a processing unit, can also That unit is individually physically present, can also two or more units integrate in a unit.Above-mentioned integrated list Member can both be realized in the form of hardware, can also be realized in the form of SFU software functional unit.The integrated unit is such as Fruit realized in the form of SFU software functional unit and as independent production marketing or in use, a computer can be stored in can Read in storage medium.Based on such understanding, technical scheme substantially in other words contributes the prior art Part or all or part of the technical solution can be embodied in the form of software product, the computer software product It is stored in a storage medium, including some instructions are used so that a computer equipment (can be personal computer, fill Put, or network equipment etc.) perform all or part of step of each embodiment the method for the present invention.And foregoing storage is situated between Matter includes：USB flash disk, mobile hard disk, read-only storage (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disc or CD etc. are various can be with the medium of store program codes.
The above, the above embodiments are merely illustrative of the technical solutions of the present invention, rather than its limitations；Although with reference to before Embodiment is stated the present invention is described in detail, it will be understood by those of ordinary skill in the art that：It still can be to preceding State the technical solution described in each embodiment to modify, or equivalent substitution is carried out to which part technical characteristic；And these Modification is replaced, and the essence of appropriate technical solution is departed from the spirit and scope of various embodiments of the present invention technical solution.

Claims (15)

  1. A kind of 1. barrage display methods, applied to the game application in live barrage display device of playing, it is characterised in that institute Stating barrage display methods includes：
    Start game in live application, the game picture of the game application is carried out using the live application live；
    Private communication passage is established between the live application；
    The barrage data of the live application acquirement are obtained by the private communication passage, the barrage data are each terminal-pair The user answered is directed to the comment data just delivered in live game picture；
    The barrage data are rendered in graphics processor GPU, and the barrage data investigation after rendering is in current game picture Shown in face.
  2. 2. barrage display methods according to claim 1, it is characterised in that established between the live application special Before communication port, further include：
    The information on services of the live application broadcast is received, the host for running the live application is included in the information on services Internet protocol address IP address and identification information；
    Judge the Internet protocol address that is included in the information on services and identification information and the machine Internet protocol address and Whether identification information corresponds to unanimously；
    If corresponding consistent, the step of establishing private communication passage between the live application is performed.
  3. 3. barrage display methods according to claim 2, it is characterised in that described to be established specially between the live application With communication port, including：
    Socket is established using between the consistent Internet protocol address and identification information and the live application Link passage.
  4. 4. the barrage display methods according to claims 1 to 3 any one, it is characterised in that described in graphics processor The barrage data are inside rendered, including：
    The barrage data are rendered in the graphics processor according to the barrage display mode of main broadcaster's user setting.
  5. 5. barrage display methods according to claim 4, it is characterised in that the barrage display mode includes：Barrage Font style, font size, font color and display effect when data are shown.
  6. 6. a kind of live broadcasting method, applied to the live application in live barrage display device of playing, it is characterised in that described straight Broadcasting method includes：
    Start direct broadcast function, the game picture progress to game application is live；
    Private communication passage is established between the game application；
    Barrage data are obtained, the barrage data are directed to for the corresponding user of each terminal and are just commented what live game picture was delivered By data；
    The barrage data are sent to the game application by the private communication passage, so that the game application will It is superimposed upon in current game picture and shows after the barrage data render.
  7. 7. live broadcasting method according to claim 6, it is characterised in that establish private communication between the game application Before passage, further include：
    Zero configuration networking Bonjour services are opened, the information on services of the live application is broadcasted, fortune is included in the information on services The Internet protocol address IP address and identification information of the host of the row live application.
  8. 8. live broadcasting method according to claim 7, it is characterised in that described that special lead to is established between the game application Believe passage, including：
    Socket is established using between the Internet protocol address IP address and identification information and the game application Link passage.
  9. 9. live broadcasting method according to claim 6, it is characterised in that the acquisition barrage data, including：
    Barrage, which is sent, to background server obtains request；
    Receive the barrage data that the background server obtains request feedback according to the barrage.
  10. 10. according to the live broadcasting method described in claim 6 to 9 any one, it is characterised in that starting direct broadcast function, to trip After the game picture progress applied of playing is live, further include：
    Resided using predetermined manner in backstage carry out process, until game over.
  11. A kind of 11. barrage display device, it is characterised in that including：
    First start unit, for starting game in live application, utilizes trip of the live application to the game application Picture of playing carries out live；
    First establishes unit, for establishing private communication passage between the live application；
    First acquisition unit, it is described for obtaining the barrage data of the live application acquirement by the private communication passage Barrage data are directed to the comment data just delivered in live game picture for the corresponding user of each terminal；
    Render processing unit, for rendering the barrage data in graphics processor GPU, and the barrage stacked data after rendering It is added in current game picture and shows.
  12. 12. barrage display device according to claim 11, it is characterised in that described device further includes：
    Receiving unit, it is described straight to include operation for receiving the information on services of the live application broadcast, in the information on services Broadcast the Internet protocol address IP address and identification information of the host of application；
    Judging unit, for the interconnection of the Internet protocol address and identification information and the machine that judge to include in the information on services It is consistent whether fidonetFido address corresponds to identification information；
    Described first, which establishes unit, is used for, the Internet protocol address and identification information and the machine included in the information on services Internet protocol address when corresponding to consistent with identification information, perform and establish private communication passage between the live application Step.
  13. A kind of 13. live broadcast device, it is characterised in that including：
    Second start unit, for starting direct broadcast function, the game picture progress to game application is live；
    Second establishes unit, for establishing private communication passage between the game application；
    Second acquisition unit, for obtaining barrage data, the barrage data are directed to just live for the corresponding user of each terminal The comment data delivered of game picture；
    Transmitting element, for the barrage data to be sent to the game application by the private communication passage, so that The game application will be superimposed upon in current game picture after the barrage data render and show.
  14. 14. live broadcast device according to claim 13, it is characterised in that the second acquisition unit includes：
    Transmission sub-unit, request is obtained for sending barrage to background server；
    Receiving subelement, the barrage data for asking to feed back are obtained for receiving the background server according to the barrage.
  15. 15. a kind of live barrage display device of playing, it is characterised in that including the barrage according to claim 11 or 12 Display device, and the live broadcast device according to claim 13 or 14.
CN201711100419.4A 2017-11-09 2017-11-09 Barrage display method, live broadcast method and related devices Active CN107911708B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201711100419.4A CN107911708B (en) 2017-11-09 2017-11-09 Barrage display method, live broadcast method and related devices

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201711100419.4A CN107911708B (en) 2017-11-09 2017-11-09 Barrage display method, live broadcast method and related devices

Publications (2)

Publication Number Publication Date
CN107911708A true CN107911708A (en) 2018-04-13
CN107911708B CN107911708B (en) 2022-04-05

Family

ID=61843952

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201711100419.4A Active CN107911708B (en) 2017-11-09 2017-11-09 Barrage display method, live broadcast method and related devices

Country Status (1)

Country Link
CN (1) CN107911708B (en)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108966035A (en) * 2018-09-03 2018-12-07 武汉斗鱼网络科技有限公司 Barrage method for message transmission, device, equipment and storage medium
CN109522085A (en) * 2018-11-28 2019-03-26 珠海金山网络游戏科技有限公司 Data processing method, calculates equipment and storage medium at device
CN110312145A (en) * 2019-08-09 2019-10-08 厦门星海无限科技有限公司 The method of interactive game, storage medium are carried out based on live streaming barrage and spectators
CN110636324A (en) * 2019-10-24 2019-12-31 腾讯科技（深圳）有限公司 Interface display method and device, computer equipment and storage medium
CN110870975A (en) * 2019-11-18 2020-03-10 网易（杭州）网络有限公司 Game live broadcast processing method, device, equipment and computer-readable storage medium
EP3623938A1 (en) * 2018-09-12 2020-03-18 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Game rendering method and apparatus, and non-transitory computer-readable storage medium
CN111343508A (en) * 2020-02-28 2020-06-26 网易（杭州）网络有限公司 Information display control method and device, electronic equipment and storage medium
CN113115115A (en) * 2021-03-05 2021-07-13 广州虎牙科技有限公司 Message pushing method and device, electronic equipment and computer-readable storage medium
CN113315982A (en) * 2021-05-07 2021-08-27 广州虎牙科技有限公司 Live broadcast method, computer storage medium and equipment
CN115243110A (en) * 2022-06-22 2022-10-25 广州博冠信息科技有限公司 Barrage display method and device, computer equipment and storage medium

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030219022A1 (en) * 2002-01-28 2003-11-27 Hughes Electronics Method and system for utilizing virtual private network (VPN) connections in a performance enhanced network
US20140215508A1 (en) * 2013-01-25 2014-07-31 Youtoo Technologies Llc Distributing Graphic Content Over a Public Network for Inclusion in a Linear Television Broadcast
CN105435453A (en) * 2015-12-22 2016-03-30 网易（杭州）网络有限公司 Bullet screen information processing method, device and system
CN105597321A (en) * 2015-12-18 2016-05-25 武汉斗鱼网络科技有限公司 Barrage display method and system in full-screen game state
CN105872653A (en) * 2016-03-21 2016-08-17 乐视网信息技术（北京）股份有限公司 Transmission method and device of barrage
WO2017008551A1 (en) * 2015-07-13 2017-01-19 腾讯科技（深圳）有限公司 Bullet screen display method and apparatus
US9565158B1 (en) * 2012-06-14 2017-02-07 Symantec Corporation Systems and methods for automatically configuring virtual private networks
CN106488296A (en) * 2016-10-18 2017-03-08 广州酷狗计算机科技有限公司 A kind of method and apparatus of display video barrage
CN106528096A (en) * 2016-10-20 2017-03-22 武汉斗鱼网络科技有限公司 Method and system for drawing popup image on D3D12 full screen game source
CN106658145A (en) * 2016-12-27 2017-05-10 北京奇虎科技有限公司 Live data processing method and device
CN107396199A (en) * 2017-08-02 2017-11-24 武汉斗鱼网络科技有限公司 Barrage method for exhibiting data and device, computer-readable recording medium

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030219022A1 (en) * 2002-01-28 2003-11-27 Hughes Electronics Method and system for utilizing virtual private network (VPN) connections in a performance enhanced network
US9565158B1 (en) * 2012-06-14 2017-02-07 Symantec Corporation Systems and methods for automatically configuring virtual private networks
US20140215508A1 (en) * 2013-01-25 2014-07-31 Youtoo Technologies Llc Distributing Graphic Content Over a Public Network for Inclusion in a Linear Television Broadcast
WO2017008551A1 (en) * 2015-07-13 2017-01-19 腾讯科技（深圳）有限公司 Bullet screen display method and apparatus
CN105597321A (en) * 2015-12-18 2016-05-25 武汉斗鱼网络科技有限公司 Barrage display method and system in full-screen game state
CN105435453A (en) * 2015-12-22 2016-03-30 网易（杭州）网络有限公司 Bullet screen information processing method, device and system
CN105872653A (en) * 2016-03-21 2016-08-17 乐视网信息技术（北京）股份有限公司 Transmission method and device of barrage
CN106488296A (en) * 2016-10-18 2017-03-08 广州酷狗计算机科技有限公司 A kind of method and apparatus of display video barrage
CN106528096A (en) * 2016-10-20 2017-03-22 武汉斗鱼网络科技有限公司 Method and system for drawing popup image on D3D12 full screen game source
CN106658145A (en) * 2016-12-27 2017-05-10 北京奇虎科技有限公司 Live data processing method and device
CN107396199A (en) * 2017-08-02 2017-11-24 武汉斗鱼网络科技有限公司 Barrage method for exhibiting data and device, computer-readable recording medium

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
熊师等: "华丽弹幕游戏中子弹运动引擎的设计与实现", 《井冈山学院学报》 *

Cited By (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108966035A (en) * 2018-09-03 2018-12-07 武汉斗鱼网络科技有限公司 Barrage method for message transmission, device, equipment and storage medium
CN108966035B (en) * 2018-09-03 2021-02-02 武汉斗鱼网络科技有限公司 Barrage message transmission method, device, equipment and storage medium
EP3623938A1 (en) * 2018-09-12 2020-03-18 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Game rendering method and apparatus, and non-transitory computer-readable storage medium
US10866818B2 (en) 2018-09-12 2020-12-15 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Game rendering method, terminal device, and non-transitory computer-readable storage medium
CN109522085A (en) * 2018-11-28 2019-03-26 珠海金山网络游戏科技有限公司 Data processing method, calculates equipment and storage medium at device
CN109522085B (en) * 2018-11-28 2022-02-01 珠海金山网络游戏科技有限公司 Data processing method and device, computing equipment and storage medium
CN110312145A (en) * 2019-08-09 2019-10-08 厦门星海无限科技有限公司 The method of interactive game, storage medium are carried out based on live streaming barrage and spectators
CN110636324B (en) * 2019-10-24 2021-06-11 腾讯科技（深圳）有限公司 Interface display method and device, computer equipment and storage medium
CN110636324A (en) * 2019-10-24 2019-12-31 腾讯科技（深圳）有限公司 Interface display method and device, computer equipment and storage medium
CN110870975A (en) * 2019-11-18 2020-03-10 网易（杭州）网络有限公司 Game live broadcast processing method, device, equipment and computer-readable storage medium
CN110870975B (en) * 2019-11-18 2023-06-27 网易（杭州）网络有限公司 Method, device and equipment for processing live game and computer readable storage medium
WO2021169092A1 (en) * 2020-02-28 2021-09-02 网易（杭州）网络有限公司 Information display control method and apparatus, electronic device and storage medium
CN111343508A (en) * 2020-02-28 2020-06-26 网易（杭州）网络有限公司 Information display control method and device, electronic equipment and storage medium
CN113115115A (en) * 2021-03-05 2021-07-13 广州虎牙科技有限公司 Message pushing method and device, electronic equipment and computer-readable storage medium
CN113315982A (en) * 2021-05-07 2021-08-27 广州虎牙科技有限公司 Live broadcast method, computer storage medium and equipment
CN115243110A (en) * 2022-06-22 2022-10-25 广州博冠信息科技有限公司 Barrage display method and device, computer equipment and storage medium
CN115243110B (en) * 2022-06-22 2024-03-01 广州博冠信息科技有限公司 Bullet screen display method, bullet screen display device, computer equipment and storage medium

Also Published As

Publication number Publication date
CN107911708B (en) 2022-04-05

Similar Documents

Publication Publication Date Title
CN107911708A (en) Barrage display methods, live broadcasting method and relevant apparatus
CN103905885B (en) Net cast method and device
CN106101756B (en) Barrage display methods, barrage adding method, apparatus and system
CN104573597B (en) A kind of two-dimensional code identification method and device
CN107438200A (en) The method and apparatus of direct broadcasting room present displaying
CN105183296B (en) interactive interface display method and device
CN106101736A (en) The methods of exhibiting of a kind of virtual present and system
CN106911900A (en) Video dubbing method and device
CN106534941A (en) Method and device for realizing video interaction
CN108287744A (en) Character displaying method, device and storage medium
CN104426963B (en) The method and terminal of associated terminal
CN106686396A (en) Method and system for switching broadcasting rooms
CN106162316A (en) The data processing method of a kind of video flowing, device and system
CN106412691A (en) Interception method and device of video images
CN104967865B (en) Video previewing method and device
CN106231433B (en) A kind of methods, devices and systems playing network video
CN107770618A (en) A kind of image processing method, device and storage medium
CN109271327A (en) EMS memory management process and device
CN103699309B (en) A kind of method for recording of synchronization video, device and mobile terminal
CN105828160A (en) Video play method and apparatus
CN106973330A (en) A kind of screen live broadcasting method, device and system
CN107276984B (en) Game live broadcast method and device and mobile terminal
CN105208458A (en) Virtual frame display method and device
CN106302087A (en) Instant communication method, Apparatus and system
CN106293901A (en) The process management method of a kind of terminal applies and device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant