CN106792034A - Live method and mobile terminal is carried out based on mobile terminal - Google Patents

Live method and mobile terminal is carried out based on mobile terminal Download PDF

Info

Publication number
CN106792034A
CN106792034A CN201710075454.9A CN201710075454A CN106792034A CN 106792034 A CN106792034 A CN 106792034A CN 201710075454 A CN201710075454 A CN 201710075454A CN 106792034 A CN106792034 A CN 106792034A
Authority
CN
China
Prior art keywords
live
message
mobile terminal
video
packet loss
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201710075454.9A
Other languages
Chinese (zh)
Inventor
曾金龙
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Skyworth RGB Electronics Co Ltd
Original Assignee
Shenzhen Skyworth RGB Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Skyworth RGB Electronics Co Ltd filed Critical Shenzhen Skyworth RGB Electronics Co Ltd
Priority to CN201710075454.9A priority Critical patent/CN106792034A/en
Publication of CN106792034A publication Critical patent/CN106792034A/en
Pending legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/414—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
    • H04N21/41407—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/254—Management at additional data server, e.g. shopping server, rights management server
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/27—Server based end-user applications
    • H04N21/274—Storing end-user multimedia data in response to end-user request, e.g. network recorder
    • H04N21/2743—Video hosting of uploaded data from client
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
    • H04N21/4334—Recording operations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/438—Interfacing the downstream path of the transmission network originating from a server, e.g. retrieving encoded video stream packets from an IP network
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47202—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting content on demand, e.g. video on demand
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/475—End-user interface for inputting end-user data, e.g. personal identification number [PIN], preference data
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/643—Communication protocols

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Human Computer Interaction (AREA)
  • General Engineering & Computer Science (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

Live method is carried out based on mobile terminal the invention discloses a kind of, including：When mobile terminal is detected for main broadcaster end, beautify strategy according to video carries out landscaping treatment to the video that mobile terminal is recorded, and obtains beautifying video data；Beautification video data is uploaded to streaming media server, for the beautification video data of viewer end receiving stream media server distribution；The live message that message server sends is received, the corresponding region that the mobile terminal is shown in after Mobile state packet loss is processed is entered to the live message.The invention also discloses a kind of mobile terminal.By the inventive method, in live, the treatment of Mobile state packet loss is entered to the live message at main broadcaster end and viewer end, can effectively reduce animation and text information in living broadcast interactive and cross the interim card for bringing, lift the interactive experience of live middle main broadcaster and spectators.

Description

Live method and mobile terminal is carried out based on mobile terminal
Technical field
The present invention relates to live broadcast of mobile terminal technical field, more particularly to live method and shifting is carried out based on mobile terminal Dynamic terminal.
Background technology
With the communication technology develop rapidly and the function of mobile terminal increasingly strengthens, the range of application of mobile terminal is Through the personal field that people's daily life is expanded to from traditional communications field.At present, mobile terminal common configuration pixel high Camera, and possess stronger communication capacity, be widely used in remote video communication scene, therefore movement is live also should Transport and give birth to.In movement is live, the interaction of main broadcaster end and viewer end is essential link, but when live online number very It is many, and interaction message amount is big, when the animation amount such as give a present is big, if be not managed to live message, in fact it could happen that animation Interim card, Hua Ping, message brush not out, message delay, a series of problems, such as lose important payment message so that live middle master The interactive experience broadcast between spectators can be very poor.
The content of the invention
It is a primary object of the present invention to solve technical problem not enough to the management of live message optimisation in the prior art.
To achieve the above object, a kind of of present invention offer carries out live method and mobile terminal based on mobile terminal, Including：
When mobile terminal is detected for main broadcaster end, beautify strategy according to video carries out U.S. to the video that mobile terminal is recorded Change is processed, and obtains beautifying video data；
Beautification video data is uploaded to streaming media server, for described in the distribution of viewer end receiving stream media server Beautification video data；
The live message that message server sends is received, institute is shown in after the treatment of Mobile state packet loss is entered to the live message State the corresponding region of mobile terminal.
Preferably, it is described to receive the live message that message server sends, the live message is entered at Mobile state packet loss The corresponding region that the mobile terminal is shown in after reason includes：
The live message that message server sends is received, the live message is classified；
According to the classification of live message, after the treatment of Mobile state packet loss is entered to the live message, it is shown in described mobile whole The corresponding region at end.
Preferably, the classification according to live message, after the treatment of Mobile state packet loss is entered to the live message, is shown in The corresponding region of the mobile terminal includes：
Judge whether the utilization rate of CPU and/or GPU reaches predetermined threshold value；
If the utilization rate of CPU and/or GPU reaches predetermined threshold value, according to preset dynamic packet loss strategy to described live Message enters the treatment of Mobile state packet loss；
According to the classification of live message, by by the live message after the treatment of dynamic packet loss, the mobile terminal is shown in Corresponding region.
Preferably, it is described when main broadcaster starts recorded video, strategy is beautified according to video the video recorded is beautified Treatment, obtains including before beautification video data：
The video beautification instruction based on user's operation triggering is received, is beautified according to the video and instructed, generation video beautification Strategy.
Preferably, it is described to receive the live message that message server sends, the live message is entered at Mobile state packet loss Being shown in after reason after the corresponding region of the mobile terminal includes：
When main broadcaster terminates recorded video, communicated with message server and streaming media server, so that message takes Business device issue program request address.
Preferably, it is described live method is carried out based on mobile terminal also to include：
When mobile terminal is detected for viewer end, the beautification video data of receiving stream media server distribution；
The live message that message server sends is received, the live message is entered and is shown after Mobile state packet loss is processed and moved The corresponding region of dynamic terminal.
Additionally, to achieve the above object, the present invention also provides a kind of mobile terminal, including：
Beautification module, for when mobile terminal is detected for main broadcaster end, beautifying strategy according to video and being recorded to mobile terminal The video of system carries out landscaping treatment, obtains beautifying video data；
Uploading module, for beautification video data to be uploaded into streaming media server, so that viewer end receiving stream media takes The beautification video data of business device distribution；
Receiver module, the live message for receiving message server transmission, Mobile state packet loss is entered to the live message The corresponding region of the mobile terminal is shown in after treatment.
Preferably, the receiver module includes：
Taxon, the live message for receiving message server transmission, classifies to the live message；
Display unit, for the classification according to live message, after the treatment of Mobile state packet loss is entered to the live message, display In the corresponding region of the mobile terminal.
Preferably, the display unit includes：
Whether judgment sub-unit, the utilization rate for judging CPU and/or GPU reaches predetermined threshold value；
Treatment subelement, if reaching predetermined threshold value for the utilization rate of CPU and/or GPU, according to preset dynamic packet loss Strategy enters the treatment of Mobile state packet loss to the live message；
Display subelement, for the classification according to live message, by by the live message after the treatment of dynamic packet loss, display In the corresponding region of the mobile terminal.
Preferably, the mobile terminal also includes：
Policy generation module, instruction is beautified for receiving the video based on user's operation triggering, is beautified according to the video Instruction, generation video beautification strategy.
Preferably, the mobile terminal also includes：
Communication module, for when main broadcaster terminates recorded video, being led to message server and streaming media server Letter, for message server issue program request address.
Preferably, the mobile terminal also includes：
Video reception module, for when detect mobile terminal for viewer end when, receiving stream media server distribution U.S. Change video data；
Message reception module, the live message for receiving message server transmission, Mobile state is entered to the live message The corresponding region of mobile terminal is shown in after packet loss treatment.
In the present invention, landscaping treatment is carried out to the video that main broadcaster end is recorded, the video data after landscaping treatment is uploaded to Streaming media server, so that viewer end receives beautification video data, lifting spectators watch the visual experience of video；To main broadcaster end And the live message of viewer end enters the treatment of Mobile state packet loss, animation and text information overload in living broadcast interactive can be effectively reduced The interim card brought, lifts the interactive experience of live middle main broadcaster and spectators.
Brief description of the drawings
Fig. 1 is the schematic flow sheet that the present invention carries out live method first embodiment based on mobile terminal；
Fig. 2 is the structural representation of the embodiment of player rendering layer one；
Fig. 3 is the schematic diagram that main broadcaster end and/or the live framework of viewer end are layered an embodiment；
Fig. 4 is the schematic diagram of the embodiment of state classification one of state layer；
Fig. 5 is the schematic diagram of the embodiment of live messaging flow one；
Fig. 6 is the schematic flow sheet of the embodiment of dynamic effect method for drafting one；
Fig. 7 is the refinement schematic flow sheet of step S40 in Fig. 1；
Fig. 8 is the schematic diagram of a scenario of the live embodiment of message layout interface one of the invention；
Fig. 9 is the refinement schematic flow sheet of step S402 in Fig. 7；
Figure 10 is the schematic flow sheet that the present invention carries out live method second embodiment based on mobile terminal；
Figure 11 is the schematic flow sheet that main broadcaster creates a live embodiment；
Figure 12 is the schematic flow sheet that the present invention carries out live method 3rd embodiment based on mobile terminal；
Figure 13 is the schematic flow sheet that the present invention carries out live method fourth embodiment based on mobile terminal；
Figure 14 is the high-level schematic functional block diagram of mobile terminal first embodiment of the present invention；
Figure 15 is the refinement high-level schematic functional block diagram of receiver module 40 in Figure 14；
Figure 16 is the refinement high-level schematic functional block diagram of display unit 402 in Figure 15；
Figure 17 is the high-level schematic functional block diagram of mobile terminal second embodiment of the present invention；
Figure 18 is the high-level schematic functional block diagram of mobile terminal 3rd embodiment of the present invention；
Figure 19 is the high-level schematic functional block diagram of mobile terminal fourth embodiment of the present invention.
The realization of the object of the invention, functional characteristics and advantage will be described further referring to the drawings in conjunction with the embodiments.
Specific embodiment
It should be appreciated that specific embodiment described herein is only used to explain the present invention, it is not intended to limit the present invention.
Present invention offer is a kind of to carry out live method based on mobile terminal.
Reference picture 1, Fig. 1 is the schematic flow sheet that the present invention carries out live method first embodiment based on mobile terminal.
In the present embodiment, carrying out live method based on mobile terminal includes：
Step S20, when mobile terminal is detected for main broadcaster end, regards according to video beautification strategy to mobile terminal recording Frequency carries out landscaping treatment, obtains beautifying video data；
In the present embodiment, the type to mobile terminal is not restricted, for example：Mobile phone, flat board, notebook etc..
In the present embodiment, the mode to detecting is not restricted, for example, be input into when carrying out and log in live software according to user Account information judges.
In the present embodiment, when main broadcaster end starts live, a live address is asked for streaming media server first, is flowed After media server initializes a live necessary data structure, live address is returned to, so that message server issues live Message so that the live message that viewer end is pushed according to message server, clicks to enter viewing.
In the present embodiment, the mode for beautification strategy is not limited, for example, adjust the color of video pictures so that main broadcaster sees Get up it is whiter a little or PS is carried out to main broadcaster's face, to meet the aesthetic conceptions of masses.The beautification strategy can be by user from It is main to define, or U.S. face treatment is carried out by preset U.S. face algorithm.
In an alternate embodiment of the present invention, the pixel of video camera output frame is set first, the readjustment side of frame output is set Method.Then, U.S. face wave filter is set, and in the present embodiment, U.S. face wave filter realizes dynamic loading by OpenGL storehouses.Filtering Algorithm is calculated by the script GLSL (Graphic Library Scrip Language, shape library script) of OpenGL Method need to load and compile vertex shader script first, load and compile fragment shader script, create and connect summit and Fragment shader, acquisition attribute variable.Then, the frame of video for video camera being exported, switchs to OES textures, then switch to 2D textures.2D Texture is beautified by applying GLSL script algorithms, then by the result output after beautification to specified buffering.And the buffering By way of setting and rendering screen, it is shown in preview screen, that is, completes the beautification and preview of live video.And the process Using separate threads, the obstruction to main thread and coding plug-flow thread is reduced.Pass through while U.S. face is rendered MediaCodeC (Multimedia Encoder) beautifies to the frame of video that video camera is exported, and makes its beautification script and beautification preview one Cause, afterwards by MediaCodeC (Multimedia Encoder) compression coding, so as to obtain beautifying video data.The compression coding process It is also adopted by separate threads so that compression coding is not interfered with using main thread, preview thread, is conducive to limiting interim card and reduction Live time delay.
Step S30, is uploaded to streaming media server, for viewer end receiving stream media server point by beautification video data The beautification video data of hair；
In the present embodiment, it is only necessary to regarded beautification using the network of suitable media transport protocol or RTP According to streaming media server is uploaded to, for example with Ttmp, (Real Time Messaging Protocol, real-time messages are passed frequency Defeated agreement), the implementation method changes smaller to existing procedure, realizes simple.
In an alternate embodiment of the present invention, beautification video data is passed through into Ttmp (Real Time Messaging Protocol, real-time messages host-host protocol) plug-flow to streaming media server, to video flowing deposited and sent by streaming media server Edge C DN servers are dealt into, CDN server is by Ttmp (Real Time Messaging Protocol, real-time messages transmission Agreement) by U.S. face video data transmission to viewer end.Viewer end enters direct broadcasting room according to live address, by Ttmp (Real Time Messaging Protocol, real-time messages host-host protocol) beautification video data is downloaded, watch live.
In the present embodiment, exported come render video by SurfaceView (rendering form).Inside SurfaceView Comprising Surface (rendering buffering).We can use the mode of MediaPlayer (multimedia player)+SurfaceView To realize the broadcasting of video.In live, main broadcaster needs the live picture of preview oneself, and viewer end needs to see the video of main broadcaster Picture, so this two ends is just as needing this player rendering layer, and is the same.As shown in Fig. 2 Fig. 2 is broadcasting The structural representation of the embodiment of device rendering layer one.In the present embodiment, Internet is to be supplied to broadcasting from network downloading data The module of device.The Internet of the present embodiment contains P2SP and downloads storehouse, Rtmp storehouses.P2SP(Peer to Server and Peer, point-to-point and server network technology) it is a kind of distributed network download technology.When main broadcaster is live, Wo Mentong Cross Rtmp storehouses and be transmitted live TV stream；During program request, we use P2SP download technologies.Internet transmits video counts to player According to transfer mode can assume localization Http servers in Internet, it is also possible to directly use interface interchange method, Qian Zheyi Good, the latter's efficiency high of plant property, has lacked memory copying.It is not limited herein, is decided according to the actual requirements.In the present embodiment, play Device object, i.e. MediaPlayer objects, it includes the management for playing control and encoding and decoding storehouse, and common encoding and decoding storehouse has Ffmpeg, built-in storehouse of this programme simultaneously optimizes, and supports the various video Container Formats such as flv, mp4.This is not restricted, tool Body is decided according to the actual requirements.In the present embodiment, render form and be exactly SurfaceView, render control interface i.e. SurfaceHolder.By rendering window object render video data, control management energy is provided by rendering control interface Power.For example in the interface of SurfaceHolder, the control method of MediaPlayer is called, reach the purpose for playing control. Player provides video data to control object is rendered, while providing control method to control interface is rendered.
It is divided into main broadcaster's pattern and Viewer-mode due to live, so there is also main broadcaster's pattern and sight in interaction in live Many patterns.To record end, spectators are broadcasting end to main broadcaster.Main broadcaster's pattern and Viewer-mode are in the interaction in live because role is different And cause some functions variant, but gross function and framework layering are consistent.As shown in figure 3, Fig. 3 be main broadcaster end and/ Or the live framework of viewer end is layered the schematic diagram of an embodiment.In the present embodiment, state layer is mainly used for live one of display A little states and exception.For example the establishment of main broadcaster end is live needs the time to buffer, and this when, it can cover face on all the layers, for example, One layer of mask of acute-matte of display, allows the main broadcaster will not so anxiety during wait；Viewer end is also such.Also When the live network that goes offline is bad, when keeper's kicking a player, state layer can also be ejected.Gone offline because network is bad as main broadcaster When, viewer end must eject prompting, " main broadcaster is right back " and suitable background.When live normal, state layer is packed up, State layer ejection, is placed in ending state at the end of live.State layer is the interactive the superiors, and priority is highest, for locating Manage information, the state of high priority.State layer can be divided three classes and illustrated, as shown in figure 4, shapes of the Fig. 4 for state layer The schematic diagram of state one embodiment of classification.1：Into live TV state.The specific initialization included when main broadcaster end starts live is waited, Viewer end enters the wait to network flow during live room.For example, when main broadcaster starts live, state layer display countdown can A length of 3 seconds during setting；Viewer end enters live room, and then " buffering " is shown during wait；2：Buffering/anomalous mode： Refer to just during live when buffering or exception, there occurs that network failure or network speed are too slow, video streaming causes nothing slowly Method starts broadcasting or has interrupted broadcasting, needs this when to point out user, and network is not good enough or failure；Except video flowing, in real time Message flow, if the message such as direct broadcasting room barrage, comment, present receives abnormal, also have corresponding prompting, also part Interface is the interface of Http agreements, if the return exception of these interfaces, can eject prompting.3：Live ending state.Live end When, direct broadcasting room is closed, and ejects the live picture for having terminated.User can be selected to leave, it is also possible to which selection viewing is replayed, i.e., Program request.Followed by alternation of bed, alternation of bed is the primary layer of living broadcast interactive.It contains live most of user mutuals, by seeing For the visual angle at many ends, for example pay close attention to main broadcaster, spectators' list and interaction, bean vermicelli number, give a present, barrage, present animation, thumb up are moved Picture, messaging list area, bottom interactive sections.Bottom interactive sections include that transmission comment, barrage, switching camera, social activity are shared, closed Close.It is finally player rendering layer, the major function of player rendering layer is exactly to play live picture.Substantially it is to pass through SurfaceView (rendering form) carrys out render video output.SurfaceView inside includes Surface (rendering buffering).I The broadcasting of video can be realized using the mode of MediaPlayer (multimedia player)+SurfaceView.Main broadcaster end Needing the live picture of preview oneself, viewer end needs to see the screen picture of main broadcaster.So two ends are just as needing this Layer, and be the same.
Step S40, receives the live message that message server sends, after the treatment of Mobile state packet loss is entered to the live message It is shown in the corresponding region of the mobile terminal.
In the present embodiment, the mode for the treatment of dynamic packet loss is not limited, for example, can be the common message for abandoning time delay high, Or reduce unessential free animated message by a certain percentage, the setting of this ratio is not limited, can also be according to CPU and/ Or the real-time accountings of GPU carry out dynamic packet loss, this is not restricted, is configured according to actual needs.For the display of live message Region is not restricted, and is selected according to actual needs, but should try one's best and do not block live picture.
In an alternate embodiment of the present invention, the real-time accounting of CPU and/or GPU can be detected, for example, work as detecting CPU And/or the real-time accounting of GPU has reached more than 95%, then abandon the common message of 10% ratio.
In the present embodiment, live message is generally word message, animated message, present message, thumb up message, concern message Deng.As shown in figure 5, Fig. 5 is the schematic diagram of the embodiment of live messaging flow one.In the present embodiment, Internet is most bottom Layer, it manages main broadcaster end and viewer end and is connected with the length of message server.In order to be used across end, can use Socket.io storehouses (socket communication storehouse, for carrying out socket management).In the present embodiment, management level are divided into live message Management module and message dispatch module, message managing module are received message, message are entered by type field then from Internet Row Classification Management, inserts different classifying messages lists.For example, present message, chat messages, thumb up message etc., then enter action State packet loss treatment, then by message dispatch module, in distributing corresponding module.Display layer receives disappearing for message dispatch module After breath is delivered, the renewal of message is shown.Display layer includes all kinds of display modules, such as UI such as barrage, present, message (User Interface, User Interface) module.As this simple display layer control of messaging list, main thread can be directly used Draw, but the complicated dynamic effect such as present, barrage and take resource, then can contemplate being drawn using newly-built thread.
In the present embodiment, for example：The interactive events such as barrage, present animation, animated message, thumb up are essential. These dynamic effects are needed by after drafting, representing on main broadcaster end and viewer end.As shown in fig. 6, Fig. 6 is painted for dynamic effect The schematic flow sheet of the embodiment of method processed.In the present embodiment, first, by render control interface (control render interface with Form one-to-one corresponding is rendered, control renders interface and renders just can be by its interface after form is bound, there is provided external control Mode processed) object obtains and locks painting canvas, and painting canvas is the carrying object of all draftings；Then, obtain and draw element；Draw unit Element can be barrage, present, thumb up etc., it is necessary to be taken out in turn from messaging list, and the list can be reentry list, can support Multi-thread access；Next, change dynamic message position and transparence information.Each need draw element have position, thoroughly The information such as lightness, content need to set, and animation is required for more new position, for example, some present animations are while more new position Also to control transparency；By after above-mentioned flow, just exciting the mechanism of redrawing, all elements are rendered on painting canvas.It is finally Judge whether thread exits, if it is not, then repeating to obtain to draw element step；If so, then terminating the drafting to dynamic effect.
In the present embodiment, live picture is beautified first, beautification video data is then uploaded to Streaming Media clothes Business device, video data transmission will be beautified to each viewer end by streaming media server, in living broadcast interactive, according to shifting in real time Dynamic terminal capabilities state, the treatment of Mobile state packet loss is entered to live message.By this method, differentiated control is carried out to live message, Animation and text information in living broadcast interactive can effectively be reduced and cross the interim card for bringing, lift interacting for live middle main broadcaster and spectators Experience.
Reference picture 7, Fig. 7 is the refinement schematic flow sheet of step S40 in Fig. 1.
In the present embodiment, step S40 includes：
Step S401, receives the live message that message server sends, and the live message is classified；
In the present embodiment, the type to live message is not limited, for example：Pay and free animation and text information, gift Thing information (spectators give main broadcaster's present), thumb up information etc..
Step S402, according to the classification of live message, after the treatment of Mobile state packet loss is entered to the live message, is shown in institute State the corresponding region of mobile terminal.
In an alternate embodiment of the present invention, various live message can be distributed in mobile terminal according to the difference of classification Different zones on screen.Due to there is main broadcaster end and viewer end, herein, we are illustrated with main broadcaster end picture.Such as Fig. 8 Shown, Fig. 8 is the schematic diagram of a scenario of the live embodiment of message layout interface one of the invention.
In the present embodiment, live message is classified, and shows the corresponding region with mobile terminal, user can be made to exist Become apparent when watching live message, be easy to the living broadcast interactive between main broadcaster and user, and live message is classified, distinguished The priority of live message, is easy to follow-up dynamic packet loss to process, and is shown with the message for ensureing high priority.
Reference picture 9, Fig. 9 is the refinement schematic flow sheet of step S402 in Fig. 7.
In the present embodiment, step S402 includes:
Step S4021, judges whether the utilization rate of CPU and/or GPU reaches predetermined threshold value；
In the present embodiment, can freely set that (difference of hardware configuration is led according to actual conditions to the setting of the threshold value Causing different mobile terminals can cause different performances in the case of the utilization rate identical of CPU/GPU).For example, setting The threshold value is 98%, and the utilization rate for even detecting CPU/GPU reaches 98% or more, then judge the use of now CPU/GPU Rate reaches threshold value.
In the present embodiment, judge whether the utilization rate of CPU and/or GPU reaches predetermined threshold value primarily to detecting this When CPU and/or GPU whether be in overload conditions.Similarly, in order to realize this purpose, the temperature of CPU/GPU can also be detected, And a temperature threshold is set, judge whether the temperature of CPU/GPU reaches threshold value.For example, the temperature threshold for setting CPU is 65 Degree, the temperature threshold of GPU is 70 degree.
In the present embodiment, judge whether the utilization rate of CPU and/or GPU reaches predetermined threshold value and judge the temperature of CPU/GPU Whether whether degree reaches threshold value is for judging current CPU/GPU in overload, here, to judging current CPU/GPU Whether the method in overload is not restricted, depending on being actually needed.
Step S4022, if the utilization rate of CPU and/or GPU reaches predetermined threshold value, according to preset dynamic packet loss strategy Enter the treatment of Mobile state packet loss to the live message；
In the present embodiment, the setting for packet loss strategy is not restricted.For example, the packet loss strategy for setting is discarding Gao Yan When common message (if a live message is the message of time delay high, the message has been out in the interaction of main broadcaster and spectators Due effect), or the packet loss strategy for setting is breath screen packet loss, and breath screen explanation user has not reviewed that this is live, should The message that this receives all is abandoned, and without being to continue with expending resource, breath screen thing can be monitored by registering in Android platform The broadcast of part is processed.
Step S4023, according to the classification of live message, by by the live message after the treatment of dynamic packet loss, is shown in institute State the corresponding region of mobile terminal.
In an alternate embodiment of the present invention, mobile terminal is set up length and is connected with message server.Live message is in order to prop up Hold real-time tranception, connection long can be set up using socket.io storehouses herein, it not only support connection management long, reconnect, heartbeat chartered plane System, and have multi-platform realization, convenient transplanting.In the message sink processing module of socket.io, good news readjustment letter is set Number a, unpacking process to message is carried out herein；Initialization classification messaging list, due to paying present because user spends The behavior message of money purchase, so priority is very high, in addition with disappearing for the high priorities such as some keeper's kicking a player, system messages Breath, is required for classifying with common message.The purpose of message classification is that dynamic is made when system resource is in short supply in order to tackle The treatment of packet loss.After setting up connection long and the good each module of initialization, by the Handshake Protocol at initial stage, and message server link Just set up, then mobile terminal can send a message to message server, it is also possible to receive the message of message server. Herein it should be noted that in order to realize independent transmitting-receiving, hair message and receipts message need to be carried out in different threads, so Just will not mutually block.Determine whether the high-priority messages such as paying present.If it is high-priority message list is inserted； Otherwise insert common message list.Detection CPU/GPU overloads.Free moving is abandoned according to the importance of time and animation if overload Draw message.CPU/GPU overloads typically all live recording/broadcasting or animation are drawn caused by occupancy CPU/GPU, so we Need to reduce unessential free animated message, packet loss is carried out according to its time and importance.For example, abandoning delay message high. , it is necessary to the time of verification message before each submodule is distributed, if being time delay high and being common message, lose Abandon.If nonoverload, live message is normally exported.
In the present embodiment, when the utilization rate of CPU and/or GPU reaches predetermined threshold value, then disappeared to live according to packet loss strategy Cease into the treatment of Mobile state packet loss, namely when the performance of current mobile terminal is bad, according to packet loss strategy to live message Enter the treatment of Mobile state packet loss, can reduce the load of CPU/GPU, reduce due to the animation amount such as interaction message amount is big, give a present it is big when The animation interim card of appearance, Hua Ping, message refresh not out, message delay, a series of problems, such as lose important payment message, lifting Main broadcaster and interactive experience of the spectators in live.
Reference picture 10, Figure 10 is that the present invention is illustrated based on the flow that mobile terminal carries out live method second embodiment Figure.
In the present embodiment, include before step S20：
Step S10, receives the video beautification instruction based on user's operation triggering, is beautified according to the video and instructed, generation Video beautification strategy.
In the present embodiment, video beautification instruction is not restricted, can is raw frames that user shoots to video camera Color adaptation is carried out, face is modified etc..Video beautification strategy can also be by beautification algorithm to realize.Do not limit herein System, depending on actual conditions.
In an alternate embodiment of the present invention, camera shoots the picture at main broadcaster end, by preview mechanism in mobile terminal On shown, main broadcaster can voluntarily be adjusted according to preview screen, after the completion of regulation is confirmed, setting according to main broadcaster choosing , generation video beautification strategy.
In the present embodiment, main broadcaster start it is live before can also carry out some self-defined settings.For example, being live setting Title, front cover, password etc..Reference picture 11, Figure 11 is the schematic flow sheet that main broadcaster creates a live embodiment.In the present embodiment In, main broadcaster can voluntarily set title or front cover, it is also possible to by program independently for main broadcaster is set.For example, title is set to " together See live, daily good mood ", front cover can choose the photo of main broadcaster's photograph album.In order to allow main broadcaster to have preferably mutually with senior spectators Kinetoplast is tested, and it is live that main broadcaster can open secret, is also implied that if viewer end wants to enter into direct broadcasting room and needs input correct Password.Typically, main broadcaster has a live account, and the account can be bound with all kinds of social software accounts of main broadcaster, if Main broadcaster's selection is shared, then shared live address by social software.When starting live, can be fallen in state layer Timing, for example, be set as countdown in 5 seconds, then starts live.
In the present embodiment, self-defined beautification is carried out to preview screen by main broadcaster, formulates video beautification strategy so that main It is better to live control power to broadcast, and lifts the live Confidence of main broadcaster.
Reference picture 12, Figure 12 is that the present invention is illustrated based on the flow that mobile terminal carries out live method 3rd embodiment Figure.
In the present embodiment, include after step S40：
Step S50, when recorded video is terminated at main broadcaster end, is communicated with message server and streaming media server, For message server issue program request address.
In the present embodiment, when main broadcaster end it is live at the end of, main broadcaster end give message server send end, message Server notifies the live end of streaming media server after receiving end, now, streaming media server generation program request address, The program request address is just pushed to viewer end by message server.
In an alternate embodiment of the present invention, when main broadcaster end it is live at the end of, main broadcaster end need give message server send out End, message server is sent to notify the live end of streaming media server, streaming media server generation program request address.Streaming Media Live saving file is carried out transcoding by server, and is stored to program request address.Because different program request players may need not Same coded format, so needing to carry out transcoding.Program request address is added to seed server and program request file is distributed CDN server.Seed server is to safeguard an index server of Internet resources, is the resource retrieval service of P2SP systems Device.Client is identified to seed server and is retrieved by seed, obtains the download address list of resource, this download address List contains CDN server resource, also contains other station address for downloading the resource, is achieved in that distributed downloads, Reduce the consumption of broadband of streaming media server.Then, program request address is issued by message server, user terminal passes through http agreements The broadcast messages can be pulled.When spectators obtain program request address, order program data is obtained by P2SP agreements, save server Bandwidth.After viewer end obtains program request address, seed server is accessed, seed server is returned and includes CDN node and domestic consumer The Resources list for node, viewer end carries out data download according to the node of a part of high-quality of condition selecting of oneself, then Give player supply video data.
In the present embodiment, at the end of live, program request address is pushed by for viewer end so that spectators are in live end After can immediately carry out program request, lift the viewing experience of spectators.
Reference picture 13, Figure 13 is that the present invention is illustrated based on the flow that mobile terminal carries out live method fourth embodiment Figure.
In the present embodiment, carrying out live method based on mobile terminal also includes：
Step S21, when mobile terminal is detected for viewer end, the beautification video counts of receiving stream media server distribution According to；
In the present embodiment, the mode for detecting is not restricted, for example, the account being input into during software live according to User logs in Number information is judged.When mobile terminal is detected for viewer end, live data can be downloaded by rtmp agreements, to watch It is live.
Step S31, receives the live message that message server sends, after the treatment of Mobile state packet loss is entered to the live message Display and the corresponding region of mobile terminal.
In the present embodiment, receive the live message of message server transmission and live message is entered at Mobile state packet loss The corresponding region of mobile terminal is shown in after reason, the part handling process can be consistent with main broadcaster end handling process in step S30, Will not be described here.
The present invention further provides a kind of mobile terminal.
Reference picture 14, Figure 14 is the high-level schematic functional block diagram of mobile terminal first embodiment of the present invention.
In the present embodiment, mobile terminal includes：
Beautification module 20, for when mobile terminal is detected for main broadcaster end, according to video beautification strategy to mobile terminal The video of recording carries out landscaping treatment, obtains beautifying video data；
In the present embodiment, the type to mobile terminal is not restricted, for example：Mobile phone, flat board, notebook etc..
In the present embodiment, the mode to detecting is not restricted, for example, be input into when carrying out and log in live software according to user Account information judges.
In the present embodiment, when main broadcaster end starts live, a live address is asked for streaming media server first, is flowed After media server initializes a live necessary data structure, live address is returned to, so that message server issues live Message so that the live message that viewer end is pushed according to message server, clicks to enter viewing.
In the present embodiment, the mode for beautification strategy is not limited, for example, adjust the color of video pictures so that main broadcaster sees Get up it is whiter a little or PS is carried out to main broadcaster's face, to meet the aesthetic conceptions of masses.The beautification strategy can be by user from It is main to define, or U.S. face treatment is carried out by preset U.S. face algorithm.
In an alternate embodiment of the present invention, the pixel of video camera output frame is set first, the readjustment side of frame output is set Method.Then, U.S. face wave filter is set, and in the present embodiment, U.S. face wave filter realizes dynamic loading by OpenGL storehouses.Filtering Algorithm is calculated by the script GLSL (Graphic Library Scrip Language, shape library script) of OpenGL Method need to load and compile vertex shader script first, load and compile fragment shader script, create and connect summit and Fragment shader, acquisition attribute variable.Then, the frame of video for video camera being exported, switchs to OES textures, then switch to 2D textures.2D Texture is beautified by applying GLSL script algorithms, then by the result output after beautification to specified buffering.And the buffering By way of setting and rendering screen, it is shown in preview screen, that is, completes the beautification and preview of live video.And the process Using separate threads, the obstruction to main thread and coding plug-flow thread is reduced.Pass through while U.S. face is rendered MediaCodeC (Multimedia Encoder) beautifies to the frame of video that video camera is exported, and makes its beautification script and beautification preview one Cause, afterwards by MediaCodeC (Multimedia Encoder) compression coding, so as to obtain beautifying video data.The compression coding process It is also adopted by separate threads so that compression coding is not interfered with using main thread, preview thread, is conducive to limiting interim card and reduction Live time delay.
Uploading module 30, for beautification video data to be uploaded into streaming media server, for viewer end receiving stream media The beautification video data of server distribution；
In the present embodiment, it is only necessary to regarded beautification using the network of suitable media transport protocol or RTP According to streaming media server is uploaded to, for example with Ttmp, (Real Time Messaging Protocol, real-time messages are passed frequency Defeated agreement), the implementation method changes smaller to existing procedure, realizes simple.
In an alternate embodiment of the present invention, beautification video data is passed through into Ttmp (Real Time Messaging Protocol, real-time messages host-host protocol) plug-flow to streaming media server, to video flowing deposited and sent by streaming media server Edge C DN servers are dealt into, CDN server is by Ttmp (Real Time Messaging Protocol, real-time messages transmission Agreement) by U.S. face video data transmission to viewer end.Viewer end enters direct broadcasting room according to live address, by Ttmp (Real Time Messaging Protocol, real-time messages host-host protocol) beautification video data is downloaded, watch live.
In the present embodiment, exported come render video by SurfaceView (rendering form).Inside SurfaceView Comprising Surface (rendering buffering).We can use the mode of MediaPlayer (multimedia player)+SurfaceView To realize the broadcasting of video.In live, main broadcaster needs the live picture of preview oneself, and viewer end needs to see the video of main broadcaster Picture, so this two ends is just as needing this player rendering layer, and is the same.As shown in Fig. 2 Fig. 2 is broadcasting The structural representation of the embodiment of device rendering layer one.In the present embodiment, Internet is to be supplied to broadcasting from network downloading data The module of device.The Internet of the present embodiment contains P2SP and downloads storehouse, Rtmp storehouses.P2SP(Peer to Server and Peer, point-to-point and server network technology) it is a kind of distributed network download technology.When main broadcaster is live, Wo Mentong Cross Rtmp storehouses and be transmitted live TV stream；During program request, we use P2SP download technologies.Internet transmits video counts to player According to transfer mode can assume localization Http servers in Internet, it is also possible to directly use interface interchange method, Qian Zheyi Good, the latter's efficiency high of plant property, has lacked memory copying.It is not limited herein, is decided according to the actual requirements.In the present embodiment, play Device object, i.e. MediaPlayer objects, it includes the management for playing control and encoding and decoding storehouse, and common encoding and decoding storehouse has Ffmpeg, built-in storehouse of this programme simultaneously optimizes, and supports the various video Container Formats such as flv, mp4.This is not restricted, tool Body is decided according to the actual requirements.In the present embodiment, render form and be exactly SurfaceView, render control interface i.e. SurfaceHolder.By rendering window object render video data, control management energy is provided by rendering control interface Power.For example in the interface of SurfaceHolder, the control method of MediaPlayer is called, reach the purpose for playing control. Player provides video data to control object is rendered, while providing control method to control interface is rendered.
It is divided into main broadcaster's pattern and Viewer-mode due to live, so there is also main broadcaster's pattern and sight in interaction in live Many patterns.To record end, spectators are broadcasting end to main broadcaster.Main broadcaster's pattern and Viewer-mode are in the interaction in live because role is different And cause some functions variant, but gross function and framework layering are consistent.As shown in figure 3, Fig. 3 be main broadcaster end and/ Or the live framework of viewer end is layered the schematic diagram of an embodiment.In the present embodiment, state layer is mainly used for live one of display A little states and exception.For example the establishment of main broadcaster end is live needs the time to buffer, and this when, it can cover face on all the layers, for example, One layer of mask of acute-matte of display, allows the main broadcaster will not so anxiety during wait；Viewer end is also such.Also When the live network that goes offline is bad, when keeper's kicking a player, state layer can also be ejected.Gone offline because network is bad as main broadcaster When, viewer end must eject prompting, " main broadcaster is right back " and suitable background.When live normal, state layer is packed up, State layer ejection, is placed in ending state at the end of live.State layer is the interactive the superiors, and priority is highest, for locating Manage information, the state of high priority.State layer can be divided three classes and illustrated, as shown in figure 4, shapes of the Fig. 4 for state layer The schematic diagram of state one embodiment of classification.1：Into live TV state.The specific initialization included when main broadcaster end starts live is waited, Viewer end enters the wait to network flow during live room.For example, when main broadcaster starts live, state layer display countdown can A length of 3 seconds during setting；Viewer end enters live room, and then " buffering " is shown during wait；2：Buffering/anomalous mode： Refer to just during live when buffering or exception, there occurs that network failure or network speed are too slow, video streaming causes nothing slowly Method starts broadcasting or has interrupted broadcasting, needs this when to point out user, and network is not good enough or failure；Except video flowing, in real time Message flow, if the message such as direct broadcasting room barrage, comment, present receives abnormal, also have corresponding prompting, also part Interface is the interface of Http agreements, if the return exception of these interfaces, can eject prompting.3：Live ending state.Live end When, direct broadcasting room is closed, and ejects the live picture for having terminated.User can be selected to leave, it is also possible to which selection viewing is replayed, i.e., Program request.Followed by alternation of bed, alternation of bed is the primary layer of living broadcast interactive.It contains live most of user mutuals, by seeing For the visual angle at many ends, for example pay close attention to main broadcaster, spectators' list and interaction, bean vermicelli number, give a present, barrage, present animation, thumb up are moved Picture, messaging list area, bottom interactive sections.Bottom interactive sections include that transmission comment, barrage, switching camera, social activity are shared, closed Close.It is finally player rendering layer, the major function of player rendering layer is exactly to play live picture.Substantially it is to pass through SurfaceView (rendering form) carrys out render video output.SurfaceView inside includes Surface (rendering buffering).I The broadcasting of video can be realized using the mode of MediaPlayer (multimedia player)+SurfaceView.Main broadcaster end Needing the live picture of preview oneself, viewer end needs to see the screen picture of main broadcaster.So two ends are just as needing this Layer, and be the same.
Receiver module 40, the live message for receiving message server transmission, enters Mobile state and loses to the live message The corresponding region of the mobile terminal is shown in after bag treatment.
In the present embodiment, the mode for the treatment of dynamic packet loss is not limited, for example, can be the common message for abandoning time delay high, Or reduce unessential free animated message by a certain percentage, the setting of this ratio is not limited, can also be according to CPU and/ Or the real-time accountings of GPU carry out dynamic packet loss, this is not restricted, is configured according to actual needs.For the display of live message Region is not restricted, and is selected according to actual needs, but should try one's best and do not block live picture.
In an alternate embodiment of the present invention, the real-time accounting of CPU and/or GPU can be detected, for example, work as detecting CPU And/or the real-time accounting of GPU has reached more than 95%, then abandon the common message of 10% ratio.
In the present embodiment, live message is generally word message, animated message, present message, thumb up message, concern message Deng.As shown in figure 5, Fig. 5 is the schematic diagram of the embodiment of live messaging flow one.In the present embodiment, Internet is most bottom Layer, it manages main broadcaster end and viewer end and is connected with the length of message server.In order to be used across end, can use Socket.io storehouses (socket communication storehouse, for carrying out socket management).In the present embodiment, management level are divided into live message Management module and message dispatch module, message managing module are received message, message are entered by type field then from Internet Row Classification Management, inserts different classifying messages lists.For example, present message, chat messages, thumb up message etc., then enter action State packet loss treatment, then by message dispatch module, in distributing corresponding module.Display layer receives disappearing for message dispatch module After breath is delivered, the renewal of message is shown.Display layer includes all kinds of display modules, such as UI such as barrage, present, message (User Interface, User Interface) module.As this simple display layer control of messaging list, main thread can be directly used Draw, but the complicated dynamic effect such as present, barrage and take resource, then can contemplate being drawn using newly-built thread.
In the present embodiment, for example：The interactive events such as barrage, present animation, animated message, thumb up are essential. These dynamic effects are needed by after drafting, representing on main broadcaster end and viewer end.As shown in fig. 6, Fig. 6 is painted for dynamic effect The schematic flow sheet of the embodiment of method processed.In the present embodiment, first, by render control interface (control render interface with Form one-to-one corresponding is rendered, control renders interface and renders just can be by its interface after form is bound, there is provided external control Mode processed) object obtains and locks painting canvas, and painting canvas is the carrying object of all draftings；Then, obtain and draw element；Draw unit Element can be barrage, present, thumb up etc., it is necessary to be taken out in turn from messaging list, and the list can be reentry list, can support Multi-thread access；Next, change dynamic message position and transparence information.Each need draw element have position, thoroughly The information such as lightness, content need to set, and animation is required for more new position, for example, some present animations are while more new position Also to control transparency；By after above-mentioned flow, just exciting the mechanism of redrawing, all elements are rendered on painting canvas.It is finally Judge whether thread exits, if it is not, then repeating to obtain to draw element step；If so, then terminating the drafting to dynamic effect.
In the present embodiment, live picture is beautified first, beautification video data is then uploaded to Streaming Media clothes Business device, video data transmission will be beautified to each viewer end by streaming media server, in living broadcast interactive, according to shifting in real time Dynamic terminal capabilities state, the treatment of Mobile state packet loss is entered to live message.By this method, differentiated control is carried out to live message, Animation and text information in living broadcast interactive can effectively be reduced and cross the interim card for bringing, lift interacting for live middle main broadcaster and spectators Experience.
Reference picture 15, Figure 15 is the refinement high-level schematic functional block diagram of receiver module 40 in Figure 14.
In the present embodiment, receiver module 40 includes：
Taxon 401, the live message for receiving message server transmission, classifies to the live message；
In the present embodiment, the type to live message is not limited, for example：Pay and free animation and text information, gift Thing information (spectators give main broadcaster's present), thumb up information etc..
Display unit 402, for the classification according to live message, after the treatment of Mobile state packet loss is entered to the live message, It is shown in the corresponding region of the mobile terminal.
In an alternate embodiment of the present invention, various live message can be distributed in mobile terminal according to the difference of classification Different zones on screen.Due to there is main broadcaster end and viewer end, herein, we are illustrated with main broadcaster end picture.Such as Fig. 8 Shown, Fig. 8 is the schematic diagram of a scenario of the live embodiment of message layout interface one of the invention.
In the present embodiment, live message is classified, and shows the corresponding region with mobile terminal, user can be made to exist Become apparent when watching live message, be easy to the living broadcast interactive between main broadcaster and user, and live message is classified, distinguished The priority of live message, is easy to follow-up dynamic packet loss to process, and is shown with the message for ensureing high priority.
Reference picture 16, Figure 16 is the refinement high-level schematic functional block diagram of display unit 402 in Figure 15.
In the present embodiment, display unit 402 includes：
Whether judgment sub-unit 4021, the utilization rate for judging CPU and/or GPU reaches predetermined threshold value；
In the present embodiment, can freely set that (difference of hardware configuration is led according to actual conditions to the setting of the threshold value Causing different mobile terminals can cause different performances in the case of the utilization rate identical of CPU/GPU).For example, setting The threshold value is 98%, and the utilization rate for even detecting CPU/GPU reaches 98% or more, then judge the use of now CPU/GPU Rate reaches threshold value.
In the present embodiment, judge whether the utilization rate of CPU and/or GPU reaches predetermined threshold value primarily to detecting this When CPU and/or GPU whether be in overload conditions.Similarly, in order to realize this purpose, the temperature of CPU/GPU can also be detected, And a temperature threshold is set, judge whether the temperature of CPU/GPU reaches threshold value.For example, the temperature threshold for setting CPU is 65 Degree, the temperature threshold of GPU is 70 degree.
In the present embodiment, judge whether the utilization rate of CPU and/or GPU reaches predetermined threshold value and judge the temperature of CPU/GPU Whether whether degree reaches threshold value is for judging current CPU/GPU in overload, here, to judging current CPU/GPU Whether the method in overload is not restricted, depending on being actually needed.
Treatment subelement 4022, if reaching predetermined threshold value for the utilization rate of CPU and/or GPU, according to preset dynamic Packet loss strategy enters the treatment of Mobile state packet loss to the live message；
In the present embodiment, the setting for packet loss strategy is not restricted.For example, the packet loss strategy for setting is discarding Gao Yan When common message (if a live message is the message of time delay high, the message has been out in the interaction of main broadcaster and spectators Due effect), or the packet loss strategy for setting is breath screen packet loss, and breath screen explanation user has not reviewed that this is live, should The message that this receives all is abandoned, and without being to continue with expending resource, breath screen thing can be monitored by registering in Android platform The broadcast of part is processed.
Display subelement 4023, for the classification according to live message, by the live message after dynamic packet loss is processed, It is shown in the corresponding region of the mobile terminal.
In an alternate embodiment of the present invention, mobile terminal is set up length and is connected with message server.Live message is in order to prop up Hold real-time tranception, connection long can be set up using socket.io storehouses herein, it not only support connection management long, reconnect, heartbeat chartered plane System, and have multi-platform realization, convenient transplanting.In the message sink processing module of socket.io, good news readjustment letter is set Number a, unpacking process to message is carried out herein；Initialization classification messaging list, due to paying present because user spends The behavior message of money purchase, so priority is very high, in addition with disappearing for the high priorities such as some keeper's kicking a player, system messages Breath, is required for classifying with common message.The purpose of message classification is that dynamic is made when system resource is in short supply in order to tackle The treatment of packet loss.After setting up connection long and the good each module of initialization, by the Handshake Protocol at initial stage, and message server link Just set up, then mobile terminal can send a message to message server, it is also possible to receive the message of message server. Herein it should be noted that in order to realize independent transmitting-receiving, hair message and receipts message need to be carried out in different threads, so Just will not mutually block.Determine whether the high-priority messages such as paying present.If it is high-priority message list is inserted； Otherwise insert common message list.Detection CPU/GPU overloads.Free moving is abandoned according to the importance of time and animation if overload Draw message.CPU/GPU overloads typically all live recording/broadcasting or animation are drawn caused by occupancy CPU/GPU, so we Need to reduce unessential free animated message, packet loss is carried out according to its time and importance.For example, abandoning delay message high. , it is necessary to the time of verification message before each submodule is distributed, if being time delay high and being common message, lose Abandon.If nonoverload, live message is normally exported.
In the present embodiment, when the utilization rate of CPU and/or GPU reaches predetermined threshold value, then disappeared to live according to packet loss strategy Cease into the treatment of Mobile state packet loss, namely when the performance of current mobile terminal is bad, according to packet loss strategy to live message Enter the treatment of Mobile state packet loss, can reduce the load of CPU/GPU, reduce due to the animation amount such as interaction message amount is big, give a present it is big when The animation interim card of appearance, Hua Ping, message refresh not out, message delay, a series of problems, such as lose important payment message, lifting Main broadcaster and interactive experience of the spectators in live.
Reference picture 17, Figure 17 is the high-level schematic functional block diagram of mobile terminal second embodiment of the present invention.
In the present embodiment, mobile terminal also includes：
Policy generation module 10, instruction is beautified for receiving the video based on user's operation triggering, beautiful according to the video Change instruction, generation video beautification strategy.
In the present embodiment, video beautification instruction is not restricted, can is raw frames that user shoots to video camera Color adaptation is carried out, face is modified etc..Video beautification strategy can also be by beautification algorithm to realize.Do not limit herein System, depending on actual conditions.
In an alternate embodiment of the present invention, camera shoots the picture at main broadcaster end, by preview mechanism in mobile terminal On shown, main broadcaster can voluntarily be adjusted according to preview screen, after the completion of regulation is confirmed, setting according to main broadcaster choosing , generation video beautification strategy.
In the present embodiment, main broadcaster start it is live before can also carry out some self-defined settings.For example, being live setting Title, front cover, password etc..Reference picture 11, Figure 11 is the schematic flow sheet that main broadcaster creates a live embodiment.In the present embodiment In, main broadcaster can voluntarily set title or front cover, it is also possible to by program independently for main broadcaster is set.For example, title is set to " together See live, daily good mood ", front cover can choose the photo of main broadcaster's photograph album.In order to allow main broadcaster to have preferably mutually with senior spectators Kinetoplast is tested, and it is live that main broadcaster can open secret, is also implied that if viewer end wants to enter into direct broadcasting room and needs input correct Password.Typically, main broadcaster has a live account, and the account can be bound with all kinds of social software accounts of main broadcaster, if Main broadcaster's selection is shared, then shared live address by social software.When starting live, can be fallen in state layer Timing, for example, be set as countdown in 5 seconds, then starts live.
In the present embodiment, self-defined beautification is carried out to preview screen by main broadcaster, formulates video beautification strategy so that main It is better to live control power to broadcast, and lifts the live Confidence of main broadcaster.
Reference picture 18, Figure 18 is the high-level schematic functional block diagram of mobile terminal 3rd embodiment of the present invention.
In the present embodiment, mobile terminal also includes：
Communication module 50, for when recorded video is terminated at main broadcaster end, entering with message server and streaming media server Row communication, for message server issue program request address.
In the present embodiment, when main broadcaster end it is live at the end of, main broadcaster end give message server send end, message Server notifies the live end of streaming media server after receiving end, now, streaming media server generation program request address, The program request address is just pushed to viewer end by message server.
In an alternate embodiment of the present invention, when main broadcaster end it is live at the end of, main broadcaster end need give message server send out End, message server is sent to notify the live end of streaming media server, streaming media server generation program request address.Streaming Media Live saving file is carried out transcoding by server, and is stored to program request address.Because different program request players may need not Same coded format, so needing to carry out transcoding.Program request address is added to seed server and program request file is distributed CDN server.Seed server is to safeguard an index server of Internet resources, is the resource retrieval service of P2SP systems Device.Client is identified to seed server and is retrieved by seed, obtains the download address list of resource, this download address List contains CDN server resource, also contains other station address for downloading the resource, is achieved in that distributed downloads, Reduce the consumption of broadband of streaming media server.Then, program request address is issued by message server, user terminal passes through http agreements The broadcast messages can be pulled.When spectators obtain program request address, order program data is obtained by P2SP agreements, save server Bandwidth.After viewer end obtains program request address, seed server is accessed, seed server is returned and includes CDN node and domestic consumer The Resources list for node, viewer end carries out data download according to the node of a part of high-quality of condition selecting of oneself, then Give player supply video data.
In the present embodiment, at the end of live, program request address is pushed by for viewer end so that spectators are in live end After can immediately carry out program request, lift the viewing experience of spectators.
Reference picture 19, Figure 19 is the high-level schematic functional block diagram of mobile terminal fourth embodiment of the present invention.
In the present embodiment, mobile terminal also includes：
Video reception module 21, when mobile terminal is detected for viewer end, the beautification of receiving stream media server distribution Video data；
In the present embodiment, the mode for detecting is not restricted, for example, the account being input into during software live according to User logs in Number information is judged.When mobile terminal is detected for viewer end, live data can be downloaded by rtmp agreements, to watch It is live.
Message reception module 31, receives the live message that message server sends, and enters Mobile state to the live message and loses The corresponding region of display and mobile terminal after bag treatment.
In the present embodiment, receive the live message of message server transmission and live message is entered at Mobile state packet loss The corresponding region of mobile terminal is shown in after reason, the part handling process can be consistent with the function of receiver module 30, does not do herein Repeat.
The preferred embodiments of the present invention are these are only, the scope of the claims of the invention is not thereby limited, it is every to utilize this hair Equivalent structure or equivalent flow conversion that bright specification and accompanying drawing content are made, or directly or indirectly it is used in other related skills Art field, is included within the scope of the present invention.

Claims (12)

1. it is a kind of that live method is carried out based on mobile terminal, it is characterised in that described that live side is carried out based on mobile terminal Method includes：
When mobile terminal is detected for main broadcaster end, beautify strategy according to video is carried out at beautification to the video that mobile terminal is recorded Reason, obtains beautifying video data；
Beautification video data is uploaded to streaming media server, for the beautification of viewer end receiving stream media server distribution Video data；
The live message that message server sends is received, movement is shown in eventually after the treatment of Mobile state packet loss is entered to the live message The corresponding region at end.
2. live method is carried out based on mobile terminal as claimed in claim 1, it is characterised in that the reception messenger service The live message that device sends, the corresponding region that the mobile terminal is shown in after Mobile state packet loss is processed is entered to the live message Including：
The live message that message server sends is received, the live message is classified；
According to the classification of live message, after the treatment of Mobile state packet loss is entered to the live message, the mobile terminal is shown in Corresponding region.
3. live method is carried out based on mobile terminal as claimed in claim 2, it is characterised in that described according to live message Classification, the live message is entered Mobile state packet loss treatment after, the corresponding region for being shown in the mobile terminal includes：
Judge whether the utilization rate of CPU and/or GPU reaches predetermined threshold value；
If the utilization rate of CPU and/or GPU reaches predetermined threshold value, according to preset dynamic packet loss strategy to the live message Enter the treatment of Mobile state packet loss；
According to the classification of live message, by by the live message after the treatment of dynamic packet loss, the right of the mobile terminal is shown in Answer region.
4. live method is carried out based on mobile terminal as described in claims 1 to 3 any one, it is characterised in that described When main broadcaster starts recorded video, beautify strategy according to video carries out landscaping treatment to the video recorded, and obtains beautifying video counts According to including before：
The video beautification instruction based on user's operation triggering is received, is beautified according to the video and instructed, generation video beautification strategy.
5. live method is carried out based on mobile terminal as described in claims 1 to 3 any one, it is characterised in that described The live message that message server sends is received, the movement is shown in eventually after the treatment of Mobile state packet loss is entered to the live message Include after the corresponding region at end：
When main broadcaster terminates recorded video, communicated with message server and streaming media server, for message server Issue program request address.
6. live method is carried out based on mobile terminal as claimed in claim 1, it is characterised in that described based on mobile terminal Carrying out live method also includes：
When mobile terminal is detected for viewer end, the beautification video data of receiving stream media server distribution；
The live message of message server transmission is received, display is whole with mobile after the treatment of Mobile state packet loss is entered to the live message The corresponding region at end.
7. a kind of mobile terminal, it is characterised in that the mobile terminal includes：
Beautification module, for when main broadcaster starts recorded video, beautify strategy according to video to be carried out at beautification to the video recorded Reason, obtains beautifying video data；
Uploading module, for beautification video data to be uploaded into streaming media server, for viewer end receiving stream media server The beautification video data of distribution；
Receiver module, the live message for receiving message server transmission enters the treatment of Mobile state packet loss to the live message The corresponding region of the mobile terminal is shown in afterwards.
8. mobile terminal as claimed in claim 7, it is characterised in that the receiver module includes：
Taxon, the live message for receiving message server transmission, classifies to the live message；
Display unit, for the classification according to live message, after the treatment of Mobile state packet loss is entered to the live message, is shown in institute State the corresponding region of mobile terminal.
9. mobile terminal as claimed in claim 8, it is characterised in that the display unit includes：
Whether judgment sub-unit, the utilization rate for judging CPU and/or GPU reaches predetermined threshold value；
Treatment subelement, if reaching predetermined threshold value for the utilization rate of CPU and/or GPU, according to preset dynamic packet loss strategy Enter the treatment of Mobile state packet loss to the live message；
Display subelement, for the classification according to live message, by by the live message after the treatment of dynamic packet loss, is shown in institute State the corresponding region of mobile terminal.
10. the mobile terminal as described in claim 7 to 9 any one, it is characterised in that the mobile terminal also includes：
Policy generation module, instruction is beautified for receiving the video based on user's operation triggering, is beautified according to the video and instructed, Generation video beautification strategy.
11. mobile terminal as described in claim 7 to 9 any one, it is characterised in that the mobile terminal also includes：
Communication module, for when main broadcaster terminates recorded video, being communicated with message server and streaming media server, with For message server issue program request address.
12. mobile terminals as claimed in claim 7, it is characterised in that the mobile terminal also includes：
Video reception module, for when mobile terminal is detected for viewer end, the beautification of receiving stream media server distribution to be regarded Frequency evidence；
Message reception module, the live message for receiving message server transmission, Mobile state packet loss is entered to the live message The corresponding region of mobile terminal is shown in after treatment.
CN201710075454.9A 2017-02-10 2017-02-10 Live method and mobile terminal is carried out based on mobile terminal Pending CN106792034A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710075454.9A CN106792034A (en) 2017-02-10 2017-02-10 Live method and mobile terminal is carried out based on mobile terminal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710075454.9A CN106792034A (en) 2017-02-10 2017-02-10 Live method and mobile terminal is carried out based on mobile terminal

Publications (1)

Publication Number Publication Date
CN106792034A true CN106792034A (en) 2017-05-31

Family

ID=58955976

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710075454.9A Pending CN106792034A (en) 2017-02-10 2017-02-10 Live method and mobile terminal is carried out based on mobile terminal

Country Status (1)

Country Link
CN (1) CN106792034A (en)

Cited By (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107277412A (en) * 2017-07-24 2017-10-20 腾讯科技（深圳）有限公司 Video recording method and device, graphics processor and electronic equipment
CN107484011A (en) * 2017-10-09 2017-12-15 武汉斗鱼网络科技有限公司 A kind of video resource coding/decoding method and device
CN108024140A (en) * 2017-12-14 2018-05-11 广州华多网络科技有限公司 A kind of live broadcasting method and system
CN108184054A (en) * 2017-12-28 2018-06-19 上海传英信息技术有限公司 A kind of preprocess method and pretreatment unit for intelligent terminal shooting image
CN108769825A (en) * 2018-06-21 2018-11-06 北京密境和风科技有限公司 The implementation method and device of live streaming
CN109040798A (en) * 2017-06-08 2018-12-18 武汉斗鱼网络科技有限公司 Live data drainage method, storage medium, electronic equipment and system
CN109064180A (en) * 2018-07-13 2018-12-21 广州神马移动信息科技有限公司 Comment on method, apparatus and terminal device
CN109062650A (en) * 2018-08-01 2018-12-21 武汉斗鱼网络科技有限公司 Barrage message distributing method, device, equipment and storage medium
CN109104626A (en) * 2017-06-20 2018-12-28 武汉斗鱼网络科技有限公司 The method and apparatus of image is filtered in a kind of network direct broadcasting
CN109120977A (en) * 2017-06-22 2019-01-01 武汉斗鱼网络科技有限公司 Methods of exhibiting, storage medium, electronic equipment and the system of live video
WO2019071678A1 (en) * 2017-10-09 2019-04-18 武汉斗鱼网络科技有限公司 Live broadcasting method and device
WO2019071679A1 (en) * 2017-10-09 2019-04-18 武汉斗鱼网络科技有限公司 Method and device for live streaming
CN109660570A (en) * 2017-10-10 2019-04-19 武汉斗鱼网络科技有限公司 Low discharge high real-time stage property distribution method, storage medium, equipment and system
CN110264635A (en) * 2019-06-10 2019-09-20 成都赶紧拍科技有限公司 A kind of real-time method for obtaining picture data
CN111343468A (en) * 2020-02-13 2020-06-26 北京字节跳动网络技术有限公司 Message processing method and device and electronic equipment
CN111416765A (en) * 2020-03-20 2020-07-14 北京字节跳动网络技术有限公司 Interactive message processing method and device
CN111787362A (en) * 2020-06-18 2020-10-16 北京字节跳动网络技术有限公司 Message processing method and device
CN112135166A (en) * 2020-08-14 2020-12-25 北京达佳互联信息技术有限公司 Method, device and system for sending and playing live broadcast data
CN113271502A (en) * 2020-02-17 2021-08-17 上海哔哩哔哩科技有限公司 Data display method and device based on video barrage and computer equipment
CN114679599A (en) * 2022-03-24 2022-06-28 上海哔哩哔哩科技有限公司 Live broadcast watching method and device
WO2023098611A1 (en) * 2021-11-30 2023-06-08 北京字节跳动网络技术有限公司 Special effect display method and apparatus, and device and storage medium

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103649904A (en) * 2011-05-10 2014-03-19 Nds有限公司 Adaptive presentation of content
CN105405325A (en) * 2015-12-22 2016-03-16 深圳市时尚德源文化传播有限公司 Network teaching method and system
CN105868247A (en) * 2015-12-15 2016-08-17 乐视网信息技术（北京）股份有限公司 Information display method and apparatus
CN106230841A (en) * 2016-08-04 2016-12-14 深圳响巢看看信息技术有限公司 A kind of video U.S. face and the method for plug-flow in real time in network direct broadcasting based on terminal
CN106303656A (en) * 2016-08-18 2017-01-04 北京奇虎科技有限公司 A kind of control the method and apparatus that information shows
CN106331872A (en) * 2016-08-26 2017-01-11 微梦创科网络科技（中国）有限公司 Message screening method and device in live broadcast interaction process
CN106330845A (en) * 2015-07-02 2017-01-11 中兴通讯股份有限公司 Method and apparatus for transmitting streaming media data

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103649904A (en) * 2011-05-10 2014-03-19 Nds有限公司 Adaptive presentation of content
CN106330845A (en) * 2015-07-02 2017-01-11 中兴通讯股份有限公司 Method and apparatus for transmitting streaming media data
CN105868247A (en) * 2015-12-15 2016-08-17 乐视网信息技术（北京）股份有限公司 Information display method and apparatus
CN105405325A (en) * 2015-12-22 2016-03-16 深圳市时尚德源文化传播有限公司 Network teaching method and system
CN106230841A (en) * 2016-08-04 2016-12-14 深圳响巢看看信息技术有限公司 A kind of video U.S. face and the method for plug-flow in real time in network direct broadcasting based on terminal
CN106303656A (en) * 2016-08-18 2017-01-04 北京奇虎科技有限公司 A kind of control the method and apparatus that information shows
CN106331872A (en) * 2016-08-26 2017-01-11 微梦创科网络科技（中国）有限公司 Message screening method and device in live broadcast interaction process

Cited By (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109040798A (en) * 2017-06-08 2018-12-18 武汉斗鱼网络科技有限公司 Live data drainage method, storage medium, electronic equipment and system
CN109104626B (en) * 2017-06-20 2021-11-09 武汉斗鱼网络科技有限公司 Method and equipment for filtering images in live webcast
CN109104626A (en) * 2017-06-20 2018-12-28 武汉斗鱼网络科技有限公司 The method and apparatus of image is filtered in a kind of network direct broadcasting
CN109120977B (en) * 2017-06-22 2020-10-16 武汉斗鱼网络科技有限公司 Live video display method, storage medium, electronic device and system
CN109120977A (en) * 2017-06-22 2019-01-01 武汉斗鱼网络科技有限公司 Methods of exhibiting, storage medium, electronic equipment and the system of live video
CN107277412A (en) * 2017-07-24 2017-10-20 腾讯科技（深圳）有限公司 Video recording method and device, graphics processor and electronic equipment
CN107484011A (en) * 2017-10-09 2017-12-15 武汉斗鱼网络科技有限公司 A kind of video resource coding/decoding method and device
WO2019071678A1 (en) * 2017-10-09 2019-04-18 武汉斗鱼网络科技有限公司 Live broadcasting method and device
WO2019071679A1 (en) * 2017-10-09 2019-04-18 武汉斗鱼网络科技有限公司 Method and device for live streaming
CN109660570A (en) * 2017-10-10 2019-04-19 武汉斗鱼网络科技有限公司 Low discharge high real-time stage property distribution method, storage medium, equipment and system
CN108024140A (en) * 2017-12-14 2018-05-11 广州华多网络科技有限公司 A kind of live broadcasting method and system
CN108184054A (en) * 2017-12-28 2018-06-19 上海传英信息技术有限公司 A kind of preprocess method and pretreatment unit for intelligent terminal shooting image
CN108769825B (en) * 2018-06-21 2020-11-06 北京密境和风科技有限公司 Method and device for realizing live broadcast
CN108769825A (en) * 2018-06-21 2018-11-06 北京密境和风科技有限公司 The implementation method and device of live streaming
CN109064180A (en) * 2018-07-13 2018-12-21 广州神马移动信息科技有限公司 Comment on method, apparatus and terminal device
CN109062650A (en) * 2018-08-01 2018-12-21 武汉斗鱼网络科技有限公司 Barrage message distributing method, device, equipment and storage medium
CN110264635A (en) * 2019-06-10 2019-09-20 成都赶紧拍科技有限公司 A kind of real-time method for obtaining picture data
CN111343468A (en) * 2020-02-13 2020-06-26 北京字节跳动网络技术有限公司 Message processing method and device and electronic equipment
CN113271502B (en) * 2020-02-17 2023-04-28 上海哔哩哔哩科技有限公司 Video barrage-based data display method and device and computer equipment
CN113271502A (en) * 2020-02-17 2021-08-17 上海哔哩哔哩科技有限公司 Data display method and device based on video barrage and computer equipment
CN111416765A (en) * 2020-03-20 2020-07-14 北京字节跳动网络技术有限公司 Interactive message processing method and device
CN111787362A (en) * 2020-06-18 2020-10-16 北京字节跳动网络技术有限公司 Message processing method and device
CN112135166A (en) * 2020-08-14 2020-12-25 北京达佳互联信息技术有限公司 Method, device and system for sending and playing live broadcast data
CN112135166B (en) * 2020-08-14 2022-03-25 北京达佳互联信息技术有限公司 Method, device and system for sending and playing live broadcast data
WO2023098611A1 (en) * 2021-11-30 2023-06-08 北京字节跳动网络技术有限公司 Special effect display method and apparatus, and device and storage medium
CN114679599A (en) * 2022-03-24 2022-06-28 上海哔哩哔哩科技有限公司 Live broadcast watching method and device

Similar Documents

Publication Publication Date Title
CN106792034A (en) Live method and mobile terminal is carried out based on mobile terminal
US10271013B2 (en) Display control method and apparatus
JP7463508B2 (en) Adaptive Graphics for Cloud Gaming
CN104410918B (en) A kind of live video parameter regulation means and device
CN109304031A (en) A kind of virtualization cloud game platform based on isomery intelligent terminal
CN105577819B (en) A kind of share system of virtualization desktop, sharing method and sharing apparatus
TWI528832B (en) System and method for video compression using feedback including data related to the successful receipt of video content
TWI501589B (en) System and method for utilizing forward error correction with video compression
TWI554115B (en) System and method for selecting a video encoding format based on feedback data
TWI475843B (en) System and method for multi-stream video compression
CN109391825A (en) A kind of video transcoding method and its device, server, readable storage medium storing program for executing
JP2018067966A (en) Live selective adaptive bandwidth
CN106302366B (en) A kind of data transmission method, device and intelligent television system
CN106621326A (en) Local application quick start with cloud transitioning
CN104956683B (en) For transmitting the adaptive noise reduction engine of video as a stream
CN106792214A (en) A kind of living broadcast interactive method and system based on digital audio-video place
CN106303674B (en) Data transmission method, device and intelligent television system
WO2015078199A1 (en) Live interaction method and device, client, server and system
Chen et al. T-gaming: A cost-efficient cloud gaming system at scale
CN108093197A (en) For the method, system and machine readable media of Information Sharing
CN107872721A (en) A kind of multimedia data transmission method, terminal and computer-readable medium
CN104320716B (en) A kind of video method of uplink transmission collaborative based on multiple terminals collaboration
CN106534916A (en) Video direct broadcast system aiming at internet cafe environment and based on three-layer server architecture
CN104618738B (en) A kind of smart television program broadcasting method and device
CN106302365B (en) A kind of client, intelligent television system and corresponding data transmission method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20170531

RJ01 Rejection of invention patent application after publication