CN108769726A - Multi-medium data method for pushing, device, storage medium and equipment - Google Patents

Multi-medium data method for pushing, device, storage medium and equipment Download PDF

Info

Publication number
CN108769726A
CN108769726A CN201810614487.0A CN201810614487A CN108769726A CN 108769726 A CN108769726 A CN 108769726A CN 201810614487 A CN201810614487 A CN 201810614487A CN 108769726 A CN108769726 A CN 108769726A
Authority
CN
China
Prior art keywords
data
medium data
medium
terminal
recombination
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201810614487.0A
Other languages
Chinese (zh)
Other versions
CN108769726B (en
Inventor
余学亮
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tencent Technology Shenzhen Co Ltd
Original Assignee
Tencent Technology Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tencent Technology Shenzhen Co Ltd filed Critical Tencent Technology Shenzhen Co Ltd
Priority to CN201810614487.0A priority Critical patent/CN108769726B/en
Publication of CN108769726A publication Critical patent/CN108769726A/en
Application granted granted Critical
Publication of CN108769726B publication Critical patent/CN108769726B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/218—Source of audio or video content, e.g. local disk arrays
    • H04N21/2187—Live feed
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/266—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4318—Generation of visual interfaces for content selection or interaction; Content or additional data rendering by altering the content in the rendering process, e.g. blanking, blurring or masking an image region
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/647—Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
    • H04N21/64784—Data processing by the network
    • H04N21/64792—Controlling the complexity of the content stream, e.g. by dropping packets

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Computer Security & Cryptography (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The invention discloses a kind of multi-medium data method for pushing, device, storage medium and equipment, belong to Internet technical field.Method includes：The multi-medium data that first terminal is sent by least two network channels is received, first terminal is used to send the multi-medium data that live streaming generates in the process by least two network channels；Data recombination is carried out to the multi-medium data received；Recombination multi-medium data is pushed to second terminal.First terminal of the present invention sends multi-medium data by multiple network channels, later, server is recombinated by the multi-medium data to multiple network tunnel transports, can effective guarantee be output to second terminal multi-medium data integrality, greatly reduce multi-medium data causes data that serious lose occurs when by single network channel transfer because network state is bad, what is in turn resulted in is broadcast live ineffective problem, in addition this kind of multi-medium data push mode will not reduce image sharpness, and video image quality is preferable.

Description

Multi-medium data method for pushing, device, storage medium and equipment
Technical field
The present invention relates to Internet technical field, more particularly to a kind of multi-medium data method for pushing, device, storage medium And equipment.
Background technology
At present multi-medium data live streaming is carried out using terminal to have become in order to which people show self and carry out amusement and leisure One of important channel, wherein multi-medium data includes picture data and audio data.By taking the live scene of mobile terminal as an example, by Place residing for the terminal of main broadcaster user is not fixed, so the generally shared network of the network of terminal access or mobile network. It for shared network, is restricted by factors such as access number, signal cover and the bandwidth upper limits, when network is shared in access Terminal it is more, when terminal offset signal coverage area is remoter, terminal sends multimedia in the network channel by sharing network It just more has some setbacks when data；For mobile network, restricted by the factors such as geographical location and surrounding number, it is more inclined in position When out-of-the-way or surrounding number is excessive, mobile network signals can be greatly reduced, and terminal sends more in the network channel by mobile network When media data, it equally also will appear the phenomenon that data transmission has some setbacks, and the appearance of above-mentioned phenomenon can undoubtedly seriously affect directly Broadcast quality.
In the related technology, in order to ensure the live streaming quality under the bad environment of network, terminal is sent out by single network channel When sending multi-medium data, following processing modes are usually taken：According to current data uploading speed and the multimedia cached The accounting situation of data calls video encoder to adjust coding Compression Strategies, by the way of the code check for reducing Video coding, Reduce the amount of coded data of each frame during being broadcast live；That is, the number of the picture data generated in the process is broadcast live by reducing for terminal According to amount, the data to alleviate single network channel upload pressure.
For above-mentioned data-pushing mode, single network channel carries out having very much when data upload in the state that network is bad Data may be largely lost, show that phenomena such as abnormal broadcasting pictures, broadcasting interim card or frame-skipping will occur in viewing user side, It is broadcast live ineffective；In addition, the code check due to Video coding is related to image sharpness, so using the code for reducing Video coding The mode of rate reduces amount of coded data, need to also be using image sharpness as cost, it may appear that video image quality bad problem, into one Step can cause to be broadcast live ineffective.
Invention content
An embodiment of the present invention provides a kind of multi-medium data method for pushing, device, storage medium and equipment, by using Multiple network channels push multi-medium data parallel, can effectively solve the problem that the broadcasting pictures that viewing user side occurs are abnormal, play Phenomena such as interim card or frame-skipping, video image quality is good, and live streaming effect is preferable.The technical solution is as follows：
On the one hand, multi-medium data method for pushing is provided, server is applied to, the method includes：
The multi-medium data that first terminal is sent by least two network channels is received, the first terminal is used for will be straight The multi-medium data generated in the process is broadcast to send by least two network channel；
Data recombination is carried out to the multi-medium data received, obtains recombination multi-medium data；
The recombination multi-medium data is pushed to second terminal.
On the other hand, a kind of multi-medium data method for pushing is provided, terminal is applied to, the method includes：
Obtain the multi-medium data that live streaming generates in the process；
The multi-medium data is sent to server by least two network channels, so that the server is to passing through It states the multi-medium data that at least two network channels receive and carries out data recombination, and obtained recombination multi-medium data is pushed To second terminal.
On the other hand, a kind of multi-medium data pusher is provided, server is applied to, described device includes：
Receiving module, the multi-medium data sent by least two network channels for receiving first terminal, described One terminal is used to send the multi-medium data that live streaming generates in the process by least two network channel；
Processing module obtains recombination multi-medium data for carrying out data recombination to the multi-medium data received；
First sending module, for the recombination multi-medium data to be pushed to second terminal.
On the other hand, a kind of multi-medium data pusher is provided, terminal is applied to, described device includes：
Acquisition module, the multi-medium data generated in the process for obtaining live streaming；
Second sending module, for sending the multi-medium data to server by least two network channels, so that The server carries out data recombination to the multi-medium data that is received by least two network channel, and will obtain Recombination multi-medium data is pushed to second terminal.
On the other hand, provide a kind of storage medium, be stored at least one instruction in the storage medium, it is described at least One instruction is loaded by processor and is executed to realize above-mentioned multi-medium data method for pushing.
On the other hand, a kind of multi-medium data pushing equipment is provided, the equipment includes processor and memory, described At least one instruction is stored in memory, at least one instruction is loaded by the processor and executed above-mentioned to realize Multi-medium data method for pushing.
The advantageous effect that technical solution provided in an embodiment of the present invention is brought is：
First terminal sends multi-medium data by multiple network channels, and later, server passes through to multiple network channels The multi-medium data of transmission is recombinated, can effective guarantee final output to the multi-medium data of second terminal integrality, Multi-medium data is greatly reduced when by single network channel transfer, data generation is caused seriously to lose because network state is bad It loses, the ineffective problem of the live streaming in turn resulted in changes a kind of expression way, due to being output to the multi-medium data of second terminal Consistency and continuity ensured, so viewing user side decoding abnormal phenomenon be greatly decreased, can effectively solve Pictures playback problem and frame-skipping, the interim cards such as green screen, Hua Ping, the mosaic that certainly screen occurs, it is discontinuous to wait fluency problem, It is preferable that effect is broadcast live.In addition, first terminal sends multi-medium data by multiple network channels, thus when front end is encoded without Dynamic code rate adaptation need to be carried out to alleviate network congestion to reduce packet loss, so this kind of multi-medium data push mode is not Image sharpness can be reduced, video image quality is preferable, further ensures live streaming effect.
Description of the drawings
To describe the technical solutions in the embodiments of the present invention more clearly, make required in being described below to embodiment Attached drawing is briefly described, it should be apparent that, drawings in the following description are only some embodiments of the invention, for For those of ordinary skill in the art, without creative efforts, other are can also be obtained according to these attached drawings Attached drawing.
Fig. 1 is the configuration diagram involved by a kind of multi-medium data method for pushing provided in an embodiment of the present invention；
Fig. 2 is that the data involved by a kind of multi-medium data method for pushing provided in an embodiment of the present invention upload schematic diagram；
Fig. 3 is a kind of flow chart of multi-medium data method for pushing provided in an embodiment of the present invention；
Fig. 4 is a kind of structural schematic diagram of data block provided in an embodiment of the present invention；
Fig. 5 is a kind of flow chart of multi-medium data method for pushing provided in an embodiment of the present invention；
Fig. 6 is a kind of flow diagram of data recombination provided in an embodiment of the present invention；
Fig. 7 is the flow diagram of another data recombination provided in an embodiment of the present invention；
Fig. 8 is a kind of flow chart of multi-medium data method for pushing provided in an embodiment of the present invention；
Fig. 9 is that the data involved by a kind of multi-medium data method for pushing provided in an embodiment of the present invention upload schematic diagram；
Figure 10 is a kind of overall execution flow chart of multi-medium data method for pushing provided in an embodiment of the present invention；
Figure 11 is a kind of overall execution flow chart of multi-medium data method for pushing provided in an embodiment of the present invention；
Figure 12 is a kind of flow diagram sending multi-medium data provided in an embodiment of the present invention；
Figure 13 is a kind of structural schematic diagram of multi-medium data pusher provided in an embodiment of the present invention；
Figure 14 is a kind of structural schematic diagram of multi-medium data pusher provided in an embodiment of the present invention；
Figure 15 is a kind of structural schematic diagram of multi-medium data pushing equipment provided in an embodiment of the present invention；
Figure 16 is a kind of structural schematic diagram of multi-medium data pushing equipment provided in an embodiment of the present invention.
Specific implementation mode
To make the object, technical solutions and advantages of the present invention clearer, below in conjunction with attached drawing to embodiment party of the present invention Formula is described in further detail.
Before to the embodiment of the present invention carrying out that explanation is explained in detail, first to the present embodiments relate to some nouns It is explained.
Multi-medium data：Main broadcaster user is referred to when initiating to be broadcast live, is acquired and is encoded in real time by the terminal of main broadcaster user Multi-medium data.In embodiments of the present invention, multi-medium data is pushed usually in the form of live TV stream by the terminal of main broadcaster user To server.
Shared network：It is not to be exclusively enjoyed by a terminal, shared network would generally be accessed by multiple terminals, and access is shared The terminal quantity of network is bigger, and the stability for sharing network is usually poorer.Illustratively, the WiFi that shop provides under line (Wireless Fidelity, Wireless Fidelity) network is one kind of shared network.
FLV (FLASH VIDEO, stream media format) Tag (label) data packet：FLV is a kind of general audio, video data Encapsulation format, for the live TV stream using FLV data encapsulation format, FLV Tag data packets are to form the base of FLV data flows This unit can be divided into video (Video) Tag and audio (Audio) Tag, and illustratively, the composition of FLV data flows can be as follows It is described：
FLV Header+Header Size、Video Tag+Tag Size、Audio Tag+Tag Size、Audio Tag+Tag Size、Video Tag+Tag Size、Audio Tag+Tag Size、Audio Tag+Tag Size…。
Wherein, above-mentioned to be followed successively by live TV stream head+head sizes, video tab+label sizes, audio tag from left to right + label sizes, audio tag+label sizes, video tab+label sizes, audio tag+label sizes, audio tag+label Size ....
It should be noted that video mentioned herein refers only to picture data, in order to distinguish itself and audio data, rear By it with picture data appellation in text.
FLV Chunk (block)：By video frame rate or video frame period durations, FLV Tag data packets are combined and are packaged, Form FLV Chunk one by one, wherein FLV Chunk are also referred to as FLV data blocks, or referred to as data block.
Assuming that the video frame rate of a live TV stream is 25, then video frame period duration is 1/25=0.04s, then one In FLV data blocks can include 1 Video Tag and 2 to 3 Audio Tag, that is, the multi-medium data to combine when Long is about 0.04s.A kind of expression way is changed, a FLV data block includes Video Tag+Tag Size, Audio Tag+ Tag Size,Audio Tag+Tag Size；According to said combination mode, the live streaming being composed as unit using FLV data blocks It flows and is just：FLV Header+Header Size,FLV Chunk,FLV Chunk,FLV Chunk,…….
Code check：Size for weighing live TV stream data volume per second, unit kbps.Wherein, code check is divided into video code rate And audio code rate, under normal circumstances, code check is higher, and the clarity of corresponding video pictures is better, audio sound quality is also better；Separately Outside, code check can also influence data upload, under normal circumstances, code check is higher, carry out data upload when require it is corresponding just higher, such as The bandwidth and network quality needed improves therewith.
CDN (Content Delivery Network, content distributing network)：It can be in real time according to network flow and each The connection of a service node, load state, to the integrated informations such as the distance of user and response time, Client-initiated is asked It re-directs on the service node nearest from user.The purpose is to make user that can obtain required content nearby, gathered around with solving network Crowded situation improves the response speed that user accesses website.
Simply it is situated between to the implementation environment involved by multi-medium data method for pushing provided in an embodiment of the present invention below It continues.Referring to Fig. 1, the implementation environment include the terminal 101 of main broadcaster user, live TV stream receive server 102, CDN server 103, Watch the terminal 104 and data recombination server 105 of user.
Multi-medium data method for pushing provided in an embodiment of the present invention carries out multi-medium data using multiple network channels Push, correspondingly, the number that live TV stream receives server 102 are usually multiple.Illustratively, in Fig. 1 only with network channel Number be 2, i.e., live TV stream receive server 102 be 2 be illustrated.
Wherein, the terminal 101 of main broadcaster user and viewing user terminal 104 type include but not limited to smart mobile phone, Tablet computer etc., Fig. 1 both for smart mobile phone only to be illustrated.And live TV stream receives server 102, CDN service Device 103 and data recombination server 105 may be either separate server, can also be integrated into a server, the present invention Embodiment is to this without specifically limiting.
Network channel can be WiFi network, 2G (2nd Generation mobile communication Technology, Generation Mobile Telecommunication System technology), 3G (3rd Generation mobile communication Technology, 3rd generation mobile communication technology) and 4G (the 4th Generation mobile communication Technology, fourth generation mobile communication technology) etc. network channel, the embodiment of the present invention is to this without specifically limiting.
It is to be self-existent between each network channel, do not interfere with each other between each other to need at illustrate first point, for For two network channels in Fig. 1, if one of them is the 4G network channels of A operators, another can be B operators 4G network channels or WiFi network.
Needing the second point illustrated is, the data volume of each network tunnel transports may be either the terminal 101 of main broadcaster user The total data amount or partial data amount of generation.With the data volume for the multi-medium data that the terminal 101 of main broadcaster user generates For M, then the first push mode can be, the equal transmitted data amount of each network channel is the multi-medium data of M；Second Push mode can be a part of each network tunnel transports data volume M, and by taking N number of network channel as an example, each network is logical The data volume of road transmission can be M/N.
Illustratively, in the first above-mentioned push mode as an example, the terminal 101 of main broadcaster user is in push multi-medium data When, the multi-medium data for generating live streaming in the process copy portion may be selected and be used as redundant data, come logical by 2 networks respectively Road uploads.Wherein, this 2 network channels can counterpart terminal double-card dual-standby situation, for example the terminal 101 of main broadcaster user is configured with 2 4G cards, are respectively derived from A operators and B operators, then as shown in Figure 1, the terminal 101 of main broadcaster user is carrying out multimedia When data-pushing, the live TV stream that a multi-medium data can be uploaded to A operators by the network channel of A operators receives clothes Business device 102, similarly, the redundant data of copy can upload to the live TV stream reception clothes of B operators by the network channel of B operators Business device 102；Later, two live TV streams receive server 102 and the multi-medium data received are transmitted to data recombination service again Device 105, then the two-way multi-medium data received is summarized by data recombination server 105；Later, passing through data weight After group server 105 is to the recombination of two-way multi-medium data and screening arrangement, then export to CDN server 103 a reliable Multi-medium data, and then again by CDN server 103 by this part of reliable multi-medium data be pushed to viewing user terminal 104。
In the first above-mentioned push mode as an example, below by a specific example to being pushed away parallel by multiple network channels The flow of multi-medium data is sent to illustrate.Referring to Fig. 2, it is assumed that the number for the multi-medium data that the terminal 101 of main broadcaster user generates According to amount be M, including number be 1/2/3/4 ... to the total N+1 data block of N+1, if pass through network channel 1 upload data volume For M multi-medium data when, be lost data block 2 and data block 4, by network channel 2 upload data volume be M multimedia When data, it is lost data block 1 and data block 3, then the corresponding live TV stream of the two network channels receives server 102 After the multi-medium data received is sent to data recombination server 105, data recombination server 105 will reconfigure At a complete multi-medium data, this part of multi-medium data includes that number is 1/2/3/4 ... to the total N+1 number of N+1 According to block, it is ensured that multi-medium data it is complete.
In conclusion the embodiment of the present invention propose in such a way that multiple network channels push multi-medium data parallel, It can effectively solve the problem that the existing problems with when pushing multi-medium data by single network channel in the related technology：
When being not in good state of network that the terminal of main broadcaster user accesses, for example the network accessed is in weak net state, is being pushed away It is likely to packet loss phenomenon occur because network congestion occurs when sending multi-medium data, in viewing user side, can exist because of portion Divide causes other frames for subsequently relying on this frame decoding to decode the case where failing with reference to frame loss, correspondingly, watches user's It is possible that local green screen, Hua Ping, mosaic, frame-skipping, interim card play phenomena such as discontinuous on terminal screen.Using dynamic Although rate adaption scheme alleviates the packet loss phenomenon caused by network congestion to a certain extent, data transmission pressure is alleviated Power, but need to be using image sharpness as cost, i.e., video image quality can reduce, ineffective.
And in embodiments of the present invention, push multi-medium data by using multiple network channels and to multiple networks The multi-medium data of channel transfer carry out screening recombination mode, can effective guarantee final output to spectators' user side more matchmakers The integrality of volume data, greatly reducing multi-medium data causes when by single network channel transfer because network state is bad Serious loss occurs for data, the ineffective problem of the live streaming in turn resulted in, that is, due to being output to the multimedia of viewing user side The consistency and continuity of data are ensured, so being greatly decreased in viewing user side decoding abnormal phenomenon, Neng Gouyou Effect solves pictures playback problem and frame-skipping, the interim cards such as green screen, Hua Ping, the mosaic that screen occurs, discontinuous that fluency is waited to ask Topic, live streaming effect are preferable.In addition, the terminal of main broadcaster user sends multi-medium data by multiple network channels, therefore preceding Without carrying out dynamic code rate adaptation in order to alleviate network congestion to reduce packet loss, so this kind of multi-medium data when the coding of end Push mode will not reduce image sharpness, and video image quality is preferable, further ensure live streaming effect.
Multi-medium data is pushed to Multi net voting channel parallel provided in an embodiment of the present invention below by detailed embodiment Method is explained.
Fig. 3 is a kind of flow chart of multi-medium data method for pushing provided in an embodiment of the present invention.The interaction master of this method Body is first terminal, server and second terminal, wherein first terminal is the terminal 101 of main broadcaster user in Fig. 1, and second eventually End is the terminal 104 that user is watched in Fig. 1, and server includes at least the live TV stream in Fig. 1 and receives server 102 and data recombination Server 105, wherein it can be separate server that live TV stream, which receives server 102 and data recombination server 105, It can be integrated into a server, the embodiment of the present invention is to this without specifically limiting.It is provided in an embodiment of the present invention referring to Fig. 3 Method flow includes：
301, first terminal obtains the multi-medium data that generates in the process of live streaming, and by least two network channels to clothes Business device sends multi-medium data.
As it was noted above, the multi-medium data of first terminal push is specifically with data block (Chunk) for unit, and it is each Include head and main body in a data block, includes the data block in the head of the data block for any one data block The main body of sequence number, the data block includes picture data and audio data.
Illustratively, as shown in figure 4, for the data block of FLV Chunk1, head FLV Chunk Header Chunk Number fields include the data block sequence number, and the main part of the data block may include 1 Video Tag+Tag Size, 2 to 3 Audio Tag+Tag Size, wherein the picture data and audio data that main part includes How much, it is related to video frame rate.
Needing at illustrate first point is, for other data blocks shown in Fig. 4, internal structure with it is entitled The data block of FLV Chunk1 is similar.
In addition, for for each data block, can be distributed for each data block incremental according to the sequence of each data block Sequence number, such as the Serial No. 1, the Serial No. 2 of FLV Chunk2, the Serial No. of FLVChunk3 of FLV Chunk1 3 ..., the Serial No. N of FLV ChunkN, the embodiment of the present invention is to the mode of assigned sequence number without specifically limiting.
Needing the second point illustrated is, for above-mentioned sequence number, each data block need to also receive server one from live TV stream Straight to carry to data recombination server, later, data recombination server can be realized according to the sequence number of each data block to warp The verification and recombination of the multi-medium data uploaded by multiple network channels are sorted；Change a kind of expression way, data recombination service Device is specifically restored according to the sequence of sequence number increments after receiving live TV stream and receiving the multi-medium data that server forwards The multi-medium data that first terminal generates.
Need to illustrate is thirdly that first terminal can send multimedia by two or more network channels Data, and it is mutually independent between each network channel, it does not interfere with each other.Wherein, the quantity of network channel is existed with first terminal Subject to the quantity that can be supported on hardware, the embodiment of the present invention is to this without specifically limiting.
302, server is after receiving the multi-medium data that first terminal is sent by least two network channels, docking The multi-medium data received carries out data recombination, and obtained recombination multi-medium data is pushed to second terminal.
In embodiments of the present invention, first terminal is specifically to receive server push to the corresponding live TV stream of each network channel Send multi-medium data.For example, network channel comes from A operators, then first terminal by the network channel to A operators Live TV stream receives server push multi-medium data, if another network channel comes from B operators, first terminal passes through the net Network channel receives server push multi-medium data to the live TV stream of B operators, and each live TV stream receives server and receiving After the multi-medium data sent to first terminal, the multi-medium data received can be turned to be pushed to data recombination server, into And the screening that data are completed by data recombination server recombinates.
It should be noted that, although there is the wind of packet loss when by each network channel upload multimedia data Danger, but via the multi-medium data of multiple network tunnel transports after being recombinated by the screening of data recombination server, data Reorganization server will as much as possible restore a reliable multi-medium data, and packet loss is reduced as far as with this, from And keep the integrality of data.
The terminal of method provided in an embodiment of the present invention, main broadcaster user sends multimedia number by multiple network channels According to, later, server carries out screening recombination by the multi-medium data to multiple network tunnel transports, can effective guarantee it is final It is output to the integrality of the multi-medium data of spectators' user side, multi-medium data is greatly reduced and is passed by single network channel Cause data that serious loss occurs because network state is bad when defeated, the ineffective problem of the live streaming in turn resulted in changes a kind of table Up to mode, since the consistency and continuity that are output to the multi-medium data for watching user side are ensured, so seeing It sees that user side decoding abnormal phenomenon is greatly decreased, can effectively solve the problem that the pictures such as green screen, Hua Ping, the mosaic that screen occurs play Problem and frame-skipping, interim card, discontinuous equal fluency problem, live streaming effect are preferable.
In addition, the terminal of main broadcaster user sends multi-medium data by multiple network channels, therefore when front end encodes Without carrying out dynamic code rate adaptation in order to alleviate network congestion to reduce packet loss, so this kind of multi-medium data pushes mode Image sharpness will not be reduced, video image quality is preferable, further ensures live streaming effect.
In another embodiment, first terminal by each network channel when sending multi-medium data, according to each The difference of the data volume of a network tunnel transports, data recombination server is when carrying out data screening recombination, the measure taken It is different.Assuming that the data volume one that the data volume that first terminal is sent by each network channel generates in the process with live streaming It causes, that is, if taking the redundant data transmissions mode of multiple network channels, as shown in figure 5, data recombination server is to receiving When the multi-medium data arrived carries out data recombination, include the following steps：
501, the multi-medium data received by different network channels is cached to different input-buffers, often respectively The sequence number that the data block of original position storage is cached in one input-buffer is consistent.
Wherein, the number of input-buffer and the number of network channel are consistent, it is assumed that the number of network channel is M, then inputs The number of caching is also M.That is, input-buffer is used to store the straight of the original push of main broadcaster user of live TV stream reception server forwarding Stream is broadcast, further, the multi-medium data of the same network tunnel transports is stored in the same input by data recombination server In caching.
In addition, data recombination server additionally provides an output caching, for storing the multimedia number after screening recombination According in order to the viewing user distribution of CDN server downstream, that is, the final live TV stream for being pushed to viewing user is output The multi-medium data of buffer memory.
It, need to also be according to it should be noted that each input-buffer is when storing the multi-medium data of each network tunnel transports According to following principles：Ensure in each input-buffer cache original position storage data block sequence number it is consistent, using as Subsequently judge whether the foundation for dropout of data block occur.
Below by taking Fig. 6 as an example, above-mentioned storage principle is described in detail.Assuming that the number of network channel is 2, then count 2 input-buffers are needed according to reorganization server, are respectively designated as input-buffer 1 and input-buffer 2, it is slow for the two inputs It deposits, when carrying out multi-medium data caching, also needs to ensure the sequence of the data block of caching original position storage in input-buffer 1 Number in input-buffer 2 cache original position storage the sequence number of data block it is consistent.Illustratively, in figure 6, input is slow Deposit the first data block FLV stored in the sequence number of the first data block FLVChunk1 stored in 1 and input-buffer 2 The sequence number of Chunk2 is consistent, for example the sequence number of the sequence number of FLV Chunk1 and FLV Chunk2 are 1.
502, slow from each input when the data volume stored in each input-buffer is respectively positioned on first object section The caching original position deposited starts sequence and carries out digital independent.
In embodiments of the present invention, the data volume that is stored in each input-buffer is typically to be weighed with the number of data block 's.Referring to Fig. 6, by taking symbol N refers to the data number of blocks of caching as an example, the data number of blocks N that is stored in each input-buffer When being respectively positioned on first object section, data recombination server starts the caching original position sequence from each input-buffer parallel Read block.Wherein, the value size of N is most important, if the value of N is smaller, due to the data cached in input-buffer Insufficient, can influence accuracy of the data recombination server when carrying out data screening recombination can shadow if the value of N is excessive Sound live streaming real-time, delay are larger.Under normal circumstances, the value of N is with the data volume for caching playable 3 to 5s in input-buffer It is accurate, it is assumed that current live is 15 frame per second, then the value of N is about 45 to 75, therefore data recombination server can be in each input Digital independent is proceeded by when storing 45 to 75 data blocks in caching.In addition, also the can be located at having data volume When the input-buffer of one target interval, just start to execute step 502, the embodiment of the present invention is to this without specifically limiting.
503, data recombination is carried out based on the data block read in each input-buffer.
In embodiments of the present invention, data recombination server is based on the data block read in each input-buffer When carrying out data recombination, can specifically following manner be taken to realize：
Step a, since the caching original position of each input-buffer, sequence judges to store at same buffered position Data block sequence number it is whether consistent.
Continue so that the number of network channel is 2 as an example, then referring to Fig. 7, first from storage of data recombination server Data BOB(beginning of block) sequence reads the data block stored in each input-buffer, and parses the Chunk in each data block header Number fields, to obtain the sequence number of each data block.
It step b, will be in any one input-buffer when the sequence number of the data block stored at same buffered position is consistent The data block of storage is stored again to output and is cached.
As shown in fig. 7, if the sequence number for the data block that input-buffer 1 is stored with same buffered position in input-buffer 2 Unanimously, then illustrate that 2 network channels do not go out active when transmitting this data block, for this kind of situation, data recombination Server may be selected to store the data block that any one input-buffer stores to output and cache.
Illustratively, in the figure 7, stored in first data block and input-buffer 2 that are stored in input-buffer 1 The sequence number of one data block is 1, therefore this data block stored in input-buffer 1 can be stored to delaying to output caching Initial position is deposited, alternatively, can also store this data block stored in input-buffer 2 to the caching start bit of output caching It sets.
Step c, when the sequence number of the data block stored at same buffered position is inconsistent, the mesh of sequence number minimum is determined Data block is marked, and target data block is stored to output and is cached.
The inconsistent situation of the serial number of the data block of storage at same buffered position in input-buffer 1 and input-buffer 2 Under, if the Serial No. 2 of second data block stored in input-buffer 1, but second data block stored in input-buffer 2 Serial No. 3, then illustrate that 2 corresponding network channel of input-buffer packet loss occurs in transmission data, cause in input-buffer 2 The sequence number of data block is out of order；If the Serial No. 3 of second data block stored in input-buffer 1, but deposited in input-buffer 2 The Serial No. 2 of second data block of storage, then illustrate that 1 corresponding network channel of input-buffer is lost in transmission data Packet, causes the sequence number of data block in input-buffer 1 out of order.
For such case, also need selection numerical value minimum sequence number, by the target data block of sequence number minimum store to Output caching, continues by taking Fig. 7 as an example, then needs second data block that will be stored in input-buffer 1 write-in output caching.With ChunkNumber1 refers to the sequence number of the data block on any one position in input-buffer 1, is referred to Chunk Number2 For the sequence number of data block in input-buffer 2 in same position, then need to select Min (ChunkNumber1, Chunk Number2 it), and then by the corresponding data blocks of Min (ChunkNumber1, Chunk Number2) is stored in output caching.
In the embodiments of the present disclosure, the terminal of main broadcaster user sends multi-medium data by multiple network channels, and every The data volume that one network channel is sent is consistent with the data volume that live streaming generates in the process, and later, server is logical to multiple networks The multi-medium data of road transmission carries out screening recombination, since each network channel is responsible for a partial data of transmission, so clothes Business device can effectively restore the initial data of main broadcaster user's push according to the data of each network tunnel transports, and effective guarantee is most It is output to the integrality of the multi-medium data of spectators' user side eventually, greatly reduces multi-medium data by single network channel Cause data that serious loss occurs because network state is bad when transmission, the ineffective problem of the live streaming in turn resulted in changes one kind Expression way, since the consistency and continuity that are output to the multi-medium data for watching user side are ensured, so Viewing user side decoding abnormal phenomenon is greatly decreased, and can effectively solve the problem that the pictures such as green screen, Hua Ping, the mosaic that screen occurs are broadcast Problem and frame-skipping, interim card are put, it is preferable that effect is broadcast live in discontinuous equal fluency problem.
In addition, since the terminal of main broadcaster user sends more parts of complete multi-medium datas, institute by multiple network channels With server can according to the data of each network tunnel transports come effectively restore main broadcaster user push initial data, therefore Without carrying out dynamic code rate adaptation in order to alleviate network congestion to reduce packet loss, so this kind of multimedia number when front end encodes Image sharpness will not be reduced according to push mode, video image quality is preferable, further ensures live streaming effect.
In another embodiment, it is assumed that the data volume that each network channel is sent is the number that live streaming generates in the process According to a part for amount, that is, if taking the distributed data transport mode of multiple network channels, as shown in figure 8, data recombination takes Business device includes the following steps when carrying out data recombination to the multi-medium data received：
801, the multi-medium data received by different network channels is cached to different input-buffers.
This step and above-mentioned steps 501 are similarly.
802, slow from each input when the data volume stored in each input-buffer is respectively positioned on first object section The caching original position deposited starts sequence and carries out digital independent.
This step and above-mentioned steps 502 are similarly.
803, according to the ascending sequence of sequence number, the data block order of reading is stored to output and is cached.
Continue by taking 2 network channels as an example, referring to Figure 12, it is assumed that the data volume that live streaming generates in the process is M, each net Each responsible transmission M/2 in network channel, for example, network channel 1 upload multi-medium data include Serial No. 1,3,5,7, 9 ..., N-1, N+1 ... data block, network channel 2 upload multi-medium data include Serial No. 2,4,6,8, 10 ..., N ... data block, then cached to input-buffer 1 in the multi-medium data for transmitting network channel 1, and will The multi-medium data that network channel 2 transmits is cached to input-buffer 2, can be according to the ascending sequence of sequence number come into line number According to recombination.
It illustratively, can be according to sequence for the data block read from the same buffered position of each input-buffer Number ascending sequence, sequential storage is to exporting caching.By taking Figure 12 as an example, it is assumed that deposit the caching initial position of input-buffer 1 The Serial No. 1 of the data block of storage, the Serial No. 2 of the data block of the caching initial position storage of input-buffer 2, then first by sequence The data block that row number is 1 is stored to output and is cached, and is then again stored the data block of Serial No. 2 to output and is cached.
In the embodiments of the present disclosure, the terminal of main broadcaster user sends multi-medium data by multiple network channels, and every The data volume that one network channel is sent is a part for the data volume that live streaming generates in the process, and it is logical that each network has been effectively relieved The data in road upload pressure, greatly reduce packet loss, later, server passes through the multimedia number to multiple network tunnel transports According to carrying out screening recombination, can effective guarantee final output to the integrality of the multi-medium data of spectators' user side, substantially reduce Multi-medium data cause because network state is bad when by single network channel transfer data occur it is serious lose, Jin Erzao At the ineffective problem of live streaming, change a kind of expression way, due to be output to viewing user side multi-medium data it is consistent Property and continuity ensured, so viewing user side decoding abnormal phenomenon be greatly decreased, can effectively solve the problem that screen The pictures such as green screen, Hua Ping, mosaic of appearance playback problem and frame-skipping, interim card, discontinuous equal fluency problem, live streaming effect Fruit is preferable.
In addition, the terminal due to main broadcaster user sends multi-medium data, and each network by multiple network channels The data volume that channel is sent is a part for the data volume that live streaming generates in the process, so each network channel has been effectively relieved Data upload pressure, greatly reduce packet loss, thus be not necessarily to when front end encode in order to alleviate network congestion and into Mobile state Rate adaption is to reduce packet loss, so this kind of multi-medium data push mode will not reduce image sharpness, video image quality compared with It is good, further ensure live streaming effect.
In addition, for the distributed data transport mode of multiple network channels, realize the bandwidth of multiple network channels It uses, the data volume that live streaming generates in the process is assigned on multiple network channels, subsequent data recombination is recycled to take Distributed data is combined into live TV stream and transmitted again by business device unification, can also transmit higher quality and more fine definition in this way Live TV stream.
In addition, the quantity for being used for transmission the network channel of multi-medium data is more, this programme more can play higher value, That is network channel number is more, and the data volume for being averagely allocated to single network channel transfer is just fewer, is more suitable for data upload in this way, It is also higher for the reduction success rate of packet loss.If the bandwidth of single channel network is a constant value, it is reacted to main broadcaster's use in this way For the side of family, with the increase of network channel quantity, the data volume that can be carried can constantly increase, so as to preferably expand It opens up image sharpness and allows to show video image quality by more multi code Rate of Chinese character.
Figure 10 is a kind of flow chart of multi-medium data method for pushing provided in an embodiment of the present invention.The interaction master of this method Body is first terminal, live TV stream reception server, data recombination server and second terminal, wherein first terminal is in Fig. 1 The terminal of main broadcaster user, second terminal are that the terminal of user is watched in Fig. 1, and live TV stream receives server and data recombination server It can be separate server, can also be integrated into a server.Wherein, it is being taken through the upload of multi-channel data redundancy When, referring to Figure 10, it is as follows that the arrangement flow of multi-medium data method for pushing provided in an embodiment of the present invention, which can comb,：
A, first terminal obtains the multi-medium data that generates in the process of live streaming, and by least two network channels to difference Live TV stream receive server send multi-medium data, and each network channel send data volume with live streaming during generate Data volume it is consistent.
Wherein, the network channel of different operators corresponds to the live TV stream reception server of different operators.
B, different live TV streams receives server after receiving multi-medium data, the multi-medium data that will respectively receive It is transmitted to data recombination server.
C, data recombination server will pass through after receiving different live TV streams and receiving the multi-medium data that server forwards Different live TV streams receive the multi-medium data that server receives and cache to different input-buffers, delay in each input-buffer The sequence number for depositing the data block of original position storage is consistent.
D, when the data volume stored in each input-buffer is respectively positioned on first object section, data recombination server from The caching original position of each input-buffer starts sequence and carries out digital independent.
E, for data recombination server since the caching original position of each input-buffer, sequence judges same buffered Whether the sequence number of the data block stored at position is consistent.
F, at same buffered position store data block sequence number it is consistent when, data recombination server by any one The data block stored in input-buffer is stored again to output and is cached.
G, when the sequence number of the data block stored at same buffered position is inconsistent, the number of targets of sequence number minimum is determined According to block, and target data block is stored to output and is cached.
H, obtained recombination multi-medium data is pushed to second terminal by data recombination server.
Figure 11 is a kind of flow chart of multi-medium data method for pushing provided in an embodiment of the present invention.The interaction master of this method Body is first terminal, live TV stream reception server, data recombination server and second terminal, wherein first terminal is in Fig. 1 The terminal of main broadcaster user, second terminal are that the terminal of user is watched in Fig. 1, and live TV stream receives server and data recombination server It can be separate server, can also be integrated into a server.Wherein, it is being taken through the upload of multichannel distributed data When, referring to Figure 11, it is as follows that the arrangement flow of multi-medium data method for pushing provided in an embodiment of the present invention, which can comb,：
A, first terminal obtains the multi-medium data that generates in the process of live streaming, and by least two network channels to difference Live TV stream receive server send multi-medium data, and each network channel send data volume be live streaming during generate Data volume a part.
B, different live TV streams receives server after receiving multi-medium data, the multi-medium data that will respectively receive It is transmitted to data recombination server.
C, data recombination server will pass through after receiving different live TV streams and receiving the multi-medium data that server forwards Different live TV streams receive the multi-medium data that server receives and cache to different input-buffers, delay in each input-buffer The sequence number for depositing the data block of original position storage is consistent.
D, when the data volume stored in each input-buffer is respectively positioned on first object section, data recombination server from The caching original position of each input-buffer starts sequence and carries out digital independent.
E, data recombination server stores the data block order of reading to output according to the ascending sequence of sequence number Caching.
F, obtained recombination multi-medium data is pushed to second terminal by data recombination server.
In another embodiment, by taking second terminal refers to the terminal of viewing user as an example, due to data recombination service Device needs to carry out verification and data recombination to the data block stored in each input-buffer, so can not accomplish that flow velocity is real-time, Correspondingly, the data block that data recombination server is stored in being cached based on output carries out to accomplish flow velocity reality when data-pushing When, if at this point, taking output to be cached with the mode that data are sent and will face flow velocity does not catch up with problem, and due to flow velocity and The broadcasting frame speed of two terminals is inconsistent, and then can lead to video buffer, that is, and data transmission bauds is slower than broadcasting speed, and second The player of terminal the phenomenon that playing interim card will occur since no data can be broadcast.
In order to solve this problem, data recombination server recombinates the multi-medium data finished in not caching output and stands It sends, but is retransmited after waiting for the data volume of caching to reach a certain size.For example playing duration 1 is cached to the data volume of 3s Start to carry out data transmission according to flow velocity again afterwards, to solve the problems, such as the playing progress rate of second terminal.Change a kind of expression way, data Reorganization server specifically takes following manner to realize when that will recombinate multi-medium data and be pushed to second terminal：
When the data volume stored in output caches is located at the second target interval, data recombination server is according to current live Video frame rate, the data block that stores will be pushed to second terminal in output caching.
Needing at illustrate first point is, data recombination server is specifically that the multi-medium data in caching output is pushed to CDN server, then second terminal is pushed to by CDN server.
Needing the second point illustrated is, the data that data recombination server stores in caching output according to video frame rate Include but not limited to that following several steps is taken to realize when block is pushed to second terminal：
Step 1 is based on video frame rate, obtains the time interval for sending stored each data block.
Step 2, a upper data block transmission after, after the time interval got, retransmit next data block, Wherein, the sequence number and the sequence number of next data block of a upper data block are continuous.
It is illustrated in a manner of the data-pushing to data reorganization server by a specific example below.
As shown in figure 12, it is assumed that system clock is arranged before executing data transmission task and is opened from 0 for data recombination server Beginning timing, by taking symbol fps refers to video frame rate as an example, then 1/fps is the time interval of a frame, and N/fps is the time of N frames Interval；Later, first data block storing is sent at 0 time point during data recombination server caches output, and the of storage Two data blocks then retransmit after waiting system clock has arrived this time point of 1/fps, and the third data block of storage then waits for System clock has arrived this time point of 2/fps and has retransmited, and so on, then waiting system clock arrives the n-th data block of storage N-1/fps this time point retransmits.
It is worth noting that, the sending method of the data stored in being cached above to output, it need to also be with constant video frame Premised on rate, a kind of expression way is changed, if the video frame rate of current live is fixed value, for example constant is that 25 frame per second are constant, that Aforesaid way can be taken to carry out data transmission.And if the video frame rate of current live is not fixed, such as certain a period of time Be 15 frame per second in another a period of time for 25 frame per second, then also need to determine in another way stored in output caching it is each The sending time point of data block specifically for this kind of situation, can obtain timestamp information from the head of each data block, into And each data block is sent according to corresponding timestamp information, i.e., when system clock has arrived and the timestamp information matched time When point, corresponding data block is sent.
Figure 13 is a kind of structural schematic diagram of multi-medium data pusher provided in an embodiment of the present invention.Referring to Figure 13, The device includes：
Receiving module 1301, the multi-medium data sent by least two network channels for receiving first terminal, institute Multi-medium data of the first terminal for generating live streaming in the process is stated to send by least two network channel；
Processing module 1302 obtains recombination multi-medium data for carrying out data recombination to the multi-medium data received；
First sending module 1303, for the recombination multi-medium data to be pushed to second terminal.
Device provided in an embodiment of the present invention sends multimedia number in the terminal of main broadcaster user by multiple network channels According to rear, screening recombination is carried out by the multi-medium data to multiple network tunnel transports, can effective guarantee final output to seeing The integrality of the multi-medium data of many user sides greatly reduces multi-medium data when by single network channel transfer because of net Network, which is not in good state, causes data that serious loss occurs, and the ineffective problem of the live streaming in turn resulted in changes a kind of expression way, by It is ensured in the consistency and continuity of the multi-medium data for being output to viewing user side, so in viewing user side solution Code abnormal phenomenon is greatly decreased, and can effectively solve the problem that the pictures playback problems such as green screen, Hua Ping, the mosaic that screen occurs, and Frame-skipping, interim card, discontinuous equal fluency problem, live streaming effect are preferable.
In addition, the terminal of main broadcaster user sends multi-medium data by multiple network channels, therefore when front end encodes Without carrying out dynamic code rate adaptation in order to alleviate network congestion to reduce packet loss, so this kind of multi-medium data pushes mode Image sharpness will not be reduced, video image quality is preferable, further ensures live streaming effect.
In another embodiment, the data volume one that the data volume that each network channel is sent generates in the process with live streaming It causes；Or,
The data volume that each described network channel is sent is a part for the data volume that live streaming generates in the process.
In another embodiment, the multi-medium data includes multiple data blocks, each data block includes head And main body, the sequence number of the data block is included in the head, the main body includes picture data and audio data.
In another embodiment, when the data volume that the data volume that each network channel is sent generates in the process with live streaming When consistent, the processing module, be additionally operable to by by heterogeneous networks channel reception to multi-medium data cached respectively to difference Input-buffer, the sequence number of the data block of caching original position storage is consistent in each input-buffer；When the input When the data volume stored in caching is located at first object section, since the caching original position of the input-buffer sequence into Row digital independent；Data recombination is carried out based on the data block read in the input-buffer.
In another embodiment, the processing module is additionally operable to the caching start bit from each input-buffer The place of setting starts, and sequence judges whether the sequence number of the data block stored at same buffered position is consistent；When the same buffered position Set place storage data block sequence number it is consistent when, the data block stored in any one input-buffer is stored again to defeated Go out caching.
In another embodiment, the processing module is additionally operable to the data block stored at the same buffered position Sequence number it is inconsistent when, determine the target data block of sequence number minimum, and the target data block is stored to the output Caching.
In another embodiment, when the data volume that each network channel is sent is the data volume that live streaming generates in the process A part when, the processing module, be additionally operable to by by heterogeneous networks channel reception to multi-medium data cache respectively to Different input-buffers；When the data volume stored in the input-buffer is located at first object section, each is defeated from described The caching original position for entering caching starts sequence progress digital independent；According to the sequence that sequence number is ascending, will read Data block order store to output cache.
In another embodiment, first sending module is additionally operable to be located at when the data volume stored in output caching When the second target interval, according to the video frame rate of current live, the data block stored in the output caching is pushed to described Second terminal.
In another embodiment, first sending module is additionally operable to, based on the video frame rate of the current live, obtain Take the time interval for sending stored each data block；After the transmission of a upper data block, after the time interval, then Send next data block；Wherein, the sequence number and the sequence number of next data block of a upper data block are continuous.
The alternative embodiment that any combination forms the disclosure may be used in above-mentioned all optional technical solutions.
Figure 14 is a kind of structural schematic diagram of multi-medium data pusher provided in an embodiment of the present invention.Referring to Figure 14, The device includes：
Acquisition module 1401, the multi-medium data generated in the process for obtaining live streaming；
Second sending module 1402, for sending the multi-medium data to server by least two network channels, So that the server carries out data recombination to the multi-medium data received by least two network channel, and incite somebody to action To recombination multi-medium data be pushed to second terminal.
Device provided in an embodiment of the present invention sends multi-medium data by multiple network channels, and later, server is logical Cross and screening recombination carried out to the multi-medium data of multiple network tunnel transports, can effective guarantee final output to spectators' user side Multi-medium data integrality, greatly reduce multi-medium data when by single network channel transfer because of network state not Good to cause data that serious loss occurs, what is in turn resulted in is broadcast live ineffective problem, a kind of expression way is changed, due to being output to The consistency and continuity for watching the multi-medium data of user side are ensured, so abnormal existing in viewing user side decoding As being greatly decreased, pictures playback problem and frame-skipping, the cards such as green screen, Hua Ping, the mosaic that screen occurs can effectively solve the problem that , it is discontinuous to wait fluency problem, live streaming effect preferable.
In addition, sending multi-medium data by multiple network channels, therefore it is not necessarily to when front end encodes in order to alleviate net Network blocks and carries out dynamic code rate adaptation to reduce packet loss, so will not to reduce picture clear for this kind of multi-medium data push mode Clear degree, video image quality is preferable, further ensures live streaming effect.
In another embodiment, second sending module is additionally operable to send and be broadcast live by each network channel The consistent multi-medium data of the data volume that generates in the process；Or, being produced during sending live streaming by each described network channel Raw part multi-medium data.
The alternative embodiment that any combination forms the disclosure may be used in above-mentioned all optional technical solutions.
It should be noted that：The multi-medium data sending device that above-described embodiment provides is when pushing multi-medium data, only The example of the division of the above functional modules, in practical application, can as needed and by above-mentioned function distribution by Different function modules is completed, i.e., the internal structure of device is divided into different function modules, described above complete to complete Portion or partial function.In addition, the multi-medium data sending device and multi-medium data method for pushing that above-described embodiment provides are real It applies example and belongs to same design, specific implementation process refers to embodiment of the method.
Figure 15 shows a kind of knot for multi-medium data pushing equipment 1500 that an illustrative embodiment of the invention provides Structure block diagram.The equipment 1500 can be portable mobile termianl, such as：Smart mobile phone, tablet computer, MP3 player (Moving Picture Experts Group Audio Layer III, dynamic image expert's compression standard audio level 3), MP4 (Moving Picture Experts Group Audio Layer IV, dynamic image expert's compression standard audio level 4) is broadcast Put device, laptop or desktop computer.Equipment 1500 be also possible to be referred to as user equipment, portable terminal, laptop terminal, Other titles such as terminal console.
In general, equipment 1500 includes：Processor 1501 and memory 1502.
Processor 1501 may include one or more processing cores, such as 4 core processors, 8 core processors etc..Place DSP (Digital Signal Processing, Digital Signal Processing), FPGA (Field- may be used in reason device 1501 Programmable Gate Array, field programmable gate array), PLA (Programmable Logic Array, may be programmed Logic array) at least one of example, in hardware realize.Processor 1501 can also include primary processor and coprocessor, master Processor is the processor for being handled data in the awake state, also referred to as CPU (Central Processing Unit, central processing unit)；Coprocessor is the low power processor for being handled data in the standby state.? In some embodiments, processor 1501 can be integrated with GPU (Graphics Processing Unit, image processor), GPU is used to be responsible for the rendering and drafting of content to be shown needed for display screen.In some embodiments, processor 1501 can also wrap AI (Artificial Intelligence, artificial intelligence) processor is included, the AI processors are for handling related machine learning Calculating operation.
Memory 1502 may include one or more computer readable storage mediums, which can To be non-transient.Memory 1502 may also include high-speed random access memory and nonvolatile memory, such as one Or multiple disk storage equipments, flash memory device.In some embodiments, the non-transient computer in memory 1502 can Storage medium is read for storing at least one instruction, at least one instruction is for performed to realize this Shen by processor 1501 Please in embodiment of the method provide multi-medium data method for pushing.
In some embodiments, equipment 1500 is also optional includes：Peripheral device interface 1503 and at least one periphery are set It is standby.It can be connected by bus or signal wire between processor 1501, memory 1502 and peripheral device interface 1503.It is each outer Peripheral equipment can be connected by bus, signal wire or circuit board with peripheral device interface 1503.Specifically, peripheral equipment includes： In radio circuit 1504, touch display screen 1505, camera 1506, voicefrequency circuit 1507, positioning component 1508 and power supply 1509 At least one.
Peripheral device interface 1503 can be used for I/O (Input/Output, input/output) is relevant at least one outer Peripheral equipment is connected to processor 1501 and memory 1502.In some embodiments, processor 1501, memory 1502 and periphery Equipment interface 1503 is integrated on same chip or circuit board；In some other embodiments, processor 1501, memory 1502 and peripheral device interface 1503 in any one or two can be realized on individual chip or circuit board, this implementation Example is not limited this.
Radio circuit 1504 is for receiving and emitting RF (Radio Frequency, radio frequency) signal, also referred to as electromagnetic signal. Radio circuit 1504 is communicated by electromagnetic signal with communication network and other communication equipments.Radio circuit 1504 is by telecommunications Number being converted to electromagnetic signal is sent, alternatively, the electromagnetic signal received is converted to electric signal.Optionally, radio circuit 1504 include：Antenna system, one or more amplifiers, tuner, oscillator, digital signal processor, compiles solution at RF transceivers Code chipset, user identity module card etc..Radio circuit 1504 can by least one wireless communication protocol come with it is other Terminal is communicated.The wireless communication protocol includes but not limited to：WWW, Metropolitan Area Network (MAN), Intranet, each third generation mobile communication network (2G, 3G, 4G and 5G), WLAN and/or WiFi (Wireless Fidelity, Wireless Fidelity) network.In some implementations In example, radio circuit 1504 can also include NFC (Near Field Communication, wireless near field communication) related Circuit, the application are not limited this.
Display screen 1505 is for showing UI (User Interface, user interface).The UI may include figure, text, Icon, video and its their arbitrary combination.When display screen 1505 is touch display screen, display screen 1505 also there is acquisition to exist The ability of the surface of display screen 1505 or the touch signal of surface.The touch signal can be used as control signal to be input to place Reason device 1501 is handled.At this point, display screen 1505 can be also used for providing virtual push button and/or dummy keyboard, it is also referred to as soft to press Button and/or soft keyboard.In some embodiments, display screen 1505 can be one, and the front panel of equipment 1500 is arranged；Another In a little embodiments, display screen 1505 can be at least two, be separately positioned on the different surfaces of equipment 1500 or in foldover design； In still other embodiments, display screen 1505 can be flexible display screen, be arranged on the curved surface of equipment 1500 or fold On face.Even, display screen 1505 can also be arranged to non-rectangle irregular figure, namely abnormity screen.Display screen 1505 can be with Using LCD (Liquid Crystal Display, liquid crystal display), OLED (Organic Light-Emitting Diode, Organic Light Emitting Diode) etc. materials prepare.
CCD camera assembly 1506 is for acquiring image or video.Optionally, CCD camera assembly 1506 includes front camera And rear camera.In general, the front panel in terminal is arranged in front camera, rear camera is arranged at the back side of terminal.? In some embodiments, rear camera at least two is that main camera, depth of field camera, wide-angle camera, focal length are taken the photograph respectively As any one in head, to realize that main camera and the fusion of depth of field camera realize background blurring function, main camera and wide Pan-shot and VR (Virtual Reality, virtual reality) shooting functions or other fusions are realized in angle camera fusion Shooting function.In some embodiments, CCD camera assembly 1506 can also include flash lamp.Flash lamp can be monochromatic temperature flash of light Lamp can also be double-colored temperature flash lamp.Double-colored temperature flash lamp refers to the combination of warm light flash lamp and cold light flash lamp, be can be used for Light compensation under different-colour.
Voicefrequency circuit 1507 may include microphone and loud speaker.Microphone is used to acquire the sound wave of user and environment, and It converts sound waves into electric signal and is input to processor 1501 and handled, or be input to radio circuit 1504 to realize that voice is logical Letter.For stereo acquisition or the purpose of noise reduction, microphone can be multiple, be separately positioned on the different parts of equipment 1500. Microphone can also be array microphone or omnidirectional's acquisition type microphone.Loud speaker is then used to that processor 1501 or radio frequency will to be come from The electric signal of circuit 1504 is converted to sound wave.Loud speaker can be traditional wafer speaker, can also be that piezoelectric ceramics is raised one's voice Device.When loud speaker is piezoelectric ceramic loudspeaker, the audible sound wave of the mankind can be not only converted electrical signals to, can also be incited somebody to action Electric signal is converted to the sound wave that the mankind do not hear to carry out the purposes such as ranging.In some embodiments, voicefrequency circuit 1507 may be used also To include earphone jack.
Positioning component 1508 is used for the current geographic position of positioning device 1500, to realize navigation or LBS (Location Based Service, location based service).Positioning component 1508 can be the GPS (Global based on the U.S. Positioning System, global positioning system), China dipper system or Russia Galileo system positioning group Part.
Power supply 1509 is used to be powered for the various components in equipment 1500.Power supply 1509 can be alternating current, direct current Electricity, disposable battery or rechargeable battery.When power supply 1509 includes rechargeable battery, which can have micro USB Battery or wireless charging battery.Wired charging battery is the battery to be charged by Wireline, and wireless charging battery is to pass through The battery of wireless coil charging.The rechargeable battery can be also used for supporting fast charge technology.
In some embodiments, equipment 1500 further include there are one or multiple sensors 1510.The one or more senses Device 1510 includes but not limited to：Acceleration transducer 1511, gyro sensor 1512, pressure sensor 1513, fingerprint sensing Device 1514, optical sensor 1515 and proximity sensor 1516.
Acceleration transducer 1511 can detect the acceleration in three reference axis of the coordinate system established with equipment 1500 Size.For example, acceleration transducer 1511 can be used for detecting component of the acceleration of gravity in three reference axis.Processor The 1501 acceleration of gravity signals that can be acquired according to acceleration transducer 1511, control touch display screen 1505 is with transverse views Or longitudinal view carries out the display of user interface.Acceleration transducer 1511 can be also used for game or the exercise data of user Acquisition.
Gyro sensor 1512 can be with the body direction of detection device 1500 and rotational angle, gyro sensor 1512 Acquisition user can be cooperateed with to act the 3D of equipment 1500 with acceleration transducer 1511.Processor 1501 is according to gyro sensors The data that device 1512 acquires, may be implemented following function：Action induction (for example changing UI according to the tilt operation of user) is clapped Image stabilization, game control when taking the photograph and inertial navigation.
The lower layer of side frame and/or touch display screen 1505 in equipment 1500 can be arranged in pressure sensor 1513.When The gripping signal that user can be detected in the side frame of equipment 1500 to equipment 1500 is arranged in pressure sensor 1513, by Reason device 1501 carries out right-hand man's identification or prompt operation according to the gripping signal that pressure sensor 1513 acquires.Work as pressure sensor 1513 are arranged in the lower layer of touch display screen 1505, are grasped to the pressure of touch display screen 1505 according to user by processor 1501 Make, realization controls the operability control on the interfaces UI.Operability control include button control, scroll bar control, At least one of icon control, menu control.
Fingerprint sensor 1514 is used to acquire the fingerprint of user, is collected according to fingerprint sensor 1514 by processor 1501 Fingerprint recognition user identity, alternatively, by fingerprint sensor 1514 according to the identity of collected fingerprint recognition user.Knowing When the identity for not going out user is trusted identity, the user is authorized to execute relevant sensitive operation, sensitivity behaviour by processor 1501 Work includes solving lock screen, checking encryption information, download software, payment and change setting etc..Fingerprint sensor 1514 can be set Install standby 1500 front, the back side or side.When being provided with physical button or manufacturer Logo in equipment 1500, fingerprint sensor 1514 can integrate with physical button or manufacturer Logo.
Optical sensor 1515 is for acquiring ambient light intensity.In one embodiment, processor 1501 can be according to light The ambient light intensity that sensor 1515 acquires is learned, the display brightness of touch display screen 1505 is controlled.Specifically, work as ambient light intensity When higher, the display brightness of touch display screen 1505 is turned up；When ambient light intensity is relatively low, the aobvious of touch display screen 1505 is turned down Show brightness.In another embodiment, the ambient light intensity that processor 1501 can also be acquired according to optical sensor 1515, Dynamic adjusts the acquisition parameters of CCD camera assembly 1506.
Proximity sensor 1516, also referred to as range sensor are generally arranged at the front panel of equipment 1500.Proximity sensor 1516 the distance between the front for acquiring user and equipment 1500.In one embodiment, when proximity sensor 1516 is examined When measuring the distance between the front of user and equipment 1500 and tapering into, by processor 1501 control touch display screen 1505 from Bright screen state is switched to breath screen state；When proximity sensor 1516 detect the distance between front of user and equipment 1500 by When gradual change is big, touch display screen 1505 is controlled by processor 1501 and is switched to bright screen state from breath screen state.
It, can be with it will be understood by those skilled in the art that structure shown in Figure 15 does not constitute the restriction to equipment 1500 Including than illustrating more or fewer components, either combining certain components or being arranged using different components.
Figure 16 is a kind of structural schematic diagram of multi-medium data pushing equipment provided in an embodiment of the present invention, the server 1600 can generate bigger difference because configuration or performance are different, may include one or more processors (central Processing units, CPU) 1601 and one or more memory 1602, wherein it is deposited in the memory 1602 At least one instruction is contained, at least one instruction is loaded by the processor 1601 and executed to realize above-mentioned each method The multi-medium data method for pushing that embodiment provides.Certainly, which can also have wired or wireless network interface, keyboard And the components such as input/output interface, to carry out input and output, which can also include other for realizing equipment work( The component of energy.
In the exemplary embodiment, a kind of computer readable storage medium, such as the memory including instruction are additionally provided, Above-metioned instruction can be executed by the processor in terminal to complete the multi-medium data method for pushing in above-described embodiment.For example, institute It can be that ROM, random access memory (RAM), CD-ROM, tape, floppy disk and light data are deposited to state computer readable storage medium Store up equipment etc..
One of ordinary skill in the art will appreciate that realizing that all or part of step of above-described embodiment can pass through hardware It completes, relevant hardware can also be instructed to complete by program, the program can be stored in a kind of computer-readable In storage medium, storage medium mentioned above can be read-only memory, disk or CD etc..
The foregoing is merely presently preferred embodiments of the present invention, is not intended to limit the invention, it is all the present invention spirit and Within principle, any modification, equivalent replacement, improvement and so on should all be included in the protection scope of the present invention.

Claims (15)

1. a kind of multi-medium data method for pushing, which is characterized in that it is applied to server, the method includes：
The multi-medium data that first terminal is sent by least two network channels is received, the first terminal will be for that will be broadcast live The multi-medium data generated in journey is sent by least two network channel；
Data recombination is carried out to the multi-medium data received, obtains recombination multi-medium data；
The recombination multi-medium data is pushed to second terminal.
2. according to the method described in claim 1, it is characterized in that, data volume and live streaming process that each network channel is sent The data volume of middle generation is consistent；Or,
The data volume that each described network channel is sent is a part for the data volume that live streaming generates in the process.
3. according to the method described in claim 1, it is characterized in that, the multi-medium data includes multiple data blocks, the number Include head and main body according to block, the sequence number of the data block is included in the head, the main body includes picture data And audio data.
4. according to the method described in claim 3, it is characterized in that, when the data volume that each network channel is sent and being broadcast live When the data volume generated in journey is consistent, the described pair of multi-medium data received carries out data recombination, including：
By by heterogeneous networks channel reception to multi-medium data cached respectively to different input-buffers, each input is slow The sequence number for depositing the data block of middle caching original position storage is consistent；
When the data volume stored in the input-buffer is located at first object section, from the caching start bit of the input-buffer It sets place's beginning sequence and carries out digital independent；
Data recombination is carried out based on the data block read in the input-buffer.
5. according to the method described in claim 4, it is characterized in that, described based on the data read in the input-buffer Block carries out data recombination, including：
Since the caching original position of each input-buffer, sequence judges the data stored at same buffered position Whether the sequence number of block is consistent；
When the sequence number of the data block stored at the same buffered position is consistent, by what is stored in any one input-buffer The data block is stored again to output and is cached.
6. according to the method described in claim 5, it is characterized in that, the method further includes：
When the sequence number of the data block stored at the same buffered position is inconsistent, the target data of sequence number minimum is determined Block, and the target data block is stored to the output and is cached.
7. according to the method described in claim 3, it is characterized in that, when the data volume that each network channel is sent is to be broadcast live When a part for the data volume generated in journey, the described pair of multi-medium data received carries out data recombination, including：
By by heterogeneous networks channel reception to multi-medium data cached respectively to different input-buffers；
When the data volume stored in the input-buffer is located at first object section, originated from the caching of each input-buffer Start sequence at position and carries out digital independent；
According to the sequence that sequence number is ascending, the data block order read is stored to output and is cached.
8. the method according to any claim in claim 4 to 7, which is characterized in that described by the more matchmakers of recombination Volume data is pushed to second terminal, including：
It, will be described according to the video frame rate of current live when the data volume stored in output caches is located at the second target interval The data block stored in output caching is pushed to the second terminal.
9., will be described defeated according to the method described in claim 8, it is characterized in that, the video frame rate according to current live Go out the data block stored in caching and is pushed to the second terminal, including：
Based on the video frame rate of the current live, the time interval for sending stored each data block is obtained；
After the transmission of a upper data block, after the time interval, next data block is retransmited；
Wherein, the sequence number and the sequence number of next data block of a upper data block are continuous.
10. a kind of multi-medium data method for pushing, which is characterized in that it is applied to terminal, the method includes：
Obtain the multi-medium data that live streaming generates in the process；
Send the multi-medium data to server by least two network channels so that the server to pass through it is described extremely The multi-medium data that few two network channels receive carries out data recombination, and obtained recombination multi-medium data is pushed to the Two terminals.
11. according to the method described in claim 10, it is characterized in that, described sent out by least two network channels to server The multi-medium data is sent, including：
Pass through the consistent multi-medium data of the data volume that each network channel is sent with live streaming generates in the process；Or, passing through institute It states each network channel and sends the part multi-medium data that live streaming generates in the process.
12. a kind of multi-medium data pusher, which is characterized in that be applied to server, described device includes：
Receiving module, the multi-medium data sent by least two network channels for receiving first terminal, described first eventually Multi-medium data of the end for generating live streaming in the process is sent by least two network channel；
Processing module obtains recombination multi-medium data for carrying out data recombination to the multi-medium data received；
First sending module, for the recombination multi-medium data to be pushed to second terminal.
13. a kind of multi-medium data pusher, which is characterized in that be applied to terminal, described device includes：
Acquisition module, the multi-medium data generated in the process for obtaining live streaming；
Second sending module, for sending the multi-medium data to server by least two network channels, so that described Server carries out data recombination, and the recombination that will be obtained to the multi-medium data received by least two network channel Multi-medium data is pushed to second terminal.
14. a kind of storage medium, which is characterized in that it is stored at least one instruction in the storage medium, described at least one Instruction is loaded by processor and is executed to realize that the multi-medium data as described in any of claim 1 to 9 claim pushes away Delivery method, or, the multi-medium data method for pushing as described in any of claim 10 to 11 claim.
15. a kind of multi-medium data pushing equipment, which is characterized in that the equipment includes processor and memory, the storage At least one instruction is stored in device, at least one instruction is loaded by the processor and executed to realize such as claim Multi-medium data method for pushing described in any of 1 to 9 claim, or, such as any of claim 10 to 11 right It is required that the multi-medium data method for pushing.
CN201810614487.0A 2018-06-14 2018-06-14 Multimedia data pushing method and device, storage medium and equipment Active CN108769726B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810614487.0A CN108769726B (en) 2018-06-14 2018-06-14 Multimedia data pushing method and device, storage medium and equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810614487.0A CN108769726B (en) 2018-06-14 2018-06-14 Multimedia data pushing method and device, storage medium and equipment

Publications (2)

Publication Number Publication Date
CN108769726A true CN108769726A (en) 2018-11-06
CN108769726B CN108769726B (en) 2022-05-31

Family

ID=64022643

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810614487.0A Active CN108769726B (en) 2018-06-14 2018-06-14 Multimedia data pushing method and device, storage medium and equipment

Country Status (1)

Country Link
CN (1) CN108769726B (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110087109A (en) * 2019-04-19 2019-08-02 中国科学院信息工程研究所 Video code rate adaptive approach and device
CN110198311A (en) * 2019-05-21 2019-09-03 腾讯科技（深圳）有限公司 A kind of data flow processing method, device, equipment and medium
CN110247955A (en) * 2019-05-21 2019-09-17 菜鸟智能物流控股有限公司 Unmanned vehicle communication method and unmanned vehicle
CN110912669A (en) * 2019-11-15 2020-03-24 珠海市新德汇信息技术有限公司 Two-channel data transmission method based on file stream and data stream
CN111885555A (en) * 2020-06-08 2020-11-03 安凯(广州)微电子技术有限公司 TWS earphone based on monitoring scheme and implementation method thereof
CN113992639A (en) * 2021-09-29 2022-01-28 阿里巴巴达摩院(杭州)科技有限公司 Audio and video processing method and equipment
CN114173144A (en) * 2021-12-02 2022-03-11 北京优祥智恒科技有限公司 Live broadcast equipment, control method thereof and live broadcast backpack
WO2023217188A1 (en) * 2022-05-11 2023-11-16 北京字节跳动网络技术有限公司 Livestream data transmission method, apparatus and system, device and medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101009581A (en) * 2006-01-24 2007-08-01 北京畅通达通信技术有限公司 Line non-loss automatic switching method and device based on analysis on the transfer quality
US20150020123A1 (en) * 2008-12-23 2015-01-15 Cisco Technology, Inc. Bandwidth Flexibility Through Multiple Frequency Channel Data Distribution
CN105392020A (en) * 2015-11-19 2016-03-09 广州华多网络科技有限公司 Internet video direct broadcasting method and system
CN105472477A (en) * 2015-12-08 2016-04-06 广州华多网络科技有限公司 Data transmission method, device and equipment

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101009581A (en) * 2006-01-24 2007-08-01 北京畅通达通信技术有限公司 Line non-loss automatic switching method and device based on analysis on the transfer quality
US20150020123A1 (en) * 2008-12-23 2015-01-15 Cisco Technology, Inc. Bandwidth Flexibility Through Multiple Frequency Channel Data Distribution
CN105392020A (en) * 2015-11-19 2016-03-09 广州华多网络科技有限公司 Internet video direct broadcasting method and system
CN105472477A (en) * 2015-12-08 2016-04-06 广州华多网络科技有限公司 Data transmission method, device and equipment

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110087109A (en) * 2019-04-19 2019-08-02 中国科学院信息工程研究所 Video code rate adaptive approach and device
CN110087109B (en) * 2019-04-19 2020-09-29 中国科学院信息工程研究所 Video code rate self-adaption method and device, electronic equipment and storage medium
CN110198311A (en) * 2019-05-21 2019-09-03 腾讯科技（深圳）有限公司 A kind of data flow processing method, device, equipment and medium
CN110247955A (en) * 2019-05-21 2019-09-17 菜鸟智能物流控股有限公司 Unmanned vehicle communication method and unmanned vehicle
CN110198311B (en) * 2019-05-21 2022-03-29 腾讯科技（深圳）有限公司 Data stream processing method, device, equipment and medium
CN110912669A (en) * 2019-11-15 2020-03-24 珠海市新德汇信息技术有限公司 Two-channel data transmission method based on file stream and data stream
CN111885555A (en) * 2020-06-08 2020-11-03 安凯(广州)微电子技术有限公司 TWS earphone based on monitoring scheme and implementation method thereof
CN111885555B (en) * 2020-06-08 2022-05-20 广州安凯微电子股份有限公司 TWS earphone based on monitoring scheme and implementation method thereof
CN113992639A (en) * 2021-09-29 2022-01-28 阿里巴巴达摩院(杭州)科技有限公司 Audio and video processing method and equipment
CN113992639B (en) * 2021-09-29 2024-04-05 杭州阿里云飞天信息技术有限公司 Audio and video processing method and equipment
CN114173144A (en) * 2021-12-02 2022-03-11 北京优祥智恒科技有限公司 Live broadcast equipment, control method thereof and live broadcast backpack
WO2023217188A1 (en) * 2022-05-11 2023-11-16 北京字节跳动网络技术有限公司 Livestream data transmission method, apparatus and system, device and medium

Also Published As

Publication number Publication date
CN108769726B (en) 2022-05-31

Similar Documents

Publication Publication Date Title
CN108769726A (en) Multi-medium data method for pushing, device, storage medium and equipment
CN108259945B (en) Method and device for processing playing request for playing multimedia data
CN110213636B (en) Method and device for generating video frame of online video, storage medium and equipment
CN109874043B (en) Video stream sending method, video stream playing method and video stream playing device
CN108833963B (en) Method, computer device, readable storage medium and system for displaying interface picture
CN108900859A (en) Live broadcasting method and system
CN108966008A (en) Live video back method and device
CN108495142A (en) Method for video coding and device
CN110213616A (en) Video providing method, acquisition methods, device and equipment
CN109600678A (en) Information displaying method, apparatus and system, server, terminal, storage medium
CN108600778B (en) Media stream transmitting method, device, system, server, terminal and storage medium
CN108769826A (en) Live media stream acquisition methods, device, terminal and storage medium
CN109618212A (en) Information display method, device, terminal and storage medium
CN107888968A (en) Player method, device and the computer-readable storage medium of live video
CN109413453A (en) Video broadcasting method, device, terminal and storage medium
CN111586431B (en) Method, device and equipment for live broadcast processing and storage medium
CN110213608A (en) Show method, apparatus, equipment and the readable storage medium storing program for executing of virtual present
CN109246123A (en) Media stream capturing method and device
KR102491006B1 (en) Data Transmission Methods and Electronic Devices
CN111596885B (en) Audio data processing method, server and storage medium
CN109951398A (en) Data transmission method for uplink, device and computer equipment
CN110121084A (en) The methods, devices and systems of port switching
CN109120933A (en) Dynamic adjusts method, apparatus, equipment and the storage medium of code rate
CN108965711B (en) Video processing method and device
CN108881931A (en) A kind of data buffering method and the network equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant