CN104270646A - Self-adaption transmission method and system based on mobile streaming media - Google Patents
Self-adaption transmission method and system based on mobile streaming media Download PDFInfo
- Publication number
- CN104270646A CN104270646A CN201410486990.4A CN201410486990A CN104270646A CN 104270646 A CN104270646 A CN 104270646A CN 201410486990 A CN201410486990 A CN 201410486990A CN 104270646 A CN104270646 A CN 104270646A
- Authority
- CN
- China
- Prior art keywords
- video
- svc
- slicing
- coding
- file
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000005540 biological transmission Effects 0.000 title claims abstract description 48
- 238000000034 method Methods 0.000 title claims abstract description 46
- 230000003044 adaptive effect Effects 0.000 claims description 17
- 238000001514 detection method Methods 0.000 claims description 14
- 230000006870 function Effects 0.000 claims description 10
- 230000003139 buffering effect Effects 0.000 claims description 9
- 230000015572 biosynthetic process Effects 0.000 claims description 6
- 230000014509 gene expression Effects 0.000 claims description 6
- 241001269238 Data Species 0.000 claims description 3
- 238000005111 flow chemistry technique Methods 0.000 claims description 3
- 238000013467 fragmentation Methods 0.000 claims description 3
- 238000006062 fragmentation reaction Methods 0.000 claims description 3
- 238000005070 sampling Methods 0.000 claims description 3
- 230000009466 transformation Effects 0.000 claims description 3
- 230000000694 effects Effects 0.000 abstract description 5
- 230000011218 segmentation Effects 0.000 abstract 1
- 239000002356 single layer Substances 0.000 abstract 1
- 238000010586 diagram Methods 0.000 description 5
- 230000006978 adaptation Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 2
- 239000000203 mixture Substances 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 238000013139 quantization Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440263—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/414—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
- H04N21/41407—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4405—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving video stream decryption
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/643—Communication protocols
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/647—Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
- H04N21/64784—Data processing by the network
- H04N21/64792—Controlling the complexity of the content stream, e.g. by dropping packets
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
- H04N21/845—Structuring of content, e.g. decomposing content into time segments
- H04N21/8456—Structuring of content, e.g. decomposing content into time segments by decomposing the content in the time domain, e.g. in time segments
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Computer Security & Cryptography (AREA)
- General Engineering & Computer Science (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention provides a method and system for transmitting an SVC-encoded streaming media video by means of the HTTP-based self-adaptation transmission technology in a mobile environment. The method mainly comprises the steps of conducting HTTP-based self-adaptation streaming media transmission and integrating the scalable video coding technology into a self-adaptation transmission system, wherein the self-adaptation transmission system is realized according to the latest MPEG-DASH standard, and the video is layered by means of the scalable video coding technology to enable the quality of the video to be adaptable to different network conditions. According to the method and system, video playing quality is improved in two aspects; in the aspect of video coding, the video is layered through scalable video coding so that effect can be improved compared with single-layer video playing; in the aspect of video transmission, a video segmentation client side can automatically select the video with proper definition according to the network condition.
Description
Technical field
The present invention relates to field of video transmission, particularly relate to a kind of SVC Streaming Media adaptive transmission method on the mobile apparatus and system.
Background technology
Along with the fast development of mobile Internet, smart mobile phone has become the instrument of staff indispensability, and mobile phone has surmounted its original basic function completely, becomes the important component part of people's entertainment life.Internet video is the valuable source that people amuse and divert oneself, and how by the video on the viewing the Internet of mobile phone smoothness, becomes the research contents that field of video transmission is important.The organizational form of the former video on Video coding mode, server, and the host-host protocol used in transmission of video are all the key factors affecting video quality.
Summary of the invention
In order to reach the object of the viewing video of smoothness on smart mobile phone, the present invention proposes a kind of video storage form from Video coding to server end, then arrive the solution of video transmission manner.
In order to achieve the above object, this invention takes following technical scheme:
A SVC video stream media adaptive transmission method under mobile environment, comprises the following steps:
Step 1:SVC Video coding; In the module of Video coding, adopt the thought of hierarchical coding, according to SVC coding standard, be multiple layers of different resolution, different frame per second, different quality by Video coding, be specially a Primary layer and multiple enhancement layer, the video packets of Primary layer contains the essential information of decoding required for displaying video, enhanced layer packets is containing the more details information of video, video playback end can carry out suitable packet loss process according to current network condition to the video packets of enhancement layer, alleviate the pressure of Internet Transmission, to reach the object of more smooth broadcasting;
Step 2:SVC video slicing stores; Follow MPEG-DASH standard, video after coding is carried out burst, video is divided into the video segment of different code check and different quality, again a kind of video of code check to be divided into etc. multiple bursts of duration according to time span, each burst is smaller, is convenient to transmit in the form of streaming in subsequent process; Meanwhile, in order to each video slicing can be navigated to, while formation burst, a corresponding video index file can be formed, after video playback end downloads index file, carry out the corresponding video segment of parsings download;
Step 3: mobile client request is carried out transmitting and carried out video playback; In order to through fire compartment wall etc., better transmit in a network, in transmitting procedure, adopt http protocol; Initiate transmission of video by client active request formula, driven by the video player of client; In the process of displaying video, the available bandwidth information of client meeting real-time collecting current network, and utilize the history bandwidth information collected, the bandwidth value of subsequent time is made prediction, to determine the video slicing of asking which kind of code check next time.
Further, the detailed process of step 1:SVC Video coding is:
Step 11: prepare yuv video: the naked video preparing the different resolution required for SVC coding, different quality;
Step 12: generate SVC configuration file: the configuration file of SVC coding is divided into master configuration file and one or more layers of configuration file, the configuration file of each layer must indicate in master configuration file, the position exporting SVC video flowing is comprised, the information such as the frame number that encode in master configuration file.Layer configuration file comprises the basic essential information of this enhancement layer, comprises the resolution of input video, the frame per second of input and output video, the quantified parameter information of sampling;
Step 13: Video coding: after the configuration file setting SVC coding, can encode to video, according to the difference of configuration file, a Primary layer of different resolution, different frame per second and different quality can add the video of multiple enhancement layer.
Further, the detailed process that step 2:SVC video slicing stores is:
Step 21: input SVC video file
Video after coding is processed, is convenient to store and follow-up transmission of video;
Step 22: SVC video flowing is split
H.264/AVC the component units that video flowing is the most basic is NAL unit, and different NAL unit represents different video datas; Each NAL unit comprises the NAL unit head of a byte, the rear 5 bit representations type of this NAL unit of first character joint, and NAL unit is all using 0x0001 or 0x001 as opening flag;
Step 3:SVC code stream burst
After obtaining SVC video flowing, video is divided into NAL unit one by one according to opening flag, by the analysis to NAL unit corresponding positions, the layer information at NAL place can be obtained.Obtain every layer obtain every layer of NAL unit after, according to frame per second and frame number, judge the length of current video section, if length reaches threshold value, by video segment new for formation one;
Step 4: generate media description file
After to SVC video flow processing, corresponding video slicing information being written to suffix is in * .mpd index file, comprises the elementary path of media slicing and the URL of each burst in index file, and the code rate information of different burst.
Further, step 3: mobile client request is carried out transmitting and the detailed process of carrying out video playback is:
Step 31: download MPD media description file
Mobile client, after beginning playing task, first downloads MPD media description file from server end;
Step 32: resolve MPD media description file
Describe one or more expressions of video in MPD media description file, often kind represents kind of the URL(uniform resource locator) describing again each video slicing, i.e. URL; The particular location of the code check of often kind of expression correspondence of video, medium kind, maximum/minimum bandwidth and each video slicing can be obtained to the parsing of media file;
Step 33: video slicing is downloaded
Video playback end asks corresponding video slicing by HTTP GET, and in buffering suitable at first;
Step 34: player decoding is play
After the threshold value that buffering area buffered data reaches certain, player starts decoding and plays, and continues request video slicing below simultaneously; Video decoding part adopts FFMPEG to do decoder, first does some initialized work, registration cell therefor and decoder; Then open video file, extract stream information, and search stream type; Then search corresponding decoder, open decoder; For frame of video allocation space, from video flowing, extract frame; Decoding completes, frame of display video;
Step 35: bandwidth prediction
Mobile client sends detection packet by independent thread to server, to obtain current available Netowrk tape width values; When the network bandwidth changes, the code check of the video slicing that the adjustment subsequent time that the control module of mobile client can be in good time according to current bandwidth conditions is downloaded, to ensure the smooth playing of video; Mobile client adds timestamp when sending detection packet to each bag, and the time interval between two detection packet is Δ
in, the time interval that receiving terminal receives two detection packet is Δ
out, when link capacity C is known, can calculate current available bandwidth value is:
Further, step 34 is specially: the download of video segment, and use libCURL storehouse, its workflow is as follows: first, calls curl_global_init () initialization libcurl; Then, call curl_easy_init () and obtain pointer to object; 3rd, call curl_easy_setopt () function setup transmission option, call back function is set the data downloaded are stored in buffering area; 4th, call curl_easy_perform () and complete transformation task; Finally, curl_easy_cleanup () releasing memory is called.
Another aspect of the present invention, additionally provide the SVC video stream media Adaptive Transmission system under a kind of mobile environment, perform the SVC video stream media adaptive transmission method under mobile environment provided by the invention, described system comprises service end and mobile client, wherein, service end comprises video encoding module, video storage modules and transmission of video playing module, and client comprises video reception module, Video decoding module, video playback module and control module; Video encoding module is responsible for original yuv video to be encoded to space, time and quality can the SVC code stream of layering; Video storage modules is responsible for SVC code stream packet fragmentation, is assigned to by the video of same code check in same group, and form index file MPD, MPD is used to indicate mobile client and navigates to concrete media slicing according to index simultaneously; The major function of video transmission module resolves index file, and use HTTP host-host protocol to transmit corresponding video slicing to carry out decoding broadcasting to mobile client; Video reception module in charge receives the video slicing using the transmission of HTTP host-host protocol, and Video decoding module is responsible for the SVC decoding of video slicing, and control module is responsible for carrying out Row control and bandwidth prediction, and video playback module is responsible for displaying video.
Further, relative to the SVC decoder of PC end, the amendment of several aspect is below made to the decoder of mobile client and has optimized adapting to the transmission of video under mobile environment:
(1) SVC decoding storehouse is prepared;
(2) revise source code, realize automatic landing and switch;
(3) Android NDK compiles.
The invention has the beneficial effects as follows: the present invention is in Video coding, the SVC video encoding standard adopted, by carry out naked video can the coding of layering, can reach and carry out the process of enhancement layer packet loss to alleviate network and to play the decoding pressure held according to network condition, better adaptation network, reaches the effect of smooth playing.Meanwhile, in video transmitting procedure, adopt MPEG-DASH standard, video is carried out burst, be divided into the video segment of different code check, play end after analysis network availability bandwidth situation, the decision-making adapting to current network conditions can be made.The scalability of Video coding combines with the adaptivity in video transmitting procedure by the present invention, reaches better network-adaptive effect.
Accompanying drawing explanation
Fig. 1 is the flow chart of the SVC video stream media adaptive transmission method under mobile environment of the present invention;
Fig. 2 is the structural representation of the SVC video stream media Adaptive Transmission system under mobile environment of the present invention;
Fig. 3 is video encoding module schematic diagram of the present invention;
Fig. 4 is SVC video slicing schematic diagram of the present invention;
Fig. 5 is the schematic diagram of media description file of the present invention;
Fig. 6 is mobile client operating diagram of the present invention.
Embodiment
Illustrate below in conjunction with accompanying drawing, the specific embodiment of the present invention is described further.
As shown in Figure 1, the SVC video stream media adaptive transmission method under the mobile environment that the present invention proposes, mainly comprise prepare yuv video, carry out SVC coding, burst stores, several step such as decoding broadcasting etc.
As shown in Figure 2, SVC video stream media Adaptive Transmission system under the mobile environment that the present invention proposes, comprise service end and mobile client, wherein, service end comprises video encoding module, video storage modules and transmission of video playing module, and client comprises video reception module, Video decoding module, video playback module and control module.Video encoding module is responsible for original yuv video to be encoded to space, time and quality can the SVC code stream of layering; Video storage modules is responsible for SVC code stream packet fragmentation, is assigned to by the video of same code check in same group, and form index file MPD, MPD is used to indicate mobile client and navigates to concrete media slicing according to index simultaneously; The major function of video transmission module resolves index file, and use HTTP host-host protocol to transmit corresponding video slicing to carry out decoding broadcasting to mobile client.Video reception module in charge receives the video slicing using the transmission of HTTP host-host protocol, and Video decoding module is responsible for the SVC decoding of video slicing, and control module is responsible for carrying out Row control and bandwidth prediction, and video playback module is responsible for displaying video.
Schematic diagram below in conjunction with modules is described in detail implementation step.
As shown in Figure 3, video coding section adopts layered coding technique, be multiple layers of different resolution, different frame per second, different quality by Video coding, be specially a Primary layer and multiple enhancement layer, the video packets of Primary layer contains the essential information of decoding required for displaying video, and enhanced layer packets is containing the more details information of video.Be after multiple layer by Video coding, use multiplexer laminatedly to become SVC code stream by different.Realize part at Video coding, adopt the SVC video coding tool that JSVM software of increasing income provides, concrete implementation step is as follows:
Step 1: prepare yuv video
Yuv video is original uncoded video, can be encoded to the video of arbitrary format as required, choose yuv video here, be convenient to subsequent treatment.
Step 2: generate SVC configuration file
The configuration file of SVC coding is divided into master configuration file and one or more layers of configuration file, and the configuration file of each layer must indicate in master configuration file.The position exporting SVC video flowing is comprised, the information such as the frame number that encode in master configuration file.Layer configuration file comprises the basic essential information of this enhancement layer, comprises the resolution of input video, the frame per second of input and output video, the information such as the quantization parameter of sampling.
Step 3: Video coding
After the configuration file setting SVC coding, can encode to video.According to the difference of configuration file, can different resolution, the video of different frame per second and different quality.
As shown in Figure 4, video storage modules adopts MPEG-DASH standard, video after coding is carried out burst, video is divided into the video segment of different code check and different quality, again a kind of video of code check to be divided into etc. multiple bursts of duration according to time span, each burst is smaller, is convenient to transmit in the form of streaming in subsequent process.Meanwhile, in order to each video slicing can be navigated to, while formation burst, a corresponding media description file can be formed, after video playback end downloads of media description document, carry out the corresponding video segment of parsings download.Concrete implementation step is as follows:
Step 1: input SVC video file
The SVC video file that input video coding module obtains.
Step 2: SVC video flowing is split
H.264/AVC the component units that video flowing is the most basic is NAL unit, and different NAL unit represents different video datas.Each NAL unit comprises the NAL unit head of a byte, the rear 5 bit representations type of this NAL unit of first character joint, and NAL unit is all using 0x0001 or 0x001 as opening flag.
Step 3:SVC code stream burst
SVC, on basis H.264/AVC, extends to 4 bytes to NAL unit head, and the NAL unit type of SVC is 14 or 20, and the syntactic information of first character joint is identical with H264/AVC, and byte packet below contains the scalable information of SVC.After obtaining SVC video flowing, video is divided into NAL unit one by one according to opening flag, by the analysis to NAL unit corresponding positions, the layer information at NAL place can be obtained.Obtain every layer obtain every layer of NAL unit after, according to frame per second and frame number, judge the length of current video section, if length reaches threshold value, by video segment new for formation one.
Step 4: generate media description file
After to SVC video flow processing, corresponding video slicing information being written to suffix is in * .mpd index file.The elementary path of media slicing and the URL of each burst is comprised in index file, and the code rate information of different burst.Accompanying drawing 5 is form and the composition of MPD file.
As shown in Figure 6, mobile client comprises video reception module, Video decoding module, video playback module and control module.In order to better transmit in a network, in transmitting procedure, employ http protocol.The present invention adopts client active request formula to initiate transmission of video, is driven by the video player of client.In the process of displaying video, play the available bandwidth information of end meeting real-time collecting current network, and utilize the history bandwidth information collected, the bandwidth value of subsequent time is made prediction, to determine the video slicing of asking which kind of code check next time.Concrete implementation step is as follows:
Step 1: download MPD media description file
Mobile phone terminal, after beginning playing task, first downloads MPD media description file from server end.
Step 2: resolve MPD media description file
Describe one or more expressions of video in MPD media description file, often kind represents kind of the URL(uniform resource locator) describing again each video slicing, i.e. URL.The particular location of the code check of often kind of expression correspondence of video, medium kind, maximum/minimum bandwidth and each video slicing can be obtained to the parsing of media file.
Step 3: video slicing is downloaded
Mobile client asks corresponding video slicing by HTTP GET, and in buffering suitable at first.The download of video segment, uses libCURL storehouse.Its workflow is as follows: first, calls curl_global_init () initialization libcurl; Then, call curl_easy_init () and obtain pointer to object; 3rd, call curl_easy_setopt () function setup transmission option, call back function is set the data downloaded are stored in buffering area; 4th, call curl_easy_perform () and complete transformation task; Finally, curl_easy_cleanup () releasing memory is called.
Step 4: player decoding is play
After the threshold value that buffering area buffered data reaches certain, player starts decoding and plays, and continues request video slicing below simultaneously.Video decoding part adopts FFMPEG to do decoder, first does some initialized work, registration cell therefor and decoder; Then open video file, extract stream information, and search stream type; Then search corresponding decoder, open decoder; For frame of video allocation space, from video flowing, extract frame; Decoding completes, frame of display video.
Step 5: bandwidth prediction
Mobile client sends detection packet by independent thread to server, to obtain current available Netowrk tape width values.When the network bandwidth changes, the code check of the video slicing that the adjustment subsequent time that the control module of mobile client can be in good time according to current bandwidth conditions is downloaded, to ensure the smooth playing of video.In detection process, mobile client sends to server the UDP bag that a series of size is 1500B, and in process of transmitting, in the time interval between the adjustment detection packet that mobile client can be in good time, ensures that bottleneck link place can not be idle.Mobile client adds timestamp when sending detection packet to each bag, and the time interval between two detection packet is Δ
in, the time interval that receiving terminal receives two detection packet is Δ
out, when link capacity C is known, can calculate current available bandwidth value is:
Relative to the SVC decoder of PC end, the decoder of the present invention to mobile client has made amendment and the optimization of several aspect below:
(1) SVC decoding storehouse is prepared
SVC decoding decoding storehouse on mobile phone, only comprises the basic storehouse that decoding SVC video is necessary, specifically comprises:
A) the AVC decoding storehouse that h264 is supported is realized;
B) to the SVC decoding storehouse that SVC supports;
C) general file storehouse and MPEG4;
D) corresponding Makefile file is revised.
(2) revise source code, realize automatic landing and switch
The SVC decoder of PC end uses order below to play:
OpenSVCDecoder-h264<filename>-layer<DqId>-tempid<DqId>
Wherein, parameter f ilename specifies played file name, and DqId specifies the quality layers and time horizon that will play.Each broadcasting needs specified file name and equivalent layer.
Amended SVC decoder, adds decision-making module, can make a policy according to bandwidth information.Detailed process is as follows:
A) bandwidth is obtained from bandwidth prediction module;
B) using bandwidth information as input parameter, add decision-making module;
C) decision-making module judges according to bandwidth information, if current bandwidth exceedes certain threshold value, then automatically switches to higher layer and plays.
(3) Android NDK compiles
A) under Ubuntu, project directory ../mySVCdecoder is entered;
B) enter SVC/build successively, perform $ NDK/ndk-build, compiler;
C) will the .so file of rear generation have been compiled, copy the libs catalogue under Android engineering to;
D) in Android engineering, state corresponding native method, after receiving the code stream of SVC, native method, realizes calling SVC decoder.
The invention has the beneficial effects as follows: the present invention is in Video coding, the SVC video encoding standard adopted, by carry out naked video can the coding of layering, can reach and carry out the process of enhancement layer packet loss to alleviate network and to play the decoding pressure held according to network condition, better adaptation network, reaches the effect of smooth playing.Meanwhile, in video transmitting procedure, adopt MPEG-DASH standard, video is carried out burst, be divided into the video segment of different code check, play end after analysis network availability bandwidth situation, the decision-making adapting to current network conditions can be made.The scalability of Video coding combines with the adaptivity in video transmitting procedure by the present invention, reaches better network-adaptive effect.
Above content is in conjunction with concrete preferred implementation further description made for the present invention, can not assert that specific embodiment of the invention is confined to these explanations.For general technical staff of the technical field of the invention, without departing from the inventive concept of the premise, some simple deduction or replace can also be made, all should be considered as belonging to protection scope of the present invention.
Claims (7)
1. the SVC video stream media adaptive transmission method under mobile environment, comprises the following steps:
Step 1:SVC Video coding; In the module of Video coding, adopt the thought of hierarchical coding, according to SVC coding standard, be multiple layers of different resolution, different frame per second, different quality by Video coding, be specially a Primary layer and multiple enhancement layer, the video packets of Primary layer contains the essential information of decoding required for displaying video, enhanced layer packets is containing the more details information of video, video playback end can carry out suitable packet loss process according to current network condition to the video packets of enhancement layer, alleviate the pressure of Internet Transmission, to reach the object of more smooth broadcasting;
Step 2:SVC video slicing stores; Follow MPEG-DASH standard, video after coding is carried out burst, video is divided into the video segment of different code check and different quality, again a kind of video of code check to be divided into etc. multiple bursts of duration according to time span, each burst is smaller, is convenient to transmit in the form of streaming in subsequent process; Meanwhile, in order to each video slicing can be navigated to, while formation burst, a corresponding video index file can be formed, after video playback end downloads index file, carry out the corresponding video segment of parsings download;
Step 3: mobile client request is carried out transmitting and carried out video playback; In order to through fire compartment wall etc., better transmit in a network, in transmitting procedure, adopt http protocol; Initiate transmission of video by client active request formula, driven by the video player of client; In the process of displaying video, the available bandwidth information of client meeting real-time collecting current network, and utilize the history bandwidth information collected, the bandwidth value of subsequent time is made prediction, to determine the video slicing of asking which kind of code check next time.
2. the SVC video stream media adaptive transmission method under mobile environment according to claim 1, is characterized in that: the detailed process of described step 1:SVC Video coding is:
Step 11: prepare yuv video: the naked video preparing the different resolution required for SVC coding, different quality;
Step 12: generate SVC configuration file: the configuration file of SVC coding is divided into master configuration file and one or more layers of configuration file, the configuration file of each layer must indicate in master configuration file, the position exporting SVC video flowing is comprised, the information such as the frame number that encode in master configuration file.Layer configuration file comprises the basic essential information of this enhancement layer, comprises the resolution of input video, the frame per second of input and output video, the quantified parameter information of sampling;
Step 13: Video coding: after the configuration file setting SVC coding, can encode to video, according to the difference of configuration file, a Primary layer of different resolution, different frame per second and different quality can add the video of multiple enhancement layer.
3. the SVC video stream media adaptive transmission method under mobile environment according to claim 1, is characterized in that: the detailed process that described step 2:SVC video slicing stores is:
Step 21: input SVC video file, processes the video after coding, is convenient to store and follow-up transmission of video;
Step 22: split by SVC video flowing, the component units that H.264/AVC video flowing is the most basic is NAL unit, and different NAL unit represents different video datas; Each NAL unit comprises the NAL unit head of a byte, the rear 5 bit representations type of this NAL unit of first character joint, and NAL unit is all using 0x0001 or 0x001 as opening flag;
Step 3:SVC code stream burst, after obtaining SVC video flowing, is divided into NAL unit one by one by video according to opening flag, by the analysis to NAL unit corresponding positions, can obtains the layer information at NAL place.Obtain every layer obtain every layer of NAL unit after, according to frame per second and frame number, judge the length of current video section, if length reaches threshold value, by video segment new for formation one;
Step 4: generate media description file, after to SVC video flow processing, corresponding video slicing information being written to suffix is in * .mpd index file, comprises the elementary path of media slicing and the URL of each burst in index file, and the code rate information of different burst.
4. the SVC video stream media adaptive transmission method under mobile environment according to claim 1, is characterized in that: described step 3: mobile client request is carried out transmitting and the detailed process of carrying out video playback is:
Step 31: download MPD media description file, mobile client, after beginning playing task, first downloads MPD media description file from server end;
Step 32: resolve MPD media description file, describes one or more expressions of video in MPD media description file, often kind represents kind of the URL(uniform resource locator) describing again each video slicing, i.e. URL; The particular location of the code check of often kind of expression correspondence of video, medium kind, maximum/minimum bandwidth and each video slicing can be obtained to the parsing of media file;
Step 33: video slicing is downloaded.Video playback end asks corresponding video slicing by HTTP GET, and in buffering suitable at first;
Step 34: player decoding is play, after the threshold value that buffering area buffered data reaches certain, player starts decoding and plays, and continues request video slicing below simultaneously; Video decoding part adopts FFMPEG to do decoder, first does some initialized work, registration cell therefor and decoder; Then open video file, extract stream information, and search stream type; Then search corresponding decoder, open decoder; For frame of video allocation space, from video flowing, extract frame; Decoding completes, frame of display video;
Step 35: bandwidth prediction, mobile client sends detection packet by independent thread to server, to obtain current available Netowrk tape width values; When the network bandwidth changes, the code check of the video slicing that the adjustment subsequent time that the control module of mobile client can be in good time according to current bandwidth conditions is downloaded, to ensure the smooth playing of video; Mobile client adds timestamp when sending detection packet to each bag, and the time interval between two detection packet is, the time interval that receiving terminal receives two detection packet is, when link capacity is known, can calculate current available bandwidth value is:
5. the SVC video stream media adaptive transmission method under mobile environment according to claim 4, it is characterized in that: step 34 is specially: the download of video segment, use libCURL storehouse, its workflow is as follows: first, calls curl_global_init () initialization libcurl; Then, call curl_easy_init () and obtain pointer to object; 3rd, call curl_easy_setopt () function setup transmission option, call back function is set the data downloaded are stored in buffering area; 4th, call curl_easy_perform () and complete transformation task; Finally, curl_easy_cleanup () releasing memory is called.
6. the SVC video stream media Adaptive Transmission system under a mobile environment, perform the SVC video stream media adaptive transmission method under the mobile environment as described in claim 1-5, described system comprises service end and mobile client, wherein, service end comprises video encoding module, video storage modules and transmission of video playing module, and client comprises video reception module, Video decoding module, video playback module and control module; Video encoding module is responsible for original yuv video to be encoded to space, time and quality can the SVC code stream of layering; Video storage modules is responsible for SVC code stream packet fragmentation, is assigned to by the video of same code check in same group, and form index file MPD, MPD is used to indicate mobile client and navigates to concrete media slicing according to index simultaneously; The major function of video transmission module resolves index file, and use HTTP host-host protocol to transmit corresponding video slicing to carry out decoding broadcasting to mobile client; Video reception module in charge receives the video slicing using the transmission of HTTP host-host protocol, and Video decoding module is responsible for the SVC decoding of video slicing, and control module is responsible for carrying out Row control and bandwidth prediction, and video playback module is responsible for displaying video.
7. the SVC video stream media Adaptive Transmission system under mobile environment according to claim 6, it is characterized in that: relative to the SVC decoder of PC end, the amendment of several aspect below made to the decoder of mobile client and has optimized adapting to the transmission of video under mobile environment:
(1) SVC decoding storehouse is prepared; (2) revise source code, realize automatic landing and switch; (3) Android NDK compiles.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410486990.4A CN104270646A (en) | 2014-09-22 | 2014-09-22 | Self-adaption transmission method and system based on mobile streaming media |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410486990.4A CN104270646A (en) | 2014-09-22 | 2014-09-22 | Self-adaption transmission method and system based on mobile streaming media |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN104270646A true CN104270646A (en) | 2015-01-07 |
Family
ID=52162123
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410486990.4A Pending CN104270646A (en) | 2014-09-22 | 2014-09-22 | Self-adaption transmission method and system based on mobile streaming media |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104270646A (en) |
Cited By (40)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104811746A (en) * | 2015-03-31 | 2015-07-29 | 康佳集团股份有限公司 | Method and system for achieving integration of SVC (scalable video coding) and DASH (dynamic adaptive streaming over HTTP (hypertext transport protocol)) through multiple connections |
| CN104883581A (en) * | 2015-05-19 | 2015-09-02 | 福建宏天信息产业有限公司 | Method and system for remote video screenshot |
| CN104918077A (en) * | 2015-06-02 | 2015-09-16 | 北京邮电大学 | Video transmission method, device and system |
| CN105472403A (en) * | 2015-12-08 | 2016-04-06 | 康佳集团股份有限公司 | Cloud service framework implementation method and system for supporting adaptive mobile streaming media |
| CN105490772A (en) * | 2015-11-25 | 2016-04-13 | 中国航空工业集团公司沈阳飞机设计研究所 | Data transmission rate control method |
| CN105635188A (en) * | 2016-03-31 | 2016-06-01 | 深圳市矽伟智科技有限公司 | Visualization content distribution method and system |
| CN105847895A (en) * | 2016-03-28 | 2016-08-10 | 乐视控股（北京）有限公司 | Video file distribution method and video file distribution system |
| WO2016172967A1 (en) * | 2015-04-30 | 2016-11-03 | 华为技术有限公司 | Media stream transmission method and device |
| CN106101602A (en) * | 2016-08-30 | 2016-11-09 | 北京北信源软件股份有限公司 | A kind of bandwidth self-adaption improves the method for network video quality |
| CN106331763A (en) * | 2016-09-12 | 2017-01-11 | 北京小度互娱科技有限公司 | Method of playing slicing media files seamlessly and device of realizing the method |
| CN106358000A (en) * | 2016-10-14 | 2017-01-25 | 上海小镜医疗器械有限公司 | Data transmission and processing method and system, micro viewer and electronic equipment |
| CN106791860A (en) * | 2016-12-28 | 2017-05-31 | 重庆邮电大学 | A kind of adaptive video coding control system and method |
| CN107241571A (en) * | 2016-03-29 | 2017-10-10 | 杭州海康威视数字技术股份有限公司 | A kind of multimedia file encapsulation, player method and device |
| CN107317728A (en) * | 2017-07-04 | 2017-11-03 | 西安万像电子科技有限公司 | Bandwidth measurement method and device |
| CN107566854A (en) * | 2016-06-30 | 2018-01-09 | 华为技术有限公司 | A kind of acquisition of media content and sending method and device |
| CN107645491A (en) * | 2016-07-21 | 2018-01-30 | 韩华泰科株式会社 | Media flow transmission equipment and media serving device |
| CN107835424A (en) * | 2017-12-18 | 2018-03-23 | 合肥亚慕信息科技有限公司 | A kind of media sync transmission player method based on data perception |
| CN108737382A (en) * | 2018-04-23 | 2018-11-02 | 浙江工业大学 | SVC coding HTTP streaming media self-adaption method based on Q-L earning |
| CN108833995A (en) * | 2018-06-08 | 2018-11-16 | 西安交通大学 | The transmission method of adaptive stream media in a kind of wireless network environment |
| CN108900874A (en) * | 2018-08-20 | 2018-11-27 | 北京科技大学 | A kind of streaming media self-adapting requesting method and its device based on SVC-DASH frame |
| CN108924592A (en) * | 2018-08-06 | 2018-11-30 | 青岛海信传媒网络技术有限公司 | A kind of method and apparatus of video processing |
| CN109068169A (en) * | 2018-08-06 | 2018-12-21 | 青岛海信传媒网络技术有限公司 | A kind of video broadcasting method and device |
| CN109121019A (en) * | 2018-09-12 | 2019-01-01 | 中国地质大学（武汉） | For the dynamic buffering dispatching method of SVC-DASH VOD system, equipment and storage equipment |
| CN109121020A (en) * | 2018-09-12 | 2019-01-01 | 中国地质大学（武汉） | For the dynamic buffering dispatching method of SVC-DASH VOD system, equipment and storage equipment |
| CN109348233A (en) * | 2018-07-23 | 2019-02-15 | 浙江工业大学 | A kind of adaptive SVC-DASH playback method of interlayer backfill |
| CN109600617A (en) * | 2018-12-19 | 2019-04-09 | 北京东土科技股份有限公司 | Coding, retransmission method, device, equipment and the storage medium of video data |
| CN109698928A (en) * | 2018-11-15 | 2019-04-30 | 贵阳朗玛信息技术股份有限公司 | The method and device of video flowing in a kind of adjusting video conferencing system |
| CN110351606A (en) * | 2018-04-04 | 2019-10-18 | 华为技术有限公司 | Media information processing method, relevant device and computer storage medium |
| CN110730160A (en) * | 2019-09-06 | 2020-01-24 | 北京钛星数安科技有限公司 | Self-adaptive remote browsing visual stream transmission method |
| CN110753230A (en) * | 2019-11-15 | 2020-02-04 | 北京淳中科技股份有限公司 | Video streaming system and method |
| CN111163364A (en) * | 2019-12-31 | 2020-05-15 | 北方工业大学 | Method for implementing equalization control of signal code rate sent to base station by video playing website |
| CN111447459A (en) * | 2020-05-14 | 2020-07-24 | 杭州当虹科技股份有限公司 | Rtmp self-adaptive code rate realizing method |
| WO2020155957A1 (en) * | 2019-01-30 | 2020-08-06 | 上海哔哩哔哩科技有限公司 | Method and apparatus for playing audio/video, and computer device and readable storage medium |
| CN112672153A (en) * | 2020-12-11 | 2021-04-16 | 北方信息控制研究院集团有限公司 | Scalable coding video code rate self-adaptive selection method fused with video feature analysis |
| CN112771884A (en) * | 2018-04-13 | 2021-05-07 | 华为技术有限公司 | Immersive media metrics for virtual reality content with multiple machine positions |
| WO2021237474A1 (en) * | 2020-05-26 | 2021-12-02 | 华为技术有限公司 | Video transmission method, device and system |
| CN114245080A (en) * | 2021-12-20 | 2022-03-25 | 厦门南棠科技有限公司 | Network video monitoring system |
| CN114900706A (en) * | 2022-04-18 | 2022-08-12 | 南京航空航天大学 | Live video stream transmission adaptive scheduling method based on extended video coding |
| CN115086663A (en) * | 2022-07-26 | 2022-09-20 | 香港中文大学（深圳） | Multi-camera real-time video transmission method based on deep reinforcement learning |
| WO2022218371A1 (en) * | 2021-04-16 | 2022-10-20 | Beijing Bytedance Network Technology Co., Ltd. | Minimizing initialization delay in live streaming |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120198031A1 (en) * | 2011-01-07 | 2012-08-02 | Nokia Corporation | Method and Apparatus for Signaling Presentation Description Updates in HTTP Streaming |
| CN103078847A (en) * | 2012-12-24 | 2013-05-01 | 深圳市龙视传媒有限公司 | Method for storing and reading multi-code-rate stream file and relevant device |
| CN103210642A (en) * | 2010-10-06 | 2013-07-17 | 数码士有限公司 | Method for transmitting a scalable http stream for natural reproduction upon the occurrence of expression-switching during http streaming |
| CN103460667A (en) * | 2011-04-07 | 2013-12-18 | 高通股份有限公司 | Network streaming of video data using byte range requests |
| US20140082054A1 (en) * | 2012-09-14 | 2014-03-20 | Canon Kabushiki Kaisha | Method and device for generating a description file, and corresponding streaming method |
-
2014
- 2014-09-22 CN CN201410486990.4A patent/CN104270646A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103210642A (en) * | 2010-10-06 | 2013-07-17 | 数码士有限公司 | Method for transmitting a scalable http stream for natural reproduction upon the occurrence of expression-switching during http streaming |
| US20120198031A1 (en) * | 2011-01-07 | 2012-08-02 | Nokia Corporation | Method and Apparatus for Signaling Presentation Description Updates in HTTP Streaming |
| CN103460667A (en) * | 2011-04-07 | 2013-12-18 | 高通股份有限公司 | Network streaming of video data using byte range requests |
| US20140082054A1 (en) * | 2012-09-14 | 2014-03-20 | Canon Kabushiki Kaisha | Method and device for generating a description file, and corresponding streaming method |
| CN103078847A (en) * | 2012-12-24 | 2013-05-01 | 深圳市龙视传媒有限公司 | Method for storing and reading multi-code-rate stream file and relevant device |
Non-Patent Citations (3)
| Title |
|---|
| CHRISTOPHER MULLER, DANIELE RENZI, STEFAN LEDERER: "USING SCALABLE VIDEO CODING FOR DYNAMIC ADAPTIVE STREAMING OVER HTTP IN MOBILE ENVIRONMENTS", 《20TH EUROPEAN SIGNAL PROCESSING CONFERENCE》 * |
| IRAJ SODAGAR: "The MPEG-DASH Standard for Multimedia Streaming Over the Internet", 《IEEE MULTIMEDIA》 * |
| 吴俊峰: "H.264 SVC可伸缩视频编码及转码技术研究", 《中国优秀硕士学位论文全文数据库 信息科技辑》 * |
Cited By (68)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104811746A (en) * | 2015-03-31 | 2015-07-29 | 康佳集团股份有限公司 | Method and system for achieving integration of SVC (scalable video coding) and DASH (dynamic adaptive streaming over HTTP (hypertext transport protocol)) through multiple connections |
| CN104811746B (en) * | 2015-03-31 | 2017-12-22 | 康佳集团股份有限公司 | Utilize the methods for reconnecting and realizing that SVC is combined with DASH more |
| CN106464985A (en) * | 2015-04-30 | 2017-02-22 | 华为技术有限公司 | Media stream transmission method and device |
| CN106464985B (en) * | 2015-04-30 | 2019-04-12 | 华为技术有限公司 | A kind of media stream transmission method and device |
| WO2016172967A1 (en) * | 2015-04-30 | 2016-11-03 | 华为技术有限公司 | Media stream transmission method and device |
| CN104883581A (en) * | 2015-05-19 | 2015-09-02 | 福建宏天信息产业有限公司 | Method and system for remote video screenshot |
| CN104918077A (en) * | 2015-06-02 | 2015-09-16 | 北京邮电大学 | Video transmission method, device and system |
| CN104918077B (en) * | 2015-06-02 | 2018-01-30 | 北京邮电大学 | A kind of video transmission method, apparatus and system |
| CN105490772A (en) * | 2015-11-25 | 2016-04-13 | 中国航空工业集团公司沈阳飞机设计研究所 | Data transmission rate control method |
| CN105472403A (en) * | 2015-12-08 | 2016-04-06 | 康佳集团股份有限公司 | Cloud service framework implementation method and system for supporting adaptive mobile streaming media |
| CN105847895A (en) * | 2016-03-28 | 2016-08-10 | 乐视控股（北京）有限公司 | Video file distribution method and video file distribution system |
| CN107241571B (en) * | 2016-03-29 | 2019-11-22 | 杭州海康威视数字技术股份有限公司 | A kind of encapsulation of multimedia file, playback method and device |
| CN107241571A (en) * | 2016-03-29 | 2017-10-10 | 杭州海康威视数字技术股份有限公司 | A kind of multimedia file encapsulation, player method and device |
| CN105635188A (en) * | 2016-03-31 | 2016-06-01 | 深圳市矽伟智科技有限公司 | Visualization content distribution method and system |
| CN105635188B (en) * | 2016-03-31 | 2019-07-09 | 深圳市矽伟智科技有限公司 | A kind of visual content distribution method and system |
| CN107566854B (en) * | 2016-06-30 | 2020-08-07 | 华为技术有限公司 | Method and device for acquiring and sending media content |
| CN107566854A (en) * | 2016-06-30 | 2018-01-09 | 华为技术有限公司 | A kind of acquisition of media content and sending method and device |
| CN107645491A (en) * | 2016-07-21 | 2018-01-30 | 韩华泰科株式会社 | Media flow transmission equipment and media serving device |
| CN106101602A (en) * | 2016-08-30 | 2016-11-09 | 北京北信源软件股份有限公司 | A kind of bandwidth self-adaption improves the method for network video quality |
| CN106101602B (en) * | 2016-08-30 | 2019-03-29 | 北京北信源软件股份有限公司 | A kind of method that bandwidth self-adaption improves network video quality |
| CN106331763B (en) * | 2016-09-12 | 2020-01-14 | 北京小度互娱科技有限公司 | Method for seamlessly playing fragmented media file and device for implementing method |
| CN106331763A (en) * | 2016-09-12 | 2017-01-11 | 北京小度互娱科技有限公司 | Method of playing slicing media files seamlessly and device of realizing the method |
| CN106358000A (en) * | 2016-10-14 | 2017-01-25 | 上海小镜医疗器械有限公司 | Data transmission and processing method and system, micro viewer and electronic equipment |
| CN106358000B (en) * | 2016-10-14 | 2020-08-07 | 上海小镜医疗器械有限公司 | Data transmission method, data processing method, data transmission system, data processing system, micro-vision instrument and electronic equipment |
| CN106791860B (en) * | 2016-12-28 | 2019-07-30 | 重庆邮电大学 | A kind of adaptive video coding control system and method |
| CN106791860A (en) * | 2016-12-28 | 2017-05-31 | 重庆邮电大学 | A kind of adaptive video coding control system and method |
| CN107317728B (en) * | 2017-07-04 | 2021-03-02 | 西安万像电子科技有限公司 | Bandwidth measuring method and device |
| CN113014447A (en) * | 2017-07-04 | 2021-06-22 | 西安万像电子科技有限公司 | Bandwidth measuring method and device |
| CN113014447B (en) * | 2017-07-04 | 2022-11-18 | 重庆京像微电子有限公司 | Bandwidth measuring method and device |
| CN107317728A (en) * | 2017-07-04 | 2017-11-03 | 西安万像电子科技有限公司 | Bandwidth measurement method and device |
| CN107835424A (en) * | 2017-12-18 | 2018-03-23 | 合肥亚慕信息科技有限公司 | A kind of media sync transmission player method based on data perception |
| US11438645B2 (en) | 2018-04-04 | 2022-09-06 | Huawei Technologies Co., Ltd. | Media information processing method, related device, and computer storage medium |
| CN110351606A (en) * | 2018-04-04 | 2019-10-18 | 华为技术有限公司 | Media information processing method, relevant device and computer storage medium |
| US11438600B2 (en) | 2018-04-13 | 2022-09-06 | Huawei Technologies Co., Ltd. | Immersive media metrics for virtual reality content with multiple viewpoints |
| CN112771884A (en) * | 2018-04-13 | 2021-05-07 | 华为技术有限公司 | Immersive media metrics for virtual reality content with multiple machine positions |
| CN108737382B (en) * | 2018-04-23 | 2020-10-09 | 浙江工业大学 | SVC coding HTTP streaming media self-adaption method based on Q-Learning |
| CN108737382A (en) * | 2018-04-23 | 2018-11-02 | 浙江工业大学 | SVC coding HTTP streaming media self-adaption method based on Q-L earning |
| CN108833995A (en) * | 2018-06-08 | 2018-11-16 | 西安交通大学 | The transmission method of adaptive stream media in a kind of wireless network environment |
| CN109348233A (en) * | 2018-07-23 | 2019-02-15 | 浙江工业大学 | A kind of adaptive SVC-DASH playback method of interlayer backfill |
| CN108924592A (en) * | 2018-08-06 | 2018-11-30 | 青岛海信传媒网络技术有限公司 | A kind of method and apparatus of video processing |
| CN109068169A (en) * | 2018-08-06 | 2018-12-21 | 青岛海信传媒网络技术有限公司 | A kind of video broadcasting method and device |
| CN108900874A (en) * | 2018-08-20 | 2018-11-27 | 北京科技大学 | A kind of streaming media self-adapting requesting method and its device based on SVC-DASH frame |
| CN108900874B (en) * | 2018-08-20 | 2020-12-22 | 北京科技大学 | Streaming media self-adaption request method and device based on SVC-DASH framework |
| CN109121020B (en) * | 2018-09-12 | 2020-01-17 | 中国地质大学（武汉） | Dynamic cache scheduling method, device and storage device for SVC-DASH on-demand system |
| CN109121019B (en) * | 2018-09-12 | 2020-01-17 | 中国地质大学（武汉） | Dynamic cache scheduling method, device and storage device for SVC-DASH on-demand system |
| CN109121019A (en) * | 2018-09-12 | 2019-01-01 | 中国地质大学（武汉） | For the dynamic buffering dispatching method of SVC-DASH VOD system, equipment and storage equipment |
| CN109121020A (en) * | 2018-09-12 | 2019-01-01 | 中国地质大学（武汉） | For the dynamic buffering dispatching method of SVC-DASH VOD system, equipment and storage equipment |
| CN109698928B (en) * | 2018-11-15 | 2021-04-13 | 贵阳朗玛信息技术股份有限公司 | Method and device for adjusting video stream in video conference system |
| CN109698928A (en) * | 2018-11-15 | 2019-04-30 | 贵阳朗玛信息技术股份有限公司 | The method and device of video flowing in a kind of adjusting video conferencing system |
| CN109600617A (en) * | 2018-12-19 | 2019-04-09 | 北京东土科技股份有限公司 | Coding, retransmission method, device, equipment and the storage medium of video data |
| CN111510791A (en) * | 2019-01-30 | 2020-08-07 | 上海哔哩哔哩科技有限公司 | Method and device for playing audio and video, computer equipment and readable storage medium |
| US11336711B2 (en) | 2019-01-30 | 2022-05-17 | Shanghai Bilibili Technology Co., Ltd. | Method of playing audio and video, computing device, and computer program product |
| WO2020155957A1 (en) * | 2019-01-30 | 2020-08-06 | 上海哔哩哔哩科技有限公司 | Method and apparatus for playing audio/video, and computer device and readable storage medium |
| CN111510791B (en) * | 2019-01-30 | 2022-07-29 | 上海哔哩哔哩科技有限公司 | Method and device for playing audio and video, computer equipment and readable storage medium |
| CN110730160B (en) * | 2019-09-06 | 2022-02-22 | 北京钛星数安科技有限公司 | Self-adaptive remote browsing data stream transmission method |
| CN110730160A (en) * | 2019-09-06 | 2020-01-24 | 北京钛星数安科技有限公司 | Self-adaptive remote browsing visual stream transmission method |
| CN110753230A (en) * | 2019-11-15 | 2020-02-04 | 北京淳中科技股份有限公司 | Video streaming system and method |
| CN111163364A (en) * | 2019-12-31 | 2020-05-15 | 北方工业大学 | Method for implementing equalization control of signal code rate sent to base station by video playing website |
| CN111447459A (en) * | 2020-05-14 | 2020-07-24 | 杭州当虹科技股份有限公司 | Rtmp self-adaptive code rate realizing method |
| WO2021237474A1 (en) * | 2020-05-26 | 2021-12-02 | 华为技术有限公司 | Video transmission method, device and system |
| CN112672153B (en) * | 2020-12-11 | 2022-06-24 | 北方信息控制研究院集团有限公司 | Scalable coding video code rate self-adaptive selection method fused with video feature analysis |
| CN112672153A (en) * | 2020-12-11 | 2021-04-16 | 北方信息控制研究院集团有限公司 | Scalable coding video code rate self-adaptive selection method fused with video feature analysis |
| WO2022218371A1 (en) * | 2021-04-16 | 2022-10-20 | Beijing Bytedance Network Technology Co., Ltd. | Minimizing initialization delay in live streaming |
| CN114245080A (en) * | 2021-12-20 | 2022-03-25 | 厦门南棠科技有限公司 | Network video monitoring system |
| CN114900706A (en) * | 2022-04-18 | 2022-08-12 | 南京航空航天大学 | Live video stream transmission adaptive scheduling method based on extended video coding |
| CN114900706B (en) * | 2022-04-18 | 2023-03-03 | 南京航空航天大学 | Live video stream transmission adaptive scheduling method based on extended video coding |
| CN115086663A (en) * | 2022-07-26 | 2022-09-20 | 香港中文大学（深圳） | Multi-camera real-time video transmission method based on deep reinforcement learning |
| CN115086663B (en) * | 2022-07-26 | 2022-11-04 | 香港中文大学（深圳） | Multi-camera real-time video transmission method based on deep reinforcement learning |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104270646A (en) | Self-adaption transmission method and system based on mobile streaming media | |
| CN106165434B (en) | It is a kind of for obtaining the method and computer-readable medium of media data | |
| CN103843301B (en) | The switching between expression during the network crossfire of decoded multi-medium data | |
| RU2435235C2 (en) | System and method of indicating interconnections of tracks in multimedia file | |
| CN106134146B (en) | Handle continuous multicycle content | |
| EP2666288B1 (en) | Apparatus and method for storing and playing content in a multimedia streaming system | |
| CN102246491B (en) | System and method for storing multi-source multimedia presentations | |
| CN103765914A (en) | Network streaming of coded video data | |
| CN103039087A (en) | Signaling random access points for streaming video data | |
| US10499094B2 (en) | Transmission apparatus, transmitting method, reception apparatus, and receiving method | |
| CN101009824A (en) | A network transfer method for audio/video data | |
| US20130204973A1 (en) | Method for transmitting a scalable http stream for natural reproduction upon the occurrence of expression-switching during http streaming | |
| CN106790005B (en) | Realize the system and method for low delay HLS live streaming | |
| CN102104762A (en) | Media recording method, equipment and system of IMS (Internet Management Specification) video conference | |
| KR102499231B1 (en) | Receiving device, sending device and data processing method | |
| CN107251521A (en) | Method and apparatus for sending and receiving media information in a communications system | |
| CN103081488A (en) | Signaling video samples for trick mode video representations | |
| KR102137858B1 (en) | Transmission device, transmission method, reception device, reception method, and program | |
| CN114629897A (en) | Data processing method and system | |
| CN109040818B (en) | Audio and video synchronization method, storage medium, electronic equipment and system during live broadcasting | |
| US9332421B2 (en) | Method and apparatus for random access to multimedia content in wireless communication system | |
| CN103561013B (en) | The data distribution systems of Streaming Media | |
| Belda et al. | A DASH server-side delay-based representation switching solution to improve the quality of experience for low-latency live video streaming | |
| CN105900437A (en) | Communication apparatus, communication data generation method, and communication data processing method | |
| KR102349451B1 (en) | The method for transmitting or receiving multimedia and apparatus thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20150107 |