CN105898384A - Method and apparatus for controlling streaming video mixing frame rate - Google Patents
Method and apparatus for controlling streaming video mixing frame rate Download PDFInfo
- Publication number
- CN105898384A CN105898384A CN201610270343.9A CN201610270343A CN105898384A CN 105898384 A CN105898384 A CN 105898384A CN 201610270343 A CN201610270343 A CN 201610270343A CN 105898384 A CN105898384 A CN 105898384A
- Authority
- CN
- China
- Prior art keywords
- streaming media
- video
- media video
- weights
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
- H04N21/2365—Multiplexing of several video streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/231—Content storage operation, e.g. caching movies for short term storage, replicating data over plural servers, prioritizing data for deletion
- H04N21/23106—Content storage operation, e.g. caching movies for short term storage, replicating data over plural servers, prioritizing data for deletion involving caching operations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
- H04N21/23805—Controlling the feeding rate to the network, e.g. by controlling the video pump
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/266—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
- H04N21/2662—Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
An embodiment of the invention provides a method and apparatus for controlling the streaming video mixing frame rate. One or more channels of streaming video are respectively loaded into corresponding one or more buffer regions, the streaming video including video frames. The method includes the steps of determining weight values corresponding to the one or more channels of streaming video; extracting, respectively from the one or more buffer regions, the corresponding one or more channels of streaming video frame by frame for mixing; when an empty buffer region exists, conducting statistics of the sum of the weight values of the streaming video in the buffer regions stored with the streaming video as a first total weight value; determining whether the first total weight value is less than a preset threshold; if so, expanding the capacity for the buffer regions stored with the streaming video; and if not, inserting frames into the empty buffer region. The invention can find the balance between two demands of fluency and real time properties, and enables better user experience as compared with that using any one method alone.
Description
Technical field
The present invention relates to technical field of video processing, particularly relate to a kind of streaming media video hybrid frame
Rate control method and a kind of streaming media video mixing frame per second control device.
Background technology
Along with media marketplace merges the most closely with network service, stream media broadcast and use day
Benefit is extensive, wherein, in MCU (Multipoint Control Unit, the multiple spot control of video conferencing system
Unit processed), and in the system such as the dispenser of safety defense monitoring system, streaming media video hybrid technology is opened
Begin to substitute original analog video blender to be widely applied.
Vision mixer (video mixer) as a example by the MCU of video conferencing system, in MCU
The streaming media video obtaining some terminals is mixed in same video, and should with fixing frame per second
Mixed video output carries out the work such as follow-up coding, transmission, in reality by decoding, mixing,
The second-compressed pattern of coding has saved bandwidth and terminal capabilities.In the past in safety defense monitoring system
Dispenser mainly acts on the process of analogue signal, and along with the networking of safety defense monitoring system, its
Streaming media video, also as video conferencing system, is carried out second-compressed pattern by tupe.
In video conferencing system and safety defense monitoring system, vision mixer based on network data source is again
Referred to as streaming media video blender.In streaming media video blender, due to network jitter, frame
The reasons such as rate asymmetric (streaming media video of each input is inconsistent with the frame per second mixing output video),
Streaming media video blender must take frame per second control measure so that the frame per second that blender output is stable
Mixed video for follow-up coding.
Frame rate control method mainly has two kinds, and a kind of method is preferential towards fluency, the method
Ensure the fluency of video by setting a bigger relief area, but bigger prolonging can be caused
Late.Another kind of method is optimum towards real-time, and the method is to reduce relief area as far as possible, improves
Real-time, but the fluency of video can be caused poor.
In streaming media video blender, fluency and real-time are mutually to restrict and conflicting,
Therefore, a technical problem that those skilled in the art urgently solve is presently required is exactly: propose one
Plant streaming media video mixing frame per second control mechanism, find in fluency and real-time both demands
Equilibrium point, and Consumer's Experience is compared be used alone any method more preferably.
Summary of the invention
Embodiment of the present invention technical problem to be solved is to provide a kind of streaming media video mixing frame per second
Control method, in order to find equilibrium point in fluency and real-time both demands, and makes to use
Family is experienced to compare and is used alone any method more preferably.
Accordingly, the embodiment of the present invention additionally provides a kind of streaming media video mixing frame per second and controls device,
In order to ensure realization and the application of said method.
In order to solve the problems referred to above, the invention discloses what a kind of streaming media video mixing frame per second controlled
Method, one or more streaming media video is loaded in corresponding one or more relief areas respectively,
Described streaming media video includes that frame of video, described method include:
Determine the weights that one or more streaming media video described is corresponding；
Respectively from the one or more relief area, extract one or more stream matchmaker of correspondence frame by frame
Volumetric video mixes；
When there is buffer empty, statistics storage has all Streaming Medias in the relief area of streaming media video
The weights sum of video is the first total weight value；
Judge that whether described first total weight value is less than preset threshold value；The most then have for described storage
The relief area of streaming media video carries out dilatation；If it is not, then carry out interleave in described buffer empty.
Preferably, the described step bag determining weights that one or more streaming media video described is corresponding
Include:
Read the layout parameter in preset configuration file；Described layout parameter includes a described road or many
The ratio that the pixel of road streaming media video is shared in preset total pixel；
Using described ratio as the weights of one or more streaming media video described.
Preferably, the described step bag determining weights that one or more streaming media video described is corresponding
Include:
Receive additional parameter；Described additional parameter includes that one or more streaming media video described is new
Weights；
Using described new weights as the weights of one or more streaming media video described.
Preferably, after the described step determining weights that one or more streaming media video is corresponding,
Also include:
The weights sum calculating one or more streaming media video described obtains the second total weight value；
Judge whether described second total weight value is not equal to default value；
The most then calculate the weights of one or more streaming media video described, with default value and the
The ratio of two total weight values is long-pending, as the weights of one or more streaming media video described.
Preferably, the described step carrying out interleave in buffer empty includes:
Replicate the previous frame of video carrying out mixing of the streaming media video corresponding to described buffer empty；
Described frame of video is inserted in described buffer empty.
Preferably, described K is 0.7.
The embodiment of the invention also discloses the device that a kind of streaming media video mixing frame per second controls, a road
Or multi-way stream media video is loaded in corresponding one or more relief areas respectively, described Streaming Media
Video includes that frame of video, described device include:
Determine module, for determining the weights that one or more streaming media video described is corresponding；
Mixing module, for respectively from the one or more relief area, extracts correspondence frame by frame
One or more streaming media video mixes；
Statistical module, for when there is buffer empty, statistics storage has the buffering of streaming media video
In district, the weights sum of all streaming media videos is the first total weight value；
Judge module, is used for judging that whether described first total weight value is less than preset threshold value；The most then
Call dilatation module, if it is not, then call interleave module；
Dilatation module, for having the relief area of streaming media video to carry out dilatation for described storage；
Interleave module, for carrying out interleave in described buffer empty.
Preferably, described determine that module includes:
Reading submodule, for reading the layout parameter in preset configuration file；Described layout parameter
Including the ratio that the pixel of one or more streaming media video described is shared in preset total pixel；
First adjusts submodule, for using described ratio as one or more Streaming Media described
The weights of video.
Preferably, described determine that module includes:
Receive submodule, be used for receiving additional parameter；Described additional parameter include a described road or
The weights that multi-way stream media video is new；
Second adjusts submodule, is used for described new weights as one or more Streaming Media described
The weights of video.
Preferably, described device also includes:
Computing module, obtains for calculating the weights sum of one or more streaming media video described
Two total weight values；
Judge module, is used for judging whether described second total weight value is not equal to default value；If so,
Then call the 3rd adjusting module；
3rd adjusting module, for calculating the weights of one or more streaming media video described, and in advance
If the ratio of numerical value and the second total weight value is long-pending, as the power of one or more streaming media video described
Value.
Compared with prior art, the embodiment of the present invention includes advantages below:
In embodiments of the present invention, according to condition meters such as video content, layout parameter, user's requests
Calculate weights, when network jitter causes relief area to be sky, using to the result of calculation of weights as frame-skipping
Or increase the foundation buffered, and thus to come dynamically to control buffer size, this adaptive process will
Relief area is made finally to be set to a rational size.Owing to being not necessary to guaranty that all videos
Smoothness, therefore can be less in required relief area, ensure that video when time delay is shorter
Fluency and real-time, improve Consumer's Experience effect.
Accompanying drawing explanation
Fig. 1 is the groundwork flow process of a kind of streaming media video blender；
Fig. 2 is the schematic diagram of a kind of video mix layout a；
Fig. 3 is the schematic diagram of a kind of video mix layout b；
Fig. 4 is the step stream of a kind of streaming media video mixing frame rate control method embodiment 1 of the present invention
Cheng Tu；
Fig. 5 is the step stream of a kind of streaming media video mixing frame rate control method embodiment 2 of the present invention
Cheng Tu；
Fig. 6 is the schematic diagram of a kind of video mix layout c；
Fig. 7 is the schematic diagram of a kind of queue theory model of the present invention；
Fig. 8 is a kind of buffer area of the present invention and satisfied corresponding frame rate control method probability of demand
Schematic diagram；
Fig. 9 is a kind of buffer area of the present invention and satisfied corresponding frame rate control method probability of demand
Total schematic diagram.
Figure 10 is the structural frames of a kind of streaming media video mixing frame per second control device embodiment of the present invention
Figure.
Detailed description of the invention
Understandable for enabling the above-mentioned purpose of the present invention, feature and advantage to become apparent from, below in conjunction with
The present invention is further detailed explanation for the drawings and specific embodiments.
As a example by the MCU of video conferencing system, with reference to a kind of streaming media video mixing shown in Fig. 1
The groundwork flow process of device, idiographic flow is as follows:
In video conferencing system, the streaming media video of each terminal arrives many from different network links
Point control unit MCU, through relief area, under frame per second control (Frame rate control) acts on,
Streaming media video uses decoder to be decoded respectively, by decoded according to certain time interval
Image brush enters streaming media video blender and carries out the image that video mix generation is new, be then encoded,
The video flowing that encapsulation composition is new, is distributed to each terminal.
In implementing, when the input frame rate of streaming media video blender is unequal with output frame rate,
Or the network jitter that causes due to noise or exchanges device capabilities problem present in network and cause
The when that input arriving unstable, need to take frame per second control.Such as, it is 20 (frames when input frame rate
/ the second), when output frame rate is 30 (frame/second), in theory, need to be inserted into (duplication) 1 every 2 frames
Frame data mix, it is contemplated that the streaming media video that network jitter causes arrives instability,
Then may carry out interleave at random according to the situation of the streaming media video in relief area, it could even be possible to
Can be because excessive network jitter causes streaming media video to arrive the slowest and take frame-skipping (abandoning)
Operation, ensures the synchronization of each road streaming media video.
According to the frame rate control method that fluency is optimum, then when requiring network jitter, the most not
Skipping any frame, to ensure the fluency of video, therefore the method needs bigger relief area, leads
Cause delay longer.According to the frame rate control method that real-time is optimum, then require to reduce as far as possible slow
Rush district, improve real-time, owing to the interference that network jitter brings cannot be tackled in less relief area,
Therefore the method can cause a large amount of frame-skipping so that video fluency is the best.
In the frame rate control method generally used, each road streaming media video is treated substantially equally, system
Need to ensure the fluency of all videos, cause system needs one more much larger than processing single video
Relief area.On the contrary, if setting a less relief area, due to fair play, respectively
Interleave or the chance of frame losing that road streaming media video causes due to network jitter are also identical.
At streaming media video blender carrying out video mix when, streaming media video can be scaled,
Cutting, and arrange according to certain layout, in implementing, in the video of final output
It is bound to exist the video area that a user pays close attention to most, the namely a certain road of Streaming Media blender
Input video is that user pays close attention to most.Schematic diagram with reference to a kind of video mix layout a shown in Fig. 2
And the schematic diagram of a kind of video mix layout b shown in Fig. 3, at Fig. 2 and Fig. 3 the two video
In mixed layout schematic diagram, being numbered the video of 1 is the content that user pays close attention to most, and remaining is 234 years old
Then take second place.If having only to preferentially ensure fluency and the real-time of this road video of label 1, it is
System then can reduce and postpone and ensure fluency in the case of ensureing Consumer's Experience as far as possible.
Inventor herein is based on above-mentioned situation just, creatively proposes the core of the embodiment of the present invention
One of design is, the frame per second control mechanism paying close attention to content priority of proposition, regards each road Streaming Media
Frequency is weighted, and as frame-skipping or is increased the foundation buffered by weights sum, thus comes dynamically to control
Buffer size processed, this adaptive process will make relief area finally be set to one rationally
Size.Compare " fluency is optimum ", owing to being not required for ensureing that all videos is smooth, therefore need
The relief area wanted is less.Compare " real-time is optimum ", it is ensured that the fluency of main body.Reach
The target of good Consumer's Experience, have found the equilibrium point of optimum between real-time and fluency.
With reference to Fig. 4, it is shown that the method that a kind of streaming media video mixing frame per second of the present invention controls is implemented
The flow chart of steps of example 1, one or more streaming media video can be loaded into one of correspondence respectively
Or in multiple relief area, described streaming media video can include that frame of video, described method specifically may be used
To comprise the steps:
Step 101, determines the weights that one or more streaming media video described is corresponding；
In implementing, streaming media video by RTSP (real time streaming protocol,
Real time streaming transport protocol) etc. agreement access system, through decapsulation after obtain compressed video data.
Wherein, the form of described compressed video data can be h264, h263, wmv, mpeg2, vp8,
Jpeg etc..
Streaming media video blender carries out video mix when, by video scaling, cutting and according to
Certain layout arranges, and regarding of can having in the video finally exported that a user pays close attention to most
Frequency domain, namely a certain road input video of blender is that user pays close attention to most.In order to ensure to use
Family experience effect, Gu Duige road streaming media video can arrange different power according to user's degree of concern
Value.
Step 102, respectively from the one or more relief area, extract frame by frame correspondence a road or
Multi-way stream media video mixes；
In implementing, Streaming Media blender obtains each road Streaming Media in units of frame from relief area
Video, zooms in and out according to the layout specified, arranges, be mixed into video data.Wherein, mixing
The video data become can be YUV (Luma and Chroma, a kind of colour coding method) data.
Video currently mainly is all based on YUV, YUV can also be subdivided into I420, YUY2, NV12
Deng multiple format.Certainly, mixed video can also is that based on extended formattings such as RGB or RGBA
Data.
It should be noted that when receiving user or the instruction of other equipment (such as intelligent tracking system),
When making layout switching, when needing notification streams media video blender to change scaling, arrangement mode,
And recalculate weights, i.e. need to re-execute step 101.
Step 103, when there is buffer empty, statistics storage has institute in the relief area of streaming media video
The weights sum having streaming media video is the first total weight value；
In actual applications, when causing relief area to be sky due to factors such as network jitters, matchmaker is i.e. flowed
When volumetric video blender currently cannot obtain a certain road or some road streaming media video, now start plan
Slightly control, in conjunction with the weights of each road streaming media video, obtain result of calculation through calculating, and use
Result of calculation determines the processing mode of streaming media video blender, and ratio is such as whether adjust the big of relief area
Little.
Step 104, it is judged that whether described first total weight value is less than preset threshold value；The most then perform step
Rapid 105, if it is not, then perform step 106；
Step 105, has the relief area of streaming media video to carry out dilatation for described storage；
Step 106, carries out interleave in described buffer empty.
In embodiments of the present invention, if there is buffer empty, then statistics storage has streaming media video
Relief area in the weights sum of all streaming media videos calculate total weight value, and judge described total weight value
Whether less than preset threshold value.Wherein, if less than preset threshold value, then the fluency of current video being described
It is unsatisfactory for desired value, it should increasing storage has the relief area of streaming media video；If more than preset threshold value,
Then illustrate that the fluency of current video meets desired value, in order to ensure that streaming media video blender works
When each road streaming media video the most at least frame data, therefore carry out in buffer empty
Interleave operates.
In order to make original technical staff further appreciate that the embodiment of the present invention, below use concrete showing
Example illustrates.Specifically, in a kind of preferred exemplary that the present invention specifically applies, based on pass
The frame per second method of note content priority can include such as lower module:
Input source management module: be responsible for connecting input source by various real-time stream media protocols, obtain
It is decoded after streaming media video data.
Buffer zone module: for buffering the image of decoded streaming media video.
Frame rate control module: control the frame per second in mixed process.
Weight computing module: set the weights of each road streaming media video according to preset rules.
Strategic control module: judge the situations such as network jitter, determines Streaming Media blender pair
The processing mode of each road streaming media video.
Mixer module: the image of the streaming media video after multipath decoding is mixed according to certain layout
Become an image.
Instructor in broadcasting's module: receive user or the switching command of other equipment generation, control streaming media video
Blender changes layout.
Coding module: the Video coding compression that streaming media video blender is exported.
Live recording module: the net cast of compression is gone out or is recorded to hard disk.
It should be noted that due to completely can not live, record, therefore be also can be only by
Display device shows, this application being wherein only used for display is called image splitter.Buffering
District can be arranged before the decoding, it is also possible to arranges after the decoding.
With reference to Fig. 5, it is shown that the method that a kind of streaming media video mixing frame per second of the present invention controls is implemented
The flow chart of steps of example 2, one or more streaming media video can be loaded into one of correspondence respectively
Or in multiple relief area, described streaming media video can include that frame of video, described method specifically may be used
To comprise the steps:
Step 201, reads the layout parameter in preset configuration file；Described layout parameter includes described
The ratio that the pixel of one or more streaming media video is shared in preset total pixel；
In implementing, layout parameter can be pre-stored within the configuration of streaming media video blender
In file.When being loaded into configuration file, zoom in and out according to layout parameter, arrange, be mixed into and regard
Frequency evidence.
Step 202, using described ratio as the weights of one or more streaming media video described；
In embodiments of the present invention, the weights of each road streaming media video can be according to each road video institute
Account for the ratio of pixel.Such as streaming media video blender processes the mixed of N road streaming media video at this
Conjunction task, after mixing, total pixel of output is S (resolution long * resolution is high), if a certain road stream
Media video shared pixel in layout is Sn, then this streaming media video weights when frame per second controls
Cn=Sn/S。
As a example by the video mix layout of Fig. 1, it is assumed that the pixel of input source is 1280*720, can
To set streaming media video blender output resolution ratio as 1706*720.Wherein video 1 is without scaling,
It takies pixel is 1280*720, and video 2,3,4 is scaled 426*240, now video 1,2,
3, the weights of 4 are respectively 0.75,0.083,0.083,0.083.
In one preferred embodiment of the invention, described weights can also obtain in the following way:
Step S11, receives additional parameter；Described additional parameter includes one or more stream matchmaker described
The weights that volumetric video is new；
Step S12, using described new weights as the weights of one or more streaming media video described.
In actual applications, such as under some particular cases, user may want to manually specify weights,
Such as in the video mix layout of Fig. 1, pixel shared by video 1,2,3 is equal, but user
More concern videos 1, configure for the ease of user, it is only necessary to it is " key frame " that user sets video 1,
Setting higher weights (such as 0.6) for video 1, remaining weights divide according still further to pixel ratio
Join.
It should be noted that weigh according to conditions such as video content, layout parameter, user's requests
Value calculates, or calculates according to the comprehensive condition of certain of the above condition, obtains weights.Such as
(the imparting that video content is the highest can also be calculated according to the degree of dynamism in video in implementing
Relatively high weight), or according to video present position calculating in layout, (different position impartings is different
Weights), this is not restricted by the embodiment of the present invention.
In one preferred embodiment of the invention, described method can also include:
The weights sum calculating one or more streaming media video described obtains the second total weight value；
Step S21, it is judged that whether described second total weight value is not equal to default value；The most then perform
Step S22；
Step S22, calculates the weights of one or more streaming media video described, with default value and the
The ratio of two total weight values is long-pending, as the weights of one or more streaming media video described.
In embodiments of the present invention, the weights of each road streaming media video are after primary distribution, also
Needs verify.
Specifically, the checking procedure of weights can be to judge whether weights sum is equal to default value,
If otherwise needing to carry out the adjustment of weights so that finally make weights sum equal to default value, necessity
Time also need to carry out equal proportion scaling.
The false code of checking procedure is as follows:
The detailed process of above-mentioned false code is:
1, calculate weights sum sum of each road streaming media video, and default value m=1 is set.
It should be noted that default value can be any reasonable value.Such as, Fig. 2 is regarded
Frequently mixed layout, the image Zhong Beige road streaming media video of its output is all assigned, the most permissible
Default value m=1 is set, and for the video mix layout of Fig. 3, video 1 in the image of its output
And video 2 is overlapping, then can arrange default value m is the numerical value more than 1, therefore real in the present invention
Execute in example and this is not restricted.
2, judge whether streaming media video shared pixel sum in layout in each road is not equal to Streaming Media and regards
Frequently (i.e. weights sum sum is not equal to default value m), such as less than to the total pixel of blender output
Or the pixel total more than output.Wherein for being specifically referred to less than when exporting total pixel
The schematic diagram of a kind of video mix layout c shown in Fig. 6.
If 3 weights sums sum are not equal to default value m, then each weights is multiplied by m/sum
Times, such as, if m=1, then each weights can be amplified 1/sum times, make final each road flow
Weights sum sum=m of media video.
In other ways weights are verified it is of course also possible to adopt so that finally make weights sum
Equal to default value, this is not restricted by the embodiment of the present invention.
Step 203, respectively from the one or more relief area, extract frame by frame correspondence a road or
Multi-way stream media video mixes；
Step 204, when there is buffer empty, statistics storage has institute in the relief area of streaming media video
The weights sum having streaming media video is the first total weight value；
Step 205, it is judged that whether described first total weight value is less than preset threshold value；The most then perform step
Rapid 206, if it is not, then perform step 207；
Step 206, has the relief area of streaming media video to carry out dilatation for described storage；
Step 207, carries out interleave in described buffer empty.
In one preferred embodiment of the invention, described step 207 can include following sub-step:
Sub-step S31, replicates that the streaming media video corresponding to described buffer empty is previous to carry out mixing
Frame of video；
Described frame of video is inserted in described buffer empty by sub-step S32.
In implementing, owing to network jitter is likely to result in the relief area on a certain road or some road
For empty situation.Now judge that the situation of buffer empty is to be caused by single network jitter or repeatedly
Network jitter causes.If single network jitter causes, the most temporarily think this road streaming media video number
According to having been off, then from streaming media video blender, delete this streaming media video；If many secondary nets
Network shake causes, then it is assumed that the network jitter of this streaming media video is relatively big, and needs determine whether there is must
System buffer to be strengthened.
Decision process false code is as follows:
The detailed process of above-mentioned false code is:
1, being carried out by the weights of each road streaming media video of relief area non-NULL adds up obtains total weight value Csum,
Wherein
If 2 these total weight values are less than K, i.e. Csum< K, then it is assumed that current video mixed effect is through adding
Ungratified desired value after power calculating, it should increase relief area, improves fluency.
Wherein, K (span (0, m), such as 0.7, wherein the highest then fluency of K value is the highest,
As K=0 then consistent with real-time precession effect, as K=m then with fluency precession effect one
Cause).
If 3 these total weight values are more than K, i.e. Csum>=K, then it is assumed that current video mixed effect is through adding
The desired value that power meets after calculating, in order to ensure streaming media video blender each road when of work
Streaming media video the most at least frame data, the streaming media video being empty to relief area carries out interleave
Process, such as can replicate former frame and carry out the video requency frame data of streaming media video mixing and put into slow
Rush in district.
In order to make it is further understood that the advantage of the embodiment of the present invention, below use
The mode of contrast is described in detail to towards the frame rate control method paying close attention to content optimum.
The two kinds of frame rate control methods currently mainly used are being ground the basis made internal disorder or usurp by the embodiment of the present invention
On, it is proposed that a kind of frame rate control method paying close attention to content priority.Utilize the correlation theory of queueing theory,
Three kinds of methods are modeled, compare the quality of various models in the case of different demands.
Queue theory model is set up:
Owing to real time flow medium data export with constant rate of speed in source, and nonrandom arrival, Gu nothing
Method directly applies mechanically queue theory model, but the noise on network or interference signal cause network jitter
The process of packet active channel be considered random arrival and obey Poisson distribution.And
Input content stream in same supposition passage may be considered with the arrival process of interference signal exists line
Property dependency.Control the frame per second in dotted line in Fig. 1 to be partially converted to as shown in Figure 7 this
The schematic diagram of bright a kind of queue theory model.
If using input content stream as discuss object, need calculate individual queue (i.e. relief area) team leader be
The probability of 0 and the impact on system thereof.But needing model conversion is with noise flowing for discussing object
Model, constant shown in form and Fig. 7 after conversion, but input object is noise flowing, calculates object and becomes
The probability taken by noise for individual queue and the impact on system thereof.
If link bandwidth is w, input content bit rate is b, then the service rate for noise is
μ=w-b, the noise exceeding this speed then can cause content stream cannot arrive relief area, the most visually
Relief area is taken for noise.In order to simplify, the process of argumentation, this example are assumed each input content stream
Bit rate is identical, and the shake intensity of each link and bandwidth are identical.Owing to shake intensity is identical, respectively
Road noise arrival rate λ1=λ2...=λN=λ, the most again due to each road input content bit rate and bandwidth phase
With, then μ1=μ2...=μN=μ.If maximum team leader is N, number of queues is K.Pool is met owing to arriving
Pine distribution, services and is distributed into fixed length, and queue (relief area) is limited, and therefore, this model is actually K
The mixed model that individual M/D/1/N/ ∞ parallel connection is connected again.The rule of series connection service is according to three kinds of frame per second controls
Method processed towards demand different and have respective difference.
1, towards the frame rate control method that fluency is optimum
The frame rate control method of fluency optimum requires that each video pictures is smooth, no as far as possible
Skip any data.The content stream i.e. requiring each relief area can not be equal to each relief area not for sky
Can be taken by noise flowing.If it is to say, in system there is the phenomenon taken by noise in any queue
Then run counter to fluency optimum requirement.
From M/D/1/N/ ∞ model calculation formula, queue arrives the probability of the longest restriction and is:
PN=ρNP0
Wherein
Then
When then meeting fluency optimum demand, the probability that K queue does not all arrive the upper limit is:
Assume bandwidth w=10 (100kb/s), input content bit rate b=8 (100kb/s), noise arrival rate
λ=1 (100kb/s), then service rate μ=2 (100kb/s), if queue upper limit N=5 (100kb), K=9 altogether
Queue, the probability going out to meet demand of calculating is:
P=0.865
I.e. when relief area is 500kb, system operation there is the probability of 86.5% meet fluency
Demand.
2, towards the frame rate control method that real-time is optimum
The frame rate control method of real-time optimum requires higher application, at acceptable effective scope
Reduce the most as far as possible and buffer even without buffering, minimize the requirement of delay.In like manner, it is known that team
Row arrive the probability of the upper limit:
The picture of frame-skipping occurs less than 30% during to seek common ground, i.e. require to arrive the team of the upper limit simultaneously
Row are less than k=K*30%.
When then meeting real-time optimum demand, the probability that at least K-k queue is not taken by noise
For:
Under the same terms above, calculate:
P=0.88
I.e. when relief area is 500kb, system operation there is the probability of 88% meet real-time
Demand.
3, towards paying close attention to the frame rate control method that content is optimum
In implementing, typically can zoom in and out according to the demand of user, arrange during video mix,
Such as Fig. 2, the mixed form shown in 3.In Fig. 2 and Fig. 3, the video of serial number 1 is indicated
Picture is the content that user pays close attention to most, then can in the case of ensureing this picture effect optimum to the greatest extent
May reduce time delay, and in tolerance interval, ignore the frame-skipping situation of other non-interesting pictures.
Such method is exactly towards paying close attention to the frame rate control method that content is optimum.
Because only considering that the effect of some video is optimum, so having only in system ensure some
The queue probability for sky within a specified time is less than limit value.So calculating process can be by
System regards system A of the M/D/1/N/ ∞ model of a single team as, adds a K-1
M/D/1/N/ ∞ model system B connected again of parallel connection, the total buffer value of system takes two systems of A, B
Maximum.
First A system is calculated.
For single group of system, it meets the probability of demand:
Under the same terms above, calculate:
PA=0.984
Calculate B system again.Due to B system is to weaken fluency to emphasize the demand of real-time, its
Computational methods meet the computational methods towards real-time optimum, it may be assumed that
Under the same terms above, calculate:
PB=0.894
Then A, B system meet the probability of demand simultaneously and are:
P=PA*PB=0.879
I.e. when relief area is 500kb, in system operation, the probability of 87.9% meets concern content priority
Demand.
Three kinds of frame per second control modes are analyzed:
By supposing the method that condition substitutes into parameter in example, calculate under given conditions, various methods
Meet the probability of demand under the same conditions.In order to analyze each method further under different qualificationss
Situation, depicts the relation caching the probability P that N meets demand with caching in each method by matlab,
A kind of buffer area being specifically referred to the present invention shown in Fig. 8 meets corresponding frame rate control method
The schematic diagram of probability of demand, wherein a is the fluency mode of priority, and b is the real-time mode of priority, c
For paying close attention to content priority method, d is three's composograph.Exist to be easy to further to compare each method
Three kinds of methods are plotted to same image by the difference under the same terms, are specifically referred to Fig. 9 institute
A kind of caching of the present invention shown and the total signal meeting corresponding frame rate control method probability of demand
Figure.Fig. 9 (a) is readily apparent to, any identical under conditions of, pay close attention to content priority method full
The probability of foot demand is between other two kinds of frame rate control methods, and reasoning understands, if meeting probability
In the case of identical, the buffer size needed for the method also between other two kinds of methods, as
Shown in Fig. 9 (b) dotted line.In summary, pay close attention to content priority method and can not reduce user's body
Buffering duration in the case of testing, needed for reducing to a certain extent.
Two kinds of conventional frame per second controlling parties in the streaming media video hybrid technology discussed in this example
Method, and propose on the basis of two kinds of conventional frame rate control methods towards paying close attention to content optimum
Frame rate control method.By modeling, utilize the correlation theory of queueing theory, several method is carried out
Analyze and compare.Relatively it is found that can be towards paying close attention to the optimum frame rate control method of content
Finding suitable equilibrium point in fluency and two kinds of demands of real-time, Consumer's Experience is effective.
It should be noted that for embodiment of the method, in order to be briefly described, therefore it is all expressed as
A series of combination of actions, but those skilled in the art should know, and the embodiment of the present invention is not
Limited by described sequence of movement, because according to the embodiment of the present invention, some step can be adopted
By other orders or carry out simultaneously.Secondly, those skilled in the art also should know, description
Described in embodiment belong to preferred embodiment, the involved action not necessarily present invention
Necessary to embodiment.
With reference to Figure 10, it is shown that the device that a kind of streaming media video of present invention mixing frame per second controls is implemented
The structured flowchart of example, one or more streaming media video can be loaded into one or many of correspondence respectively
In individual relief area, described streaming media video can include frame of video, specifically can include such as lower module:
Determine module 301, for determining the weights that one or more streaming media video described is corresponding；
In one preferred embodiment of the invention, described determine that module 301 may include that
Reading submodule, for reading the layout parameter in preset configuration file；Described layout parameter
Including the ratio that the pixel of one or more streaming media video described is shared in preset total pixel；
First adjusts submodule, for using described ratio as one or more Streaming Media described
The weights of video.
In one preferred embodiment of the invention, described determine that module 301 may include that
Receive submodule, be used for receiving additional parameter；Described additional parameter include a described road or
The weights that multi-way stream media video is new；
Second adjusts submodule, is used for described new weights as one or more Streaming Media described
The weights of video.
Mixing module 302, for respectively from the one or more relief area, extracts correspondence frame by frame
One or more streaming media video mix；
Statistical module 303, for when there is buffer empty, statistics storage has the slow of streaming media video
The weights sum rushing all streaming media videos in district is the first total weight value；
Judge module 304, is used for judging that whether described first total weight value is less than preset threshold value；If so,
Then call dilatation module 305, if it is not, then call interleave module 306；
Dilatation module 305, for having the relief area of streaming media video to carry out dilatation for described storage；
Interleave module 306, for carrying out interleave in described buffer empty.
In one preferred embodiment of the invention, described device can also include:
Computing module, obtains for calculating the weights sum of one or more streaming media video described
Two total weight values；
Judge module, is used for judging whether described second total weight value is not equal to default value；If so,
Then call the 3rd adjusting module；
3rd adjusting module, for calculating the weights of one or more streaming media video described, and in advance
If the ratio of numerical value and the second total weight value is long-pending, as the power of one or more streaming media video described
Value.
For device embodiment, owing to it is with embodiment of the method basic simlarity, so describe
Fairly simple, relevant part sees the part of embodiment of the method and illustrates.
Each embodiment in this specification all uses the mode gone forward one by one to describe, each embodiment emphasis
Illustrate is all the difference with other embodiments, identical similar part between each embodiment
See mutually.
Those skilled in the art it should be appreciated that the embodiment of the embodiment of the present invention can be provided as method,
Device or computer program.Therefore, the embodiment of the present invention can use complete hardware embodiment,
Completely software implementation or the form of the embodiment in terms of combining software and hardware.And, this
Bright embodiment can use at one or more computers wherein including computer usable program code
Usable storage medium (including but not limited to disk memory, CD-ROM, optical memory etc.) is upper real
The form of the computer program executed.
The embodiment of the present invention be with reference to according to embodiments of the present invention method, terminal unit (system) and
The flow chart of computer program and/or block diagram describe.It should be understood that can be by computer journey
Sequence instructs each flow process in flowchart and/or block diagram and/or square frame and flow chart
And/or the flow process in block diagram and/or the combination of square frame.These computer program instructions can be provided
To general purpose computer, special-purpose computer, Embedded Processor or other programmable data processing terminals
The processor of equipment is to produce a machine so that processed by computer or other programmable datas
The instruction that the processor of terminal unit performs produces for realizing at one flow process of flow chart or multiple stream
The device of the function specified in journey and/or one square frame of block diagram or multiple square frame.
These computer program instructions may be alternatively stored in and can guide at computer or other programmable datas
In the computer-readable memory that reason terminal unit works in a specific way so that be stored in this calculating
Instruction in machine readable memory produces the manufacture including command device, and this command device realizes
One flow process of flow chart or multiple flow process and/or one square frame of block diagram or multiple square frame are specified
Function.
These computer program instructions also can be loaded into computer or other programmable data processing terminals
On equipment so that on computer or other programmable terminal equipment perform sequence of operations step with
Produce computer implemented process, thus perform on computer or other programmable terminal equipment
Instruction provides for realizing at one flow process of flow chart or multiple flow process and/or one square frame of block diagram
Or the step of the function specified in multiple square frame.
Although have been described for the preferred embodiment of the embodiment of the present invention, but those skilled in the art
Once know basic creative concept, then these embodiments can be made other change and amendment.
So, claims are intended to be construed to include preferred embodiment and fall into the embodiment of the present invention
All changes of scope and amendment.
Finally, in addition it is also necessary to explanation, in this article, the relation of such as first and second or the like
Term is used merely to separate an entity or operation with another entity or operating space, and not
Necessarily require or imply and there is the relation of any this reality or suitable between these entities or operation
Sequence.And, term " includes ", " comprising " or its any other variant are intended to nonexcludability
Comprise, so that include the process of a series of key element, method, article or terminal unit not only
Including those key elements, but also include other key elements being not expressly set out, or also include for
The key element that this process, method, article or terminal unit are intrinsic.There is no more restriction
In the case of, statement " including ... " key element limited, it is not excluded that including described key element
Process, method, article or terminal unit there is also other identical element.
Above to a kind of streaming media video mixing frame rate control method provided by the present invention and a kind of stream
Media video mixing frame per second controls device, is described in detail, specific case used herein
Principle and embodiment to the present invention are set forth, and the explanation of above example is only intended to side
Assistant solves method and the core concept thereof of the present invention；Simultaneously for one of ordinary skill in the art,
According to the thought of the present invention, the most all will change, combine
Upper described, this specification content should not be construed as limitation of the present invention.
Claims (10)
1. the method that a streaming media video mixing frame per second controls, it is characterised in that one or more
Streaming media video is loaded in corresponding one or more relief areas respectively, described streaming media video bag
Including frame of video, described method includes:
Determine the weights that one or more streaming media video described is corresponding；
Respectively from the one or more relief area, extract one or more stream matchmaker of correspondence frame by frame
Volumetric video mixes；
When there is buffer empty, statistics storage has all Streaming Medias in the relief area of streaming media video
The weights sum of video is the first total weight value；
Judge that whether described first total weight value is less than preset threshold value；The most then have for described storage
The relief area of streaming media video carries out dilatation；If it is not, then carry out interleave in described buffer empty.
Method the most according to claim 1, it is characterised in that described determine a described road or
The step of the weights that multi-way stream media video is corresponding includes:
Read the layout parameter in preset configuration file；Described layout parameter includes a described road or many
The ratio that the pixel of road streaming media video is shared in preset total pixel；
Using described ratio as the weights of one or more streaming media video described.
Method the most according to claim 1 and 2, it is characterised in that described determine described one
The step of road or weights corresponding to multi-way stream media video includes:
Receive additional parameter；Described additional parameter includes that one or more streaming media video described is new
Weights；
Using described new weights as the weights of one or more streaming media video described.
Method the most according to claim 1, it is characterised in that determine a road or many described
After the step of the weights that road streaming media video is corresponding, also include:
The weights sum calculating one or more streaming media video described obtains the second total weight value；
Judge whether described second total weight value is not equal to default value；
The most then calculate the weights of one or more streaming media video described, with default value and the
The ratio of two total weight values is long-pending, as the weights of one or more streaming media video described.
Method the most according to claim 1, it is characterised in that described enter in buffer empty
The step of row interleave includes:
Replicate the previous frame of video carrying out mixing of the streaming media video corresponding to described buffer empty；
Described frame of video is inserted in described buffer empty.
Method the most according to claim 1, it is characterised in that described K is 0.7.
7. the device that a streaming media video mixing frame per second controls, it is characterised in that one or more
Streaming media video is loaded in corresponding one or more relief areas respectively, described streaming media video bag
Including frame of video, described device includes:
Determine module, for determining the weights that one or more streaming media video described is corresponding；
Mixing module, for respectively from the one or more relief area, extracts correspondence frame by frame
One or more streaming media video mixes；
Statistical module, for when there is buffer empty, statistics storage has the buffering of streaming media video
In district, the weights sum of all streaming media videos is the first total weight value；
Judge module, is used for judging that whether described first total weight value is less than preset threshold value；The most then
Call dilatation module, if it is not, then call interleave module；
Dilatation module, for having the relief area of streaming media video to carry out dilatation for described storage；
Interleave module, for carrying out interleave in described buffer empty.
Device the most according to claim 7, it is characterised in that described determine that module includes:
Reading submodule, for reading the layout parameter in preset configuration file；Described layout parameter
Including the ratio that the pixel of one or more streaming media video described is shared in preset total pixel；
First adjusts submodule, for using described ratio as one or more Streaming Media described
The weights of video.
9. according to the device described in claim 7 or 8, it is characterised in that described determine module bag
Include:
Receive submodule, be used for receiving additional parameter；Described additional parameter include a described road or
The weights that multi-way stream media video is new；
Second adjusts submodule, is used for described new weights as one or more Streaming Media described
The weights of video.
Device the most according to claim 7, it is characterised in that also include:
Computing module, obtains for calculating the weights sum of one or more streaming media video described
Two total weight values；
Judge module, is used for judging whether described second total weight value is not equal to default value；If so,
Then call the 3rd adjusting module；
3rd adjusting module, for calculating the weights of one or more streaming media video described, and in advance
If the ratio of numerical value and the second total weight value is long-pending, as the power of one or more streaming media video described
Value.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610270343.9A CN105898384B (en) | 2016-04-26 | 2016-04-26 | A kind of method and apparatus of streaming media video mixing frame per second control |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610270343.9A CN105898384B (en) | 2016-04-26 | 2016-04-26 | A kind of method and apparatus of streaming media video mixing frame per second control |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105898384A true CN105898384A (en) | 2016-08-24 |
| CN105898384B CN105898384B (en) | 2019-03-22 |
Family
ID=56701955
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610270343.9A Active CN105898384B (en) | 2016-04-26 | 2016-04-26 | A kind of method and apparatus of streaming media video mixing frame per second control |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105898384B (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107005703A (en) * | 2016-09-09 | 2017-08-01 | 深圳市大疆创新科技有限公司 | Method for encoding images and system |
| CN109711421A (en) * | 2017-10-25 | 2019-05-03 | 腾讯科技（深圳）有限公司 | A kind of data processing method and device |
| CN109769140A (en) * | 2018-12-20 | 2019-05-17 | 南京杰迈视讯科技有限公司 | A kind of network video smoothness control method for playing back based on stream media technology |
| CN112422888A (en) * | 2019-08-23 | 2021-02-26 | 浙江宇视科技有限公司 | Video splicing method and device, electronic equipment and computer readable storage medium |
| CN113157228A (en) * | 2021-02-01 | 2021-07-23 | 中国船舶重工集团公司第七0九研究所 | Display control device and method for multi-source frame rate interactive high frame rate |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1141106A (en) * | 1994-12-19 | 1997-01-22 | 摩托罗拉公司 | Multimedia multiplexing device and method using dynamic packet segmentation |
| CN1149374A (en) * | 1994-04-20 | 1997-05-07 | 汤姆森消费电子有限公司 | Multiplexer system using constant bit rate encoders |
| JP2006054801A (en) * | 2004-08-16 | 2006-02-23 | Kddi Corp | Video information composition simultaneous encoding apparatus |
| CN101527834A (en) * | 2009-03-26 | 2009-09-09 | 浙江大华技术股份有限公司 | Wireless narrowband network video transmission method |
| US20110191449A1 (en) * | 2003-04-30 | 2011-08-04 | Akamai Technologies, Inc. | Automatic migration of data via a distributed computer network |
| US20110243218A1 (en) * | 2002-12-16 | 2011-10-06 | Xiaochun Nie | Method of implementing improved rate control for a multimedia compression and encoding system |
| CN102427532A (en) * | 2011-10-24 | 2012-04-25 | 成都虢电智能电力科技有限公司 | Multipath video adapting coding transmission method under limited bandwidth and transmission system thereof |
| US20120246689A1 (en) * | 2005-07-22 | 2012-09-27 | Genevieve Thomas | Buffering content on a handheld electronic device |
-
2016
- 2016-04-26 CN CN201610270343.9A patent/CN105898384B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1149374A (en) * | 1994-04-20 | 1997-05-07 | 汤姆森消费电子有限公司 | Multiplexer system using constant bit rate encoders |
| CN1141106A (en) * | 1994-12-19 | 1997-01-22 | 摩托罗拉公司 | Multimedia multiplexing device and method using dynamic packet segmentation |
| US20110243218A1 (en) * | 2002-12-16 | 2011-10-06 | Xiaochun Nie | Method of implementing improved rate control for a multimedia compression and encoding system |
| US20110191449A1 (en) * | 2003-04-30 | 2011-08-04 | Akamai Technologies, Inc. | Automatic migration of data via a distributed computer network |
| JP2006054801A (en) * | 2004-08-16 | 2006-02-23 | Kddi Corp | Video information composition simultaneous encoding apparatus |
| US20120246689A1 (en) * | 2005-07-22 | 2012-09-27 | Genevieve Thomas | Buffering content on a handheld electronic device |
| CN101527834A (en) * | 2009-03-26 | 2009-09-09 | 浙江大华技术股份有限公司 | Wireless narrowband network video transmission method |
| CN102427532A (en) * | 2011-10-24 | 2012-04-25 | 成都虢电智能电力科技有限公司 | Multipath video adapting coding transmission method under limited bandwidth and transmission system thereof |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107005703A (en) * | 2016-09-09 | 2017-08-01 | 深圳市大疆创新科技有限公司 | Method for encoding images and system |
| US10972681B2 (en) | 2016-09-09 | 2021-04-06 | SZ DJI Technology Co., Ltd. | Image encoding method and system |
| CN109711421A (en) * | 2017-10-25 | 2019-05-03 | 腾讯科技（深圳）有限公司 | A kind of data processing method and device |
| CN109769140A (en) * | 2018-12-20 | 2019-05-17 | 南京杰迈视讯科技有限公司 | A kind of network video smoothness control method for playing back based on stream media technology |
| CN112422888A (en) * | 2019-08-23 | 2021-02-26 | 浙江宇视科技有限公司 | Video splicing method and device, electronic equipment and computer readable storage medium |
| CN112422888B (en) * | 2019-08-23 | 2022-07-19 | 浙江宇视科技有限公司 | Video splicing method and device, electronic equipment and computer readable storage medium |
| CN113157228A (en) * | 2021-02-01 | 2021-07-23 | 中国船舶重工集团公司第七0九研究所 | Display control device and method for multi-source frame rate interactive high frame rate |
| CN113157228B (en) * | 2021-02-01 | 2022-07-05 | 中国船舶重工集团公司第七0九研究所 | Display control device and method for multi-source frame rate interactive high frame rate |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105898384B (en) | 2019-03-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105898384A (en) | Method and apparatus for controlling streaming video mixing frame rate | |
| CN103310820B (en) | A kind of method that multimedia player is optimized | |
| CN100496129C (en) | H.264 based multichannel video transcoding multiplexing method | |
| US20090010325A1 (en) | Method of performing rate control for a compression system | |
| CN108810545B (en) | Method, apparatus, computer readable medium and electronic device for video encoding | |
| JP2015536594A (en) | Aggressive video frame drop | |
| CN102037730A (en) | Content adaptive video encoder and coding method | |
| CN102625147A (en) | Self-adapting display method for mobile video equipment | |
| CN104506870B (en) | A kind of video coding processing method and device suitable for more code streams | |
| CN106791850A (en) | Method for video coding and device | |
| CN110493600A (en) | Image encoding method, device, computer equipment and storage medium | |
| JPH06165146A (en) | Method and device for encoding image | |
| CN107820095A (en) | A kind of long term reference image-selecting method and device | |
| CN106791957A (en) | Net cast processing method and processing device | |
| CN108200470A (en) | A kind of video code rate method of adjustment and equipment | |
| EP0949822A2 (en) | Video coding control method and apparatus | |
| KR20000029596A (en) | Method of switching video sequences and corresponding switching device and decoding system | |
| Wang et al. | Rate control for MPEG transcoders | |
| Seeling et al. | Evaluating multimedia networking mechanisms using video traces | |
| Rezaei et al. | Joint video coding and statistical multiplexing for broadcasting over DVB-H channels | |
| WO2002049364A2 (en) | Method and apparatus for adaptive bit rate control in an asynchronized encoding system | |
| CN105323578B (en) | Statistic multiplexing method and device | |
| Alheraish et al. | A GACS modeling approach for MPEG broadcast video | |
| Mueller et al. | Context-aware video encoding as a network-based media processing (NBMP) workflow | |
| Zhang et al. | A novel scheme of transporting pre-stored MPEG video to support video-on-demand (VoD) services |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: 510665, Guangzhou high tech Industrial Development Zone, Guangdong Science Town 162 science Avenue, creative building B2, building second, 201 units Applicant after: Guangzhou Ncast Electronic Science & Technology Co., Ltd. Address before: 510665 Guangdong city of Guangzhou province Tianhe District Tong Road 188, room 409, 407 Applicant before: Guangzhou Ncast Electronic Science & Technology Co., Ltd. |
|
| COR | Change of bibliographic data | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| PE01 | Entry into force of the registration of the contract for pledge of patent right |
Denomination of invention: Method and device for controlling mixed frame rate of streaming media video Effective date of registration: 20210506 Granted publication date: 20190322 Pledgee: China Co. truction Bank Corp Guangzhou economic and Technological Development Zone sub branch Pledgor: GUANGZHOU NCAST ELECTRONICS Co.,Ltd. Registration number: Y2021980003287 |
|
| PE01 | Entry into force of the registration of the contract for pledge of patent right |