CN105979304A - Video pushing method and video pushing device - Google Patents
Video pushing method and video pushing device Download PDFInfo
- Publication number
- CN105979304A CN105979304A CN201610379727.4A CN201610379727A CN105979304A CN 105979304 A CN105979304 A CN 105979304A CN 201610379727 A CN201610379727 A CN 201610379727A CN 105979304 A CN105979304 A CN 105979304A
- Authority
- CN
- China
- Prior art keywords
- interest
- video
- bandwidth
- area
- regions
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 35
- 238000013139 quantization Methods 0.000 claims abstract description 84
- 230000006855 networking Effects 0.000 claims description 28
- 230000001419 dependent effect Effects 0.000 claims description 9
- 238000005516 engineering process Methods 0.000 claims description 8
- 238000001514 detection method Methods 0.000 claims description 7
- 238000004891 communication Methods 0.000 claims description 6
- 241000208340 Araliaceae Species 0.000 claims 1
- 235000005035 Panax pseudoginseng ssp. pseudoginseng Nutrition 0.000 claims 1
- 235000003140 Panax quinquefolius Nutrition 0.000 claims 1
- 235000008434 ginseng Nutrition 0.000 claims 1
- 238000004458 analytical method Methods 0.000 description 6
- 238000011156 evaluation Methods 0.000 description 4
- 238000004364 calculation method Methods 0.000 description 3
- 238000013461 design Methods 0.000 description 3
- 238000012417 linear regression Methods 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 238000013441 quality evaluation Methods 0.000 description 3
- 230000003321 amplification Effects 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 238000003199 nucleic acid amplification method Methods 0.000 description 2
- 238000012360 testing method Methods 0.000 description 2
- 238000000540 analysis of variance Methods 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 238000001303 quality assessment method Methods 0.000 description 1
- 230000006641 stabilisation Effects 0.000 description 1
- 238000011105 stabilization Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/266—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
- H04N21/2662—Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/167—Position within a video image, e.g. region of interest [ROI]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/23418—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses a video pushing method and a video pushing device, which are used for a server. The video pushing method is characterized in that network bandwidth of a client used for playing a target on-line video is acquired in a real-time manner; whether the network bandwidth satisfies a requirement of playing the target on-line video is determined; when the answer is no, the interested area and the uninterested area of every frame of the target on-line video are determined according to a preset determining rule; the proportions of the network bandwidth occupied by the interested areas and the uninterested areas are determined according to the network bandwidth and the frame rate of the target on-line video; according to the proportions, first quantization parameters corresponding to the interested areas and second quantization parameters corresponding to the uninterested areas are determined; according to the first quantization parameters and the second quantization parameters, the interested areas and the uninterested areas are respectively coded; the coded frames are pushed to the client, and then the client is used to play the target on-line video. By adopting the video pushing method and the video pushing device, a part of the on-line video having the high regional definition is played.
Description
Technical field
The present invention relates to technical field of video processing, particularly to a kind of video pushing method and device.
Background technology
Along with the development of the Internet, viewing Online Video has become as a part for people's life.Under normal circumstances, same
Online Video has multiple definition.The definition of Online Video is the highest, more can allow users to obtain more preferable viewing and experience.
But, play the Online Video that definition is higher, higher to the network bandwidth requirement of client.If client
The network bandwidth is not enough, during playing the Online Video that definition is higher, it may appear that video Caton phenomenon.Regard to reduce
Frequently the appearance of Caton phenomenon, needs to reduce the definition of the Online Video play, it is generally the case that can reduce regarding online of broadcasting
The definition of each frame of frequency, and then cause the Online Video entirety play the most unintelligible.
Summary of the invention
The purpose of the embodiment of the present invention is to provide a kind of video pushing method and device, for solving regarding online of broadcasting
Frequently the most unsharp problem of entirety.Technical scheme is as follows:
For arriving above-mentioned purpose, the embodiment of the invention discloses a kind of video pushing method, be applied to server, described clothes
Business device is connected with client communication, and method includes:
Obtain described client in real time for playing the network bandwidth of target Online Video;
Judge whether the described network bandwidth meets the requirement playing described target Online Video;
If it does not, determine rule according to presetting, determine the area-of-interest of each frame of video in described target Online Video
And regions of non-interest, wherein, described area-of-interest is the region that need not reduce video definition, described non-interested
Region is the region needing to reduce video definition;
According to the described network bandwidth and the frame per second of described target Online Video, determine that described area-of-interest and non-sense are emerging
Interest region accounts for the ratio of described networking bandwidth respectively;
According to described ratio, determine the first quantization parameter and regions of non-interest difference that described area-of-interest is corresponding
The second corresponding quantization parameter;
According to described first quantization parameter and described second quantization parameter, respectively to described area-of-interest and described non-
Area-of-interest encodes;
Frame of video after coding is pushed to described client, so that target Online Video described in described client terminal playing.
It is also preferred that the left described basis is preset determines rule, determine the interested of each frame of video in described target Online Video
Region and regions of non-interest, including:
Determine rule according to presetting, determine each frame of video do not play in video segment of described target Online Video
Area-of-interest and regions of non-interest.
It is also preferred that the left described basis is preset determines rule, determine the interested of each frame of video in described target Online Video
Region and regions of non-interest, including:
In the described target Online Video that face recognition technology will be utilized to identify, the face in each frame of video, is defined as
Area-of-interest, will be defined as non-sense except the region that described region of interest is overseas in each frame of video in described target Online Video
Interest region.
It is also preferred that the left described according to the described network bandwidth with the frame per second of described target Online Video, determine described region of interest
Territory and regions of non-interest account for the ratio of described networking bandwidth respectively, including:
According to overall video quality VqWith area-of-interest shared by the relation of overall bandwidth ratio p:
By overall video quality VqP corresponding when being in optimum is defined as described area-of-interest and accounts for described networking bandwidth
Ratio;1-p is defined as described regions of non-interest and accounts for the ratio of described networking bandwidth;
Wherein, 0.5≤p < 1, v1、v2、v3、v4、v5、v6、v7、v1'、v2'、v3'、v4'、v5'、v6'、v7' be and coding staff
Formula, video frame rate, constant coefficient that Video Key frame period is relevant with video resolution, FrvFrame for described target Online Video
Rate, BrvFor the described network bandwidth, w1For the weight coefficient of regions of non-interest, w2Weight coefficient for area-of-interest.
It is also preferred that the left described according to described ratio, determine the first quantization parameter and non-sense that described area-of-interest is corresponding
The second quantization parameter that interest region is the most corresponding, including:
Account for the ratio of described networking bandwidth according to described area-of-interest and described regions of non-interest, calculate respectively
Described area-of-interest and the bandwidth of described regions of non-interest;
According to bandwidth and the relation of quantization parameter, determine described first quantization parameter and described second quantization parameter, its
In, bandwidth with the relation of quantization parameter is:
Brv=aQP-1+bQP-2
Wherein, BrvFor bandwidth, a with b is the model parameter relevant to frame type, and QP is quantization parameter.
For reaching above-mentioned purpose, the embodiment of the invention also discloses a kind of video push device, be applied to server, described
Server is connected with client communication, and described device includes: bandwidth detection, bandwidth judge module, region divide module, band
Wide ratio-dependent module, quantization parameter determine module, coding module, pushing module, wherein,
Described bandwidth detection, obtains described client for playing the Netowrk tape of target Online Video in real time
Wide;
Described bandwidth judge module, plays wanting of described target Online Video for judging whether the described network bandwidth meets
Ask;
Described region divides module, for when the judged result of bandwidth judge module is no, determines rule according to presetting,
Determine area-of-interest and the regions of non-interest of each frame of video in described target Online Video, wherein, described interested
Region is the region that need not reduce video definition, and described regions of non-interest is to need to reduce the region of video definition;
Described bandwidth ratio-dependent module, is used for according to the described network bandwidth and the frame per second of described target Online Video, really
Fixed described area-of-interest and regions of non-interest account for the ratio of described networking bandwidth respectively;
Described quantization parameter determines module, for according to described ratio, determines the first amount that described area-of-interest is corresponding
Change parameter and the second quantization parameter of regions of non-interest correspondence respectively;
Described coding module, for according to described first quantization parameter and described second quantization parameter, respectively to described
Area-of-interest and described regions of non-interest encode;
Described pushing module, for the frame of video after coding is pushed to described client, so that described client terminal playing
Described target Online Video.
It is also preferred that the left described region divides module, specifically for:
Determine rule according to presetting, determine each frame of video do not play in video segment of described target Online Video
Area-of-interest and regions of non-interest.
It is also preferred that the left described region divides module, specifically for:
In the described target Online Video that face recognition technology will be utilized to identify, the face in each frame of video, is defined as
Area-of-interest, will be defined as non-sense except the region that described region of interest is overseas in each frame of video in described target Online Video
Interest region.
It is also preferred that the left described bandwidth ratio-dependent module, specifically for:
According to overall video quality VqWith area-of-interest shared by the relation of overall bandwidth ratio p:
By overall video quality VqP corresponding when being in optimum is defined as described area-of-interest and accounts for described networking bandwidth
Ratio;1-p is defined as described regions of non-interest and accounts for the ratio of described networking bandwidth;
Wherein, 0.5≤p < 1, v1、v2、v3、v4、v5、v6、v7、v1'、v2'、v3'、v4'、v5'、v6'、v7' be and coding staff
Formula, video frame rate, constant coefficient that Video Key frame period is relevant with video resolution, FrvFrame for described target Online Video
Rate, BrvFor the described network bandwidth, w1For the weight coefficient of regions of non-interest, w2Weight coefficient for area-of-interest.
It is also preferred that the left described quantization parameter determines module, specifically for:
Account for the ratio of described networking bandwidth according to described area-of-interest and described regions of non-interest, calculate respectively
Described area-of-interest and the bandwidth of described regions of non-interest;
According to bandwidth and the relation of quantization parameter, determine described first quantization parameter and described second quantization parameter, its
In, bandwidth with the relation of quantization parameter is:
Brv=aQP-1+bQP-2
Wherein, BrvFor bandwidth, a with b is the model parameter relevant to frame type, and QP is quantization parameter.
As seen from the above technical solutions, the embodiment of the invention discloses a kind of video pushing method and device, be applied to
Server, described server is connected with client communication, and method includes: it is online that the described client of real-time acquisition is used for playing target
The network bandwidth of video;Judge whether the described network bandwidth meets the requirement playing described target Online Video;If it does not, according to
Preset and determine rule, determine area-of-interest and the regions of non-interest of each frame of video in described target Online Video, its
In, described area-of-interest is the region that need not reduce video definition, and described regions of non-interest reduces video for needs
The region of definition;According to the described network bandwidth and the frame per second of described target Online Video, determine described area-of-interest and
Regions of non-interest accounts for the ratio of described networking bandwidth respectively;According to described ratio, determine that described area-of-interest is corresponding
Second quantization parameter of one quantization parameter and regions of non-interest correspondence respectively;According to described first quantization parameter and described
Second quantization parameter, encodes described area-of-interest and described regions of non-interest respectively;By the frame of video after coding
It is pushed to described client, so that target Online Video described in described client terminal playing.Visible, this programme can by calculating
Make area-of-interest and the bandwidth ratio of regions of non-interest that video quality is the highest, determine area-of-interest and non-region of interest
The quantization parameter in territory, carries out subregion coding to each frame of video of target video, because the amount of the area-of-interest calculated
Changing the parameter quantization parameter less than regions of non-interest, the video quality of corresponding area-of-interest is higher than regions of non-interest, institute
Can realize playing the video that subregion definition is higher.
Certainly, arbitrary product or the method for implementing the present invention must be not necessarily required to reach all the above excellent simultaneously
Point.
Accompanying drawing explanation
In order to be illustrated more clearly that the embodiment of the present invention or technical scheme of the prior art, below will be to embodiment or existing
In having technology to describe, the required accompanying drawing used is briefly described, it should be apparent that, the accompanying drawing in describing below is only this
Some embodiments of invention, for those of ordinary skill in the art, on the premise of not paying creative work, it is also possible to
Other accompanying drawing is obtained according to these accompanying drawings.
The schematic flow sheet of a kind of video pushing method that Fig. 1 provides for the embodiment of the present invention;
The structural representation of a kind of video push device that Fig. 2 provides for the embodiment of the present invention;
Bandwidth that Fig. 3 provides for the embodiment of the present invention, frame per second, optimal area-of-interest account for bandwidth ratio scatterplot;
Fig. 4 accounts for the curve assessment figure of bandwidth ratio and frame per second for the optimal area-of-interest that the embodiment of the present invention provides;
Fig. 5 accounts for the curve assessment figure of bandwidth ratio and bandwidth for the optimal area-of-interest that the embodiment of the present invention provides;
The normal curve rectangular histogram of the standardized residual that Fig. 6 provides for the embodiment of the present invention;
The P-P figure of the standardized residual that Fig. 7 provides for the embodiment of the present invention.
Detailed description of the invention
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete
Describe, it is clear that described embodiment is only a part of embodiment of the present invention rather than whole embodiments wholely.Based on
Embodiment in the present invention, it is every other that those of ordinary skill in the art are obtained under not making creative work premise
Embodiment, broadly falls into the scope of protection of the invention.
In order to solve existing have technical problem, embodiments provide a kind of video pushing method and device.Below
First a kind of video pushing method provided the embodiment of the present invention is introduced.
It should be noted that the embodiment of the present invention is preferably applied to server, server is connected with client communication.
The schematic flow sheet of a kind of video pushing method that Fig. 1 provides for the embodiment of the present invention, comprises the steps:
S101: obtain described client in real time for playing the network bandwidth of target Online Video;
It is emphasized that the above-mentioned network bandwidth refers to be currently used in the network bandwidth playing target Online Video, not
Being the network bandwidth of client entirety, such as, client is also being downloaded data while playing target Online Video, then I
Need to obtain in real time is to play the network bandwidth shared by target Online Video, the network that not including downloads data takies
Bandwidth.
S102: judge whether the described network bandwidth meets the requirement playing described target Online Video, if it does not, perform
S103;
Wherein, it is judged that whether the described network bandwidth meets the requirement playing described target Online Video, if it does not, perform
S103, particularly as follows: client step S101 obtained in real time is used for playing the network bandwidth of target Online Video and presets
The minimum network bandwidth required for playing target Online Video compares, if less than default minimal network bandwidth, then
Perform step S103.
S103: determine rule according to presetting, determine in described target Online Video the area-of-interest of each frame of video with
And regions of non-interest, wherein, described area-of-interest is the region that need not reduce video definition, described non-region of interest
Territory is the region needing to reduce video definition;
Wherein, area-of-interest is particularly as follows: a part of image-region of concentrating most of observer's attention of image.Such as,
People, when observing image, does not give equal attention to all regions in image, and often in image its
Region (such as face) attention interested is higher, and relatively low to other region attention.
Concrete, determine rule according to presetting, determine the area-of-interest of each frame of video in described target Online Video
And regions of non-interest, Ke Yiwei: determining rule according to presetting, determine described target Online Video does not plays video segment
In the area-of-interest of each frame of video and regions of non-interest.Such as, the reproduction time of current goal Online Video enters
Degree be 1 point 50 seconds, then, according to preset rules, determine the region of interest of the target Online Video 1 point each frame of video after 50 seconds
Territory and regions of non-interest.
Concrete, determine rule according to presetting, determine the area-of-interest of each frame of video in described target Online Video
And regions of non-interest, Ke Yiwei: each video in the described target Online Video that face recognition technology will be utilized to identify
Face in frame, is defined as area-of-interest, will remove described area-of-interest in each frame of video in described target Online Video
Outer region is defined as regions of non-interest.
S104: according to the described network bandwidth and the frame per second of described target Online Video, determine described area-of-interest and
Regions of non-interest accounts for the ratio of described networking bandwidth respectively;
Concrete, according to the described network bandwidth and the frame per second of described target Online Video, determine described area-of-interest with
And regions of non-interest accounts for the ratio of described networking bandwidth respectively, Ke Yiwei:
Video quality assessment is divided into objective evaluation and subjective evaluation, the method using objective evaluation in the embodiment of the present invention:
G.1070 standard based on ITU-T (International Telecommunication Union-Telecommunication Standardization Sector), only needs the frame per second of video, bit rate, and packet loss is just
A video quality estimation value can be obtained.
G.1070 model has 5 parts: parameter extraction unit, for the quality evaluation unit of coding distortion, for packet loss
The quality evaluation unit of distortion, decoder error hide evaluation unit and coefficient data storehouse.Video quality VqComputing formula
For:
Wherein: PplvFor packet loss, packet loss can directly obtain from channel;For packet loss robustness sex factor, represent
Video Stabilization quality robustness degree in packet loss environment.
First, from the bag of video flowing, bit rate, frame per second, code/decode type, video format and coding robustness etc. are obtained
Information, and according to factors such as terminal type, termination property, surrounding brightness, from coefficient data storehouse, select specific coefficient
Table.Video stream characteristics information and particular factor table are substituted into elementary video quality I of formula calculation code distortion effectcoding, depending on
Frequently quality I affected by encoder in quality calculation formulacodingComputing formula is as follows:
Wherein, OfrFor the frame per second of the best video quality under every kind of bit rate, computing formula is:
Ofr=v1+v2Brv
Wherein, 1≤Ofr≤ 30, v1And v2For constant;
IOfrFor the maximum video mass value in the case of each bit rate, computing formula is:
Wherein, 0≤IOfr≤ 4, v3、v4、v5For constant;
DFrVThe robustness degree affected by frame per second change for video, computing formula is:
DFrV=v6+v7Brv
Wherein, 0≤DFrV, v6、v7For constant.
The quality of area-of-interest and regions of non-interest is carried out quality evaluation respectively, and overall video quality is interested
Region and regions of non-interest quality weighting sum, computing formula is:
Vq=w1VqBG+w2VqROI
Wherein, w1+w2=1, VqBGFor the quality of regions of non-interest, VqROIFor the quality of area-of-interest, w1For non-sense
The weight of the quality in interest region, w2Weight for the quality of area-of-interest.
By video quality objective assessment models G.1070, video quality V is obtainedqWith network bandwidth Brv, frame per second Frv, and
Packet loss PplvBetween relation be:
Wherein, v1、v2、v3、v4、v5、v6、v7、v8、v9、v10、v11、v12For with coded system, video frame rate, Video Key
The constant coefficient that frame period is relevant with video resolution.
By packet loss PplvValue be set to 0, as the above analysis: overall video quality VqWith area-of-interest shared by whole
The relation of body bandwidth ratio p:
By overall video quality VqP corresponding when being in optimum is defined as described area-of-interest and accounts for described networking bandwidth
Ratio, is defined as 1-p described regions of non-interest and accounts for the ratio of described networking bandwidth, wherein, 0.5≤p < 1, v1、v2、v3、
v4、v5、v6、v7、v1'、v2'、v3'、v4'、v5'、v6'、v7' be and coded system, video frame rate, Video Key frame period and video
The constant coefficient that resolution is relevant, FrvFor the frame per second of described target Online Video, BrvFor the described network bandwidth, w1For non-interested
The weight coefficient in region, w2Weight coefficient for area-of-interest.
Under conditions of various bandwidth and frame per second, v1、v2、、、v7Calculation procedure as follows:
Step one: calculate Iofr(the maximum video mass value in the case of each bit rate), Ofr(obtain maximum video quality
Corresponding frame per second), DfrV(video quality is by frame per second and the robustness of bandwidth contributions), concrete formula is shown in above-mentioned analysis;
A, assume to have the different frame per second of M group and the various combination of bit rate, combination as shown in table 1:
Table 1
Brv | Frv | Vq |
bn | f1 | Vqs(bn,f1) |
bn | f2 | Vqs(bn,f2) |
… | … | … |
bn | fm | Vqs(bn,fm) |
… | … | … |
bn | fM | Vqs(bn,fM) |
Wherein, M represents frame per second number of combinations, f1>f2>…>fM, Vqs(bn,fm) represent that MOS is at bit rate bnWith frame per second fmBar
Value under part, illustrates herein for test video quality in the case of fixed bit rate.
B, by the data set in table 1 is applied to formulaIn, Iofr, Ofr, DfrVValue
Can be at every kind of bit rate bnIn the case of use least square approximation method to calculate, as shown in table 2:
Table 2
Brv | Ofr | Iofr | DfrV |
b1 | O1 | I1 | D1 |
b2 | O2 | I2 | D2 |
… | … | … | … |
bn | On | In | Dn |
… | … | … | … |
bN | ON | IN | DN |
N is bandwidth varied number in cycle tests, wherein, b1>b2>…>bN。
Step 2: design factor v1、v2:
By b in table 2nAnd On, n=1,2 ... N, substitute into formula Ofr=v1+v2BrvIn, use least square approximation to calculate
Coefficient v1,v2。
Step 3: design factor v3、v4、v5:
By b in table 2nAnd In, n=1,2 ... N, substitute into formulaIn, use least square approximation
Calculate coefficient v3、v4、v5。
Step 4: design factor v6、v7:
By the b in table 2n, Dn, n=1,2 ... N, apply to formula DFrV=v6+v7BrvIn, coefficient v6、v7Can pass through
A young waiter in a wineshop or an inn takes advantage of approximation computation out.
Analyze area-of-interest below by instantiation and account for the optimal proportion of bandwidth:
By above-mentioned analysis it is recognised that overall video quality and area-of-interest account for total bandwidth ratio, bandwidth, the pass of frame per second
System, uses statistical analysis software SPSS, and by difference frame per second, bandwidth makes the highest interested of video quality under the conditions of combining
Region accounting example and these frame per second, bandwidth carries out multiple linear regression analysis, thus show that optimal area-of-interest accounts for bandwidth ratio
Example and frame per second, the functional relation of bandwidth.Frame per second is from 5~30 frames/second, and amplification is 1 frame/second, bandwidth from 100~1000kbps,
Amplification is 100, under every kind of frame per second, bandwidth combination, obtains optimal area-of-interest and accounts for bandwidth ratio, altogether 260 kinds of combinations.Band
The scatterplot of width, frame per second and optimal area-of-interest accounting example is as shown in Figure 3.
Area-of-interest can not be apparent from from Fig. 3 and account for bandwidth ratio p and frame per second Frv, bandwidth B rvBetween letter
Number relational expression;Therefore, by p respectively with Frv、BrvCarry out curve estimation analysis respectively.P and FrvAnd BrvCurve estimation figure as figure
Shown in 4 and Fig. 5, when Fig. 4 is for carrying a width of 400kbps, different FrvWith the curve estimation figure of p, Fig. 5 is frame per second when being 20fps, no
Same BrvCurve estimation figure with p.P and Fr is can be seen that by two curve estimation figures of Fig. 4 and Fig. 5v、BrvFunction model be:
Wherein, y represents p, x1Represent Brv, x2Represent Frv.Formula is carried out variable replacement, i.e.x1x2=x4,
The like, obtain y and x1~x9Linear relationship be:
Y=a0+a1x1+a2x2+a3x3+a4x4+a5x5+a6x6+a7x7+a8x8+a9x9
Use SPSS statistical analysis software, by y, x1~x9Data set carry out multiple linear regression analysis, draw above-mentioned public affairs
Coefficient set in formula, as shown in table 3:
Table 3
Table 4 is analysis of variance table, as follows:
Table 4
Model | Quadratic sum | df | Mean square | F | Sig |
Return | 8.126 | 9 | 0.903 | 484.546 | 0.000 |
Residual error | 0.417 | 224 | 0.002 | ||
Amount to | 8.544 | 233 |
By the Sig value (statistical significance value) in table 4 it can be seen that above-mentioned y and x1~x9Relation equation linear regression bright
Aobvious.
Fig. 6 is the normal curve rectangular histogram of standardized residual, it can be seen that standardized residual is normal distribution, and each point dissipates
Point is linearly distributed near between straight line, explanatory variable in straight line up or down.
Fig. 7 is the P-P figure of standardized residual, it can be seen that two variable the most linearly trend, demonstrates Fig. 6 further
Conclusion.
Fig. 6 and Fig. 7 demonstrates optimal area-of-interest and account between bandwidth ratio and bandwidth, frame per second and resolution is to meet
Fit correlation.Therefore, above-mentioned regression equation meets linear and that variance is homogeneous inspection.
S105: according to described ratio, determine the first quantization parameter and non-region of interest that described area-of-interest is corresponding
The second quantization parameter that territory is the most corresponding;
Concrete, according to described ratio, determine the first quantization parameter that described area-of-interest is corresponding and non-interested
The second quantization parameter that region is the most corresponding, Ke Yiwei:
Account for the ratio of described networking bandwidth according to described area-of-interest and described regions of non-interest, calculate respectively
Described area-of-interest and the bandwidth of described regions of non-interest:
Band shared by area-of-interest is a width of:
BrvROI=pBrv
Band shared by regions of non-interest is a width of:
BrvBG=(1-p) Brv
Wherein, BrvFor the described network bandwidth, BrvROIBandwidth shared by area-of-interest, BrvBGFor regions of non-interest
Shared bandwidth, p is overall bandwidth ratio shared by area-of-interest, 0.5≤p < 1.
According to bandwidth and the relation of quantization parameter, determine described first quantization parameter and described second quantization parameter, its
In, bandwidth with the relation of quantization parameter is:
Brv=aQP-1+bQP-2
Wherein, BrvFor bandwidth, a with b is the model parameter relevant to frame type, and QP is quantization parameter.
S106: according to described first quantization parameter and described second quantization parameter, respectively to described area-of-interest and
Described regions of non-interest encodes;
S107: the frame of video after coding is pushed to described client, so that target described in described client terminal playing is online
Video.
Visible, this programme can make, by calculating, area-of-interest and the band of regions of non-interest that video quality is the highest
Wide ratio, determines the quantization parameter of area-of-interest and regions of non-interest, each frame of video of target video is carried out subregion
Territory encodes, because the quantization parameter of the area-of-interest calculated is less than the quantization parameter of regions of non-interest, corresponding interested
The video quality in region is higher than regions of non-interest, it is possible to realize playing the video that subregion definition is higher.
Corresponding with said method embodiment, the embodiment of the present invention also provides for a kind of video push device.
The structural representation of a kind of video push device that Fig. 2 provides for the embodiment of the present invention, may include that bandwidth detection
Module 201, bandwidth judge module 202, region division module 203, bandwidth ratio-dependent module 204, quantization parameter determine module
205, coding module 206, pushing module 207.
Wherein, bandwidth detection 201, for described bandwidth detection, it is used for for obtaining described client in real time
Play the network bandwidth of target Online Video;
Bandwidth judge module 202, plays wanting of described target Online Video for judging whether the described network bandwidth meets
Ask;
Region divides module 203, for when the judged result of bandwidth judge module is no, determines rule according to presetting,
Determine area-of-interest and the regions of non-interest of each frame of video in described target Online Video, wherein, described interested
Region is the region that need not reduce video definition, and described regions of non-interest is to need to reduce the region of video definition;
In actual applications, the region shown in the embodiment of the present invention divides module 203, specifically may be used for: according to presetting
Determine rule, determine the area-of-interest of each frame of video do not play in video segment of described target Online Video and non-
Area-of-interest.
In actual applications, the region shown in the embodiment of the present invention divides module 203, specifically may be used for: will utilize people
In the described target Online Video that face identification technology identifies, the face in each frame of video, is defined as area-of-interest, by institute
State the region removing described region of interest overseas in each frame of video in target Online Video and be defined as regions of non-interest.
Bandwidth ratio-dependent module 204, for according to the described network bandwidth and the frame per second of described target Online Video, determines
Described area-of-interest and regions of non-interest account for the ratio of described networking bandwidth respectively;
In actual applications, the bandwidth ratio-dependent module 204 shown in the embodiment of the present invention, specifically may be used for:
According to overall video quality VqWith area-of-interest shared by the relation of overall bandwidth ratio p:
By overall video quality VqP corresponding when being in optimum is defined as described area-of-interest and accounts for described networking bandwidth
Ratio;1-p is defined as described regions of non-interest and accounts for the ratio of described networking bandwidth;
Wherein, 0.5≤p < 1, v1、v2、v3、v4、v5、v6、v7、v1'、v2'、v3'、v4'、v5'、v6'、v7' be and coding staff
Formula, video frame rate, constant coefficient that Video Key frame period is relevant with video resolution, FrvFrame for described target Online Video
Rate, BrvFor the described network bandwidth, w1For the weight coefficient of regions of non-interest, w2Weight coefficient for area-of-interest.
Quantization parameter determines module 205, for according to described ratio, determining the first quantization that described area-of-interest is corresponding
Second quantization parameter of parameter and regions of non-interest correspondence respectively;
In actual applications, the quantization parameter shown in the embodiment of the present invention determines module 205, specifically may be used for:
Account for the ratio of described networking bandwidth according to described area-of-interest and described regions of non-interest, calculate respectively
Described area-of-interest and the bandwidth of described regions of non-interest;
According to bandwidth and the relation of quantization parameter, determine described first quantization parameter and described second quantization parameter, its
In, bandwidth with the relation of quantization parameter is:
Brv=aQP-1+bQP-2
Wherein, BrvFor bandwidth, a with b is the model parameter relevant to frame type, and QP is quantization parameter.
Coding module 206, for according to described first quantization parameter and described second quantization parameter, respectively to described sense
Interest region and described regions of non-interest encode;
Pushing module 207, for the frame of video after coding is pushed to described client, so that described client terminal playing institute
State target Online Video.
Visible, this programme can make, by calculating, area-of-interest and the band of regions of non-interest that video quality is the highest
Wide ratio, determines the quantization parameter of area-of-interest and regions of non-interest, each frame of video of target video is carried out subregion
Territory encodes, because the quantization parameter of the area-of-interest calculated is less than the quantization parameter of regions of non-interest, corresponding interested
The video quality in region is higher than regions of non-interest, it is possible to realize playing the video that subregion definition is higher.
It should be noted that in this article, the relational terms of such as first and second or the like is used merely to a reality
Body or operation separate with another entity or operating space, and deposit between not necessarily requiring or imply these entities or operating
Relation or order in any this reality.And, term " includes ", " comprising " or its any other variant are intended to
Comprising of nonexcludability, so that include that the process of a series of key element, method, article or equipment not only include that those are wanted
Element, but also include other key elements being not expressly set out, or also include for this process, method, article or equipment
Intrinsic key element.In the case of there is no more restriction, statement " including ... " key element limited, it is not excluded that
Including process, method, article or the equipment of described key element there is also other identical element.
Each embodiment in this specification all uses relevant mode to describe, identical similar portion between each embodiment
Dividing and see mutually, what each embodiment stressed is the difference with other embodiments.Real especially for device
For executing example, owing to it is substantially similar to embodiment of the method, so describe is fairly simple, relevant part sees embodiment of the method
Part illustrate.
One of ordinary skill in the art will appreciate that all or part of step realizing in said method embodiment is can
Completing instructing relevant hardware by program, described program can be stored in computer read/write memory medium,
The storage medium obtained designated herein, such as: ROM/RAM, magnetic disc, CD etc..
The foregoing is only presently preferred embodiments of the present invention, be not intended to limit protection scope of the present invention.All
Any modification, equivalent substitution and improvement etc. made within the spirit and principles in the present invention, are all contained in protection scope of the present invention
In.
Claims (10)
1. a video pushing method, it is characterised in that be applied to server, described server is connected with client communication, side
Method includes:
Obtain described client in real time for playing the network bandwidth of target Online Video;
Judge whether the described network bandwidth meets the requirement playing described target Online Video;
If it does not, according to preset determine rule, determine each frame of video in described target Online Video area-of-interest and
Regions of non-interest, wherein, described area-of-interest is the region that need not reduce video definition, described regions of non-interest
For needing to reduce the region of video definition;
According to the described network bandwidth and the frame per second of described target Online Video, determine described area-of-interest and non-region of interest
Territory accounts for the ratio of described networking bandwidth respectively;
According to described ratio, determine the first quantization parameter and regions of non-interest correspondence respectively that described area-of-interest is corresponding
The second quantization parameter;
According to described first quantization parameter and described second quantization parameter, emerging to described area-of-interest and described non-sense respectively
Interest region encodes;
Frame of video after coding is pushed to described client, so that target Online Video described in described client terminal playing.
Method the most according to claim 1, it is characterised in that described basis is preset and determined rule, determines that described target exists
The area-of-interest of each frame of video and regions of non-interest in line video, including:
Determine rule according to presetting, determine that the sense of each frame of video do not play in video segment of described target Online Video is emerging
Interest region and regions of non-interest.
Method the most according to claim 1, it is characterised in that described basis is preset and determined rule, determines that described target exists
The area-of-interest of each frame of video and regions of non-interest in line video, including:
In the described target Online Video that face recognition technology will be utilized to identify, the face in each frame of video, is defined as feeling emerging
Interest region, will be defined as non-interested except the region that described region of interest is overseas in each frame of video in described target Online Video
Region.
Method the most according to claim 1, it is characterised in that described regard online according to the described network bandwidth and described target
The frame per second of frequency, determines that described area-of-interest and regions of non-interest account for the ratio of described networking bandwidth respectively, including:
According to overall video quality VqWith area-of-interest shared by the relation of overall bandwidth ratio p:
By overall video quality VqP corresponding when being in optimum is defined as described area-of-interest and accounts for the ratio of described networking bandwidth;
1-p is defined as described regions of non-interest and accounts for the ratio of described networking bandwidth;
Wherein, 0.5≤p < 1, v1、v2、v3、v4、v5、v6、v7、v1'、v2'、v3'、v4'、v5'、v6'、v7' for coded system, regard
Frequently frame per second, constant coefficient that Video Key frame period is relevant with video resolution, FrvFor the frame per second of described target Online Video, Brv
For the described network bandwidth, w1For the weight coefficient of regions of non-interest, w2Weight coefficient for area-of-interest.
Method the most according to claim 1, it is characterised in that described according to described ratio, determines described area-of-interest
Second quantization parameter of the first corresponding quantization parameter and regions of non-interest correspondence respectively, including:
Account for the ratio of described networking bandwidth according to described area-of-interest and described regions of non-interest, calculate respectively is described
Area-of-interest and the bandwidth of described regions of non-interest;
According to bandwidth and the relation of quantization parameter, determine described first quantization parameter and described second quantization parameter, wherein, band
The wide relation with quantization parameter is:
Brv=aQP-1+bQP-2
Wherein, BrvFor bandwidth, a with b is the model parameter relevant to frame type, and QP is quantization parameter.
6. a video push device, it is characterised in that be applied to server, described server is connected with client communication, institute
State device to include: bandwidth detection, bandwidth judge module, region division module, bandwidth ratio-dependent module, quantization parameter are true
Cover half block, coding module, pushing module, wherein,
Described bandwidth detection, obtains described client for playing the network bandwidth of target Online Video in real time;
Described bandwidth judge module, for judging whether the described network bandwidth meets the requirement playing described target Online Video;
Described region divides module, for when the judged result of bandwidth judge module is no, determines rule according to presetting, determines
The area-of-interest of each frame of video and regions of non-interest in described target Online Video, wherein, described area-of-interest
For need not reduce the region of video definition, described regions of non-interest is to need to reduce the region of video definition;
Described bandwidth ratio-dependent module, for according to the described network bandwidth and the frame per second of described target Online Video, determines institute
State area-of-interest and regions of non-interest accounts for the ratio of described networking bandwidth respectively;
Described quantization parameter determines module, for according to described ratio, determining the first quantization ginseng that described area-of-interest is corresponding
Second quantization parameter of number and regions of non-interest correspondence respectively;
Described coding module, for according to described first quantization parameter and described second quantization parameter, emerging to described sense respectively
Interest region and described regions of non-interest encode;
Described pushing module, for the frame of video after coding is pushed to described client, so that described in described client terminal playing
Target Online Video.
Device the most according to claim 6, it is characterised in that described region divides module, specifically for:
Determine rule according to presetting, determine that the sense of each frame of video do not play in video segment of described target Online Video is emerging
Interest region and regions of non-interest.
Device the most according to claim 6, it is characterised in that described region divides module, specifically for:
In the described target Online Video that face recognition technology will be utilized to identify, the face in each frame of video, is defined as feeling emerging
Interest region, will be defined as non-interested except the region that described region of interest is overseas in each frame of video in described target Online Video
Region.
Device the most according to claim 6, it is characterised in that described bandwidth ratio-dependent module, specifically for:
According to overall video quality VqWith area-of-interest shared by the relation of overall bandwidth ratio p:
By overall video quality VqP corresponding when being in optimum is defined as described area-of-interest and accounts for the ratio of described networking bandwidth;
1-p is defined as described regions of non-interest and accounts for the ratio of described networking bandwidth;
Wherein, 0.5≤p < 1, v1、v2、v3、v4、v5、v6、v7、v1'、v2'、v3'、v4'、v5'、v6'、v7' for coded system, regard
Frequently frame per second, constant coefficient that Video Key frame period is relevant with video resolution, FrvFor the frame per second of described target Online Video, Brv
For the described network bandwidth, w1For the weight coefficient of regions of non-interest, w2Weight coefficient for area-of-interest.
Device the most according to claim 6, it is characterised in that described quantization parameter determines module, specifically for:
Account for the ratio of described networking bandwidth according to described area-of-interest and described regions of non-interest, calculate respectively is described
Area-of-interest and the bandwidth of described regions of non-interest;
According to bandwidth and the relation of quantization parameter, determine described first quantization parameter and described second quantization parameter, wherein, band
The wide relation with quantization parameter is:
Brv=aQP-1+bQP-2
Wherein, BrvFor bandwidth, a with b is the model parameter relevant to frame type, and QP is quantization parameter.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610379727.4A CN105979304A (en) | 2016-05-31 | 2016-05-31 | Video pushing method and video pushing device |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610379727.4A CN105979304A (en) | 2016-05-31 | 2016-05-31 | Video pushing method and video pushing device |
Publications (1)
Publication Number | Publication Date |
---|---|
CN105979304A true CN105979304A (en) | 2016-09-28 |
Family
ID=57010747
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201610379727.4A Pending CN105979304A (en) | 2016-05-31 | 2016-05-31 | Video pushing method and video pushing device |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN105979304A (en) |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106851335A (en) * | 2017-01-23 | 2017-06-13 | 建荣半导体(深圳)有限公司 | A kind of image transmitting bandwidth match method, equipment and system |
CN110719430A (en) * | 2018-07-13 | 2020-01-21 | 杭州海康威视数字技术股份有限公司 | Image data generation method, image data generation device, electronic device, and storage medium |
CN110785994A (en) * | 2018-11-30 | 2020-02-11 | 深圳市大疆创新科技有限公司 | Image processing method, apparatus and storage medium |
CN110856019A (en) * | 2019-11-20 | 2020-02-28 | 广州酷狗计算机科技有限公司 | Code rate allocation method, device, terminal and storage medium |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20060215752A1 (en) * | 2005-03-09 | 2006-09-28 | Yen-Chi Lee | Region-of-interest extraction for video telephony |
US20140355671A1 (en) * | 2013-05-30 | 2014-12-04 | Ya-Ti Peng | Bit-rate control for video coding using object-of-interest data |
CN104410860A (en) * | 2014-11-28 | 2015-03-11 | 北京航空航天大学 | Method for regulating quality of high-definition video containing ROI (region of interest) in real time |
CN104967914A (en) * | 2015-06-19 | 2015-10-07 | 美国掌赢信息科技有限公司 | Instant video coding method and electronic device |
CN104980740A (en) * | 2014-04-08 | 2015-10-14 | 富士通株式会社 | Image processing method, image processing device and electronic equipment |
CN105049850A (en) * | 2015-03-24 | 2015-11-11 | 上海大学 | HEVC (High Efficiency Video Coding) code rate control method based on region-of-interest |
-
2016
- 2016-05-31 CN CN201610379727.4A patent/CN105979304A/en active Pending
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20060215752A1 (en) * | 2005-03-09 | 2006-09-28 | Yen-Chi Lee | Region-of-interest extraction for video telephony |
US20140355671A1 (en) * | 2013-05-30 | 2014-12-04 | Ya-Ti Peng | Bit-rate control for video coding using object-of-interest data |
CN104980740A (en) * | 2014-04-08 | 2015-10-14 | 富士通株式会社 | Image processing method, image processing device and electronic equipment |
CN104410860A (en) * | 2014-11-28 | 2015-03-11 | 北京航空航天大学 | Method for regulating quality of high-definition video containing ROI (region of interest) in real time |
CN105049850A (en) * | 2015-03-24 | 2015-11-11 | 上海大学 | HEVC (High Efficiency Video Coding) code rate control method based on region-of-interest |
CN104967914A (en) * | 2015-06-19 | 2015-10-07 | 美国掌赢信息科技有限公司 | Instant video coding method and electronic device |
Non-Patent Citations (1)
Title |
---|
陈靖: "《深入理解视频编解码技术 基于H.264标准及参考模型》", 31 October 2012 * |
Cited By (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106851335A (en) * | 2017-01-23 | 2017-06-13 | 建荣半导体(深圳)有限公司 | A kind of image transmitting bandwidth match method, equipment and system |
US10542066B2 (en) | 2017-01-23 | 2020-01-21 | Smartech Worldwide Limited | Method and system for matching image transmission bandwidth and electronic device |
CN110719430A (en) * | 2018-07-13 | 2020-01-21 | 杭州海康威视数字技术股份有限公司 | Image data generation method, image data generation device, electronic device, and storage medium |
CN110785994A (en) * | 2018-11-30 | 2020-02-11 | 深圳市大疆创新科技有限公司 | Image processing method, apparatus and storage medium |
WO2020107376A1 (en) * | 2018-11-30 | 2020-06-04 | 深圳市大疆创新科技有限公司 | Image processing method, device, and storage medium |
CN110856019A (en) * | 2019-11-20 | 2020-02-28 | 广州酷狗计算机科技有限公司 | Code rate allocation method, device, terminal and storage medium |
CN110856019B (en) * | 2019-11-20 | 2021-11-12 | 广州酷狗计算机科技有限公司 | Code rate allocation method, device, terminal and storage medium |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
Seshadrinathan et al. | Temporal hysteresis model of time varying subjective video quality | |
Huynh-Thu et al. | Study of rating scales for subjective quality assessment of high-definition video | |
CN105979304A (en) | Video pushing method and video pushing device | |
US8184720B2 (en) | Optimal video adaptation for resource constrained mobile devices based on subjective utility models | |
Jiang et al. | BLIQUE-TMI: Blind quality evaluator for tone-mapped images based on local and global feature analyses | |
Utke et al. | NDNetGaming-development of a no-reference deep CNN for gaming video quality prediction | |
Wang et al. | Reduced-and no-reference image quality assessment | |
Wang et al. | Reduced-reference image quality assessment using a wavelet-domain natural image statistic model | |
CN100461864C (en) | Multimedia video communication objective quality appraising method based on digital watermark | |
EP2018068B1 (en) | Video quality estimating device, method, and program | |
Staelens et al. | Constructing a no-reference H. 264/AVC bitstream-based video quality metric using genetic programming-based symbolic regression | |
Wang et al. | An image quality evaluation method based on digital watermarking | |
CN100559880C (en) | A kind of highly-clear video image quality evaluation method and device based on self-adapted ST area | |
US7965203B2 (en) | Video quality estimation apparatus, method, and program | |
Ma et al. | Reduced-reference video quality assessment of compressed video sequences | |
CN110049372B (en) | Method, device, equipment and storage medium for predicting stable retention rate of anchor | |
WO2002007354A3 (en) | Systems and processes for measuring, evaluating and reporting audience response to audio, video, and other content | |
Rehman et al. | Reduced-reference SSIM estimation | |
CN101282481A (en) | Method for evaluating video quality based on artificial neural net | |
Lee et al. | Objective video quality assessment | |
CN102084660A (en) | Video quality measurement | |
Rehman et al. | Perceptual experience of time-varying video quality | |
Patil et al. | Survey on image quality assessment techniques | |
Dewangan et al. | Image quality costing of compressed image using full reference method | |
Li et al. | General-purpose reduced-reference image quality assessment based on perceptually and statistically motivated image representation |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20160928 |