CN107396108A - Code rate allocation method and device - Google Patents
Code rate allocation method and device Download PDFInfo
- Publication number
- CN107396108A CN107396108A CN201710697008.1A CN201710697008A CN107396108A CN 107396108 A CN107396108 A CN 107396108A CN 201710697008 A CN201710697008 A CN 201710697008A CN 107396108 A CN107396108 A CN 107396108A
- Authority
- CN
- China
- Prior art keywords
- image block
- value
- marking area
- significant region
- distribution
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/146—Data rate or code amount at the encoder output
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
- H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/184—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being bits, e.g. of the compressed video stream
Abstract
The invention discloses a kind of code rate allocation method and device.Wherein, this method includes：Obtain current frame image；Current frame image is divided into marking area and non-significant region, wherein, the significance measure value of marking area is higher than the significance measure value in non-significant region；Different code check resources is distributed to marking area and non-significant region respectively, wherein, the code check resource distributed non-significant region is more than to the code check resource of marking area distribution.The present invention solves the bad technical problem of effect that the code rate allocation method in correlation technique perceives relative to human eye.
Description
Technical field
The present invention relates to image code domain, in particular to a kind of code rate allocation method and device.
Background technology
Data Rate Distribution is an important step of video coding process, the bit that Data Rate Distribution is distributed every two field picture it is more
The quality of coding quality has been largely fixed less.In the case where network bandwidth resources are limited, how balanced code rate distributes
With the problem of video quality into come numerous researchers hot issue.In h .264, after typically by video compress
PSNR (Y-PSNR, Peak Signal to Noise Ratio), SSIM (structural similarity, Structural
Similarity Index) etc. parameter evaluate compression effectiveness, but the value of these parameters can only react the overall condition of video,
The requirement to the notable perception of human eye can not be met.
In traditional code stream control method, the complexity that the principle of Data Rate Distribution considers picture frame but ignores human eye
For the significant properties of picture frame, by taking the rate control algorithm JVT012 of main flow as an example, although the Rate Control of BU layers is in network
In the case that condition is strict, improve the accuracy of Rate Control on the basis of also certain, but its elementary cell layer include it is grand
Block positional information is changeless, causes it to be adjusted according to the vision significant properties of the region of macro block, this
It is poor to this may result in the local video quality that human eye most significantly perceives.
The bad technical problem of the effect that is perceived relative to human eye for the code rate allocation method in correlation technique, at present still
Effective solution is not proposed.
The content of the invention
The embodiments of the invention provide a kind of code rate allocation method and device, at least to solve the code check in correlation technique point
The bad technical problem of effect that method of completing the square perceives relative to human eye.
One side according to embodiments of the present invention, there is provided a kind of code rate allocation method, this method include：Obtain current
Two field picture；Current frame image is divided into marking area and non-significant region, wherein, the significance measure value of marking area is higher than non-
The significance measure value of marking area；Different code check resources is distributed to marking area and non-significant region respectively, wherein, to aobvious
The code check resource for writing region distribution is more than the code check resource distributed non-significant region.
Further, current frame image is divided into marking area and non-significant region includes：Current frame image is divided into
Multiple images block；The significance measure value of each image block is calculated respectively；Judged according to the significance measure value of each image block
It is marking area or non-significant region.
Further, in the case where multiple images block includes the first image block, the conspicuousness of the first image block is calculated
Metric includes：Fourier transformation is carried out to the pixel value of the first image block and obtains the amplitude spectrum of the first image block；Determine
The average amplitude value of one image block；Calculate difference in the first image block between the amplitude and average amplitude value of each pixel simultaneously
Judge whether more than the first predetermined threshold value, wherein it is determined that difference more than the number of the first predetermined threshold value is the in the first image block
The significance measure value of one image block.
Further, judge that it is wrapped for marking area or non-significant region according to the significance measure value of each image block
Include：Judge the significance measure value of the first image block whether more than the one the second default thresholds according to each pixel in the first image block
Whether value is notable pixel come pixel corresponding to judging；If the number for the notable pixel that the first image block includes is more than second
Predetermined threshold value judged result is yes, it is determined that the first image block is marking area；If the notable picture that the first image block includes
The number of element is no no more than the second predetermined threshold value judged result, it is determined that the first image block is non-significant region.
Further, obtaining the amplitude spectrum of the first image block includes：Logarithm process is carried out to the amplitude spectrum of the first image block,
Obtain the logarithmic amplitude spectrum of the first image block；Determining the average amplitude value of the first image block includes：To the logarithm of the first image block
Amplitude spectrum carries out average value processing, obtains the average logarithmic amplitude spectrum of the first image block；Shaken according to the average logarithm of the first image block
Width spectrum determines the average amplitude value of the first image block.
Further, distributing different code check resources to marking area and non-significant region respectively includes：Be determined to for
Total bit value B that current frame image provides；The bit value B to marking area distribution is determined according to default distribution formula1, and it is right
The bit value B of non-significant region distribution2, wherein, B1＞ B2。
Further, the bit value B to marking area distribution is determined according to default distribution formula1, and to non-significant area
The bit value B of domain distribution2Including：It is determined that the bit value B to each image block distribution in marking aream1, and to non-significant area
The bit value B of each image block distribution in domainm2；By bit value Bm1It is multiplied to obtain to aobvious with the number of image block in marking area
Write the bit value B of region distribution1, by bit value Bm2It is multiplied to obtain to non-significant region with the number of image block in non-significant region
The bit value B of distribution2。
Further, the bit value B to marking area distribution is being determined according to default distribution formula1Afterwards, this method is also
Including：According to the bit value B distributed marking area1And the number of the notable pixel of each image block is adjusted in marking area
The whole bit value to each image block distribution in marking area, wherein, the significantly pixel is and the pixel value of surrounding pixel
Difference exceedes the pixel of preparatory condition, and the bit value B to the distribution of non-significant region is being determined according to default distribution formula2Afterwards,
This method also includes：According to the bit value B distributed non-significant region2And in non-significant region each image block it is notable
Bit value of the number adjustment of pixel to each image block distribution in non-significant region.
Another aspect according to embodiments of the present invention, additionally provides a kind of Data Rate Distribution device, and the device includes：Obtain single
Member, for obtaining current frame image；Taxon, for current frame image to be divided into marking area and non-significant region, wherein,
The significance measure value of marking area is higher than the significance measure value in non-significant region；Allocation unit, for respectively to notable area
Different code check resources is distributed in domain and non-significant region, wherein, the code check resource of marking area distribution is more than to non-significant area
The code check resource of domain distribution.
Further, taxon includes：Piecemeal module, for current frame image to be divided into multiple images block；Calculate
Module, for calculating the significance measure value of each image block respectively；Sort module, for the conspicuousness according to each image block
Metric judges it for marking area or non-significant region.
Further, in the case where multiple images block includes the first image block, computing module includes：Convert submodule
Block, carry out Fourier transformation applied to the pixel value to the first image block and obtain the amplitude spectrum of the first image block；First determines
Submodule, for determining the average amplitude value of the first image block；First calculating sub module, it is each in the first image block for calculating
Difference between the amplitude and average amplitude value of pixel simultaneously judges whether more than the first predetermined threshold value, wherein it is determined that the first figure
As in block difference more than the first predetermined threshold value number be the first image block significance measure value.
Further, sort module includes：Judging submodule, for judge the first image block significance measure value whether
More than the second predetermined threshold value according to the significance measure value of each pixel in the first image block whether more than the first predetermined threshold value come
Whether pixel corresponding to judgement is notable pixel；Logic sub-modules, for determining that the first image block is when judged result is and is
Marking area, it is the notable picture that non-significant region includes in the first image block that the first image block is determined when judged result is no
Determine that the first image block is marking area when the number of element is more than the second predetermined threshold value, in the notable picture that the first image block includes
The number of element determines that the first image block is non-significant region when being no more than the second predetermined threshold value.
Further, transformation submodule includes：First processing submodule, for being carried out to the amplitude spectrum of the first image block pair
Number processing, obtains the logarithmic amplitude spectrum of the first image block；First determination sub-module includes：Second processing submodule, for
The logarithmic amplitude spectrum of one image block carries out average value processing, obtains the average logarithmic amplitude spectrum of the first image block；Second determines submodule
Block, for determining the average amplitude value of the first image block according to the average logarithmic amplitude spectrum of the first image block.
Further, allocation unit includes：First determining module, for be determined to for current frame image provide always than
Paricular value B；Second determining module, for determining the bit value B to marking area distribution according to default distribution formula1, and to non-
The bit value B of marking area distribution2, wherein, B1＞ B2。
Further, the second determining module includes：Second determination sub-module, for determining to each image in marking area
The bit value B of block distributionm1, and the bit value B to each image block distribution in non-significant regionm2；Second calculating sub module,
For by bit value Bm1It is multiplied to obtain the bit value B to marking area distribution with the number of image block in marking area1, by bit
Value Bm2It is multiplied to obtain the bit value B to the distribution of non-significant region with the number of image block in non-significant region2。
Further, the device also includes：First adjusting module, for being determined according to default distribution formula to notable area
The bit value B of domain distribution1Afterwards, according to the bit value B distributed marking area1And in marking area each image block it is aobvious
The bit value that the number adjustment of pixel is distributed each image block in marking area is write, wherein, notable pixel is and surrounding pixel
Pixel value difference exceed preparatory condition pixel, the second adjusting module, for according to it is default distribution formula determine to non-
After the bit value B2 of marking area distribution, according to the bit value B distributed non-significant region2It is and every in non-significant region
Bit value of the number adjustment of the notable pixel of individual image block to each image block distribution in non-significant region.
Another aspect according to embodiments of the present invention, a kind of processor being additionally provided, the processor is used for operation program, its
In, code rate allocation method of the invention is performed when program is run.
In embodiments of the present invention, by obtaining current frame image；Current frame image is divided into marking area and non-significant
Region, wherein, the significance measure value of marking area is higher than the significance measure value in non-significant region；Respectively to marking area and
Different code check resources is distributed in non-significant region, wherein, the code check resource of marking area distribution is more than to non-significant region point
The code check resource matched somebody with somebody, solve the bad technology of effect that the code rate allocation method in correlation technique perceives relative to human eye and ask
Topic, and then realize the effect superior technique effect to the notable perception of human eye.
Brief description of the drawings
Accompanying drawing described herein is used for providing a further understanding of the present invention, forms the part of the application, this hair
Bright schematic description and description is used to explain the present invention, does not form inappropriate limitation of the present invention.In the accompanying drawings：
Fig. 1 is a kind of flow chart of optional code rate allocation method according to embodiments of the present invention；
Fig. 2 is the flow chart of the optional code rate allocation method of another kind according to embodiments of the present invention；
Fig. 3 is a kind of schematic diagram of optional picture frame subregion according to embodiments of the present invention；
Fig. 4 is a kind of schematic diagram of optional Data Rate Distribution device according to embodiments of the present invention.
Embodiment
In order that those skilled in the art more fully understand the present invention program, below in conjunction with the embodiment of the present invention
Accompanying drawing, the technical scheme in the embodiment of the present invention is clearly and completely described, it is clear that described embodiment is only
The embodiment of a part of the invention, rather than whole embodiments.Based on the embodiment in the present invention, ordinary skill people
The every other embodiment that member is obtained under the premise of creative work is not made, it should all belong to the model that the present invention protects
Enclose.
It should be noted that term " first " in description and claims of this specification and above-mentioned accompanying drawing, "
Two " etc. be for distinguishing similar object, without for describing specific order or precedence.It should be appreciated that so use
Data can exchange in the appropriate case, so as to embodiments of the invention described herein can with except illustrating herein or
Order beyond those of description is implemented.In addition, term " comprising " and " having " and their any deformation, it is intended that cover
Cover it is non-exclusive include, be not necessarily limited to for example, containing the process of series of steps or unit, method, system, product or equipment
Those steps or unit clearly listed, but may include not list clearly or for these processes, method, product
Or the intrinsic other steps of equipment or unit.
This application provides a kind of embodiment of code rate allocation method.
Fig. 1 is a kind of flow chart of optional code rate allocation method according to embodiments of the present invention, as shown in figure 1, the party
Method comprises the following steps：
Step S101, obtain current frame image；
Step S102, current frame image is divided into marking area and non-significant region, wherein, the conspicuousness degree of marking area
Value is higher than the significance measure value in non-significant region, and significance measure value is the value of significance measure parameter, significance measure
The value of parameter is the value calculated by presetting method, and significance measure parameter can characterize the pixel value of each pixel in the region
Difference condition, the difference value in a region between each pixel is bigger, and the significance measure value in the region is bigger；
Step S103, different code check resources is distributed to marking area and non-significant region respectively, wherein, due to notable area
The significance measure value in domain be higher than non-significant region significance measure value, that is, in marking area pixel value differences
More than the value differences of pixel in non-significant region, therefore, the code check resource of marking area distribution will be more than to non-significant
The code check resource of region distribution, specifically, code check resource can be bit value.
The embodiment is by obtaining current frame image；Current frame image is divided into marking area and non-significant region, wherein,
The significance measure value of marking area is higher than the significance measure value in non-significant region；Respectively to marking area and non-significant region
Different code check resources is distributed, wherein, the code check money distributed non-significant region is more than to the code check resource of marking area distribution
Source, solve the bad technical problem of effect that the code rate allocation method in correlation technique perceives relative to human eye, and then realize
To the effect superior technique effect of the notable perception of human eye.
, can be with as an alternative embodiment, when current frame image is divided into marking area and non-significant region
Current frame image is divided into multiple images block, that is, current frame image is the image block array that multiple images block is formed, respectively
The significance measure value of each image block is calculated, judges it for marking area or non-according to the significance measure value of each image block
Marking area.
Assuming that multiple images block includes the first image block, the first image block can be any one in multiple images block
Image block, by taking the first image block as an example, the step of illustrating to calculate the significance measure value of each image block：First, to the first figure
As the pixel value of block carries out Fourier transformation and obtains the amplitude spectrum of the first image block；Secondly, being averaged for the first image block is determined
Amplitude；Finally, calculate the difference in the first image block between the amplitude and average amplitude value of each pixel and judge whether
More than the first predetermined threshold value, wherein it is determined that difference more than the number of the first predetermined threshold value is the first image block in the first image block
Significance measure value.
Further, judge that it is wrapped for marking area or non-significant region according to the significance measure value of each image block
Include：Judge the significance measure value of the first image block whether more than the one the second default thresholds according to each pixel in the first image block
Whether value is notable pixel come pixel corresponding to judging；If the number for the notable pixel that the first image block includes is more than second
Predetermined threshold value judged result is yes, it is determined that the first image block is marking area；If the notable picture that the first image block includes
The number of element is no no more than the second predetermined threshold value judged result, it is determined that the first image block is non-significant region.
Optionally, the result of Fourier transformation can be handled, significance measure is determined with the amplitude spectrum after processing
Value.Specifically, first, logarithm process is carried out to the amplitude spectrum of the first image block, obtains the logarithmic amplitude spectrum of the first image block,
Secondly, average value processing is carried out to the logarithmic amplitude spectrum of the first image block, obtains the average logarithmic amplitude spectrum of the first image block, the
Three, the average amplitude value of the first image block is determined according to the average logarithmic amplitude spectrum of the first image block, finally, calculates the first image
Difference in block between the average logarithmic amplitude value of each pixel and average amplitude value, and judge it whether more than the first default threshold
Value.
As an alternative embodiment, distribute different code check resource bags to marking area and non-significant region respectively
Include：The total bit value B provided for current frame image is provided, the ratio to marking area distribution is determined according to default distribution formula
Paricular value B1, and the bit value B to the distribution of non-significant region2.Wherein, B1＞ B2。
Optionally, it is determined that B1And B2Afterwards, each image block in each region can also be distributed respectively respectively different
Bit value, specifically, the bit value B to marking area distribution is being determined according to default distribution formula1Afterwards, according to notable
The bit value B of region distribution1And the number of the notable pixel of each image block is adjusted to every in marking area in marking area
The bit value of individual image block distribution, wherein, the significantly pixel is to exceed preparatory condition with the difference of the pixel value of surrounding pixel
Pixel, according to it is default distribution formula determine to non-significant region distribution bit value B2Afterwards, this method also includes：According to
To the bit value B of non-significant region distribution2And the number of the notable pixel of each image block is adjusted to non-in non-significant region
The bit value of each image block distribution in marking area.
Optionally, the code rate allocation method that the embodiment provides can apply to H.264/AVS Video coding.
One two field picture is divided into marking area and non-significant region this embodiment offers one kind, it is different preferential to distinguish
The code rate allocation method of rank, characteristic is perceived according to notable, marking area is preferentially distributed more sufficient code check, makes human eye
Vision can significantly obtain more clearly compressing, and the marking area that human eye is paid close attention at first distributes more code checks and provided
Source, more meet human eye vision and significantly perceive mechanism, reach preferable Rate Control result, fully ensure that its video quality problems.
A kind of embodiment of above-described embodiment is described in detail with reference to Fig. 2：
(1) first, current frame image is obtained, current picture frame is divided into marking area as shown in Figure 3 and non-significant
Region.Specifically, obtaining the image of a frame W pixels × H pixels in screen video, the image of m pixels × n-pixel is divided into
Block.Piece image can be divided into marking area (saliency area) and two, non-significant region (non-saliency area)
Point, each image block may belong to marking area or non-significant region.
(2) it is specifically as follows to the mode classification of each image block：For i-th of image block, we are carried out to pixel value
Fourier transformation, the amplitude spectrum A of image block is obtained by Fourier transformationi。
(3) logarithm process is done to its amplitude spectrum, obtains the logarithmic amplitude spectrum L of image blocki。
(4) then to amplitude spectrum LiAverage value processing is done, obtains average log amplitude spectrum Mi。
(5) it is next determined that the average log amplitude spectrum M of i-th of image blockiAverage amplitude value, calculated amplitude spectrum MiWith
The difference of average amplitude value obtains error image block.
(6) significance measure value is determined according to error image block, if specifically, in the error image block, each picture
The value S of vegetarian refreshmentsi(x, y) is if greater than threshold value T, then it is assumed that and the pixel is notable pixel, if less than (or equal to) threshold value
T, then the pixel is not notable pixel.
(7) number of notable pixel in each image block is counted, in an error image block, its total pixel is
It is N number of, if significantly pixel number in the total pixel number of image block accounting more than percent TH, wherein, TH is threshold value, then recognizes
Belong to marking area for the image block.
After whole two field picture to be divided into marking area and non-significant region, the image block number in statistically significant region and non-
The image block number of marking area, adaptive code check resource allocation is carried out to its region afterwards.
Specifically, setting the total bit number for distributing to two field picture acquisition as B, each image block in marking area is pre-assigned to
Bit number be Bm1, the bit number for being pre-assigned to each image block in non-significant region is Bm2, image block is total in a two field picture
Number is N, and marking area image block number is N1, non-significant area image block number is N2, marking area and non-significant region account for always
The ratio of image block number be respectively P1And P2。
According to equation below, marking area and the distribution weight K in non-significant region are set1And K2, wherein, K1=Bm1/(B/
N), K2=Bm2/(B/N)。
So, the bit number for being pre-assigned to marking area is B1=Bm1*N1, the bit number for being pre-assigned to non-significant region is
B2=Bm2*N2, wherein, B1+B2=B.
There is P again1=N1/ N, P2=N2/ N, and P1、P2Meet：P1+P2=1, it can obtain, P1*K1+P2*K2=1.Therefore, setting
Put K1And K2Occurrence when, can be configured according to following principle：
If P1/P2>=1, then K1=2；
If P1/P2<1, then K1=2- (1/2) * (P1/P2)。
Further, in K1On the basis of value determines, K can be obtained2=1- (P1/P2)*(K1-1)。
So far, the bit number to marking area and the bits allocation in non-significant region finish, can be to each region
Interior each image block carries out Data Rate Distribution.
Optionally, B can be distributed to each image block in marking area with mean allocationm1Individual bit, in non-significant region
Each image block distribution Bm2Individual bit.
Or the adaptive bit for adjusting different images block in each region.Specifically, it is assumed that BiFor to be notable
Remaining bit number when i-th of image block is allocated in region, then distribute to the bit number T of i-th of image blockiFor：Ti=
Bi*(Smb/Stotal_mb), wherein, SmbRepresent the number of notable pixel in current i-th of image block, Stotal_mbExpression does not include
The notable pixel number sum of all remaining marking area image blocks including current image block.Such as：Marking area has altogether
Have 10 image blocks, before have been allocated for 6, what is currently distributed is the 7th, i.e. i=7, if the 7th image block is notable
Pixel has 200, then Smb=200, and the remaining 8th, 9,10 image block, if its notable pixel is respectively 200,220,
230, then Stotal_mb=200+220+230.The step of when being allocated to j-th of image block in non-significant region similarly,
This is repeated no more.
The bandwidth (bit) obtained from channel is distributed into marking area and non-significant region, Zhi Hougen according to above-mentioned steps
According to H.264 quantization parameter obtaining step, the code check that quantization parameter is distributed by above-mentioned steps acquisition image block is obtained, by its band
Enter in secondary R-Q Rate Controls model, obtain the quantization parameter of current image block.
The code rate allocation method that the embodiment provides, for each two field picture of screen video, is divided into m pixels
The image block of × n-pixel, it is determined that each image block belongs to marking area and non-significant region, the band provided then according to channel
Wide and frame per second obtains the code check of each frame video screen video, marking area is carried out to it and the code check in non-significant region provides
Source is distributed, and this method is to carry out enough Data Rate Distributions to the marking area given priority to according to human eye sensory perceptual system, so that its
There is more visible volume compression effectiveness.
It should be noted that accompanying drawing flow chart though it is shown that logical order, but in some cases, can be with
Shown or described step is performed different from order herein.
Present invention also provides a kind of embodiment of storage medium, the storage medium of the embodiment includes the program of storage,
Wherein, equipment performs the code rate allocation method of the embodiment of the present invention where controlling storage medium when program is run.
Present invention also provides a kind of embodiment of processor, the processor of the embodiment is used for operation program, wherein, journey
The code rate allocation method of the embodiment of the present invention is performed during sort run.
Present invention also provides a kind of embodiment of Data Rate Distribution device.
Fig. 4 is a kind of schematic diagram of optional Data Rate Distribution device according to embodiments of the present invention, as shown in figure 4, the dress
Put including acquiring unit 10, taxon 20 and allocation unit 30.
Acquiring unit, for obtaining current frame image；Taxon, for current frame image to be divided into marking area and non-
Marking area, wherein, the significance measure value of marking area is higher than the significance measure value in non-significant region；Allocation unit, use
In code check resources different to marking area and the distribution of non-significant region respectively, wherein, to the code check resource of marking area distribution
More than the code check resource distributed non-significant region.
The embodiment is by acquiring unit, for obtaining current frame image；Taxon, for current frame image to be divided into
Marking area and non-significant region, wherein, the significance measure value of marking area is higher than the significance measure value in non-significant region；
Allocation unit, for distributing different code check resources to marking area and non-significant region respectively, wherein, marking area is distributed
Code check resource be more than code check resource to the distribution of non-significant region, solve code rate allocation method in correlation technique relative to
The bad technical problem of effect that human eye perceives, and then realize the effect superior technique effect to the notable perception of human eye.
Further, taxon includes：Piecemeal module, for current frame image to be divided into multiple images block；Calculate
Module, for calculating the significance measure value of each image block respectively；Sort module, for the conspicuousness according to each image block
Metric judges it for marking area or non-significant region.
Further, in the case where multiple images block includes the first image block, computing module includes：Convert submodule
Block, carry out Fourier transformation applied to the pixel value to the first image block and obtain the amplitude spectrum of the first image block；First determines
Submodule, for determining the average amplitude value of the first image block；First calculating sub module, it is each in the first image block for calculating
Difference between the amplitude and average amplitude value of pixel simultaneously judges whether more than the first predetermined threshold value, wherein it is determined that the first figure
As in block difference more than the first predetermined threshold value number be the first image block significance measure value.
Further, sort module includes：Judging submodule, for judge the first image block significance measure value whether
More than the second predetermined threshold value according to the significance measure value of each pixel in the first image block whether more than the first predetermined threshold value come
Whether pixel corresponding to judgement is notable pixel；Logic sub-modules, for determining that the first image block is when judged result is and is
Marking area, it is the notable picture that non-significant region includes in the first image block that the first image block is determined when judged result is no
Determine that the first image block is marking area when the number of element is more than the second predetermined threshold value, in the notable picture that the first image block includes
The number of element determines that the first image block is non-significant region when being no more than the second predetermined threshold value.
Further, transformation submodule includes：First processing submodule, for being carried out to the amplitude spectrum of the first image block pair
Number processing, obtains the logarithmic amplitude spectrum of the first image block；First determination sub-module includes：Second processing submodule, for
The logarithmic amplitude spectrum of one image block carries out average value processing, obtains the average logarithmic amplitude spectrum of the first image block；Second determines submodule
Block, for determining the average amplitude value of the first image block according to the average logarithmic amplitude spectrum of the first image block.
Further, allocation unit includes：First determining module, for be determined to for current frame image provide always than
Paricular value B；Second determining module, for determining the bit value B to marking area distribution according to default distribution formula1, and to non-
The bit value B of marking area distribution2, wherein, B1＞ B2。
Further, the second determining module includes：Second determination sub-module, for determining to each image in marking area
The bit value B of block distributionm1, and the bit value B to each image block distribution in non-significant regionm2；Second calculating sub module,
For by bit value Bm1It is multiplied to obtain the bit value B to marking area distribution with the number of image block in marking area1, by bit
Value Bm2It is multiplied to obtain the bit value B to the distribution of non-significant region with the number of image block in non-significant region2。
Further, the device also includes：First adjusting module, for being determined according to default distribution formula to notable area
The bit value B of domain distribution1Afterwards, according to the bit value B distributed marking area1And in marking area each image block it is aobvious
The bit value that the number adjustment of pixel is distributed each image block in marking area is write, wherein, notable pixel is and surrounding pixel
Pixel value difference exceed preparatory condition pixel, the second adjusting module, for according to it is default distribution formula determine to non-
The bit value B of marking area distribution2Afterwards, according to the bit value B distributed non-significant region2It is and each in non-significant region
Bit value of the number adjustment of the notable pixel of image block to each image block distribution in non-significant region.
Above-mentioned device can include processor and memory, and said units can be stored in storage as program unit
In device, corresponding function is realized by the said procedure unit of computing device storage in memory.
Memory may include computer-readable medium in volatile memory, random access memory (RAM) and/
Or the form such as Nonvolatile memory, such as read-only storage (ROM) or flash memory (flashRAM), memory includes at least one storage
Chip.
Technical scheme provided in an embodiment of the present invention can at least bring following technique effect：
Compatibility is good：Algorithm is that software realization can support polymorphic type mobile terminal, including the equipment such as mobile phone, PC.
Wide adaptability：Algorithm is the Rate Control based on conspicuousness, and the system for needing Rate Control can all be applied.
Experience property is good：Transmission display effect is good, and Consumer's Experience is good.
Optionally, technical scheme provided in an embodiment of the present invention can use algorithm to design, and use any machine word
Speech is realized, hardware can also be used to realize, or, there is provided the mode that software, hardware are combined is realized.
The order of above-mentioned the embodiment of the present application does not represent the quality of embodiment.
In above-described embodiment of the application, the description to each embodiment all emphasizes particularly on different fields, and does not have in some embodiment
The part of detailed description, it may refer to the associated description of other embodiment.In several embodiments provided herein, it should be appreciated that
Arrive, disclosed technology contents, can realize by another way.
Wherein, device embodiment described above is only schematical, such as the division of the unit, can be one
Kind of division of logic function, can there is an other dividing mode when actually realizing, for example, multiple units or component can combine or
Another system is desirably integrated into, or some features can be ignored, or do not perform.It is another, it is shown or discussed it is mutual it
Between coupling or direct-coupling or communication connection can be INDIRECT COUPLING or communication link by some interfaces, unit or module
Connect, can be electrical or other forms.
In addition, each functional unit in each embodiment of the application can be integrated in a processing unit, can also
That unit is individually physically present, can also two or more units it is integrated in a unit.Above-mentioned integrated list
Member can both be realized in the form of hardware, can also be realized in the form of SFU software functional unit.
If the integrated unit is realized in the form of SFU software functional unit and is used as independent production marketing or use
When, it can be stored in a computer read/write memory medium.Based on such understanding, the technical scheme of the application is substantially
The part to be contributed in other words to prior art or all or part of the technical scheme can be in the form of software products
Embody, the computer software product is stored in a storage medium, including some instructions are causing a computer
Equipment (can be personal computer, server or network equipment etc.) perform each embodiment methods described of the application whole or
Part steps.And foregoing storage medium includes：USB flash disk, read-only storage (ROM, Read-Only Memory), arbitrary access are deposited
Reservoir (RAM, Random Access Memory), mobile hard disk, magnetic disc or CD etc. are various can be with store program codes
Medium.
Described above is only the preferred embodiment of the application, it is noted that for the ordinary skill people of the art
For member, on the premise of the application principle is not departed from, some improvements and modifications can also be made, these improvements and modifications also should
It is considered as the protection domain of the application.
Claims (15)
- A kind of 1. code rate allocation method, it is characterised in that including：Obtain current frame image；The current frame image is divided into marking area and non-significant region, wherein, the significance measure value of the marking area Higher than the significance measure value in the non-significant region；Different code check resources is distributed to the marking area and the non-significant region respectively, wherein, to the marking area The code check resource of distribution is more than the code check resource to the non-significant region distribution.
- 2. according to the method for claim 1, it is characterised in that the current frame image is divided into marking area and non-significant Region includes：The current frame image is divided into multiple images block；The significance measure value of each image block is calculated respectively；Judge it for marking area or non-significant region according to the significance measure value of each image block.
- 3. according to the method for claim 2, it is characterised in that include the feelings of the first image block in the multiple image block Under condition, calculating the significance measure value of described first image block includes：Fourier transformation is carried out to the pixel value of described first image block and obtains the amplitude spectrum of described first image block；Determine the average amplitude value of described first image block；Calculate the difference in described first image block between the amplitude of each pixel and the average amplitude value and judge whether More than the first predetermined threshold value, wherein it is determined that the number that difference exceedes first predetermined threshold value in described first image block is institute State the significance measure value of the first image block.
- 4. according to the method for claim 3, it is characterised in that judge that it is according to the significance measure value of each image block Marking area or non-significant region include：Judge the significance measure value of described first image block whether more than the second predetermined threshold value；If it is judged that it is yes, it is determined that described first image block is the marking area；If it is judged that it is no, it is determined that described first image block is the non-significant region.
- 5. according to the method for claim 3, it is characterised in thatObtaining the amplitude spectrum of described first image block includes：Logarithm process is carried out to the amplitude spectrum of described first image block, obtained The logarithmic amplitude spectrum of described first image block；Determining the average amplitude value of described first image block includes：The logarithmic amplitude spectrum of described first image block is carried out at average Reason, obtains the average logarithmic amplitude spectrum of described first image block；Determined according to the average logarithmic amplitude spectrum of described first image block The average amplitude value of described first image block.
- 6. according to the method for claim 1, it is characterised in that respectively to the marking area and the non-significant region point Include with different code check resources：The total bit value B provided for the current frame image is provided；The bit value B to marking area distribution is determined according to default distribution formula1, and the non-significant region is distributed Bit value B2, wherein, B1＞ B2。
- 7. according to the method for claim 6, it is characterised in thatThe bit value B to marking area distribution is being determined according to default distribution formula1Afterwards, methods described also includes：According to To the bit value B of marking area distribution1And the number of the notable pixel of each image block adjusts in the marking area To the bit value of each image block distribution in the marking area, wherein, the significantly pixel is the pixel value with surrounding pixel Difference exceed preparatory condition pixel；The bit value B to the non-significant region distribution is being determined according to default distribution formula2Afterwards, methods described also includes：Root According to the bit value B to the non-significant region distribution2And in the non-significant region the notable pixel of each image block Bit value of the number adjustment to each image block distribution in the non-significant region.
- A kind of 8. Data Rate Distribution device, it is characterised in that including：Acquiring unit, for obtaining current frame image；Taxon, for the current frame image to be divided into marking area and non-significant region, wherein, the marking area Significance measure value is higher than the significance measure value in the non-significant region；Allocation unit, for distributing different code check resources to the marking area and the non-significant region respectively, wherein, it is right The code check resource of the marking area distribution is more than the code check resource to the non-significant region distribution.
- 9. device according to claim 8, it is characterised in that the taxon includes：Piecemeal module, for the current frame image to be divided into multiple images block；Computing module, for calculating the significance measure value of each image block respectively；Sort module, for judging it for marking area or non-significant region according to the significance measure value of each image block.
- 10. device according to claim 9, it is characterised in that include the first image block in the multiple image block In the case of, the computing module includes：Transformation submodule, carry out Fourier transformation applied to the pixel value to described first image block and obtain described first image The amplitude spectrum of block；First determination sub-module, for determining the average amplitude value of described first image block；First calculating sub module, for calculate in described first image block the amplitude of each pixel and the average amplitude value it Between difference and judge whether more than the first predetermined threshold value, wherein it is determined that in described first image block difference exceed described first The number of predetermined threshold value is the significance measure value of described first image block.
- 11. device according to claim 10, it is characterised in that the sort module includes：Judging submodule, for judging the significance measure value of described first image block whether more than the second predetermined threshold value；Logic sub-modules, for determining that described first image block is the marking area when judged result is and is, judging to tie It is the non-significant region that described first image block is determined when fruit is no.
- 12. device according to claim 10, it is characterised in thatThe transformation submodule includes：First processing submodule, for being carried out to the amplitude spectrum of described first image block at logarithm Reason, obtains the logarithmic amplitude spectrum of described first image block；First determination sub-module includes：Second processing submodule, for entering to the logarithmic amplitude spectrum of described first image block Row average value processing, obtain the average logarithmic amplitude spectrum of described first image block；Second determination sub-module, for according to described first The average logarithmic amplitude spectrum of image block determines the average amplitude value of described first image block.
- 13. device according to claim 8, it is characterised in that the allocation unit includes：First determining module, for the total bit value B for being determined to provide for the current frame image；Second determining module, for determining the bit value B to marking area distribution according to default distribution formula1, and to institute State the bit value B of non-significant region distribution2, wherein, B1＞ B2。
- 14. device according to claim 13, it is characterised in that described device also includes：First adjusting module, for determining the bit value B to marking area distribution according to default distribution formula1Afterwards, root According to the bit value B distributed the marking area1And the number of the notable pixel of each image block is adjusted in the marking area The whole bit value to each image block distribution in the marking area, wherein, the significantly pixel is the pixel with surrounding pixel The difference of value exceedes the pixel of preparatory condition,Second adjusting module, for determining the bit value B to the non-significant region distribution according to default distribution formula2Afterwards, According to the bit value B distributed the non-significant region2And the notable pixel of each image block in the non-significant region Bit value of the number adjustment to each image block distribution in the non-significant region.
- A kind of 15. processor, it is characterised in that the processor is used for operation program, wherein, right of execution when described program is run Profit requires the code rate allocation method described in 1 to 7 any one.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710697008.1A CN107396108A (en) | 2017-08-15 | 2017-08-15 | Code rate allocation method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710697008.1A CN107396108A (en) | 2017-08-15 | 2017-08-15 | Code rate allocation method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107396108A true CN107396108A (en) | 2017-11-24 |
Family
ID=60354677
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710697008.1A Pending CN107396108A (en) | 2017-08-15 | 2017-08-15 | Code rate allocation method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107396108A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110460832A (en) * | 2019-07-31 | 2019-11-15 | 南方医科大学南方医院 | Processing method, system and the storage medium of double vision point video |
| CN113469922A (en) * | 2021-04-07 | 2021-10-01 | 海能达通信股份有限公司 | Image processing method, computer device, and computer-readable storage medium |
| WO2021203203A1 (en) * | 2020-04-10 | 2021-10-14 | Gao Xihe | Method and system for video encoding guided by hybrid visual attention analysis |
| CN113923398A (en) * | 2021-09-30 | 2022-01-11 | 中国工商银行股份有限公司 | Video conference realization method and device |
| CN114567778A (en) * | 2022-04-24 | 2022-05-31 | 北京云中融信网络科技有限公司 | Video coding method and system |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101494785A (en) * | 2008-12-19 | 2009-07-29 | 无锡亿普得科技有限公司 | Method for encoding H.264 interesting region |
| CN104200429A (en) * | 2014-08-19 | 2014-12-10 | 南京理工大学 | Variable density compressing and sampling method of Fourier domain image significance information |
| CN104463855A (en) * | 2014-11-25 | 2015-03-25 | 武汉科技大学 | Significant region detection method based on combination of frequency domain and spatial domain |
| CN104980740A (en) * | 2014-04-08 | 2015-10-14 | 富士通株式会社 | Image processing method, image processing device and electronic equipment |
| CN105049850A (en) * | 2015-03-24 | 2015-11-11 | 上海大学 | HEVC (High Efficiency Video Coding) code rate control method based on region-of-interest |
-
2017
- 2017-08-15 CN CN201710697008.1A patent/CN107396108A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101494785A (en) * | 2008-12-19 | 2009-07-29 | 无锡亿普得科技有限公司 | Method for encoding H.264 interesting region |
| CN104980740A (en) * | 2014-04-08 | 2015-10-14 | 富士通株式会社 | Image processing method, image processing device and electronic equipment |
| CN104200429A (en) * | 2014-08-19 | 2014-12-10 | 南京理工大学 | Variable density compressing and sampling method of Fourier domain image significance information |
| CN104463855A (en) * | 2014-11-25 | 2015-03-25 | 武汉科技大学 | Significant region detection method based on combination of frequency domain and spatial domain |
| CN105049850A (en) * | 2015-03-24 | 2015-11-11 | 上海大学 | HEVC (High Efficiency Video Coding) code rate control method based on region-of-interest |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110460832A (en) * | 2019-07-31 | 2019-11-15 | 南方医科大学南方医院 | Processing method, system and the storage medium of double vision point video |
| CN110460832B (en) * | 2019-07-31 | 2021-09-07 | 南方医科大学南方医院 | Processing method, system and storage medium of double-viewpoint video |
| WO2021203203A1 (en) * | 2020-04-10 | 2021-10-14 | Gao Xihe | Method and system for video encoding guided by hybrid visual attention analysis |
| CN113469922A (en) * | 2021-04-07 | 2021-10-01 | 海能达通信股份有限公司 | Image processing method, computer device, and computer-readable storage medium |
| CN113923398A (en) * | 2021-09-30 | 2022-01-11 | 中国工商银行股份有限公司 | Video conference realization method and device |
| CN114567778A (en) * | 2022-04-24 | 2022-05-31 | 北京云中融信网络科技有限公司 | Video coding method and system |
| CN114567778B (en) * | 2022-04-24 | 2022-07-05 | 北京云中融信网络科技有限公司 | Video coding method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107396108A (en) | Code rate allocation method and device | |
| DE60301035T2 (en) | Method and apparatus for scheduling data transmissions to users in telecommunication systems | |
| CN110096318B (en) | Task unloading method and device based on mobile edge calculation | |
| DE602004002195T2 (en) | METHOD AND APPARATUS FOR THE EXPORT CONTROL OF PACKAGES | |
| CN106922002A (en) | A kind of network section virtual resource allocation method based on internal auction mechanism | |
| CN108600014B (en) | Stackelberg game-based storage resource allocation method | |
| Kuo et al. | Utility-based radio resource allocation for QoS traffic in wireless networks | |
| CN113038187B (en) | Method, apparatus and medium for video quality of experience fair and practical network bandwidth allocation | |
| CN112911408B (en) | Intelligent video code rate adjustment and bandwidth allocation method based on deep learning | |
| CN107734511A (en) | Network capacity extension method and access network equipment | |
| Kbah et al. | Resource allocation in cellular systems for applications with random parameters | |
| Ma et al. | Paid prioritization and its impact on net neutrality | |
| KR20070087470A (en) | Method and apparatus for transmitting data on plc network by classifying data | |
| Zanforlin et al. | SSIM-based video admission control and resource allocation algorithms | |
| CN107800574A (en) | Store QOS adjusting methods, system, equipment and computer-readable memory | |
| DE602005002819T2 (en) | A method of identifying RTP (Real Time Protocol) and RTCP (Real Time Control Protocol) packets based on a packet property | |
| JP2021531571A (en) | Certificate image extraction method and terminal equipment | |
| CN106716368A (en) | Network classification for applications | |
| CN110287024A (en) | The dispatching method of multi-service oriented device multi-user in a kind of industrial intelligent edge calculations | |
| CN107205150A (en) | Coding method and device | |
| CN111137761A (en) | Face recognition elevator false triggering prevention method and device and storage medium | |
| CN107027069A (en) | Processing method, device and system, storage medium and the processor of view data | |
| CN112153702B (en) | Local area network bandwidth resource allocation method, storage device and equipment | |
| JP3734732B2 (en) | Dynamic bandwidth allocation circuit, dynamic bandwidth allocation method, dynamic bandwidth allocation program, and recording medium | |
| CN107872673A (en) | A kind of method and device of Intelligent Dynamic regulation video encoder |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20171124 |
|
| RJ01 | Rejection of invention patent application after publication |