CN106303697A - A kind of P frame processing method and equipment - Google Patents
A kind of P frame processing method and equipment Download PDFInfo
- Publication number
- CN106303697A CN106303697A CN201610703073.6A CN201610703073A CN106303697A CN 106303697 A CN106303697 A CN 106303697A CN 201610703073 A CN201610703073 A CN 201610703073A CN 106303697 A CN106303697 A CN 106303697A
- Authority
- CN
- China
- Prior art keywords
- frame
- region
- threshold value
- threshold
- pixel
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 10
- 238000000034 method Methods 0.000 claims abstract description 41
- 238000012545 processing Methods 0.000 claims description 15
- 238000012216 screening Methods 0.000 claims description 7
- 238000005457 optimization Methods 0.000 abstract description 7
- 230000009191 jumping Effects 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 230000000694 effects Effects 0.000 description 4
- 238000005192 partition Methods 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 239000003550 marker Substances 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 238000009432 framing Methods 0.000 description 2
- 230000000717 retained effect Effects 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 230000004069 differentiation Effects 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 238000002372 labelling Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000013386 optimize process Methods 0.000 description 1
- 230000011218 segmentation Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
- H04N21/845—Structuring of content, e.g. decomposing content into time segments
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440281—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the temporal resolution, e.g. by frame skipping
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The invention discloses a kind of P frame processing method and equipment, it is multiple region by display image division in advance, obtain the P frame after I frame and the 2nd P frame after a described P frame successively, determine regional pixel average in a P frame, according to pixel average and be each region preset threshold value screen from region specify region, determine whether to abandon a P frame, until all P frames after I frame complete the judgement whether abandoned according to the quantity specifying region that each threshold value is corresponding.By display picture is divided multiple regions, and combine the importance of regional and determine whether to abandon P frame relative to the intensity of variation of I frame, achieve the image quality optimization that in video decoding process, P frame processes such that it is able on the basis of ensureing picture quality, promote user's viewing experience.
Description
Technical field
The present invention relates to video decoding filed, particularly to a kind of P frame processing method.The present invention also relates to one and regards
Frequently decoding apparatus.
Background technology
Video refers to and is caught in signal of telecommunication mode by a series of static images, record, processes, and stores, and transmits, with weight
Existing various technology, decoding then utilize ad hoc approach number be reduced into it representative in perhaps by electric impulse signal,
Optical signal, radio wave etc. are converted into the process of its representative information, data etc..Along with network technology development and
The continuous raising of living standard, user is the most more come for definition, the fluency of its video seen by display terminal
More pay attention to, accordingly, how to improve coding and decoding video speed to improve Consumer's Experience and also increasingly become institute of display terminal manufacturer
Problem to be solved.
Continuous some width images, during encoding for continuous dynamic image, can be divided into P, B by prior art,
I three types, I frame represents key frame, and P frame is predicted by the P frame before it or I frame, what P frame represented is this frame with
The difference of a key frame (or P frame) before, needs to be superimposed with the difference of this frame definition with the picture cached before during decoding,
Generate final picture.
It is limited to objective condition, the impact that the time delay that the method that there is no at present is completely eliminated in video transmitting procedure is brought, pin
The scene higher to delay requirement, in prior art, the following strategy that processes of general employing ensures and raising decoding speed:
(1) reduce the data buffer storage during transmission and decoding, rapidly input decoder；
(2) code stream of special scenes is recompiled, reduce the quantity of I frame in code stream and remove B frame, improve decoding
The speed of device decoding；
(3) take random drop or the difference of frame contrast front and back, lose a certain proportion of P frame.
For mode described above (3), the process that realizes of prior art is usually random drop a number of P frame,
Or the pixel difference of former and later two P frame representative image of overall calculation, if difference is in certain threshold values, abandon, otherwise will
Reservation, then the P frame of reservation is calculated next P frame to be abandoned as reference frame loop.
Present inventor, during realizing the present invention, finds that existing P frame processing mode is not each for image
The data information content in individual region is analyzed, and Processing Algorithm is very simple, thus significantly impacts picture quality and use
Family is experienced.
Summary of the invention
The embodiment of the present invention provides a kind of P frame processing method and device, abandons place for P frame in order to solving in prior art
The problem that reason is simple and causes poor user experience, it is possible to promote user's viewing experience, the party on the basis of ensureing picture quality
Display image division is multiple region by method in advance, further comprising the steps of:
During video code flow decodes, obtain successively the P frame after I frame and after a described P frame the
Two P frames, comprise at least two continuous print P frame after described I frame；
Determining regional pixel average in a described P frame, described pixel average is according to a described P frame
In in each pixel and the 2nd P frame the chromaticity coordinate difference of corresponding pixel points generate；
According to described pixel average and be each described region preset threshold value, from described region screening specify district
Territory, the pixel average in described appointment region is higher than the threshold value in described appointment region；
Determine whether to abandon a described P frame according to the quantity specifying region that each described threshold value is corresponding, until described I frame
After all P frames complete the judgement that whether abandons.
It addition, the embodiment of the present application additionally provides a kind of P frame processing apparatus, including:
Acquisition module, the P frame after obtaining I frame successively and the 2nd P frame after a described P frame, institute
At least two continuous print P frame is comprised after stating I frame；
Processing module, for determining regional pixel average in a described P frame, described pixel average root
Generate according to the chromaticity coordinates difference of corresponding pixel points in each pixel in a described P frame and the 2nd P frame；
Screening module, for according to described pixel average and be the default threshold value in each described region, from described region
Region is specified in middle screening, and the pixel average in described appointment region is higher than the threshold value in described appointment region；
Determine module, determine whether to abandon a described P for the quantity specifying region corresponding according to each described threshold value
Frame, until all P frames after described I frame complete the judgement whether abandoned.
Compared with prior art, the Advantageous Effects of the technical scheme that the embodiment of the present invention is proposed includes:
It is multiple region by display image division in advance, obtains the P frame after I frame successively and at a described P frame
The 2nd P frame afterwards, determines regional pixel average in a P frame, according to pixel average and be each region
The threshold value preset screens appointment region from region, determines whether to abandon first according to the quantity specifying region that each threshold value is corresponding
P frame, until all P frames after I frame complete the judgement whether abandoned.By display picture is divided multiple regions, and combine each
The importance in individual region and determine whether to abandon P frame relative to the intensity of variation of I frame, it is achieved that P frame in video decoding process
The image quality optimization processed such that it is able to promote user's viewing experience on the basis of ensureing picture quality.
Accompanying drawing explanation
In order to be illustrated more clearly that technical scheme, the required accompanying drawing used in embodiment being described below
It is briefly described, it should be apparent that, the accompanying drawing in describing below is only some embodiments of the present invention, general for this area
From the point of view of logical technical staff, on the premise of not paying creative work, it is also possible to obtain other accompanying drawing according to these accompanying drawings.
Fig. 1 is the disposed of in its entirety schematic flow sheet of audio frequency and video in prior art；
The schematic flow sheet of a kind of P frame processing method that Fig. 2 is proposed by the embodiment of the present invention；
The schematic flow sheet of P frame processing method under a kind of concrete application scenarios that Fig. 3 is proposed by the embodiment of the present invention；
" checked spun antung " region partition strategy that Fig. 4 is proposed by the embodiment of the present invention and weight allocation table；
The priority policy that Fig. 5 is proposed by the embodiment of the present invention judges schematic diagram.
The structural representation of a kind of P frame processing apparatus that Fig. 6 is proposed by the embodiment of the present invention.
Detailed description of the invention
As it is shown in figure 1, be the disposed of in its entirety schematic flow sheet of audio frequency and video in prior art, this flow process is big from front end to rear end
Cause is divided into four-stage: head end code stream extracts stage, code stream assembling and analyzing and processing stage, code stream decoding stage and shows defeated
Go out the stage.The reason that audio and video playing introduces time delay is a lot, and time delay to be reduced will be from the processing procedure sublevel of whole audio frequency and video
Piecewise analysis.Owing to each stage reduces strategy all differences of low delay, therefore the application is for phase III " code stream decoding rank
Section " time delay be optimized process, the most i.e. relate to the optimization abandoned for P frame.
The most as described in background the invention, the particular field of low delay is required for some special scenes such as game etc.
Scape, uses skills such as " reduce transmission and decoding buffer zone, recode TS and remove I, B frame, jump P frame at random " substantially in prior art
Art realizes the quick decoding of video, for " random jumping P frame ", although can to a certain degree solve low delay
Problem, but current jumping P frame strategy is mostly used random jumping or is processed by the direct difference contrast of front and back's frame, and these process
Image quality will be had a huge impact by strategy, it is impossible to ensures the viewing experience of user while realizing quickly decoding.
Because above the problems of the prior art, present applicant proposes a kind of P frame processing method.The method will be by showing
Show that picture divides multiple regions, and combine the importance of regional and determine whether to abandon P relative to the intensity of variation of I frame
Frame, it is achieved that the image quality optimization that in video decoding process, P frame processes such that it is able to promote on the basis of ensureing picture quality and use
Family viewing experience.
Based on foregoing invention conceive, perform the program concrete steps before, need by display image division be in advance
Multiple regions.This division is intended to according to use habit, display image is distinguished zones of different, technical staff can be these not
With region according to the degree being concerned, priority and/or threshold value is set, follow-up when determining whether to abandon P frame with this P frame
Whether the intensity of variation of middle different piece can reach the quantity in threshold value and the region that reaches threshold value judges.
In a preferred embodiment of the application, technical staff can divide it display image has been carried out region
After, corresponding priority is set for regional, is that each region sets further according to the appointed priority in multiple regions after dividing
Put threshold value, the threshold value that the threshold value that wherein region of high priority is corresponding is corresponding less than the region of low priority, the most concerned more
Many regions can easier be retained.
In the particular embodiment, the present invention proposes " checked spun antung " region partition strategy, should divide in " checked spun antung " region
One secondary audiovisual presentation is divided into nine big regions by strategy, gives different threshold values to it respectively according to the difference of human eye attention rate
And it is divided into the region that area is different.In this specific embodiment, display image specifically divides according to nine grids mode,
And showing the central area correspondence first threshold of image, the correspondence Second Threshold of central area up and down of this display image, this shows
Corresponding 3rd threshold value in the central area, left and right of diagram picture, corresponding 4th threshold value of four angular zones of this display image, wherein the first threshold
Value, Second Threshold, the 3rd threshold value, the 4th threshold value are according to distinguishing value from small to large.
As in figure 2 it is shown, the schematic flow sheet of a kind of P frame processing method proposed by the embodiment of the present invention, including following
Step:
A P frame after step S201, successively acquisition I frame and the 2nd P frame after a described P frame, described I frame
Comprise at least two continuous print P frame afterwards.
As stated in the Background Art, the image after I frame is made up of multiple P frames, and therefore the application judges whether that needs abandon
During certain P frame, need to determine the need for abandoning as reference based on the P frame after the I frame before this P frame and this P frame, because of
This this step obtains the P frame after I frame and the 2nd P frame after a P frame successively, concrete P frame choose mode
Difference can be according to actual decoding requirements depending on, have no effect on the protection domain of the application.
Step S202, determining regional pixel average in a described P frame, described pixel average is according to institute
State in a P frame chromaticity coordinate difference of corresponding pixel points in each pixel and the 2nd P frame to generate.
This step be intended to determine a P frame relative to I frame and the variable quantity of the 2nd P frame, in order to by concrete for this variable quantity
Changing, the application is used " pixel average " to be indicated, and this pixel average is according to each pixel in a described P frame
Point generates with the chromaticity coordinate difference of corresponding pixel points in the 2nd P frame.
In the preferred embodiment of the application, the step obtaining " pixel average " is as follows:
Step a) obtains the chromaticity coordinate of a described P frame each pixel based on described I frame, and described 2nd P frame
The chromaticity coordinate of each pixel based on described I frame；
Step b) obtains the described 2nd P frame color relative to each pixel of a described P frame according to described chromaticity coordinate
Coordinate difference；
Step c) generates regional at a described P according to the quantity of described difference and the pixel in each described region
Pixel average in frame.
In actual application scenarios, for the realization of initialization operation, it is also possible to arrange the chromaticity coordinate of one group of acquiescence,
Concrete, the selection of acquiescence chromaticity coordinate can be configured according to actual needs, such as luminance component, chroma blue component with
And red chrominance component, the change of specifically chosen content is all within the protection domain of the application.
Step S203, according to described pixel average and be each described region preset threshold value, from described region sieve
Region is specified in choosing, and the pixel average in described appointment region is higher than the threshold value in described appointment region.
In this step, decoder according to regional preset threshold value, by the pixel average in each region respectively with this
The threshold values preset compares, and taking pixel average higher than the region of predetermined threshold value is appointment region, at actual application scenarios
In, the manner of comparison in this step, can be pixel average one by one with threshold comparison, it is also possible to be first pixel average to be entered
Row contrast contrasts with threshold value again, and such change can't affect the protection domain of the application.
Step S204, according to each described threshold value corresponding specify region quantity determine whether to abandon a described P frame, directly
All P frames to described I frame complete the judgement whether abandoned.
This step specifies the quantity corresponding to region and the corresponding relation with threshold value by filter out in step S203
Compare, it is determined whether abandon a P frame.
In a preferred embodiment, this threshold value includes first threshold, Second Threshold, the 3rd threshold value and the 4th threshold value, specifically
Situation is divided into following three kinds:
Situation one, the quantity in the appointment region that first threshold is corresponding is not zero, and retains a P frame；
Situation two, the quantity in the appointment region that first threshold is corresponding is zero, the appointment that Second Threshold is corresponding with the 3rd threshold value
The quantity sum in region is more than or equal to the first threshold value, retains a P frame；Or, the finger that Second Threshold is corresponding with the 3rd threshold value
The quantity sum determining region is less than the first threshold value, the number specifying region that Second Threshold, the 3rd threshold value are corresponding with the 4th threshold value
Amount sum, less than the second threshold value, abandons a P frame；
Situation three, the quantity specifying region corresponding to described first threshold, Second Threshold, the 3rd threshold value is zero, and
What the 4th threshold value was corresponding specifies the quantity in region less than the second threshold value, abandons a P frame.
It should be noted that in above judge process, the first threshold value is less than the second threshold value, and these are only this Shen
A kind of preferred embodiment please whether abandoned for P frame, on the basis of with this result as basis for estimation, concrete judgement side
The difference of formula has no effect on the protection domain of the application.
Furthermore, it is necessary to explanation, after this step achieves the judgement whether abandoned for a P frame, this step
Difference based on judged result is performed different processing modes, specifically, if a P frame is retained, a P frame is replaced
Change original I frame, and obtain the P frame after new two field picture and the 2nd P frame after a P frame successively, if this
One P frame is dropped, and the 2nd P frame replaces with a P frame, and obtains the 2nd P frame after a new P two field picture successively,
The judgement whether abandoned is completed again by all P frames after repeating above-mentioned flow process and completing I frame.
As can be seen here, compared with prior art, the Advantageous Effects bag of the technical scheme that the embodiment of the present invention is proposed
Include:
It is multiple region by display image division in advance, obtains the P frame after I frame successively and at a described P frame
The 2nd P frame afterwards, determines regional pixel average in a P frame, according to pixel average and be each region
The threshold value preset screens appointment region from region, determines whether to abandon first according to the quantity specifying region that each threshold value is corresponding
P frame, until all P frames after I frame complete the judgement whether abandoned.By display picture is divided multiple regions, and combine each
The importance in individual region and determine whether to abandon P frame relative to the intensity of variation of I frame, it is achieved that P frame in video decoding process
The image quality optimization processed such that it is able to promote user's viewing experience on the basis of ensureing picture quality.
Below in conjunction with the accompanying drawing in the present invention, the technical scheme in the present invention is carried out clear, complete description, aobvious
So, described embodiment is a part of embodiment of the present invention rather than whole embodiments.Based on the enforcement in the present invention
Example, the every other embodiment that those of ordinary skill in the art are obtained on the premise of not making creative work, all belong to
In the scope of protection of the invention.
As it has been described above, in the process strategy of the scene higher for delay requirement well known in the prior art, can take
Random drop or front and back frame contrast difference lose the mode of a certain proportion of P frame.Although this process strategy can to a certain degree solve
The certainly problem of low delay, but the jumping P frame strategy taked is all random jumping or is processed by the direct difference contrast of front and back's frame, this
A little strategies that process will produce impact to image quality, it is impossible to ensures Consumer's Experience.
The embodiment of the present invention, in order to solve above-mentioned problem, processes strategy for P frame and carries out emphasis optimization, it is proposed that such as figure
Method shown in 3, uses distinctive " checked spun antung " allocation strategy and weight allocation strategy to select P frame to be abandoned, the party
Method comprises the following steps:
Step S301, according to eye recognition characteristic each piece of region carried out different weights distribution process.
In actual application scenarios, this step needs to carry out image subarea processing, as shown in Figure 4, for this
" checked spun antung " region partition strategy that bright embodiment is proposed and weight allocation table, it can be seen that " the well word that the present invention uses
Lattice " a secondary audiovisual presentation is divided into nine big regions by region partition strategy, according to the difference of human eye attention rate respectively to its tax
Give different weights and be divided into the region that area is different.Weights take tetra-values of W1, W2, W3, W4 respectively, region respectively with
A1, A2, A3, A4, A5, A6, A7, A8, A9 labelling.Weighting ratio relation is: the face of W1=2*W2=4*W3=5*W4, A1～A9
Long-pending relation is: A1=2*A2=4*A4=5*A6, and wherein, A2=A3, A4=A5, A6=A7=A8=A9, A1 region is core
Region, gives the highest weights, and A2, A3 are time nucleus, give second highest weights, by that analogy.
When decoder gets the information of the image dividing region, first randomly select a framing number as reference
Frame, for the realization of initialization operation, it is also possible to arrange framing number reference frame by default, concrete, default reference frame
Selection can be configured according to actual needs, the change of specifically chosen content can't affect protection scope of the present invention.
For example, it is assumed that reference frame I frame is In, the P frame after reference frame I frame is followed successively by Pn、Pn+1、Pn+2... by that analogy, at the tool of the present invention
In body embodiment, obtain P respectivelynBased on InThe reference value of each pixel, then obtain P respectivelyn+1Based on InEach
The reference value of pixel, determines P respectively according to the reference value of each pixeln+1With PnDifference, calculate P successivelyn+1With
Pn+2、Pn+2With Pn+3... difference.
Step S302, the reference value calculating each pixel of P frame based on reference frame and difference, weigh difference with region
Value is multiplied the weighted value of each pixel drawing P frame.
P is obtained respectively according to reference framenReference value Y of each pixel based on reference framen、CrnAnd Cbn, then distinguish
Obtain Pn+1Reference value Y of each pixel based on reference framen+1、Crn+1And Cbn+1, according to the reference value of each pixel
Determine P respectivelyn+1With PnDifference Dyn、Dcrn、Dcbn, and calculate P successivelyn+1With Pn+2、Pn+2With Pn+3... difference.?
Here, reference frame can be the default reference frame arranged, it is also possible to select according to practical situation, the change of specifically chosen content
Change can't affect protection scope of the present invention.
Then, determine the region at each pixel place according to the nine big regions divided, obtain the weights in this region
W, using weights W as the factor respectively with difference Dyn、Dcrn、DcbnDo value Ey after multiplying obtains the weighting of each pixeln,
Ecrn, Ecbn,
Eyn=W*Dyn
Ecrn=W*Dcrn
Ecbn=W*Dcbn
Wherein, weights W takes certain value in W1～W4 respectively according to pixel region.
Step S303, calculate the weighted mean of each region each pixel according to weighted value and compare with threshold values, will
Weighted mean is 1 higher than the zone marker of threshold values and adds up.
This step is added up weighted value Ey of each pixel in each regionn, Ecrn, Ecbn, by each region
The weighted value of all pixels is added, and the summation after addition, divided by the number of all pixels, determines in the coldest days of the year end of big region each
The weighted mean Aey in regionn, Aecbn, Aecrn, then the weighted mean in each region is come out respectively with each
The threshold values in region compares, if less than threshold values, then this zone marker is 0, higher than threshold values, then and this zone marker 1, and add up
All be marked as 1 region.
In a particular embodiment of the present invention, the threshold value in this step can be that the weights according to each region are configured
, it is also possible to it is that the regional value according to each region is arranged flexibly, certainly, in actual application scenarios, in this step
Manner of comparison, can be weighted mean one by one with threshold comparison, it is also possible to be first weighted mean to be contrasted and threshold again
Value contrasts, and such change can't affect the protection domain of the application.
Step S304, all regions being labeled as 1 are carried out P frame process judge.
In a particular embodiment of the present invention, concrete P frame processes strategy as described in Figure 5, including following judgement step:
A) such as A1=1, the most do not abandon this P frame, otherwise perform next step；
B) such as A1+A2+A3+A4+A5 >=2, the most do not abandon this P frame, be otherwise 1 or 0 according to the value of A1+A2+A3+A4+A5
Select to perform step c or d, step c that performs when being 1 on duty, on duty perform step d when being 0；
C) such as A1+A2+A3+A4+A5=1, and A6+A7+A8+A9 >=3, the most do not abandon this P frame, otherwise such as A1+A2+A3+
A4+A5=1, and A6+A7+A8+A9 < 3, then abandon；
D) such as A1+A2+A3+A4+A5=0, and A6+A7+A8+A9 < 4, then abandon this P frame, the most do not abandon this P frame；
If PnIt is dropped, then continues to calculate according to above-mentioned algorithm the P of next P framen+1Whether frame is dropped；
If PnIt is not dropped, then with this PnFrame recalculates, as reference frame, the P frame that next group needs to be dropped.
The technical scheme that the embodiment of the present application is proposed and tradition determine the scheme comparison of P frame pixel difference, further
The algorithm optimizing frame losing, emphasis is accustomed to audio frequency and video region segmentation being nine big regions according to the focusing of human eye, and big by nine
Region gives different parameters respectively, if A1 differentiation in different regions is little and is marked as 0, then reselection considers time key area A2
～A5 region, eventually passing through logical calculated, the comprehensive strategic that key area, non-key area are judged by employing respectively in selection is
No abandon P frame, improve image quality and Consumer's Experience.
Based on the inventive concept as said method, the embodiment of the present application also proposed a kind of P frame processing apparatus, its knot
Structure schematic diagram as shown in Figure 6, specifically includes:
Acquisition module 61, the P frame after obtaining I frame successively and the 2nd P frame after a described P frame,
At least two continuous print P frame is comprised after described I frame；
Processing module 62, for determining regional pixel average in a described P frame, described pixel average
Generate according to the chromaticity coordinates difference of corresponding pixel points in each pixel in a described P frame and the 2nd P frame；
Screening module 63, for according to described pixel average and be the default threshold value in each described region, from described district
In territory, region is specified in screening, and the pixel average in described appointment region is higher than the threshold value in described appointment region；
Determine module 64, determine whether to abandon described first for the quantity specifying region corresponding according to each described threshold value
P frame, until all P frames after described I frame complete the judgement whether abandoned.
In concrete application scenarios, described processing module specifically for:
Obtain the chromaticity coordinate of a described P frame each pixel based on described I frame, and described 2nd P frame is based on institute
State the chromaticity coordinate of each pixel of I frame；
The described 2nd P frame chromaticity coordinate relative to each pixel of a described P frame is obtained according to described chromaticity coordinate
Difference；
Quantity according to described difference and the pixel in each described region generates regional in a described P frame
Pixel average.
In concrete application scenarios, described threshold value includes first threshold, Second Threshold, the 3rd threshold value and the 4th threshold
Value, described determine module specifically for:
If the quantity in the appointment region that described first threshold is corresponding is not zero, retain a described P frame；
If the quantity in the appointment region that described first threshold is corresponding is zero, and described Second Threshold is corresponding with the 3rd threshold value
Specify the quantity sum in region more than or equal to the first threshold value, retain a described P frame；
If the quantity specifying region corresponding to described first threshold, Second Threshold, the 3rd threshold value is zero, and described the
What four threshold values were corresponding specifies the quantity in region less than the second threshold value, abandons a described P frame；
If the quantity in the appointment region that described first threshold is corresponding is zero, described Second Threshold is corresponding with described 3rd threshold value
Specify the quantity sum in region less than the first threshold value, described Second Threshold, described 3rd threshold value and described 4th threshold value pair
That answers specifies the quantity sum in region less than the second threshold value, abandons a described P frame；
Wherein, described first threshold value is less than described second threshold value.
In concrete application scenarios, also include:
Module 65 is set, for the priority appointed according to the plurality of region after dividing, for each described region
Described threshold value is set；
Wherein, the threshold value that the threshold value that the region of high priority is corresponding is corresponding less than the region of low priority.
In concrete application scenarios, described display image specifically divides according to nine grids mode, wherein:
The corresponding described first threshold in the central area of described display image, the central area up and down of described display image is corresponding
Described Second Threshold, corresponding described 3rd threshold value in the central area, left and right of described display image, four angular regions of described display image
Corresponding described 4th threshold value in territory.
As can be seen here, by applying the technical scheme of the application, it is multiple region by display image division in advance, obtains successively
Take the P frame after I frame and the 2nd P frame after a described P frame, determine regional pixel in a P frame
Meansigma methods, according to pixel average and be each region preset threshold value screen from region specify region, according to each threshold value pair
The quantity specifying region answered determines whether to abandon a P frame, until all P frames after I frame complete the judgement whether abandoned.Logical
Cross and display picture is divided multiple regions, and combine the importance of regional and determine relative to the intensity of variation of I frame and be
No abandon P frame, it is achieved that the image quality optimization that in video decoding process, P frame processes such that it is able on the basis ensureing picture quality
Upper lifting user's viewing experience.
In the specific embodiment of the invention, modules can be integrated in one, it is also possible to separates and disposes, and above-mentioned module is closed
And be a module, it is also possible to it is further split into multiple submodule.
Through the above description of the embodiments, those skilled in the art is it can be understood that arrive the embodiment of the present invention
Can be realized by hardware, it is also possible to the mode adding necessary general hardware platform by software realizes.Based on such reason
Solving, the technical scheme of the embodiment of the present invention can embody with the form of software product, and this software product can be stored in one
In individual non-volatile memory medium (can be CD-ROM, USB flash disk, portable hard drive etc.), including some instructions with so that a meter
Calculate machine equipment (can be personal computer, server, or network equipment etc.) and perform each enforcement scene of the embodiment of the present invention
Described method.
It will be appreciated by those skilled in the art that accompanying drawing is a schematic diagram being preferable to carry out scene, module in accompanying drawing or
Flow process is not necessarily implemented necessary to the embodiment of the present invention.
It will be appreciated by those skilled in the art that the module in the device implemented in scene can be entered according to implementing scene description
Row is distributed in the device implementing scene, it is also possible to carries out respective change and is disposed other than one or more dresses of this enforcement scene
In putting.The module of above-mentioned enforcement scene can merge into a module, it is also possible to is further split into multiple submodule.
The invention described above embodiment sequence number, just to describing, does not represent the quality implementing scene.
The several scenes that are embodied as being only the embodiment of the present invention disclosed above, but, the embodiment of the present invention not office
Being limited to this, the changes that any person skilled in the art can think of all should fall into the business of the embodiment of the present invention and limit scope.
Claims (10)
1. a P frame processing method, it is characterised in that being multiple region by display image division in advance, the method includes:
During video code flow decodes, obtain the P frame after I frame and the 2nd P after a described P frame successively
Frame, comprises at least two continuous print P frame after described I frame；
Determining regional pixel average in a described P frame, described pixel average is according to every in a described P frame
In individual pixel and the 2nd P frame, the chromaticity coordinates difference of corresponding pixel points generates；
According to described pixel average and be each described region preset threshold value, from described region screening specify region, institute
State the pixel average specifying region higher than the threshold value in described appointment region；
Determine whether to abandon a described P frame according to the quantity specifying region that each described threshold value is corresponding, until after described I frame
All P frames complete the judgement whether abandoned.
2. the method for claim 1, it is characterised in that determine that regional pixel in a described P frame is average
Value, specifically includes:
Obtain the chromaticity coordinate of a described P frame each pixel based on described I frame, and described 2nd P frame is based on described I frame
The chromaticity coordinate of each pixel；
The described 2nd P frame chromaticity coordinates difference relative to each pixel of a described P frame is obtained according to described chromaticity coordinate；
Quantity according to described difference and the pixel in each described region generates regional pixel in a described P frame
Meansigma methods.
3. the method for claim 1, it is characterised in that described threshold value includes first threshold, Second Threshold, the 3rd threshold value
And the 4th threshold value, determine whether to abandon a described P frame, specifically according to the quantity specifying region that each described threshold value is corresponding
For:
If the quantity in the appointment region that described first threshold is corresponding is not zero, retain a described P frame；
If the quantity in the appointment region that described first threshold is corresponding is zero, and the appointment that described Second Threshold is corresponding with the 3rd threshold value
The quantity sum in region is more than or equal to the first threshold value, retains a described P frame；
If the quantity specifying region corresponding to described first threshold, Second Threshold, the 3rd threshold value is zero, and described 4th threshold
What value was corresponding specifies the quantity in region less than the second threshold value, abandons a described P frame；
If the quantity in the appointment region that described first threshold is corresponding is zero, the finger that described Second Threshold is corresponding with described 3rd threshold value
The quantity sum determining region is less than the first threshold value, and described Second Threshold, described 3rd threshold value are corresponding with described 4th threshold value
Specify the quantity sum in region less than the second threshold value, abandon a described P frame；
Wherein, described first threshold value is less than described second threshold value.
4. the method as described in any one of claim 1-3, it is characterised in that a P frame after obtaining I frame successively and
Before the 2nd P frame after a described P frame, also include:
According to the priority that the plurality of region after dividing is appointed, described threshold value is set for each described region；
Wherein, the threshold value that the threshold value that the region of high priority is corresponding is corresponding less than the region of low priority.
5. the method as described in any one of claim 1-3, it is characterised in that described display image is specifically according to nine grids mode
Divide, wherein:
The corresponding described first threshold in the central area of described display image, described in the correspondence of central area up and down of described display image
Second Threshold, corresponding described 3rd threshold value in the central area, left and right of described display image, four angular zones pair of described display image
Should described 4th threshold value.
6. a P frame processing apparatus, it is characterised in that including:
Acquisition module, the P frame after obtaining I frame successively and the 2nd P frame after a described P frame, described I frame
Comprise at least two continuous print P frame afterwards；
Processing module, for determining regional pixel average in a described P frame, described pixel average is according to institute
State in a P frame chromaticity coordinates difference of corresponding pixel points in each pixel and the 2nd P frame to generate；
Screening module, for according to described pixel average and be each described region preset threshold value, from described region sieve
Region is specified in choosing, and the pixel average in described appointment region is higher than the threshold value in described appointment region；
Determine module, determine whether to abandon a described P frame, directly for the quantity specifying region corresponding according to each described threshold value
All P frames to described I frame complete the judgement whether abandoned.
7. device as claimed in claim 6, it is characterised in that described processing module specifically for:
Obtain the chromaticity coordinate of a described P frame each pixel based on described I frame, and described 2nd P frame is based on described I frame
The chromaticity coordinate of each pixel；
The described 2nd P frame chromaticity coordinate difference relative to each pixel of a described P frame is obtained according to described chromaticity coordinate；
Quantity according to described difference and the pixel in each described region generates regional pixel in a described P frame
Meansigma methods.
8. device as claimed in claim 6, it is characterised in that described threshold value includes first threshold, Second Threshold, the 3rd threshold value
And the 4th threshold value, described determine module specifically for:
If the quantity in the appointment region that described first threshold is corresponding is not zero, retain a described P frame；
If the quantity in the appointment region that described first threshold is corresponding is zero, and the appointment that described Second Threshold is corresponding with the 3rd threshold value
The quantity sum in region is more than or equal to the first threshold value, retains a described P frame；
If the quantity specifying region corresponding to described first threshold, Second Threshold, the 3rd threshold value is zero, and described 4th threshold
What value was corresponding specifies the quantity in region less than the second threshold value, abandons a described P frame；
If the quantity in the appointment region that described first threshold is corresponding is zero, the finger that described Second Threshold is corresponding with described 3rd threshold value
The quantity sum determining region is less than the first threshold value, and described Second Threshold, described 3rd threshold value are corresponding with described 4th threshold value
Specify the quantity sum in region less than the second threshold value, abandon a described P frame；
Wherein, described first threshold value is less than described second threshold value.
9. the device as described in any one of claim 6-8, it is characterised in that also include:
Module is set, for the priority appointed according to the plurality of region after dividing, institute is set for each described region
State threshold value；
Wherein, the threshold value that the threshold value that the region of high priority is corresponding is corresponding less than the region of low priority.
10. the device as described in any one of claim 6-8, it is characterised in that described display image is specifically according to nine grids side
Formula divides, wherein:
The corresponding described first threshold in the central area of described display image, described in the correspondence of central area up and down of described display image
Second Threshold, corresponding described 3rd threshold value in the central area, left and right of described display image, four angular zones pair of described display image
Should described 4th threshold value.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610703073.6A CN106303697B (en) | 2016-08-22 | 2016-08-22 | A kind of P frame processing method and equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610703073.6A CN106303697B (en) | 2016-08-22 | 2016-08-22 | A kind of P frame processing method and equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106303697A true CN106303697A (en) | 2017-01-04 |
| CN106303697B CN106303697B (en) | 2019-07-02 |
Family
ID=57661274
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610703073.6A Active CN106303697B (en) | 2016-08-22 | 2016-08-22 | A kind of P frame processing method and equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106303697B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112637538A (en) * | 2020-12-15 | 2021-04-09 | 重庆紫光华山智安科技有限公司 | Smart tag method, system, medium, and terminal for optimizing video analysis |
| CN112822505A (en) * | 2020-12-31 | 2021-05-18 | 杭州星犀科技有限公司 | Audio and video frame loss method, device, system, storage medium and computer equipment |
| CN116801047A (en) * | 2023-08-17 | 2023-09-22 | 深圳市艾科维达科技有限公司 | Weight normalization-based set top box image processing module and method |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1689337A (en) * | 2002-10-09 | 2005-10-26 | 皇家飞利浦电子股份有限公司 | Sequential digital image compression |
| EP2200325A3 (en) * | 2008-12-17 | 2011-01-19 | Sony Corporation | Information processor and method therefor |
| CN102695028A (en) * | 2012-05-22 | 2012-09-26 | 广东威创视讯科技股份有限公司 | Dynamic frame rate reduction method and system for video images |
| CN103283249A (en) * | 2010-12-09 | 2013-09-04 | 赛格纳斯广播公司 | Systems and methods for prioritization of data for intelligent discard in a communication network |
| CN105357592A (en) * | 2015-10-26 | 2016-02-24 | 山东大学苏州研究院 | Selective frame dropping method for streaming media adaptive transmission |
-
2016
- 2016-08-22 CN CN201610703073.6A patent/CN106303697B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1689337A (en) * | 2002-10-09 | 2005-10-26 | 皇家飞利浦电子股份有限公司 | Sequential digital image compression |
| EP2200325A3 (en) * | 2008-12-17 | 2011-01-19 | Sony Corporation | Information processor and method therefor |
| CN103283249A (en) * | 2010-12-09 | 2013-09-04 | 赛格纳斯广播公司 | Systems and methods for prioritization of data for intelligent discard in a communication network |
| CN102695028A (en) * | 2012-05-22 | 2012-09-26 | 广东威创视讯科技股份有限公司 | Dynamic frame rate reduction method and system for video images |
| CN105357592A (en) * | 2015-10-26 | 2016-02-24 | 山东大学苏州研究院 | Selective frame dropping method for streaming media adaptive transmission |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112637538A (en) * | 2020-12-15 | 2021-04-09 | 重庆紫光华山智安科技有限公司 | Smart tag method, system, medium, and terminal for optimizing video analysis |
| CN112637538B (en) * | 2020-12-15 | 2022-08-02 | 重庆紫光华山智安科技有限公司 | Smart tag method, system, medium, and terminal for optimizing video analysis |
| CN112822505A (en) * | 2020-12-31 | 2021-05-18 | 杭州星犀科技有限公司 | Audio and video frame loss method, device, system, storage medium and computer equipment |
| CN112822505B (en) * | 2020-12-31 | 2023-03-03 | 杭州星犀科技有限公司 | Audio and video frame loss method, device, system, storage medium and computer equipment |
| CN116801047A (en) * | 2023-08-17 | 2023-09-22 | 深圳市艾科维达科技有限公司 | Weight normalization-based set top box image processing module and method |
| CN116801047B (en) * | 2023-08-17 | 2024-02-13 | 深圳市艾科维达科技有限公司 | Weight normalization-based set top box image processing module and method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106303697B (en) | 2019-07-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101059951B (en) | Image processing apparatus and method | |
| CN104902088B (en) | Mobile terminal adjusts the method and device of screen intensity | |
| CN103841389B (en) | A kind of video broadcasting method and player | |
| CN111327959A (en) | Video frame insertion method and related device | |
| CN107465936A (en) | A kind of live list mirror image methods of exhibiting, live Platform Server and client | |
| CN104811677B (en) | The display control method of mobile terminal and device | |
| CN102054424B (en) | Image processing apparatus and image processing method | |
| CN106303697A (en) | A kind of P frame processing method and equipment | |
| CN107948627B (en) | Video broadcasting method, calculates equipment and storage medium at device | |
| CN105574813B (en) | A kind of image processing method and device | |
| JP2015512194A (en) | Method and wireless handheld device for determining the hue of an image | |
| CN106055712A (en) | Method and device for screening picture, and terminal | |
| EP1841223A1 (en) | Moving picture image reproduction method and moving picture image reproduction apparatus | |
| CN106791850A (en) | Method for video coding and device | |
| CN104506968B (en) | A kind of video frequency abstract figure determines method and device | |
| CN108322652A (en) | A kind of focusing reminding method and terminal | |
| WO2014194656A1 (en) | Method and device for data screening | |
| CN115061617A (en) | Processing method and device of live broadcast picture, computer equipment and storage medium | |
| CN111768377A (en) | Image color evaluation method and device, electronic equipment and storage medium | |
| CN110392295A (en) | Multi-channel video plays the implementation method of automatic split screen in a kind of video monitoring system | |
| WO2017143812A1 (en) | Method and device for differentiating objects | |
| CN111097169B (en) | Game image processing method, device, equipment and storage medium | |
| CN113411553A (en) | Image processing method, image processing device, electronic equipment and storage medium | |
| CN107241635A (en) | A kind of method and device of barrage position switching | |
| CN108737851A (en) | Method, system and medium for the palette extraction for video content item |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |