CN102547225B - Video monitoring scene judgment method and device, and monitored image encoding method and device - Google Patents
Video monitoring scene judgment method and device, and monitored image encoding method and device Download PDFInfo
- Publication number
- CN102547225B CN102547225B CN201010612077.6A CN201010612077A CN102547225B CN 102547225 B CN102547225 B CN 102547225B CN 201010612077 A CN201010612077 A CN 201010612077A CN 102547225 B CN102547225 B CN 102547225B
- Authority
- CN
- China
- Prior art keywords
- video
- scene
- block
- monitoring
- unit
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Abstract
The invention discloses a video monitoring scene judgment method, a video monitoring scene judgment device, a monitored image encoding method and a monitored image encoding device. The video monitoring scene judgment method comprises the following steps of: acquiring the current video image frame monitored by a front-end video monitoring device; dividing the acquired current video image frame into blocks with M*N pixel sizes, wherein M and N are natural numbers; determining a brightness mean value of each divided block respectively; determining the maximum brightness mean value Ymax and the minimum brightness mean value Ymin from the respectively determined brightness mean values of the blocks; and if (Ymax-Ymin)/Ymin is greater than TH, determining that the current monitoring scene, in which the front-end video monitoring device is positioned, is an indoor scene, otherwise, determining that the current monitoring scene, in which the front-end video monitoring device is positioned, is an outdoor scene, wherein TH is a set quotient threshold value. According to the methods and the devices, monitored video images under different monitoring scenes can be subjected to adaptive encoding modes, and the image encoding quality for video monitoring is improved.
Description
Technical field
The present invention relates to technical field of video monitoring, especially relate to a kind of video monitoring scene method of discrimination and device thereof, and a kind of video monitoring image coding method and device thereof.
Background technology
At present, along with the Large scale construction of the maturation of security protection industry and safe city, Safe Campus, real-time remote monitoring more and more obtains the attention of people, and video monitoring obtains to be applied more and more widely.Video monitoring also from wired develop into wireless, to meet ever-increasing mobility and convenience requirement.But because the upstream bandwidth of the 3G wireless networks such as TD-SCDMA is limited, make the transmission quality of video monitoring image not good, greatly have impact on the effect of video monitoring.
While increase wireless network transmissions bandwidth, also need to be optimized the Video coding mode of information source end, to be lifted at the transmission of video images quality under prior wireless network situation.But the monitoring scenes such as the application scenarios of video monitoring much under normal circumstances, as daytime, night, fixes, movement, the video image characteristic that different monitoring scene lower front end camera head gathers is not identical, not identical to the performance requirement of encoder yet.If same set of coding configuration schemes is adopted to carry out same way coding to the video image monitored under all multiple different monitoring scenes unified, its video encoding quality just can not reach optimal effectiveness, and the difference in quality of reconstruction video image is also very large after compression, the effect of consistent monitor video image cannot be presented, thus have impact on the implementation result of Video Supervision Technique.
Summary of the invention
The embodiment of the present invention provides a kind of video monitoring scene method of discrimination and device thereof, and a kind of video monitoring image coding method and device thereof, with realize under indoor/outdoor monitoring scene, daytime/night monitoring scene under the video image that monitors adopt the coded system adapted to, promote the Image Coding quality of video monitoring.
The technical scheme that the embodiment of the present invention proposes is as follows:
For a video monitoring image coding method for indoor scene, comprise the current video image frame obtaining head end video supervising device and monitor; The current video image frame of acquisition is divided into the block of M × N pixel size, wherein M, N are natural number; Determine the brightness average dividing each piece that obtains respectively; And according to the brightness average of each piece that determines, the block selecting brightness average to be less than the block of the first setting threshold and brightness average thereof to be greater than the second setting threshold, wherein the first setting threshold is less than the second setting threshold; Carry out in coded quantization process to the block selected, reduce and quantize step value; And based on the quantization step value after reducing, the block selected is encoded.
For a video monitoring image code device for indoor scene, comprise picture frame and obtain unit, for obtaining the current video image frame that head end video supervising device monitors; Block division unit, the current video image frame obtained for picture frame being obtained unit is divided into the block of M × N pixel size, and wherein M, N are natural number; Brightness average determining unit, for determining that block division unit divides the brightness average of each piece that obtains respectively; Blocking selected cell, for the brightness average of each piece determined according to brightness average determining unit, the block selecting brightness average to be less than the block of the first setting threshold and brightness average thereof to be greater than the second setting threshold, wherein the first setting threshold is less than the second setting threshold; Reduce step value unit, the block for selecting block selected cell carries out in coded quantization process, reduces and quantizes step value; And video encoding unit, for the quantization step value after reducing based on reduction step value unit, the block that block selected cell is selected is encoded.
A kind of video monitoring scene method of discrimination, comprises the current video image frame obtaining head end video supervising device and monitor; The current video image frame of acquisition is divided into the block of M × N pixel size, wherein M, N are natural number; Determine the brightness average dividing each piece that obtains respectively; And in the brightness average of each piece that determines respectively, determine high-high brightness average Y
maxwith minimum brightness average Y
min; If
then differentiate that the current residing monitoring scene of head end video supervising device is indoor scene; Otherwise differentiate that the current residing monitoring scene of head end video supervising device is outdoor scene, wherein TH is the quotient threshold value of setting.
A kind of video monitoring scene discriminating gear, comprises picture frame and obtains unit, for obtaining the current video image frame that head end video supervising device monitors; Block division unit, the current video image frame obtained for picture frame being obtained unit is divided into the block of M × N pixel size, and wherein M, N are natural number; Brightness average determining unit, for determining that block division unit divides the brightness average of each piece that obtains respectively; Minimax brightness value determining unit, in the brightness average of each piece determined respectively in brightness average determining unit, determines high-high brightness average Y
maxwith minimum brightness average Y
min; Scene judgement unit, for the high-high brightness average Y determined in minimax brightness value determining unit
maxwith minimum brightness average Y
minmeet
time, differentiate that the current residing monitoring scene of head end video supervising device is indoor scene; Otherwise differentiate that the current residing monitoring scene of head end video supervising device is outdoor scene, wherein TH is the quotient threshold value of setting.
A kind of video monitoring scene method of discrimination, comprises the current video image frame obtaining head end video supervising device and monitor; Determine the average of the brightness value of each pixel comprised in the current video image frame obtained; If the described average determined is greater than the average threshold value of setting, then differentiate that the current residing monitoring scene of head end video supervising device is scene on daytime; Otherwise differentiate that the current residing monitoring scene of head end video supervising device is night scenes.
A kind of video monitoring scene discriminating gear, comprises picture frame and obtains unit, for obtaining the current video image frame that head end video supervising device monitors; Brightness value average determining unit, for determining that picture frame obtains the average of the brightness value of each pixel comprised in the current video image frame of unit acquisition; Scene judgement unit, the described average for determining in brightness value average determining unit is greater than the average threshold value of setting, differentiates that the current residing monitoring scene of head end video supervising device is scene on daytime; Otherwise differentiate that the current residing monitoring scene of head end video supervising device is night scenes.
For a video monitoring image coding method for night scenes on daytime, the current video image frame be included in head end video supervising device monitors carries out in coded quantization process, reduces and quantizes step value; And based on the quantization step value after reducing, current video image frame is encoded.
For a video monitoring image code device for night scenes on daytime, comprise and reduce step value unit, for carrying out at the current video image frame monitored head end video supervising device in coded quantization process, reducing and quantizing step value; And video encoding unit, for the quantization step value after reducing based on reduction step value unit, current video image frame is encoded.
The embodiment of the present invention by propose indoor/outdoor monitoring scene, daytime/identifying schemes of night monitoring scene, and for the indoor/outdoor monitoring scene recognized, daytime/night monitoring scene, the adaptive encoding scheme of monitoring image is targetedly proposed, thus achieve for indoor/outdoor monitoring scene, daytime/night monitoring scene carries out image optimization coding respectively, improve the video monitoring image quality under various monitoring scene, reduce the complexity of encoding video pictures, and then effectively improve the implementation result of Video Supervision Technique.
Accompanying drawing explanation
Fig. 1 is the composition structural representation of video monitoring system;
Fig. 2 is video coding process schematic diagram in video monitoring system;
Fig. 3 is video coding framework schematic diagram detailed in video monitoring system;
Fig. 4 is the differentiation video monitoring scene that the embodiment of the present invention proposes is the process chart of motion/static scene;
Fig. 5 is the differentiation video monitoring scene that the embodiment of the present invention proposes is the composition structural representation of the processing unit of motion/static scene;
Fig. 6 to be differentiation video monitoring scene that the embodiment of the present invention proposes be daytime/process chart of night scenes;
Fig. 7 to be differentiation video monitoring scene that the embodiment of the present invention proposes be daytime/the composition structural representation of processing unit of night scenes;
Fig. 8 is the differentiation video monitoring scene that the embodiment of the present invention proposes is the process chart of indoor/outdoor scene;
Fig. 9 is the differentiation video monitoring scene that the embodiment of the present invention proposes is the composition structural representation of the processing unit of indoor/outdoor scene;
Figure 10 is the first process chart for the video monitoring image coding method of moving scene that the embodiment of the present invention proposes;
Figure 11 be the embodiment of the present invention propose the first be the composition structural representation of the video monitoring image code processing apparatus of moving scene for video monitoring scene;
Figure 12 is the enforcement schematic diagram of the second for the video monitoring image coding method of moving scene of embodiment of the present invention proposition;
Figure 13 is the process chart of the second for the video monitoring image coding method of moving scene of embodiment of the present invention proposition;
Figure 14 is the second that the embodiment of the present invention proposes is the composition structural representation of the video monitoring image code processing apparatus of moving scene for video monitoring scene;
Figure 15 is the process chart of the video monitoring image coding method for static scene that the embodiment of the present invention proposes;
What Figure 16 was that the embodiment of the present invention proposes is the composition structural representation of the video monitoring image code processing apparatus of static scene for video monitoring scene;
Figure 17 is the schematic diagram that the embodiment of the present invention is optimized and revised null value area quantization;
Figure 18 is code optimization schematic flow sheet under night scenes;
What Figure 19 was that the embodiment of the present invention proposes is the composition structural representation of video monitoring image code processing apparatus of night scenes on daytime for video monitoring scene;
What Figure 20 was that the embodiment of the present invention proposes is the composition structural representation of the video monitoring image code processing apparatus of indoor scene for video monitoring scene;
Figure 21 is the process chart of the video monitoring coding method that the embodiment of the present invention proposes;
Figure 22 is the composition structural representation of the video monitoring code processing apparatus that the embodiment of the present invention proposes.
Embodiment
All do not consider for existing video monitoring scheme the different scene features monitoring application, do not take different code optimization strategies for different monitoring scenes, therefore can not be applicable to multiple monitoring scene.In addition, the kind of the video monitoring particularly front end surveillance device of wireless video monitoring is more, the disposal ability of a lot of front end surveillance device is more weak, and adopt existing based on such as H.264 the encoding scheme of standard is too complicated, be difficult on devices carry out real-time coding, or multiplex coding cannot be carried out, thus have impact on carrying out of Video Supervision Technique.For the problem of prior art, this programme embodiment proposes a set of code optimization scheme for video surveillance applications, code optimization is targetedly carried out based on different video surveillance applications scenes, to be fully lifted at the video quality under each monitoring scene, more good Consumer's Experience is provided, and and then the video encoding complexity reduced under different application monitoring scene, to be conducive to the realization of front end surveillance device product.
As shown in Figure 1, for the composition structural representation of video monitoring system, wherein video surveillance applications system roughly comprises video camera, head end video supervising device, transmission network and client device etc. end to end, to realize the functions such as video acquisition, coding, Internet Transmission, decoding and display translation.
As shown in Figure 2, being video coding process schematic diagram in video monitoring system, as shown in Figure 3, is video coding framework schematic diagram detailed in video monitoring system.For general coding flow process here, video monitoring due to application scenarios comparatively complicated, for the feature of different application monitoring scenes, this coding scheme can be optimized targetedly, to obtain the best video quality under application-specific scene, and reduce the complexity of coding.
The monitoring scene that the embodiment of the present invention proposes here can be divided into static/moving scene, daytime/night scenes, indoor/outdoor scene three class, can adopt and come with the following method to distinguish different monitoring scenes respectively.
Embodiment one, the differentiation of motion/static scene:
As shown in Figure 4, the differentiation video monitoring scene proposed for the embodiment of the present invention is the process chart of motion/static scene, motion detection wherein can be adopted to differentiate that video monitoring scene is that moving scene is still for static scene, the present frame and the previous frame image that are about to the video monitored subtract each other, and obtain residual frame.As front and back two two field picture correspondence position does not move, then the correspondence position pixel brightness value (referred to as brightness value) of the residual frame obtained is zero; As front and back two two field picture correspondence position does not move, then the correspondence position pixel brightness value of the residual frame obtained is the brightness value of non-zero.Added up by the brightness value of each pixel of residual frame, all pixel number object ratio values as comprised in the pixel number of zero brightness value and residual frame are greater than certain thresholding, then differentiate that current video monitoring scene is moving scene; Otherwise differentiate that current video monitoring scene is static scene.Specific implementation flow process is as follows:
Step 40, obtains last video frame image and current video image frame that in video monitoring system, head end video supervising device monitors;
Step 41, obtains image residual frame by the current video image frame of above-mentioned acquisition and last video image frame subtract;
Step 42, determines the brightness value of each pixel in image residual frame obtained above respectively;
Step 43, according to the brightness value of the above-mentioned each pixel determined respectively, determines the ratio value of the number of all pixels in the pixel number of zero brightness value and residual frame;
Step 44, the ratio value determined if above-mentioned is greater than the proportion threshold value (in usual practical application scene, this proportion threshold value can be chosen to be 30%) of setting, then differentiate that the current residing monitoring scene of head end video supervising device is moving scene; Otherwise differentiate that the current residing monitoring scene of head end video supervising device is static scene.
Accordingly, the embodiment of the present invention also proposes a kind ofly to differentiate that video monitoring scene is the processing unit of motion/static scene, the concrete composition structure of this device as shown in Figure 5, comprise picture frame and obtain unit 50, for obtaining the last video frame image and current video image frame that head end video supervising device in video monitoring system monitors; Residual frame obtains unit 52, for picture frame being obtained current video image frame that unit 50 obtains and last video image frame subtract obtains image residual frame; Brightness value determining unit 54, for determining the brightness value of each pixel in the image residual frame that residual frame acquisition unit 52 obtains respectively; Ratio value determining unit 56, for the brightness value of each pixel determined respectively according to brightness value determining unit 54, determines the ratio value of the number of all pixels in the pixel number of zero brightness value and described residual frame; Scene judgement unit 58, when ratio value for determining in ratio value determining unit 56 is greater than the proportion threshold value of setting, differentiate that the current residing monitoring scene of head end video supervising device is moving scene, otherwise differentiate that the current residing monitoring scene of head end video supervising device is static scene.
Embodiment two, daytime/differentiation of night scenes:
As shown in Figure 6, the differentiation video monitoring scene proposed for the embodiment of the present invention be daytime/process chart of night scenes, the embodiment of the present invention represents image brightness based on brightness value in picture frame, by adding up the brightness value average of all pixels in a two field picture, be greater than certain thresholding as added up the brightness value average obtained, then can differentiate that the monitoring scene residing for head end video supervising device is scene on daytime; The brightness value average obtained as added up lower than this thresholding, then can differentiate that the monitoring scene residing for head end video supervising device is night scenes.Specific implementation flow process is as follows:
Step 60, obtains the current video image frame that in video monitoring system, head end video supervising device monitors;
Step 61, determines the average of the brightness value of each pixel comprised in the current video image frame of above-mentioned acquisition;
Step 62, if the average of the brightness value determined above-mentioned is greater than the average threshold value of setting (in usual practical application scene, this average threshold value can be chosen to be 128), then can differentiate that the current residing monitoring scene of head end video supervising device is scene on daytime; Otherwise can differentiate that the current residing monitoring scene of head end video supervising device is night scenes.
In addition, also can by differentiating that to the detection of time period the scene of video monitoring is scene or night scenes on daytime, such as, within the time period of 6:00 ~ 19:00, can differentiate that video monitoring scene is scene on daytime, be night monitoring scene in all the other time periods.
Accordingly, the embodiment of the present invention also propose a kind of differentiate video monitoring scene be daytime/processing unit of night scenes, the concrete composition structure of this device as shown in Figure 7, specifically comprise picture frame and obtain unit 70, for obtaining the current video image frame that head end video supervising device in video monitoring system monitors; Brightness value average determining unit 72, for determining that picture frame obtains the average of the brightness value of each pixel comprised in the current video image frame of unit 70 acquisition; Scene judgement unit 74, when the average for the brightness value determined in brightness value average determining unit is greater than the average threshold value of setting, differentiates that the current residing monitoring scene of head end video supervising device is scene on daytime; Otherwise differentiate that the current residing monitoring scene of head end video supervising device is night scenes.
Embodiment three, the differentiation of indoor/outdoor scene:
As shown in Figure 8, differentiation video monitoring scene for embodiment of the present invention proposition is the process chart of indoor/outdoor scene, in embodiment of the present invention divided chamber, monitoring scene or outdoor monitoring scene mainly pay close attention to video frame image whether uniform-illumination, the general uneven illumination of video frame image wherein monitored under Indoor Video scene is even, as impacts such as light.The block that the two field picture monitored is divided into 16x16 pixel (can certainly be divided into the block of other sizes, the block of pixels of the sizes such as such as 8 × 8,4 × 4), and calculate the brightness average Y of the block of pixels that each division obtains, obtain the high-high brightness average Y of block of pixels in a two field picture
maxwith minimum brightness average Y
min, as the Y obtained
maxand Y
minmeet following formula, then differentiate that the scene of head end video supervising device current monitor is indoor scene; Otherwise the scene differentiating head end video supervising device current monitor is outdoor scene.
Wherein TH can value be 2 usually.Its concrete handling process is as follows:
Step 80, obtains the current video image frame that in video monitoring system, head end video supervising device monitors;
Step 81, is divided into the block of M × N pixel size by the current video image frame of above-mentioned acquisition, wherein M, N are natural number;
Step 82, determines the brightness average of each block of pixels that above-mentioned division obtains respectively;
Step 83, in the brightness average of the above-mentioned each block of pixels determined respectively, determines maximum brightness average Y
maxwith minimum brightness average Y
min;
Step 84, the Y determined if above-mentioned
maxand Y
minmeet relational expression
then differentiate that the current residing monitoring scene of head end video supervising device is indoor scene; Otherwise differentiate that the current residing monitoring scene of head end video supervising device is outdoor scene, wherein TH is the quotient threshold value of setting, and can be, but not limited to value in usual practical application scene is 2.
Accordingly, the embodiment of the present invention also proposes a kind ofly to differentiate that video monitoring scene is the processing unit of indoor/outdoor scene, the concrete composition structure of this device as shown in Figure 9, specifically comprises picture frame and obtains unit 90, for obtaining the current video image frame that head end video supervising device monitors; Block division unit 92, the current video image frame obtained for picture frame being obtained unit 90 is divided into the block of M × N pixel size, and wherein M, N are natural number; Brightness average determining unit 94, for determining that block division unit 92 divides the brightness average of each piece that obtains respectively; Minimax brightness value determining unit 96, in the brightness average of each piece determined respectively in brightness average determining unit 94, determines maximum brightness average Y
maxwith minimum brightness average Y
min; Scene judgement unit 98, for the Y determined in minimax brightness value determining unit 96
maxand Y
minmeet
time, differentiate that the current residing monitoring scene of head end video supervising device is indoor scene; Otherwise differentiate that the current residing monitoring scene of head end video supervising device is outdoor scene, wherein TH is the quotient threshold value of setting.
The method of certain automatic discrimination monitoring scene except introducing above, also can manually arrange monitoring scene pattern in head end video supervising device.
The embodiment of the present invention differentiates scheme for the monitoring scene of above-mentioned proposition, proposes code optimization scheme targetedly respectively, specifically will describe in detail successively following for often kind of different monitoring scene.
Embodiment four, the code optimization scheme under moving scene:
In video monitoring system, moving scene correspond to video camera move and individual soldier's equipment use time video acquisition situation, static scene corresponds to the video acquisition situation of video camera when fixing.
When monitoring scene is in moving scene, there is the motions such as taking turn due to video camera, motion-estimation precision is lower, and motion vector numerical value is very large, easily cause encoding code stream to change greatly, easily occur the phenomenons such as packet loss when fixed network bandwidth for transmission, significantly reduce video encoding quality.For this defect, the present invention is that strength proposes under monitoring scene is moving scene, increases overall motion estimation operation, obtain global motion vector MV before prediction processing in an encoding process
g, can be used for the motion vector representing video camera.Then carry out block-based estimation, obtain block motion vector MV
b, and calculate its difference MV
d:
MV
d＝MV
b-MV
g (2)
Then with MV
dbased on carry out subsequently motion vector encoder, to reduce the numerical values recited of motion vector, improve the quality of Video coding.
Therefore, as shown in Figure 10, be the first process chart for the video monitoring image coding method of moving scene that the embodiment of the present invention proposes, its specific implementation process is as follows:
Step 100, first carries out overall motion estimation to the current video image frame that the head end video supervising device in video monitoring system monitors, obtains global motion vector MV before coded prediction
g;
Step 101, first carries out block-based estimation to current video image frame before coded prediction, obtains block motion vector MV
b;
Step 102, determines the block motion vector MV of above-mentioned acquisition
bwith global motion vector MV
gdifference MV
d;
Step 103, based on difference MV obtained above
dmotion vector encoder is carried out to current video image frame.
Accordingly, it is the video monitoring image code processing apparatus of moving scene for video monitoring scene that the embodiment of the present invention also proposes a kind of, the concrete composition structure of this device as shown in figure 11, specifically comprise motion estimation unit 110, current video image frame for monitoring the head end video supervising device in video monitoring system carries out overall motion estimation before coded prediction, obtains global motion vector MV
g; And before coded prediction, block-based estimation is carried out to current video image frame, obtain block motion vector MV
b; Vector difference determining unit 111, for determining the block motion vector MV that motion estimation unit 110 obtains
bwith global motion vector MV
gdifference MV
d; Vector coding unit 112, for the difference MV determined based on vector difference determining unit 111
dmotion vector encoder is carried out to current video image frame.
Further, different images content frame may be caused when considering camera motion to occur, and the probability periodically repeated is less, therefore reference frame quantity when reducing Video coding can be considered, change single frames reference into from multi-frame-reference, while not reducing precision of prediction, reduce the amount of calculation of estimation.Because the quality requirement of video monitoring to single-frame images is higher, when causing code check to increase too fast when moving too acutely, need to adjust Rate Control mode, QP can be kept particularly substantially constant, constant code rate is reached by dynamically reducing frame per second, with the quality of bonding two field picture, specific embodiments as shown in figure 12.
Therefore, as shown in figure 13, the second proposed for the embodiment of the present invention is for the process chart of the video monitoring image coding method of moving scene, and its specific implementation process is as follows:
Step 130, carries out overall motion estimation to the current video image frame that the head end video supervising device in video monitoring system monitors, obtains global motion vector MV before coded prediction
g;
Step 131, carries out block-based estimation to current video image frame before coded prediction, obtains block motion vector MV
b;
Step 132, determines the block motion vector MV of above-mentioned acquisition
bwith global motion vector MV
gdifference MV
d;
Step 133, based on the difference MV of above-mentioned acquisition
dfirst time motion vector encoder is carried out to current video image frame;
Step 134, carries out frame per second adjustment (i.e. Rate Control process) according to above-mentioned coding result to current video image frame;
Step 135, first carries out overall motion estimation to the current video image frame after above-mentioned frame per second adjustment, obtains global motion vector MV before coded prediction
g';
Step 136, first carries out block-based estimation to the current video image frame after frame per second adjustment, obtains block motion vector MV before coded prediction
b';
Step 137, determines the block motion vector MV of above-mentioned acquisition
b' and global motion vector MV
g' difference MV
d';
Step 138, based on the difference MV of above-mentioned acquisition
d' second time motion vector encoder is carried out to the current video image frame after frame per second adjustment.
Accordingly, the embodiment of the present invention also proposes the video monitoring image code processing apparatus that another kind is moving scene for video monitoring scene, the concrete composition structure of this device as shown in figure 14, specifically comprise motion estimation unit 141, current video image frame for monitoring the head end video supervising device in video monitoring system carries out overall motion estimation before coded prediction, obtains global motion vector MV
g; And before coded prediction, block-based estimation is carried out to current video image frame, obtain block motion vector MV
b; Vector difference determining unit 143, for determining the block motion vector MV that motion estimation unit 141 obtains
bwith global motion vector MV
gdifference MV
d; Motion vector coding unit 145, for the difference MV determined based on vector difference determining unit 143
dfirst time motion vector encoder is carried out to current video image frame; Frame rate adjustment unit 147, carries out frame per second adjustment for the coding result according to motion vector coding unit 145 to current video image frame; Subsequent motion estimation unit 141 also for carrying out overall motion estimation to the current video image frame after the adjustment of frame rate adjustment unit 145 frame per second before coded prediction, obtains global motion vector MV
g'; And before coded prediction, block-based estimation is carried out to the current video image frame after frame per second adjustment, obtain block motion vector MV
b'; Vector difference determining unit 143 is also for determining block motion vector MV
b' and global motion vector MV
g' difference MV
d'; Motion vector coding unit 145 is also for based on difference MV
d' second time motion vector encoder is carried out to the current video image frame after frame per second adjustment.
Embodiment five, the code optimization scheme under static scene:
When monitoring scene is static scene, because the background parts of monitoring image remains unchanged, only occur changing at fraction image-region when moving object occurs, therefore can consider only to encode, farthest to reduce encoder bit rate to the part of change.As shown in figure 15, be the process chart of the video monitoring image coding method for static scene that the embodiment of the present invention proposes, its specific implementation process is as follows:
Step 150, judges whether the current image frame that the head end video supervising device in video monitoring system monitors is the first frame video image; When judged result is for being, perform step 151; Otherwise perform step 152;
Step 151, the current image frame reference frame f as a setting that the head end video supervising device in video monitoring system is monitored
b;
Step 152, judges the current video image frame f that head end video supervising device monitors
irelative to the first frame video image frame f of the reference frame as a setting monitored
bwhether there is region of variation; If so, perform step 153, otherwise perform step 156;
Step 153, the current video image frame f that head end video supervising device is monitored
irelative to the f of reference frame as a setting monitored
bthe area part that changes of the first frame video image frame as residual frame f
Δ;
Step 154, to the above-mentioned residual frame f determined
Δcarry out estimation relative to the last video frame image monitored, and carry out Video coding according to motion estimation result;
Step 155, in decoding end, decoding generates residual frame f
Δreconstruction frames
after, substitute reference background frame f
bcorresponding changing unit, thus combine generate f
ireconstruction frames
Step 156, skips cataloged procedure, ignores this current video picture frame f
icarry out coded treatment, decoding end direct display background reference frame f
bdecoded result.
Based on the code optimization scheme under monitoring scene is static scene of above-mentioned proposition, the complexity that encoding and decoding calculate just greatly can be reduced when keeping monitor video picture quality constant.In addition because actual coding frame number reduces, and the coding region of coded frame reduces, and therefore can improve the coding quality of each frame video image when code check is constant.
Accordingly, it is the video monitoring image code processing apparatus of static scene for video monitoring scene that the embodiment of the present invention also proposes a kind of, the concrete composition structure of this device as shown in figure 16, specifically comprise residual frame determining unit 160, for current video image frame that the head end video supervising device in video monitoring system is monitored relative to the region of variation as the first frame video image frame with reference to frame monitored as residual frame; Video encoding unit 161, carries out estimation for the residual frame determined described residual frame determining unit 160 relative to the last video frame image monitored, and carries out Video coding according to motion estimation result.
Embodiment six, daytime/night scenes under code optimization scheme:
Because illumination is strong under daytime scene, video capture image will be excessively bright, pixel brightness value is too concentrated, cause in cataloged procedure that its ac coefficient AC will all close to zero after conversion process, after quantizing, AC coefficient is directly zero, therefore image detail can be caused to lose, show as image a vast expanse of whiteness, be difficult to the details differentiated wherein.For night scenes, excessively dark owing to gathering image, also there is the excessive problem directly causing image detail to be lost in a large number of identical quantization error.
For this problem, can carry out at the current video image frame monitored head end video supervising device in coded quantization process, the null value region obtained after conversion is processed, namely reduce and quantize step value QStep
0, obtain new quantization step value QStep
0', then based on new quantization step value QStep
0' current video image frame is encoded.Wherein:
QStep
0′＝QStep
0-d (3)
Like this, carrying out in cataloged procedure to the video monitoring image under daytime night scenes, just can realize less conversion coefficient and being retained, and then remaining more image detail, improving the coding quality of image.In actual applications, quantification regulation coefficient d can be, but not limited to value is QStep
0/ 2.
As shown in figure 17, be schematic diagram that the embodiment of the present invention is optimized and revised null value area quantization.
In addition, identical null value area quantization method of adjustment also can be taked under night scenes to avoid the video image details monitored seriously to lose.In addition due to the restriction of video camera technique, a large amount of noise can be inevitably there is when night gathers video image, greatly have impact on the quality of the video image monitored, too increase encoder bit rate, for addressing this problem, before Image Coding, filtering process can be carried out to remove noise to current video image frame, promote the coding quality of video image.Under concrete night scenes, code optimization schematic flow sheet as shown in figure 18.
Accordingly, it is the video monitoring image code processing apparatus of night scenes on daytime for video monitoring scene that the embodiment of the present invention also proposes a kind of, the concrete composition structure of this device as shown in figure 19, specifically comprise and reduce step value unit 190, for carrying out at the current video image frame monitored head end video supervising device in coded quantization process, reducing and quantizing step value; Video encoding unit 191, carries out coded treatment for the quantization step value after reducing based on reduction step value unit 190 to current video image frame.Filter unit 192, for when the current residing monitoring scene of head end video supervising device is night scenes, quantization step value after reducing based on reduction step value unit carries out filtering process to current video image frame before encoding to current video image frame.
Embodiment seven, the code optimization scheme under indoor/outdoor scene:
When video monitoring scene is indoor scene, often because the reasons such as light-illuminating are on the impact of video image generation brightness irregularities, often there is the region in bright (around bulb) and excessively dark (corner that light is blocked).The same with night scenes on aforementioned daytime, a large amount of detail content of image may be lost due to the operation of uniform quantization.Therefore, for the video monitoring image frame be under indoor scene, every for current acquisition frame video image frame can be divided into the block of M × N pixel size, wherein M, N are natural number, can be, but not limited to be divided into the block of the pixel sizes such as 8 × 8,4 × 4,16 × 16,16 × 8 here.Based on dividing each block of pixels obtained, the brightness average Y of each piece can be determined respectively based on following formula:
Wherein Y
ijfor the brightness value of each pixel comprised in block, i, j are positive integer.
According to the brightness average Y of each piece that determines, the block selecting brightness average to be less than the block of the first setting threshold and brightness average thereof to be greater than the second setting threshold, wherein the first setting threshold is less than the second setting threshold; The block B dividing each the M × N pixel size obtained by this current video picture frame is divided into two class B
uand B
n:
Wherein TH1 is the first setting threshold, and TH2 is the second setting threshold, and usual TH1 can get 64, TH2 can get 191.For the block of above-mentioned selection (namely for B
ublock), the process of null value area quantization can be carried out, namely for the B chosen
ublock, is carrying out in coded quantization process, by reducing its quantization step value QStep
0for QStep
0'; Then based on the quantization step value QStep after reduction
0' to the B selected
ublock is encoded.And for unselected piece (namely for B
nblock), then can carry out coded treatment according to existing normal encoding mode.Such Optimized Coding Based mode can well promote bright area or cross the Image Coding quality of dark areas.
When being outdoor scene for video monitoring scene, also can carry out coded treatment according to existing normal encoding mode.If under outdoor scene, be simultaneously daytime scene or night scenes time, then can in conjunction with above-mentioned by the agency of daytime/night scenes under Optimized Coding Based mode carry out corresponding Optimized Coding Based process.
Accordingly, it is the video monitoring image code processing apparatus of indoor scene for video monitoring scene that the embodiment of the present invention also proposes a kind of, the concrete composition structure of this device as shown in figure 20, specifically comprise picture frame and obtain unit 200, the current video image frame that the head end video supervising device for obtaining in video monitoring system monitors; Block division unit 201, the current video image frame obtained for picture frame being obtained unit 200 is divided into the block of M × N pixel size, and wherein M, N are natural number; Brightness average determining unit 202, for determining that block division unit 201 divides the brightness average of each piece that obtains respectively, wherein brightness average determining unit 202 can according to formula
determine the brightness average dividing each piece that obtains: wherein Y
ijfor the brightness value of each pixel comprised in block, i, j are positive integer; Block selected cell 203, for the brightness average of each piece determined according to brightness average determining unit 202, the block selecting brightness average to be less than the block of the first setting threshold and brightness average thereof to be greater than the second setting threshold, wherein the first setting threshold is less than the second setting threshold; Reduce step value unit 204, the block for selecting block selected cell 203 carries out in coded quantization process, reduces and quantizes step value; Video encoding unit 205, carries out coded treatment for the quantization step value after reducing based on reduction step value unit 204 to the block that block selected cell 203 is selected.
For the arbitration schemes of aforementioned various identification monitoring scenes of having set forth respectively, and for the Different Optimization encoding scheme that the different monitoring scene recognized proposes, the embodiment of the present invention proposes a kind of new video monitoring coding method, specifically as shown in figure 21, for the process chart of the video monitoring coding method that the embodiment of the present invention proposes, specific implementation process is as follows:
Step 210, differentiates the current residing monitoring scene of head end video supervising device in video monitoring system; Particularly monitoring scene can be, but not limited to comprise motion/static scene, daytime/night scene, indoor/outdoor scene etc., wherein how to identify above-mentioned various monitoring scene in above-mentioned elaboration, no longer too much repeat here.
Step 211, according to the corresponding relation of the monitoring scene preset and Video coding mode, determines the Video coding mode that the above-mentioned monitoring scene determined is corresponding; Can pre-set should the Optimized Coding Based mode of monitoring scene under wherein different monitoring scenes, wherein for different monitoring scenes, the coded system which kind of adopts optimize in above-mentioned elaboration, also no longer too much repeats here.
Step 212, carries out coded treatment according to the above-mentioned Video coding mode determined to every frame video image information that head end video supervising device monitors.The specific coding process of concrete often kind of Optimized Coding Based mode, also in above-mentioned elaboration, also no longer too much repeats here.
Accordingly, the embodiment of the present invention also proposes a kind of video monitoring code processing apparatus, the concrete composition structure of this device as shown in figure 22, specifically comprises scene judgement unit 221, for differentiating the current residing monitoring scene of head end video supervising device in video monitoring system; Coded system determining unit 222, for the corresponding relation according to the monitoring scene preset and Video coding mode, determines the Video coding mode that monitoring scene that scene judgement unit 221 determines is corresponding; Coding unit 223, carries out coded treatment for the Video coding mode determined according to coded system determining unit 222 to every frame video image information that head end video supervising device monitors.How scene judgement unit 221 identifies that how above-mentioned various monitoring scene, coded system determining unit 222 are for different monitoring scenes particularly, the coded system which kind of adopts optimize and coding unit 223 adopt the specific coding process of often kind of Optimized Coding Based mode all to distinguish in above-mentioned elaboration particularly, no longer too much repeat here.
To sum up discuss visible, the embodiment of the present invention is by proposing the identifying schemes of different monitoring scene, and for the different monitoring scene recognized, the adaptive encoding scheme of monitoring image is targetedly proposed, thus achieve and carry out image optimization coding respectively for different monitoring scenes, improve the video monitoring image quality under various monitoring scene, reduce the complexity of encoding video pictures, and then effectively improve the implementation result of Video Supervision Technique.
Obviously, those skilled in the art can carry out various change and modification to the present invention and not depart from the spirit and scope of the present invention.Like this, if these amendments of the present invention and modification belong within the scope of the claims in the present invention and equivalent technologies thereof, then the present invention is also intended to comprise these change and modification.
Claims (4)
1., for a video monitoring image coding method for indoor scene, it is characterized in that, comprising:
Obtain the current video image frame that head end video supervising device monitors;
The current video image frame of acquisition is divided into the block of M × N pixel size, wherein M, N are natural number;
Determine the brightness average dividing each piece that obtains respectively; And
According to the brightness average of each piece that determines, the block selecting brightness average to be less than the block of the first setting threshold and brightness average thereof to be greater than the second setting threshold, wherein the first setting threshold is less than the second setting threshold;
Carry out in coded quantization process to the block selected, reduce and quantize step value; And
Based on the quantization step value after reducing, the block selected is encoded.
2. the method for claim 1, is characterized in that, determines the brightness average dividing each piece that obtains according to the following equation:
Wherein Y
ijfor the brightness value of each pixel comprised in block, i, j are positive integer.
3., for a video monitoring image code device for indoor scene, it is characterized in that, comprising:
Picture frame obtains unit, for obtaining the current video image frame that head end video supervising device monitors;
Block division unit, the current video image frame obtained for picture frame being obtained unit is divided into the block of M × N pixel size, and wherein M, N are natural number;
Brightness average determining unit, for determining that block division unit divides the brightness average of each piece that obtains respectively; And
Block selected cell, for the brightness average of each piece determined according to brightness average determining unit, the block selecting brightness average to be less than the block of the first setting threshold and brightness average thereof to be greater than the second setting threshold, wherein the first setting threshold is less than the second setting threshold;
Reduce step value unit, the block for selecting block selected cell carries out in coded quantization process, reduces and quantizes step value; And
Video encoding unit, encodes to the block that block selected cell is selected for the quantization step value after reducing based on reduction step value unit.
4. device as claimed in claim 3, it is characterized in that, brightness average determining unit determines the brightness average dividing each piece that obtains according to the following equation:
Wherein Y
ijfor the brightness value of each pixel comprised in block, i, j are positive integer.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201010612077.6A CN102547225B (en) | 2010-12-29 | 2010-12-29 | Video monitoring scene judgment method and device, and monitored image encoding method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201010612077.6A CN102547225B (en) | 2010-12-29 | 2010-12-29 | Video monitoring scene judgment method and device, and monitored image encoding method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102547225A CN102547225A (en) | 2012-07-04 |
| CN102547225B true CN102547225B (en) | 2014-12-31 |
Family
ID=46353038
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201010612077.6A Active CN102547225B (en) | 2010-12-29 | 2010-12-29 | Video monitoring scene judgment method and device, and monitored image encoding method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102547225B (en) |
Families Citing this family (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2017219353A1 (en) * | 2016-06-24 | 2017-12-28 | Qualcomm Incorporated | Methods and systems of performing rate control based on scene dynamics and channel dynamics |
| CN106131502B (en) * | 2016-08-16 | 2020-03-24 | 深圳英飞拓科技股份有限公司 | Video monitoring method and device for pipe gallery tunnel |
| CN107635115A (en) * | 2017-10-09 | 2018-01-26 | 深圳市天视通电子科技有限公司 | A kind of method, storage medium and electronic equipment for realizing ultralow code check |
| CN109905711B (en) * | 2019-02-28 | 2021-02-09 | 深圳英飞拓智能技术有限公司 | Image processing method and system and terminal equipment |
| CN110740328A (en) * | 2019-10-14 | 2020-01-31 | 深圳市天视通电子科技有限公司 | network video image compression method and device |
| CN111970510B (en) * | 2020-07-14 | 2023-06-02 | 浙江大华技术股份有限公司 | Video processing method, storage medium, and computing device |
| US11582464B2 (en) * | 2021-06-23 | 2023-02-14 | Microsoft Technology Licensing, Llc | Using morphological operations to process frame masks in video content |
| CN114466109B (en) * | 2021-12-27 | 2024-03-08 | 天翼云科技有限公司 | Image processing method based on high-speed image shooting instrument, terminal equipment and medium |
| CN114429761B (en) * | 2022-04-01 | 2022-06-03 | 南京有物信息科技有限公司 | Display control method, device and system suitable for multiple terminals |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1378384A (en) * | 2001-03-23 | 2002-11-06 | 夏普公司 | Self adaptive quantization based on bit rate predictino and predictive error energy |
| JP2003085671A (en) * | 2001-09-14 | 2003-03-20 | Taiheiyo Boeki Kk | Movement stoppage detector |
| CN101163241A (en) * | 2007-09-06 | 2008-04-16 | 武汉大学 | Video sequence coding/decoding structure |
| CN101309410A (en) * | 2008-07-08 | 2008-11-19 | 武汉大学 | Video coding and decoding architecture |
| CN101378501A (en) * | 2008-10-10 | 2009-03-04 | 天津市亚安科技电子有限公司 | Ganged monitoring apparatus for infrared panorama and control method thereof |
| WO2009027089A2 (en) * | 2007-08-30 | 2009-03-05 | Valeo Schalter Und Sensoren Gmbh | Method and system for weather condition detection with image-based road characterization |
| JP2009171245A (en) * | 2008-01-16 | 2009-07-30 | Panasonic Electric Works Co Ltd | Interphone system |
| CN101872526A (en) * | 2010-06-01 | 2010-10-27 | 重庆市海普软件产业有限公司 | Smoke and fire intelligent identification method based on programmable photographing technology |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1953551A (en) * | 2006-11-24 | 2007-04-25 | 北京中星微电子有限公司 | A device and method for image compression |
| KR100950465B1 (en) * | 2007-12-21 | 2010-03-31 | 손승남 | Camera control method for vehicle enrance control system |
-
2010
- 2010-12-29 CN CN201010612077.6A patent/CN102547225B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1378384A (en) * | 2001-03-23 | 2002-11-06 | 夏普公司 | Self adaptive quantization based on bit rate predictino and predictive error energy |
| JP2003085671A (en) * | 2001-09-14 | 2003-03-20 | Taiheiyo Boeki Kk | Movement stoppage detector |
| WO2009027089A2 (en) * | 2007-08-30 | 2009-03-05 | Valeo Schalter Und Sensoren Gmbh | Method and system for weather condition detection with image-based road characterization |
| CN101163241A (en) * | 2007-09-06 | 2008-04-16 | 武汉大学 | Video sequence coding/decoding structure |
| JP2009171245A (en) * | 2008-01-16 | 2009-07-30 | Panasonic Electric Works Co Ltd | Interphone system |
| CN101309410A (en) * | 2008-07-08 | 2008-11-19 | 武汉大学 | Video coding and decoding architecture |
| CN101378501A (en) * | 2008-10-10 | 2009-03-04 | 天津市亚安科技电子有限公司 | Ganged monitoring apparatus for infrared panorama and control method thereof |
| CN101872526A (en) * | 2010-06-01 | 2010-10-27 | 重庆市海普软件产业有限公司 | Smoke and fire intelligent identification method based on programmable photographing technology |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102547225A (en) | 2012-07-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102547225B (en) | Video monitoring scene judgment method and device, and monitored image encoding method and device | |
| CN102572380B (en) | Video monitoring coding method and device | |
| CN102395030B (en) | Motion analysis method based on video compression code stream, code stream conversion method and apparatus thereof | |
| CN102572381A (en) | Video monitoring scene judging method and monitoring image coding method and device thereof | |
| CN101163241B (en) | Video sequence coding/decoding system | |
| CN102420988B (en) | Multi-view video coding system utilizing visual characteristics | |
| CN102014279B (en) | Method and device for intensifying video image contrast | |
| CN104994382B (en) | A kind of optimization method of perception rate distortion | |
| CN110139112B (en) | Video coding method based on JND model | |
| CN105072345A (en) | Video encoding method and device | |
| Kong et al. | Object-detection-based video compression for wireless surveillance systems | |
| CN103561232A (en) | Method and device for identifying video monitoring scenes | |
| CN101567964A (en) | Method for preprocessing noise reduction and block effect removal in low bit-rate video application | |
| CN102984541B (en) | Video quality assessment method based on pixel domain distortion factor estimation | |
| WO2013056200A1 (en) | Method and apparatus for video compression of stationary scenes | |
| CN107257464A (en) | HD video encoder bit rate control algolithm based on Sobel operators and linear regression | |
| EP0985318B1 (en) | System for extracting coding parameters from video data | |
| CN117640942A (en) | Coding method and device for video image | |
| CN101309410A (en) | Video coding and decoding architecture | |
| CN106339994A (en) | Image enhancement method | |
| CN101841713A (en) | Video coding method for reducing coding code rate and system | |
| US8121199B2 (en) | Reducing the block effect in video file compression | |
| CN103561268A (en) | Method and device for encoding video monitoring image | |
| CN103747257B (en) | A kind of method of video data high efficient coding | |
| CN102804783B (en) | Picture coding device and camera system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |