CN101599175A - Determine the detection method and the image processing equipment of alteration of shooting background - Google Patents

Determine the detection method and the image processing equipment of alteration of shooting background Download PDF

Info

Publication number
CN101599175A
CN101599175A CNA2009100869641A CN200910086964A CN101599175A CN 101599175 A CN101599175 A CN 101599175A CN A2009100869641 A CNA2009100869641 A CN A2009100869641A CN 200910086964 A CN200910086964 A CN 200910086964A CN 101599175 A CN101599175 A CN 101599175A
Authority
CN
China
Prior art keywords
background
image
identified areas
current frame
pixel
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CNA2009100869641A
Other languages
Chinese (zh)
Other versions
CN101599175B (en
Inventor
邓亚峰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Mid Star Technology Ltd By Share Ltd
Original Assignee
Vimicro Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Vimicro Corp filed Critical Vimicro Corp
Priority to CN200910086964.1A priority Critical patent/CN101599175B/en
Publication of CN101599175A publication Critical patent/CN101599175A/en
Application granted granted Critical
Publication of CN101599175B publication Critical patent/CN101599175B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Image Analysis (AREA)
  • Studio Devices (AREA)

Abstract

The invention provides a kind of detection method and image processing equipment of definite alteration of shooting background, wherein method comprises: determine the background identified areas in the background reference image; The imaging region of characteristic body in described background reference image in the described background identified areas identification sources background; Utilize current frame image, obtain the contrast images of described background reference image; With the image in the background identified areas in the described background reference image, compare with image in the respective regions in the described contrast images, obtain comparison result; According to described comparison result, whether the shooting background that detects in the current frame image conforms to described source background, if conform to, determines that then shooting background does not become; Otherwise, determine alteration of shooting background.The technical scheme that the embodiment of the invention provides can effectively reduce the false detection probability whether shooting background is changed.

Description

Determine the detection method and the image processing equipment of alteration of shooting background
Technical field
The present invention relates to technical field of image processing, particularly a kind of detection method of definite alteration of shooting background and image processing equipment.
Background technology
In the practical application, handling for the convenient image that image capture device such as camera are photographed, is two parts, foreground image and background image with the image division that photographs usually.Wherein, background image mainly embodies the background of finding a view, can comprise stationary body such as static wall in the background of finding a view, be placed in the ornament of fixed position, or the like material object.Foreground image mainly embodies dynamic object, as the people who before camera, walks about, the vehicle of enforcement, or the like.
For conveniently carrying out Flame Image Process, set up the background image model based on the background image that photographs usually.But if the background of finding a view changes, increase, or the focal length of camera or putting position be changed as the material object in the background, or the like, the background image that then will cause collecting changes, correspondingly, and need be based on the background image background image updating model that is updated.
Under other situations; because the interference of foreground image; usually can cause flase drop; be that background changes, but because of the interference of prospect, causing the device handler flase drop is that background image changes; thereby cause device handler need re-execute the operation of setting up the background image model; cause the unnecessary burden of device handler, and increase the energy consumption of equipment, be unfavorable for energy-conservation.
Prior art takes corresponding measure to reduce this erroneous judgement probability, and this measure mainly comprises:
Reference background frame and present frame are done difference processing, differ bigger, determine that then background is modified if difference result shows present frame and reference background frame; Otherwise, if showing present frame and reference background frame, difference result differs less, determine that then background is not modified.
Prior art can reduce the erroneous judgement probability to a certain extent, but the inventor is in realizing process of the present invention, and still there are the following problems at least to find prior art:
Difference at reference background frame and present frame is bigger, but in fact image capture device at the picked-up background do not change, then flase drop will appear in prior art.
Therefore, prior art is difficult to effectively reduce the false detection probability whether shooting background is changed.
Summary of the invention
The embodiment of the invention provides a kind of detection method and image processing equipment of definite alteration of shooting background, to solve the technical matters that being difficult to of existing in the prior art effectively reduce the erroneous judgement probability whether shooting background changed.
For solving the problems of the technologies described above, embodiments of the invention provide a kind of detection method of definite alteration of shooting background, comprising:
Determine the background identified areas in the background reference image; The imaging region of characteristic body in described background reference image in the described background identified areas identification sources background;
Utilize current frame image, obtain the contrast images of described background reference image;
With the image in the background identified areas in the described background reference image, compare with image in the respective regions in the described contrast images, obtain comparison result;
According to described comparison result, whether the shooting background that detects in the current frame image conforms to described source background, if conform to, determines that then shooting background does not become; Otherwise, determine alteration of shooting background.
Preferably, the background identified areas in described definite background reference image comprises:
Utilize edge detecting technology, obtain a plurality of pixels that edge intensity value computing in the described background reference image satisfies preset requirement;
Calculate all connected regions that described a plurality of pixel can form;
From all connected regions, select described background identified areas.
Preferably, the described edge detecting technology of utilizing, from described background reference image, extract edge intensity value computing and satisfy pre-conditioned a plurality of pixels and comprise:
Calculate the edge intensity value computing of each pixel on the described background reference image;
Edge intensity value computing to described each pixel is made Filtering Processing, obtains the updating edge intensity level of each pixel;
Select the pixel of updating edge intensity level, as described a plurality of pixels greater than preset first threshold value.
Preferably, described edge intensity value computing to described each pixel is made Filtering Processing, and the updating edge intensity level that obtains each pixel comprises:
According to preset rules, the edge intensity value computing of choosing specified pixel point in the default spectral window is upgraded the edge intensity value computing of described pixel, obtains described updating edge intensity level;
Described spectral window is the center with described pixel and has default size.
Preferably, describedly from all connected regions, select described background identified areas and comprise:
Select the connected region of area, as described background identified areas greater than default second threshold value.
Preferably, the described current frame image that utilizes, the contrast images of obtaining described background reference image comprises:
Consecutive frame image to described current frame image and this current frame image is done calculus of differences, obtains difference image; Described difference image comprises by described current frame image all pixels formed pixel region of variation different with pixel value on the described consecutive frame image;
Described difference image is used as described contrast images.
Preferably, described with the image in the background identified areas in the described background reference image, comparing with image in the respective regions in described contrast images comprises:
Calculate described background identified areas shared zone in described background reference image, with the intersection area in described pixel region of variation shared zone in described contrast images;
Detect described intersection area area occupied and whether satisfy preset requirement, described preset requirement comprises: the ratio between described intersection area area occupied and the described background identified areas area occupied is no more than default the 3rd threshold value.
Preferably, the described comparison result that draws comprises: described ratio is no more than described the 3rd threshold value;
Described according to described comparison result, whether the shooting background in the detection current frame image conforms to described source background and comprises: detect described shooting background and conform to described source background; Or,
The described comparison result that draws comprises: described ratio surpasses described the 3rd threshold value;
Described according to described comparison result, whether the shooting background in the detection current frame image conforms to described source background and comprises: detect described shooting background and do not conform to described source background.
Preferably, described according to described comparison result, whether the shooting background in the detection current frame image conforms to described source background and comprises:
If described comparison result is: described ratio surpasses described the 3rd threshold value, then utilize block-matching technique, compare described background reference image and described current frame image, from described current frame image find out with described background identified areas in the matching image that is complementary of image, image in the wherein said background identified areas comprises a plurality of to be matched, and described matching image comprises a plurality of match block;
Obtain in the image in the described background identified areas displacement beacon information between the match block position corresponding in each to be matched position and described matching image;
According to described displacement beacon information, add up in the described matching image, to be matched position of the correspondence of comparing, offset deviation surpasses the number of all match block of default the 4th threshold value, if the number of described all match block surpasses default the 5th threshold value, determine that then the shooting background in the current frame image does not conform to described source background.
For solving the problems of the technologies described above, embodiments of the invention also provide a kind of image processing equipment, comprising:
Processing unit is used for determining the background identified areas of background reference image; The imaging region of characteristic body in described background reference image in the described background identified areas identification sources background;
Acquiring unit is used to utilize current frame image, obtains the contrast images of described background reference image;
The compare of analysis unit is used for the image in the described background reference image background identified areas, compares with image in the respective regions in the described contrast images, obtains comparison result; According to described comparison result, whether the shooting background that detects in the current frame image conforms to described source background, if conform to, determines that then shooting background does not become; Otherwise, determine alteration of shooting background.
Preferably, described processing unit comprises:
Computing unit is used to utilize edge detecting technology, obtains a plurality of pixels that edge intensity value computing in the described background reference image satisfies preset requirement; Calculate all connected regions that described a plurality of pixel can form;
Selected cell is used for selecting described background identified areas from all connected regions.
Preferably, described acquiring unit comprises:
Choose the unit, be used for selecting the consecutive frame image of current frame image and this current frame image from the image of shooting;
The calculus of differences unit, be used for described current frame image and described consecutive frame image are done calculus of differences, calculate the difference image that is used as described contrast images, described difference image comprises by described current frame image all pixels formed pixel region of variation different with pixel value on the described consecutive frame image.
Preferably, described compare of analysis unit comprises:
The common factor computing unit is used for calculating described background identified areas in the shared zone of described background reference image, with the intersection area in described pixel region of variation shared zone in described contrast images;
Detecting unit is used to detect described intersection area area occupied and whether satisfies preset requirement, and described preset requirement comprises: the ratio between described intersection area area occupied and the described background identified areas area occupied is no more than default the 3rd threshold value,
Whether analysis and processing unit is used for the comparison result that obtains according to detecting unit, analyze described shooting background and change.
Preferably, described analysis and processing unit comprises:
Matching unit, be used for according to described comparison result be: described ratio surpasses described the 3rd threshold value, utilize block-matching technique, compare described background reference image and described current frame image, from described current frame image find out with described background identified areas in the matching image that is complementary of image, image in the wherein said background identified areas comprises a plurality of to be matched, and described matching image comprises a plurality of match block;
The displacement computing unit is used for obtaining the displacement beacon information between the match block position corresponding in each to be matched position of image and the described matching image in the described background identified areas;
Statistical analysis unit, be used for according to described displacement beacon information, add up in the described matching image, to be matched position of the correspondence of comparing, offset deviation surpasses the number of all match block of default the 4th threshold value, if the number of described all match block surpasses default the 5th threshold value, determine that then the shooting background in the current frame image does not conform to described source background.
The technical scheme that embodiments of the invention provided, by determining the background identified areas of characteristic body imaging region in the identification sources background, utilize the image in the background identified areas, with the processing that compares based on the image in the respective regions in the contrast images of current frame image acquisition, whether detect the shooting background that is embodied on the image of shooting conforms to the source background that background reference image is embodied, because in the embodiments of the invention, adopt comparison targetedly to handle, image on the comparison different images in the specific region, as above-mentioned image in the respective regions in image in the background identified areas in the background reference image and the contrast images is done contrast, the prior art of comparing, improve the precision of comparison scope in the image comparison processing, therefore can effectively reduce the erroneous judgement probability, improve the accuracy that detects.
Further, terminal handler can determine whether to rebulid the background image model based on correct testing result, effectively reduces the number of times of the execution repetitive operation of terminal handler, stablizes the performance of terminal handler, and effectively cuts down the consumption of energy.
Description of drawings
Fig. 1 is a detection method process flow diagram of determining alteration of shooting background in the embodiments of the invention;
Fig. 2 is the synoptic diagram of background identified areas in the embodiments of the invention;
Fig. 3 is a process flow diagram of determining the background identified areas in the embodiments of the invention;
Fig. 4 is the synoptic diagram of connected region in the embodiments of the invention;
Fig. 5 is a process flow diagram of determining marginal point in the embodiments of the invention;
Fig. 6 is the synoptic diagram of spectral window in the embodiments of the invention;
Fig. 7 determines the process flow diagram whether shooting background is changed in the embodiments of the invention;
Fig. 8 is the synoptic diagram in pixel region of variation shared zone on contrast images in the embodiments of the invention;
Fig. 9 is an intersection area synoptic diagram in the embodiments of the invention;
Figure 10 is the structural representation of image processing equipment in the embodiments of the invention;
Figure 11 is another structural representation of image processing equipment in the embodiments of the invention.
Embodiment
Prior art adopts direct technological means with reference background frame and the contrast of present frame do, and whether the background of coming the detected image collecting device to take changes, because this technological means is simple, therefore, the probability that testing result is made mistakes is bigger.
In the embodiments of the invention, whether changed for detecting captured background, not merely the reference background frame is compared with present frame, but determined background identified areas in the background reference image, based on this background identified areas and background reference image, determine whether background changes.
Below in conjunction with specific embodiment and accompanying drawing, the technical scheme of embodiments of the invention is elaborated.
Referring to Fig. 1, Fig. 1 is a detection method process flow diagram of determining alteration of shooting background in the embodiments of the invention, and this flow process can may further comprise the steps:
Step 101, determine the background identified areas in the background reference image; The imaging region of characteristic body in background reference image in this background identified areas identification sources background.
Specifically, in the embodiments of the invention, the neighborhood pixels point of comparing in the imaging region image appearance background reference image, the pixel that pixel value changes greatly surrounds regional image information, for example as, captured source background is a potted flower of putting before interior metope of certain space scope and the wall, on the background reference image, generally can there be sudden change in the compare pixel value of other area pixel points of the pixel value of the shade imaging edges of regions pixel of potted flower and potted flower, then potted flower and shade can be regarded the characteristic body on the background of source as, and the imaging region of potted flower and shade can be used as the background identified areas.
Can be referring to Fig. 2, Fig. 2 is the synoptic diagram of background identified areas in the embodiments of the invention.Among Fig. 2, the background identified areas comprises three sub regions, indicates with A, B, C respectively.
Step 102, utilize current frame image, obtain the contrast images of background reference image.
Step 103, with the image in the background identified areas in the background reference image, compare with image in the respective regions in the contrast images, obtain comparison result.
Step 104, according to comparison result, whether the shooting background that detects in the current frame image conforms to the source background, if conform to, then definite shooting background does not become; Otherwise, determine alteration of shooting background.
In the practical application,, then can provide the prompting that needs update background module as required if testing result is an alteration of shooting background.
Referring to Fig. 3, Fig. 3 is a process flow diagram of determining the background identified areas in the embodiments of the invention, and this flow process can may further comprise the steps:
Step 301, utilize edge detecting technology, determine that edge intensity value computing in the background reference image satisfies a plurality of pixels of preset requirement, claims that these a plurality of pixels are marginal point.
In the embodiments of the invention,, determine the background identified areas, so that be positioned at the image of background identified areas on the subsequent analysis different frame image by means of edge detecting technology.And edge detecting technology is generally used for extracting the edge of the portrait on image border such as the digital photo in the prior art, so that follow-uply be for further processing at the portrait that extracts.
In the embodiments of the invention, for determining marginal point, can adopt edge detecting technology to calculate the edge intensity value computing of each pixel on the background reference image, comprise: adopt boundary operator, extract the horizontal edge and the vertical edge of each pixel on the background reference image, the quadratic sum of calculated level edge and vertical edge, this quadratic sum can be used as the edge intensity value computing of this pixel; Wherein, boundary operator has a lot of definition modes, can adopt prewitt operator, Suo Beier (sobel) or Tuscany (canny) operator etc., and usually, the operand of prewitt operator is less relatively, and the operand of sobel and canny operator is relatively large.
And then, can select the marginal point that edge intensity value computing satisfies preset requirement based on the edge intensity value computing of each pixel of calculating.
Step 302, obtain all connected regions that marginal point can form.
Because marginal point disperses, therefore,, need to connect discrete marginal point, to sketch the contours of connected region one by one for finally determining the background identified areas.Particularly, in the embodiments of the invention, can adopt the connected domain analytical technology,, obtain connected region based on discrete marginal point.
Referring to Fig. 4, Fig. 4 is the synoptic diagram of connected region in the embodiments of the invention.Among Fig. 4, marginal point the connected region that can form comprise four, indicate by A, B, C and D respectively.
Step 303, from all connected regions, select the background identified areas.
In the embodiments of the invention, consider that the connected region of calculating based on marginal point may not all be imaging regions of characteristic body, and may produce because of the error of calculation.Therefore, in the embodiments of the invention, for reduce error as far as possible, not directly with all connected regions all as the background identified areas, but from a plurality of connected regions, select meet preset requirement as the background identified areas, concrete as, select the connected region of region area, as the background identified areas greater than predetermined threshold value T1.
As shown in Figure 4, in the embodiments of the invention, select the satisfactory A of area, B, three connected regions of C, promptly the A among Fig. 2, B, C three sub regions are used as effective background identified areas, and that area is not less D zone is as the background identified areas.
In the practical application, also can choose suitable connected region as the background identified areas according to actual conditions.
Enumerate the embodiment that determines marginal point in the above-mentioned steps 301 below.Referring to Fig. 5, Fig. 5 is a process flow diagram of determining marginal point in the embodiments of the invention, and this flow process can may further comprise the steps:
The edge intensity value computing of each pixel on step 501, the calculating background reference image, the data message that title comprises the edge intensity value computing of each pixel is the edge strength image.
Step 502, the default spectral window of utilization are done Filtering Processing to the edge intensity image, upgrade the edge intensity value computing of each pixel, obtain the updating edge intensity level of each pixel.
In the practical application, can select edge intensity value computing to be used as marginal point, surpass predetermined threshold value T2, then select corresponding pixel as marginal point as edge intensity value computing at the pixel of preset range.But the marginal point of selecting like this may not have representative preferably.
For making the marginal point of selecting more suitable, in the embodiments of the invention, the edge intensity image is made further Filtering Processing, to upgrade the edge intensity value computing of each pixel.In the embodiments of the invention, the concrete ordering wave filter (rank-filter) that adopts carries out Filtering Processing, specifically comprises:
Default spectral window, the big I of this spectral window is made as RW*RH;
If the center of each spectral window is each pixel, and can be referring to Fig. 6, Fig. 6 is the synoptic diagram of spectral window in the embodiments of the invention; Then can select the edge intensity value computing of specified pixel point in each spectral window for use, upgrade the edge intensity value computing of this spectral window central pixel point according to preset rules.Concrete rank-filter filtering can comprise:
The edge intensity value computing that comprises pixel in the spectral window is done ordering to be handled;
According to the value of the filtering parameter r of preliminary election, select the specified pixel point; Wherein, parameter r is provided with the embodiment preset rules, and its value can be located between 0 to 1, as gets r=0.8, represents that then selected edge intensity value computing is greater than 80% edge intensity value computing in the spectral window.For example as, the edge intensity value computing of five pixels is arranged in the spectral window, by ordering from big to small be: 1,1.1,2,4,4.3, if set r=0.8, then selecting edge intensity value computing is 4, as the updating edge intensity level of central pixel point.
Then adopt above-mentioned rank-filter filtering, upgrade the edge intensity value computing of each pixel.
Based on above-mentioned rank-filter Filtering Processing, can make the relatively convergence of degree of scatter of the pixel that the imaging region edge pixel value of characteristic body undergos mutation, so that follow-uply select the marginal point that concentrate relatively the position.In the practical application, also can adopt other filtering techniques to upgrade the edge intensity value computing of each pixel.
Step 503, based on the updating edge intensity level of each pixel, select the marginal point of updating edge intensity level in preset range.
In this step 503, preset range comprises: greater than the scope of predetermined threshold value T3.
Above-mentioned flow process shown in Figure 5 finishes, and Fig. 5 flow process has been enumerated the specific embodiment of choosing marginal point, in the practical application, also can adopt other modes to select and be used to define characteristic body imaging region and other regional marginal points.
Based on determined background identified areas, in the embodiments of the invention, whether the target background of further analyzing other two field pictures and being embodied conforms to the source background that background reference image is embodied.
Referring to Fig. 7, Fig. 7 determines the process flow diagram whether shooting background is changed in the embodiments of the invention, and this flow process can may further comprise the steps:
Step 701, utilize the image shoot, obtain be used for the background identified areas in source images make the contrast images of contrast, wherein, getting the image of shooting is that present image is adjacent two field picture.
In this step 701, particularly, can do calculus of differences, calculate the difference image of two two field pictures, this difference image is used as contrast images present image and consecutive frame image.Contrast images can embody the different formed pixel region of variation of all pixels of pixel value on two two field pictures.
The way of concrete calculus of differences can comprise: calculate the absolute value of the luminance component difference of corresponding pixel points in adjacent two two field pictures, keep the pixel that absolute value surpasses preset value; Or calculate the absolute value of difference of RGB (RGB) three colouring components of corresponding pixel points in adjacent two two field pictures, keep the pixel that absolute value surpasses preset value.In the practical application, also can adopt other modes to calculate contrast images.
Referring to Fig. 8, Fig. 8 is the synoptic diagram in pixel region of variation shared zone on contrast images in the embodiments of the invention.Among Fig. 8, the pixel region of variation is indicated by E.
Step 702, obtain on the contrast images intersection area of background identified areas on the pixel region of variation and background reference image.
In the practical application, the specific practice in the zone that seeks common ground can comprise:
In advance background reference image is done binary conversion treatment, the binary value of establishing background identified areas interior pixel point is " 1 ", and the binary value of the pixel in the non-background identified areas is " 0 ", obtains the binaryzation background reference image;
After obtaining contrast images, contrast images is done binary conversion treatment, the binary value of establishing pixel region of variation interior pixel point is " 1 ", the binary value of non-pixel region of variation interior pixel point is " 0 ", obtains the binaryzation contrast images;
Binaryzation contrast images and binaryzation background reference image are done logical operation; In the embodiments of the invention, according to the setting of above binary value, the algorithm of logical operation is specially AND operation;
Then calculate binary value and be above-mentioned common factor for the zone of " 1 ".
In the practical application, also the binary value of each pixel can be set as required, and corresponding logical operation algorithm is set, to calculate above-mentioned common factor.
Other it should be noted that, in the embodiments of the invention, the mode of the common factor by asking pixel region of variation and background identified areas realizes that the contrast of the image in the respective regions on background identified areas and the contrast images is handled, and it is comparatively convenient to calculate.In the practical application, also can directly the image in the respective regions on background identified areas and the contrast images be contrasted.
Referring to Fig. 9, Fig. 9 is an intersection area synoptic diagram in the embodiments of the invention.Among Fig. 9, the common factor of binaryzation contrast images and binaryzation background reference image comprises two zones, is indicated by ae, ce respectively.
Whether step 703, detection intersection area area occupied satisfy preset requirement, if satisfy, determine that then shooting background does not change execution in step 704; Otherwise, execution in step 705.
In the embodiments of the invention, set preset requirement comprises: the intersection area area is no more than predetermined threshold value T4 with the ratio of background identified areas area occupied.
Then with the ae that calculates and ce area occupied sum divided by background identified areas area occupied, the ratio of calculating is compared with T4, as if not surpassing, can determine that then shooting background does not change.
In the practical application, preset requirement also can be set be: directly with intersection area area and predetermined threshold value T5 relatively,, determine that then shooting background does not change if surpass T5.
Step 704, continuation monitoring next frame image return execution in step 701.
Step 705, utilize block-matching technique, comparison background reference image and present image, from present image find out with background reference image on the matching image that is complementary of source images, wherein source images comprises a plurality of to be matched, matching image comprises a plurality of match block.
In the practical application, can not satisfy preset requirement at the region area that above-mentioned steps 703 is judged common factor after, determine that directly the background of taking changes.But in the practical application, ae may appear and ce area sum is bigger, but real background and unchanged situation, closer as preceding scenery from camera, make that the Background region area that foreground picture covered is bigger, under this situation,, then may cause background not become but the erroneous judgement that is defined as changing if directly judge based on the region area that occurs simultaneously whether background changes.
In the embodiments of the invention,, propose further innovative approach as far as possible, promptly further utilize the optical flow analysis technology, analyze the intersection area area and be more greatly because shooting background changes or because the interference of foreground picture causes for reducing the erroneous judgement probability.
Source images is the imaging of background identified areas in the background reference image.In this step 705, particularly, can be based on default piece matching strategy, with background reference image to be matched and present image, be divided into the piece that a plurality of sizes are RWRH, based on existing block-matching technique, find out in the present image, with each to be matched match block that is complementary in the background reference image.Institute it should be noted that, in the embodiments of the invention, so-called coupling is not that the pixel value of each pixel in the expression match block is identical with the pixel value of each pixel in corresponding to be matched, and the compare pixel value of other pixels in the matching window of expression, the pixel value of each pixel and the pixel value of to be matched interior pixel point differ less in the match block.
Step 706, obtain in the source images displacement beacon information between the match block position corresponding in each to be matched position and matching image.
In this step 706, particularly, for each to be matched in the source images, can this to be matched position be starting point, the match block position of this to be matched correspondence is a terminal point in the matching image, draws displacement vector, and this displacement vector can be used for representing above-mentioned displacement beacon information.
Obtain in the source images each displacement vector of to be matched.
The displacement beacon information that step 707, basis are obtained determines whether shooting background changes, if become, returns execution in step 704; If change execution in step 708.
In this step 707, determine that specifically the operation whether shooting background changes can comprise:
For the sub regions in the background identified areas, find out this subregion intrinsic displacement size to be matched, and be convenient statement above predetermined threshold value T6, represent sub regions intrinsic displacement size to be matched with G above T6; If the number of G is more, meet preset requirement, the number of preset requirement such as G surpasses predetermined threshold value T7, and perhaps the ratio of to be matched total SM surpasses predetermined threshold value T8 in the number of G and this subregion; Can determine that then the image change in this subregion is bigger; Otherwise, if the number of G is less, surpass T7, or surpass T8 with the ratio of SM, can determine that then the image change in this subregion is less;
Further, statistical picture changes the number SN of subregion greatly, if SN is bigger, meet pre-conditionedly, surpass predetermined threshold value T9, or the ratio of the total SUM of subregion surpasses predetermined threshold value T10 in SN and the background identified areas as SN, and the variance of the horizontal component of the displacement vector of intra-zone is less than threshold value, and the variance of vertical component can determine then that less than threshold value the image in the background identified areas changes, and background changes in other words; Otherwise, if SN is less, surpass T9, or surpass T10 with the ratio of SUM, can determine that then background does not change.
Step 708, proposition information warning change with the caution shooting background.
In the practical application, can be arranged on draw information warning after, carry out the operation of update background module by the background model update functions, concrete background model is upgraded operation and can be realized based on the Density Estimator technology, does not give unnecessary details among the application.
In addition, in the practical application, also can directly a two field picture of shooting be used for contrast images, with the background reference image processing that compares, compare emphatically on the source images of background identified areas and the contrast images with respective regions that source images occupies in image, and determine according to comparison result whether shooting background has change.
Referring to Figure 10, Figure 10 is the structural representation of image processing equipment in the embodiments of the invention.Among Figure 10, equipment 1000 comprises:
Processing unit 1001 is used for determining the background identified areas of background reference image; The imaging region of characteristic body in described background reference image in the described background identified areas identification sources background;
Acquiring unit 1002 is used to utilize current frame image, obtains the contrast images of background reference image;
Compare of analysis unit 1003 is used for the image in the background reference image background identified areas, compares with image in the respective regions in the contrast images, obtains comparison result; According to described comparison result, whether the shooting background that detects in the current frame image conforms to described source background, if conform to, determines that then shooting background does not become; Otherwise, determine alteration of shooting background.
Referring to Figure 11, Figure 11 is another structural representation of image processing equipment in the embodiments of the invention.Among Figure 11, processing unit 1001 comprises:
Computing unit 1101 is used to utilize edge detecting technology, obtains a plurality of pixels that edge intensity value computing in the described background reference image satisfies preset requirement; Calculate all connected regions that described a plurality of pixel can form;
Selected cell 1102 is used for selecting described background identified areas from all connected regions.
Acquiring unit 1002 comprises:
Choose unit 1103, be used for selecting the consecutive frame image of current frame image and this current frame image from the image of shooting;
Calculus of differences unit 1104, be used for described current frame image and described consecutive frame image are done calculus of differences, calculate the difference image that is used as described contrast images, described difference image comprises by described current frame image all pixels formed pixel region of variation different with pixel value on the described consecutive frame image.
Compare of analysis unit 1003 comprises:
Common factor computing unit 1105 is used for calculating described background identified areas in the shared zone of described background reference image, with the intersection area in described pixel region of variation shared zone in described contrast images;
Detecting unit 1106 is used to detect described intersection area area occupied and whether satisfies preset requirement, and described preset requirement comprises: the ratio between described intersection area area occupied and the described background identified areas area occupied is no more than default the 3rd threshold value,
Whether analysis and processing unit 1107 is used for the comparison result that obtains according to detecting unit, analyze described shooting background and change.
Analysis and processing unit 1107 can comprise (not shown among Figure 11):
Matching unit, be used for according to described comparison result be: described ratio surpasses described the 3rd threshold value, utilize block-matching technique, compare described background reference image and described current frame image, from described current frame image find out with described background identified areas in the matching image that is complementary of image, image in the wherein said background identified areas comprises a plurality of to be matched, and described matching image comprises a plurality of match block;
The displacement computing unit is used for obtaining the displacement beacon information between the match block position corresponding in each to be matched position of image and the described matching image in the described background identified areas;
Statistical analysis unit, be used for according to described displacement beacon information, add up in the described matching image, to be matched position of the correspondence of comparing, offset deviation surpasses the number of all match block of default the 4th threshold value, if the number of described all match block surpasses default the 5th threshold value, determine that then the shooting background in the current frame image does not conform to described source background.
The above only is a preferred implementation of the present invention; should be pointed out that for those skilled in the art, under the prerequisite that does not break away from the principle of the invention; can also make some improvements and modifications, these improvements and modifications also should be considered as protection scope of the present invention.

Claims (14)

1, a kind of detection method of definite alteration of shooting background is characterized in that, comprising:
Determine the background identified areas in the background reference image; The imaging region of characteristic body in described background reference image in the described background identified areas identification sources background;
Utilize current frame image, obtain the contrast images of described background reference image;
With the image in the background identified areas in the described background reference image, compare with image in the respective regions in the described contrast images, obtain comparison result;
According to described comparison result, whether the shooting background that detects in the current frame image conforms to described source background, if conform to, determines that then shooting background does not become; Otherwise, determine alteration of shooting background.
2, method according to claim 1 is characterized in that, the background identified areas in described definite background reference image comprises:
Utilize edge detecting technology, obtain a plurality of pixels that edge intensity value computing in the described background reference image satisfies preset requirement;
Calculate all connected regions that described a plurality of pixel can form;
From all connected regions, select described background identified areas.
3, method according to claim 2 is characterized in that, the described edge detecting technology of utilizing is extracted edge intensity value computing and satisfied pre-conditioned a plurality of pixels and comprise from described background reference image:
Calculate the edge intensity value computing of each pixel on the described background reference image;
Edge intensity value computing to described each pixel is made Filtering Processing, obtains the updating edge intensity level of each pixel;
Select the pixel of updating edge intensity level, as described a plurality of pixels greater than preset first threshold value.
4, method according to claim 3 is characterized in that, described edge intensity value computing to described each pixel is made Filtering Processing, and the updating edge intensity level that obtains each pixel comprises:
According to preset rules, the edge intensity value computing of choosing specified pixel point in the default spectral window is upgraded the edge intensity value computing of described pixel, obtains described updating edge intensity level;
Described spectral window is the center with described pixel and has default size.
5, method according to claim 2 is characterized in that, describedly selects described background identified areas comprise from all connected regions:
Select the connected region of area, as described background identified areas greater than default second threshold value.
6, method according to claim 1 is characterized in that, the described current frame image that utilizes, and the contrast images of obtaining described background reference image comprises:
Consecutive frame image to described current frame image and this current frame image is done calculus of differences, obtains difference image; Described difference image comprises by described current frame image all pixels formed pixel region of variation different with pixel value on the described consecutive frame image;
Described difference image is used as described contrast images.
7, method according to claim 6 is characterized in that, and is described with the image in the background identified areas in the described background reference image, and comparing with image in the respective regions in described contrast images comprises:
Calculate described background identified areas shared zone in described background reference image, with the intersection area in described pixel region of variation shared zone in described contrast images;
Detect described intersection area area occupied and whether satisfy preset requirement, described preset requirement comprises: the ratio between described intersection area area occupied and the described background identified areas area occupied is no more than default the 3rd threshold value.
8, method according to claim 7 is characterized in that,
The described comparison result that draws comprises: described ratio is no more than described the 3rd threshold value;
Described according to described comparison result, whether the shooting background in the detection current frame image conforms to described source background and comprises: detect described shooting background and conform to described source background; Or,
The described comparison result that draws comprises: described ratio surpasses described the 3rd threshold value;
Described according to described comparison result, whether the shooting background in the detection current frame image conforms to described source background and comprises: detect described shooting background and do not conform to described source background.
9, method according to claim 7 is characterized in that, and is described according to described comparison result, and whether the shooting background in the detection current frame image conforms to described source background and comprise:
If described comparison result is: described ratio surpasses described the 3rd threshold value, then utilize block-matching technique, compare described background reference image and described current frame image, from described current frame image find out with described background identified areas in the matching image that is complementary of image, image in the wherein said background identified areas comprises a plurality of to be matched, and described matching image comprises a plurality of match block;
Obtain in the image in the described background identified areas displacement beacon information between the match block position corresponding in each to be matched position and described matching image;
According to described displacement beacon information, add up in the described matching image, to be matched position of the correspondence of comparing, offset deviation surpasses the number of all match block of default the 4th threshold value, if the number of described all match block surpasses default the 5th threshold value, determine that then the shooting background in the current frame image does not conform to described source background.
10, a kind of image processing equipment is characterized in that, comprising:
Processing unit is used for determining the background identified areas of background reference image; The imaging region of characteristic body in described background reference image in the described background identified areas identification sources background;
Acquiring unit is used to utilize current frame image, obtains the contrast images of described background reference image;
The compare of analysis unit is used for the image in the described background reference image background identified areas, compares with image in the respective regions in the described contrast images, obtains comparison result; According to described comparison result, whether the shooting background that detects in the current frame image conforms to described source background, if conform to, determines that then shooting background does not become; Otherwise, determine alteration of shooting background.
11, equipment according to claim 10 is characterized in that, described processing unit comprises:
Computing unit is used to utilize edge detecting technology, obtains a plurality of pixels that edge intensity value computing in the described background reference image satisfies preset requirement; Calculate all connected regions that described a plurality of pixel can form;
Selected cell is used for selecting described background identified areas from all connected regions.
12, equipment according to claim 10 is characterized in that, described acquiring unit comprises:
Choose the unit, be used for selecting the consecutive frame image of current frame image and this current frame image from the image of shooting;
The calculus of differences unit, be used for described current frame image and described consecutive frame image are done calculus of differences, calculate the difference image that is used as described contrast images, described difference image comprises by described current frame image all pixels formed pixel region of variation different with pixel value on the described consecutive frame image.
13, equipment according to claim 12 is characterized in that, described compare of analysis unit comprises:
The common factor computing unit is used for calculating described background identified areas in the shared zone of described background reference image, with the intersection area in described pixel region of variation shared zone in described contrast images;
Detecting unit is used to detect described intersection area area occupied and whether satisfies preset requirement, and described preset requirement comprises: the ratio between described intersection area area occupied and the described background identified areas area occupied is no more than default the 3rd threshold value,
Whether analysis and processing unit is used for the comparison result that obtains according to detecting unit, analyze described shooting background and change.
14, equipment according to claim 13 is characterized in that, described analysis and processing unit comprises:
Matching unit, be used for according to described comparison result be: described ratio surpasses described the 3rd threshold value, utilize block-matching technique, compare described background reference image and described current frame image, from described current frame image find out with described background identified areas in the matching image that is complementary of image, image in the wherein said background identified areas comprises a plurality of to be matched, and described matching image comprises a plurality of match block;
The displacement computing unit is used for obtaining the displacement beacon information between the match block position corresponding in each to be matched position of image and the described matching image in the described background identified areas;
Statistical analysis unit, be used for according to described displacement beacon information, add up in the described matching image, to be matched position of the correspondence of comparing, offset deviation surpasses the number of all match block of default the 4th threshold value, if the number of described all match block surpasses default the 5th threshold value, determine that then the shooting background in the current frame image does not conform to described source background.
CN200910086964.1A 2009-06-11 2009-06-11 Detection method for determining alteration of shooting background and image processing device Active CN101599175B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN200910086964.1A CN101599175B (en) 2009-06-11 2009-06-11 Detection method for determining alteration of shooting background and image processing device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN200910086964.1A CN101599175B (en) 2009-06-11 2009-06-11 Detection method for determining alteration of shooting background and image processing device

Publications (2)

Publication Number Publication Date
CN101599175A true CN101599175A (en) 2009-12-09
CN101599175B CN101599175B (en) 2014-04-23

Family

ID=41420608

Family Applications (1)

Application Number Title Priority Date Filing Date
CN200910086964.1A Active CN101599175B (en) 2009-06-11 2009-06-11 Detection method for determining alteration of shooting background and image processing device

Country Status (1)

Country Link
CN (1) CN101599175B (en)

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102254396A (en) * 2011-07-06 2011-11-23 北京国铁华晨通信信息技术有限公司 Intrusion detection method and device based on video
CN103090796A (en) * 2011-11-01 2013-05-08 北京航天发射技术研究所 Measuring system and measuring method for deflection and descending of rocket
CN103327249A (en) * 2013-06-19 2013-09-25 北京小米科技有限责任公司 Method, device and equipment for photographing
CN104475344A (en) * 2014-11-04 2015-04-01 上海维宏电子科技股份有限公司 Method for realizing sorting of textile bobbins based on machine vision
CN104657997A (en) * 2015-02-28 2015-05-27 北京格灵深瞳信息技术有限公司 Lens shifting detection methods and devices
CN104751444A (en) * 2014-12-24 2015-07-01 张�林 Method and device for screening significant differences from similar images
CN107404419A (en) * 2017-08-01 2017-11-28 南京华苏科技有限公司 Based on the anti-false survey method and device of the network covering property of picture or video test
CN107784844A (en) * 2016-08-31 2018-03-09 百度在线网络技术(北京)有限公司 Intelligent traffic lamp system and its road environment detection method
CN107992198A (en) * 2013-02-06 2018-05-04 原相科技股份有限公司 Optical profile type pointing system
CN110674676A (en) * 2019-08-02 2020-01-10 杭州电子科技大学 Road confidence estimation fuzzy frame method based on semantic segmentation
CN111783771A (en) * 2020-06-12 2020-10-16 北京达佳互联信息技术有限公司 Character detection method and device, electronic equipment and storage medium
CN112070113A (en) * 2020-07-28 2020-12-11 北京旷视科技有限公司 Camera scene change judgment method and device, electronic equipment and readable storage medium
CN113344496A (en) * 2021-06-16 2021-09-03 国家珠宝检测中心(广东)有限责任公司 Method and system for multi-strategy jewelry identification
CN113936242A (en) * 2021-12-14 2022-01-14 苏州浪潮智能科技有限公司 Video image interference detection method, system, device and medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040233283A1 (en) * 2003-05-19 2004-11-25 Goo-Ho Kang Apparatus and method of detecting change in background area in video images
US20050078853A1 (en) * 2003-10-10 2005-04-14 Buehler Christopher J. System and method for searching for changes in surveillance video
CN1976394A (en) * 2006-12-07 2007-06-06 浙江大学 Scene change real-time detecting method based on compression field
CN101196996A (en) * 2007-12-29 2008-06-11 北京中星微电子有限公司 Image detection method and device
CN101369346A (en) * 2007-08-13 2009-02-18 北京航空航天大学 Tracing method for video movement objective self-adapting window

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040233283A1 (en) * 2003-05-19 2004-11-25 Goo-Ho Kang Apparatus and method of detecting change in background area in video images
US20050078853A1 (en) * 2003-10-10 2005-04-14 Buehler Christopher J. System and method for searching for changes in surveillance video
CN1976394A (en) * 2006-12-07 2007-06-06 浙江大学 Scene change real-time detecting method based on compression field
CN101369346A (en) * 2007-08-13 2009-02-18 北京航空航天大学 Tracing method for video movement objective self-adapting window
CN101196996A (en) * 2007-12-29 2008-06-11 北京中星微电子有限公司 Image detection method and device

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
王文波等: "基于小波包的图像拼接算法", 《激光与红外》 *

Cited By (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102254396A (en) * 2011-07-06 2011-11-23 北京国铁华晨通信信息技术有限公司 Intrusion detection method and device based on video
CN103090796B (en) * 2011-11-01 2017-03-15 北京航天发射技术研究所 Rocket beat, the measuring system of sedimentation and method
CN103090796A (en) * 2011-11-01 2013-05-08 北京航天发射技术研究所 Measuring system and measuring method for deflection and descending of rocket
CN107992198B (en) * 2013-02-06 2021-01-05 原相科技股份有限公司 Optical pointing system
CN107992198A (en) * 2013-02-06 2018-05-04 原相科技股份有限公司 Optical profile type pointing system
CN103327249A (en) * 2013-06-19 2013-09-25 北京小米科技有限责任公司 Method, device and equipment for photographing
CN103327249B (en) * 2013-06-19 2016-12-28 小米科技有限责任公司 Photographic method, device and equipment
CN104475344A (en) * 2014-11-04 2015-04-01 上海维宏电子科技股份有限公司 Method for realizing sorting of textile bobbins based on machine vision
CN104751444A (en) * 2014-12-24 2015-07-01 张�林 Method and device for screening significant differences from similar images
CN104657997B (en) * 2015-02-28 2018-01-09 北京格灵深瞳信息技术有限公司 A kind of lens shift detection method and device
CN104657997A (en) * 2015-02-28 2015-05-27 北京格灵深瞳信息技术有限公司 Lens shifting detection methods and devices
CN107784844A (en) * 2016-08-31 2018-03-09 百度在线网络技术(北京)有限公司 Intelligent traffic lamp system and its road environment detection method
CN107784844B (en) * 2016-08-31 2021-05-14 百度在线网络技术(北京)有限公司 Intelligent traffic signal lamp system and road environment detection method thereof
CN107404419A (en) * 2017-08-01 2017-11-28 南京华苏科技有限公司 Based on the anti-false survey method and device of the network covering property of picture or video test
CN110674676A (en) * 2019-08-02 2020-01-10 杭州电子科技大学 Road confidence estimation fuzzy frame method based on semantic segmentation
CN110674676B (en) * 2019-08-02 2022-03-29 杭州电子科技大学 Road confidence estimation fuzzy frame method based on semantic segmentation
CN111783771A (en) * 2020-06-12 2020-10-16 北京达佳互联信息技术有限公司 Character detection method and device, electronic equipment and storage medium
CN111783771B (en) * 2020-06-12 2024-03-19 北京达佳互联信息技术有限公司 Text detection method, text detection device, electronic equipment and storage medium
CN112070113A (en) * 2020-07-28 2020-12-11 北京旷视科技有限公司 Camera scene change judgment method and device, electronic equipment and readable storage medium
CN112070113B (en) * 2020-07-28 2024-03-26 北京旷视科技有限公司 Imaging scene change judging method and device, electronic equipment and readable storage medium
CN113344496A (en) * 2021-06-16 2021-09-03 国家珠宝检测中心(广东)有限责任公司 Method and system for multi-strategy jewelry identification
CN113936242A (en) * 2021-12-14 2022-01-14 苏州浪潮智能科技有限公司 Video image interference detection method, system, device and medium
CN113936242B (en) * 2021-12-14 2022-03-11 苏州浪潮智能科技有限公司 Video image interference detection method, system, device and medium
WO2023109016A1 (en) * 2021-12-14 2023-06-22 苏州浪潮智能科技有限公司 Video image interference detection method and system, and device and medium

Also Published As

Publication number Publication date
CN101599175B (en) 2014-04-23

Similar Documents

Publication Publication Date Title
CN101599175B (en) Detection method for determining alteration of shooting background and image processing device
KR101683704B1 (en) Face calibration method and system, and computer storage medium
US8712149B2 (en) Apparatus and method for foreground detection
CN101794406B (en) Automatic counting system for density of Bemisia tabaci adults
CN107506760A (en) Traffic signals detection method and system based on GPS location and visual pattern processing
JP2007235950A (en) Method and device for detecting vehicle position
CN103235938A (en) Method and system for detecting and identifying license plate
WO2007061779A1 (en) Shadow detection in images
CN107635099B (en) Human body induction double-optical network camera and security monitoring system
RU2395787C2 (en) Method of detecting objects
CN106604005A (en) Automatic projection TV focusing method and system
US20170116750A1 (en) Device and Method for Camera Driven Background Subtraction
CN109378279A (en) Wafer detection method and wafer detection system
CN104778723A (en) Method for performing motion detection on infrared image with three-frame difference method
CN113989771A (en) Traffic signal lamp identification method based on digital image processing
CN106530292B (en) A kind of steel strip surface defect image Fast Identification Method based on line scan camera
JP3860540B2 (en) Entropy filter and region extraction method using the filter
KR101381580B1 (en) Method and system for detecting position of vehicle in image of influenced various illumination environment
RU2329535C2 (en) Method of automatic photograph framing
JP2000030033A (en) Person detecting method
JP2004208209A (en) Device and method for monitoring moving body
JP7194534B2 (en) Object detection device, image processing device, object detection method, image processing method, and program
Lo et al. Shadow detection by integrating multiple features
JP2001126192A (en) Method for judging parked or vacancy state in parking space of parking lot
CN117456371B (en) Group string hot spot detection method, device, equipment and medium

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20171219

Address after: 519031 Guangdong city of Zhuhai province Hengqin Baohua Road No. 6, room 105, -23898 (central office)

Patentee after: Zhongxing Technology Co., Ltd.

Address before: 100083, Haidian District, Xueyuan Road, Beijing No. 35, Nanjing Ning building, 15 Floor

Patentee before: Beijing Vimicro Corporation

CP01 Change in the name or title of a patent holder
CP01 Change in the name or title of a patent holder

Address after: 519031 -23898, 105 room 6, Baohua Road, Hengqin New District, Zhuhai, Guangdong (centralized office area)

Patentee after: Mid Star Technology Limited by Share Ltd

Address before: 519031 -23898, 105 room 6, Baohua Road, Hengqin New District, Zhuhai, Guangdong (centralized office area)

Patentee before: Zhongxing Technology Co., Ltd.