CN105957101A - Device for remotely acquiring useful monitoring information - Google Patents

Device for remotely acquiring useful monitoring information Download PDF

Info

Publication number
CN105957101A
CN105957101A CN201610237899.8A CN201610237899A CN105957101A CN 105957101 A CN105957101 A CN 105957101A CN 201610237899 A CN201610237899 A CN 201610237899A CN 105957101 A CN105957101 A CN 105957101A
Authority
CN
China
Prior art keywords
module
background
video image
image
sequence information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201610237899.8A
Other languages
Chinese (zh)
Inventor
张志华
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to CN201610237899.8A priority Critical patent/CN105957101A/en
Publication of CN105957101A publication Critical patent/CN105957101A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10016Video; Image sequence
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20024Filtering details

Abstract

The invention provides a device for remotely acquiring useful monitoring information. The device comprises a remote transmission device and a video monitoring device, wherein the video monitoring device comprises the components of (1), an image acquisition module which is used for acquiring a video monitoring image; (2), an image preprocessing module which is used for performing moving object preliminary detection on original video image sequence information and outputting effective video image sequence information that comprises a moving object; (3), a filtering module which is used for receiving the effective video image sequence information and filtering the background shape of the effective video image sequence information; (4), a background modeling module which is used for establishing a background model after filtering, wherein the background module is composed of N shape context histograms which comprise weights and represent edge points; (5), a background subtraction module which is used for performing attribute classifying on the edge points on the current image frame and subtracting the edge points that belong to the background; and (6), a characteristic matching module. The device can maximally reduce moving object error detection caused by background noise and camera jitter, and furthermore has high real-time performance.

Description

A kind of remotely useful monitoring massaging device of acquisition
Technical field
The present invention relates to field of intelligent monitoring, be specifically related to a kind of remotely useful monitoring massaging device of acquisition.
Background technology
Video monitoring apparatus in correlation technique, there is problems in that (1) in video monitoring image series due to background The existence of noise and be moving target by background flase drop;(2) during video monitoring, there is slight jitter, can be by background flase drop For moving target;(3) during the detection to moving target, exist computationally intensive, the problem of poor real and can not be timely Moving target detected.
Summary of the invention
For the problems referred to above, the present invention provides a kind of and remotely obtains useful monitoring massaging device, the video prison in this device Control device can farthest reduce the flase drop to moving target caused due to background noise and DE Camera Shake, and real-time Good.
The purpose of the present invention realizes by the following technical solutions:
Provide a kind of remotely useful monitoring massaging device of acquisition, including remote transmitting device and video monitoring apparatus, its In, video monitoring apparatus includes:
(1) image capture module, is used for gathering video monitoring image, and it is connected to video monitoring equipment and gathers therein Original video image sequence information;
(2) image just processing module, is connected with image capture module, for carrying out described original video image sequence information The Preliminary detection of moving target processes and exports the effective video image sequence information including moving target;
(3) filtration module, is connected with image just processing module, is used for receiving described effective video image sequence information right The background shape of effective video image sequence information is filtered processing, at the beginning of carrying out described background shape including using wiener ripple The first-level filtering of secondary filtering is except submodule and uses again be filtered first filtered background shape two grades of gaussian filtering Filter submodule;
(4) background modeling module, is connected with filtration module, is used for setting up filtered background model, described background model Set by N number of Weight represent marginal point Shape context rectangular histogram form, background model up contour point in shape under Literary composition histogram table is shown as:
{ w n , x h → n , x , n ∈ 1 , ... N , w n , x = ( B θ + n ) × ( B l + n ) B θ × B l Σ n = 1 N [ ( B θ + n ) × ( B l + n ) B θ × B l ] }
Wherein, x is background edge point coordinates, and N represents the histogrammic number of comprised Shape context, the value model of N Enclose for [5,10], wn,xRepresent the weight that the n-th Shape context rectangular histogram is corresponding, BlRepresent and sit for pole with background edge point x The mark center of circle, radius are the circle concentric circular number according to logarithm distance foundation of R, BθRepresent and angle of circumference division is waited number;
(5) background subtraction module, is connected with background modeling module, for the marginal point on current frame image is carried out attribute Classify and cut down the marginal point belonging to background, judging son including matching degree calculating sub module, constraints calculating sub module, attribute Module and abatement submodule, described matching degree calculating sub module, constraints calculating sub module are all connected to described attribute and judge Submodule, described attribute decision sub-module is connected to described abatement submodule, wherein:
A, matching degree calculating sub module, for calculating the Shape context rectangular histogram of current frame image up contour point with described Matching degree between the Shape context rectangular histogram of corresponding marginal point in background model, the computing formula of described matching degree is:
In formula,The Shape context rectangular histogram of the marginal point x on expression current frame image,Represent the back of the body The Shape context rectangular histogram of corresponding marginal point x on scape model, n=1 ... N;Represent marginal point x's Neighborhood,It is used for weighing the histogrammic difference of Shape context of two edges point,The least, show that the Shape context histogram difference of two edges point is the least;
B, constraints calculating sub module, for calculating Shape context rectangular histogram and the institute of current frame image up contour point Stating the constraints between the histogrammic difference of Shape context corresponding in background model, constraints formula is:
C, attribute decision sub-module, described attribute decision sub-module is for judging the genus of the marginal point on current frame image Property, the marginal point on described current frame image is that the decision condition of the marginal point belonging to background is:
And
Wherein, TPFor the matching degree threshold value set according to background model, TYFor the constraints threshold set according to background model Value;
D, abatement submodule, be judged to belong to the marginal point of background by attribute decision sub-module and output belongs to for rejecting The area image of moving target;
(6) characteristic matching module, is connected with abatement submodule, for by the described area image belonging to moving target and number Characteristic matching is carried out according to solid plate pre-in storehouse.
Preferably, described image just processing module includes:
A, reference effective degree set submodule, for the effective degree reference threshold of the storage video image sample containing moving target Value, described effective degree represents for judging in original video image sequence information that m frame video image is whether as described effective video The judgement factor of image, described effective degree reference threshold includes rate of change of brightness reference threshold and target size reference threshold;
B, actually active degree calculating sub module, for calculating having of m frame video image in original video image sequence information Validity, the computing formula of effective degree is:
V = L m × ( M - m v M ) × | d - d p | d p
Wherein, V represents effective degree, LmBeing the rate of change of brightness of m frame video image, M represents that original video image sequence is believed Video image totalframes included in breath, m=1 ... M, mvFor rate of change of brightness in original video image sequence information more than bright The totalframes of the video image of degree rate of change reference threshold, d is the target size of m frame video image, dpJoin for target size Examine threshold value;
C, output sub-module, belong to the image information of effective video image sequence, when described current frame image for output Effective degree more than described effective degree reference threshold time, described output sub-module export described current frame image.
The invention have the benefit that
1, image just processing module is set, for described original video image sequence information carries out the preliminary inspection of moving target Survey processes and exports the effective video image sequence information including moving target, it is possible to be greatly saved memory space, improves inspection The speed surveyed;
2, filtration module is set, is filtered local shape processing, it is possible to effectively filter out environment noise, it is to avoid will make an uproar Sound flase drop is moving target;
3, background modeling module is set, uses weighting Shape context rectangular histogram to enter by the filtered background of filtration module Row modeling, farthest decreases the flase drop to moving target caused due to background noise and DE Camera Shake;
4, in modeling process, only the Shape context rectangular histogram of marginal point is calculated, be greatly saved storage sky Between, improve arithmetic speed, the real-time of system is strengthened;
5, background subtraction module is set, introduces matching degree and background is cut down by matching constraint condition, it is possible to be quickly accurate True registrates moving target, completes detection.
Accompanying drawing explanation
The invention will be further described to utilize accompanying drawing, but the embodiment in accompanying drawing does not constitute any limit to the present invention System, for those of ordinary skill in the art, on the premise of not paying creative work, it is also possible to obtain according to the following drawings Other accompanying drawing.
Fig. 1 is the connection diagram of each module of the present invention.
Detailed description of the invention
The invention will be further described with the following Examples.
Embodiment 1
Seeing Fig. 1, the useful monitoring massaging device that remotely obtains of the present embodiment includes remote transmitting device and video monitoring Device, wherein, video monitoring apparatus includes:
(1) image capture module, is used for gathering video monitoring image, and it is connected to video monitoring equipment and gathers therein Original video image sequence information;
(2) image just processing module, is connected with image capture module, for carrying out described original video image sequence information The Preliminary detection of moving target processes and exports to be located at the beginning of the effective video image sequence information including moving target, described image Reason module includes:
A, reference effective degree set submodule, for the effective degree reference threshold of the storage video image sample containing moving target Value, described effective degree represents for judging in original video image sequence information that m frame video image is whether as described effective video The judgement factor of image, described effective degree reference threshold includes rate of change of brightness reference threshold and target size reference threshold;
B, actually active degree calculating sub module, for calculating having of m frame video image in original video image sequence information Validity, the computing formula of effective degree is:
V = L m × ( M - m v M ) × | d - d p | d p
Wherein, V represents effective degree, LmBeing the rate of change of brightness of m frame video image, M represents that original video image sequence is believed Video image totalframes included in breath, m=1 ... M, mvFor rate of change of brightness in original video image sequence information more than bright The totalframes of the video image of degree rate of change reference threshold, d is the target size of m frame video image, dpJoin for target size Examine threshold value;
C, output sub-module, belong to the image information of effective video image sequence, when described current frame image for output Effective degree more than described effective degree reference threshold time, described output sub-module export described current frame image;
(3) filtration module, is connected with image just processing module, is used for receiving described effective video image sequence information right The background shape of effective video image sequence information is filtered processing, at the beginning of carrying out described background shape including using wiener ripple The first-level filtering of secondary filtering is except submodule and uses again be filtered first filtered background shape two grades of gaussian filtering Filter submodule;
(4) background modeling module, is connected with filtration module, is used for setting up filtered background model, described background model Set by N number of Weight represent marginal point Shape context rectangular histogram form, background model up contour point in shape under Literary composition histogram table is shown as:
{ w n , x h → n , x , n ∈ 1 , ... N , w n , x = ( B θ + n ) × ( B l + n ) B θ × B l Σ n = 1 N [ ( B θ + n ) × ( B l + n ) B θ × B l ] }
Wherein, x is background edge point coordinates, and N represents the histogrammic number of comprised Shape context, the value model of N Enclose for [5,10], wn,xRepresent the weight that the n-th Shape context rectangular histogram is corresponding, BlRepresent and sit for pole with background edge point x The mark center of circle, radius are the circle concentric circular number according to logarithm distance foundation of R, BθRepresent and angle of circumference division is waited number;
(5) background subtraction module, is connected with background modeling module, for the marginal point on current frame image is carried out attribute Classify and cut down the marginal point belonging to background, judging son including matching degree calculating sub module, constraints calculating sub module, attribute Module and abatement submodule, described matching degree calculating sub module, constraints calculating sub module are all connected to described attribute and judge Submodule, described attribute decision sub-module is connected to described abatement submodule, wherein:
A, matching degree calculating sub module, for calculating the Shape context rectangular histogram of current frame image up contour point with described Matching degree between the Shape context rectangular histogram of corresponding marginal point in background model, the computing formula of described matching degree is:
In formula,The Shape context rectangular histogram of the marginal point x on expression current frame image,Represent the back of the body The Shape context rectangular histogram of corresponding marginal point x on scape model, n=1 ... N;Represent marginal point x's Neighborhood,It is used for weighing the histogrammic difference of Shape context of two edges point,The least, show that the Shape context histogram difference of two edges point is the least;
B, constraints calculating sub module, for calculating Shape context rectangular histogram and the institute of current frame image up contour point Stating the constraints between the histogrammic difference of Shape context corresponding in background model, constraints formula is:
C, attribute decision sub-module, described attribute decision sub-module is for judging the genus of the marginal point on current frame image Property, the marginal point on described current frame image is that the decision condition of the marginal point belonging to background is:
And
Wherein, TPFor the matching degree threshold value set according to background model, TYFor the constraints threshold set according to background model Value;
D, abatement submodule, be judged to belong to the marginal point of background by attribute decision sub-module and output belongs to for rejecting The area image of moving target;
(6) characteristic matching module, is connected with abatement submodule, for by the described area image belonging to moving target and number Characteristic matching is carried out according to solid plate pre-in storehouse.
The present embodiment arranges image just processing module, for described original video image sequence information is carried out moving target Preliminary detection processes and exports the effective video image sequence information including moving target, it is possible to be greatly saved memory space, Improve the speed of detection;Filtration module is set, is filtered local shape processing, it is possible to effectively filter out environment noise, keep away Exempting from noise flase drop is moving target;Background modeling module is set, uses weighting Shape context rectangular histogram to by filtration module Filtered background is modeled, farthest decrease due to background noise and DE Camera Shake cause to moving target Flase drop;In modeling process, only the Shape context rectangular histogram of marginal point is calculated, is greatly saved memory space, Improve arithmetic speed, the real-time of system is strengthened;Background subtraction module is set, introduces matching degree and matching constraint condition Background is cut down, it is possible to fast and accurately moving target is registrated, complete detection;Wherein, N value is the biggest to background It is the strongest that dynamic adapts to ability, but can take and store resource more, increases amount of calculation, and real-time also can be deteriorated, the present embodiment Value N=5, compared with the video monitoring apparatus in relative skill, false drop rate reduces 1%, and arithmetic speed improves 5%.
Embodiment 2
Seeing Fig. 1, the useful monitoring massaging device that remotely obtains of the present embodiment includes remote transmitting device and video monitoring Device, wherein, video monitoring apparatus includes:
(1) image capture module, is used for gathering video monitoring image, and it is connected to video monitoring equipment and gathers therein Original video image sequence information;
(2) image just processing module, is connected with image capture module, for carrying out described original video image sequence information The Preliminary detection of moving target processes and exports to be located at the beginning of the effective video image sequence information including moving target, described image Reason module includes:
A, reference effective degree set submodule, for the effective degree reference threshold of the storage video image sample containing moving target Value, described effective degree represents for judging in original video image sequence information that m frame video image is whether as described effective video The judgement factor of image, described effective degree reference threshold includes rate of change of brightness reference threshold and target size reference threshold;
B, actually active degree calculating sub module, for calculating having of m frame video image in original video image sequence information Validity, the computing formula of effective degree is:
V = L m × ( M - m v M ) × | d - d p | d p
Wherein, V represents effective degree, LmBeing the rate of change of brightness of m frame video image, M represents that original video image sequence is believed Video image totalframes included in breath, m=1 ... M, mvFor rate of change of brightness in original video image sequence information more than bright The totalframes of the video image of degree rate of change reference threshold, d is the target size of m frame video image, dpJoin for target size Examine threshold value;
C, output sub-module, belong to the image information of effective video image sequence, when described current frame image for output Effective degree more than described effective degree reference threshold time, described output sub-module export described current frame image;
(3) filtration module, is connected with image just processing module, is used for receiving described effective video image sequence information right The background shape of effective video image sequence information is filtered processing, at the beginning of carrying out described background shape including using wiener ripple The first-level filtering of secondary filtering is except submodule and uses again be filtered first filtered background shape two grades of gaussian filtering Filter submodule;
(4) background modeling module, is connected with filtration module, is used for setting up filtered background model, described background model Set by N number of Weight represent marginal point Shape context rectangular histogram form, background model up contour point in shape under Literary composition histogram table is shown as:
{ w n , x h → n , x , n ∈ 1 , ... N , w n , x = ( B θ + n ) × ( B l + n ) B θ × B l Σ n = 1 N [ ( B θ + n ) × ( B l + n ) B θ × B l ] }
Wherein, x is background edge point coordinates, and N represents the histogrammic number of comprised Shape context, the value model of N Enclose for [5,10], wn,xRepresent the weight that the n-th Shape context rectangular histogram is corresponding, BlRepresent and sit for pole with background edge point x The mark center of circle, radius are the circle concentric circular number according to logarithm distance foundation of R, BθRepresent and angle of circumference division is waited number;
(5) background subtraction module, is connected with background modeling module, for the marginal point on current frame image is carried out attribute Classify and cut down the marginal point belonging to background, judging son including matching degree calculating sub module, constraints calculating sub module, attribute Module and abatement submodule, described matching degree calculating sub module, constraints calculating sub module are all connected to described attribute and judge Submodule, described attribute decision sub-module is connected to described abatement submodule, wherein:
A, matching degree calculating sub module, for calculating the Shape context rectangular histogram of current frame image up contour point with described Matching degree between the Shape context rectangular histogram of corresponding marginal point in background model, the computing formula of described matching degree is:
In formula,The Shape context rectangular histogram of the marginal point x on expression current frame image,Represent The Shape context rectangular histogram of corresponding marginal point x in background model, n=1 ... N;Represent marginal point x's Neighborhood,It is used for weighing the histogrammic difference of Shape context of two edges point,The least, show that the Shape context histogram difference of two edges point is the least;
B, constraints calculating sub module, for calculating Shape context rectangular histogram and the institute of current frame image up contour point Stating the constraints between the histogrammic difference of Shape context corresponding in background model, constraints formula is:
C, attribute decision sub-module, described attribute decision sub-module is for judging the genus of the marginal point on current frame image Property, the marginal point on described current frame image is that the decision condition of the marginal point belonging to background is:
And
Wherein, TPFor the matching degree threshold value set according to background model, TYFor the constraints threshold set according to background model Value;
D, abatement submodule, be judged to belong to the marginal point of background by attribute decision sub-module and output belongs to for rejecting The area image of moving target;
(6) characteristic matching module, is connected with abatement submodule, for by the described area image belonging to moving target and number Characteristic matching is carried out according to solid plate pre-in storehouse.
The present embodiment arranges image just processing module, for described original video image sequence information is carried out moving target Preliminary detection processes and exports the effective video image sequence information including moving target, it is possible to be greatly saved memory space, Improve the speed of detection;Filtration module is set, is filtered local shape processing, it is possible to effectively filter out environment noise, keep away Exempting from noise flase drop is moving target;Background modeling module is set, uses weighting Shape context rectangular histogram to by filtration module Filtered background is modeled, farthest decrease due to background noise and DE Camera Shake cause to moving target Flase drop;In modeling process, only the Shape context rectangular histogram of marginal point is calculated, is greatly saved memory space, Improve arithmetic speed, the real-time of system is strengthened;Background subtraction module is set, introduces matching degree and matching constraint condition Background is cut down, it is possible to fast and accurately moving target is registrated, complete detection;Wherein, N value is the biggest to background It is the strongest that dynamic adapts to ability, but can take and store resource more, increases amount of calculation, and real-time also can be deteriorated, the present embodiment Value N=6, compared with the video monitoring apparatus in relative skill, false drop rate reduces 2%, and arithmetic speed improves 4.5%.
Embodiment 3
Seeing Fig. 1, the useful monitoring massaging device that remotely obtains of the present embodiment includes remote transmitting device and video monitoring Device, wherein, video monitoring apparatus includes:
(1) image capture module, is used for gathering video monitoring image, and it is connected to video monitoring equipment and gathers therein Original video image sequence information;
(2) image just processing module, is connected with image capture module, for carrying out described original video image sequence information The Preliminary detection of moving target processes and exports to be located at the beginning of the effective video image sequence information including moving target, described image Reason module includes:
A, reference effective degree set submodule, for the effective degree reference threshold of the storage video image sample containing moving target Value, described effective degree represents for judging in original video image sequence information that m frame video image is whether as described effective video The judgement factor of image, described effective degree reference threshold includes rate of change of brightness reference threshold and target size reference threshold;
B, actually active degree calculating sub module, for calculating having of m frame video image in original video image sequence information Validity, the computing formula of effective degree is:
V = L m × ( M - m v M ) × | d - d p | d p
Wherein, V represents effective degree, LmBeing the rate of change of brightness of m frame video image, M represents that original video image sequence is believed Video image totalframes included in breath, m=1 ... M, mvFor rate of change of brightness in original video image sequence information more than bright The totalframes of the video image of degree rate of change reference threshold, d is the target size of m frame video image, dpJoin for target size Examine threshold value;
C, output sub-module, belong to the image information of effective video image sequence, when described current frame image for output Effective degree more than described effective degree reference threshold time, described output sub-module export described current frame image;
(3) filtration module, is connected with image just processing module, is used for receiving described effective video image sequence information right The background shape of effective video image sequence information is filtered processing, at the beginning of carrying out described background shape including using wiener ripple The first-level filtering of secondary filtering is except submodule and uses again be filtered first filtered background shape two grades of gaussian filtering Filter submodule;
(4) background modeling module, is connected with filtration module, is used for setting up filtered background model, described background model Set by N number of Weight represent marginal point Shape context rectangular histogram form, background model up contour point in shape under Literary composition histogram table is shown as:
{ w n , x h → n , x , n ∈ 1 , ... N , w n , x = ( B θ + n ) × ( B l + n ) B θ × B l Σ n = 1 N [ ( B θ + n ) × ( B l + n ) B θ × B l ] }
Wherein, x is background edge point coordinates, and N represents the histogrammic number of comprised Shape context, the value model of N Enclose for [5,10], wn,xRepresent the weight that the n-th Shape context rectangular histogram is corresponding, BlRepresent and sit for pole with background edge point x The mark center of circle, radius are the circle concentric circular number according to logarithm distance foundation of R, BθRepresent and angle of circumference division is waited number;
(5) background subtraction module, is connected with background modeling module, for the marginal point on current frame image is carried out attribute Classify and cut down the marginal point belonging to background, judging son including matching degree calculating sub module, constraints calculating sub module, attribute Module and abatement submodule, described matching degree calculating sub module, constraints calculating sub module are all connected to described attribute and judge Submodule, described attribute decision sub-module is connected to described abatement submodule, wherein:
A, matching degree calculating sub module, for calculating the Shape context rectangular histogram of current frame image up contour point with described Matching degree between the Shape context rectangular histogram of corresponding marginal point in background model, the computing formula of described matching degree is:
In formula,The Shape context rectangular histogram of the marginal point x on expression current frame image,Represent The Shape context rectangular histogram of corresponding marginal point x in background model, n=1 ... N;Represent marginal point x Neighborhood,It is used for weighing the histogrammic difference of Shape context of two edges point,The least, show that the Shape context histogram difference of two edges point is the least;
B, constraints calculating sub module, for calculating Shape context rectangular histogram and the institute of current frame image up contour point Stating the constraints between the histogrammic difference of Shape context corresponding in background model, constraints formula is:
C, attribute decision sub-module, described attribute decision sub-module is for judging the genus of the marginal point on current frame image Property, the marginal point on described current frame image is that the decision condition of the marginal point belonging to background is:
And
Wherein, TPFor the matching degree threshold value set according to background model, TYFor the constraints threshold set according to background model Value;
D, abatement submodule, be judged to belong to the marginal point of background by attribute decision sub-module and output belongs to for rejecting The area image of moving target;
(6) characteristic matching module, is connected with abatement submodule, for by the described area image belonging to moving target and number Characteristic matching is carried out according to solid plate pre-in storehouse.
The present embodiment arranges image just processing module, for described original video image sequence information is carried out moving target Preliminary detection processes and exports the effective video image sequence information including moving target, it is possible to be greatly saved memory space, Improve the speed of detection;Filtration module is set, is filtered local shape processing, it is possible to effectively filter out environment noise, keep away Exempting from noise flase drop is moving target;Background modeling module is set, uses weighting Shape context rectangular histogram to by filtration module Filtered background is modeled, farthest decrease due to background noise and DE Camera Shake cause to moving target Flase drop;In modeling process, only the Shape context rectangular histogram of marginal point is calculated, is greatly saved memory space, Improve arithmetic speed, the real-time of system is strengthened;Background subtraction module is set, introduces matching degree and matching constraint condition Background is cut down, it is possible to fast and accurately moving target is registrated, complete detection;Wherein, N value is the biggest to background It is the strongest that dynamic adapts to ability, but can take and store resource more, increases amount of calculation, and real-time also can be deteriorated, the present embodiment Value N=7, compared with the video monitoring apparatus in relative skill, false drop rate reduces 3.5%, and arithmetic speed improves 4%.
Embodiment 4
Seeing Fig. 1, the useful monitoring massaging device that remotely obtains of the present embodiment includes remote transmitting device and video monitoring Device, wherein, video monitoring apparatus includes:
(1) image capture module, is used for gathering video monitoring image, and it is connected to video monitoring equipment and gathers therein Original video image sequence information;
(2) image just processing module, is connected with image capture module, for carrying out described original video image sequence information The Preliminary detection of moving target processes and exports to be located at the beginning of the effective video image sequence information including moving target, described image Reason module includes:
A, reference effective degree set submodule, for the effective degree reference threshold of the storage video image sample containing moving target Value, described effective degree represents for judging in original video image sequence information that m frame video image is whether as described effective video The judgement factor of image, described effective degree reference threshold includes rate of change of brightness reference threshold and target size reference threshold;
B, actually active degree calculating sub module, for calculating having of m frame video image in original video image sequence information Validity, the computing formula of effective degree is:
V = L m × ( M - m v M ) × | d - d p | d p
Wherein, V represents effective degree, LmBeing the rate of change of brightness of m frame video image, M represents that original video image sequence is believed Video image totalframes included in breath, m=1 ... M, mvFor rate of change of brightness in original video image sequence information more than bright The totalframes of the video image of degree rate of change reference threshold, d is the target size of m frame video image, dpJoin for target size Examine threshold value;
C, output sub-module, belong to the image information of effective video image sequence, when described current frame image for output Effective degree more than described effective degree reference threshold time, described output sub-module export described current frame image;
(3) filtration module, is connected with image just processing module, is used for receiving described effective video image sequence information right The background shape of effective video image sequence information is filtered processing, at the beginning of carrying out described background shape including using wiener ripple The first-level filtering of secondary filtering is except submodule and uses again be filtered first filtered background shape two grades of gaussian filtering Filter submodule;
(4) background modeling module, is connected with filtration module, is used for setting up filtered background model, described background model Set by N number of Weight represent marginal point Shape context rectangular histogram form, background model up contour point in shape under Literary composition histogram table is shown as:
{ w n , x h → n , x , n ∈ 1 , ... N , w n , x = ( B θ + n ) × ( B l + n ) B θ × B l Σ n = 1 N [ ( B θ + n ) × ( B l + n ) B θ × B l ] }
Wherein, x is background edge point coordinates, and N represents the histogrammic number of comprised Shape context, the value model of N Enclose for [5,10], wn,xRepresent the weight that the n-th Shape context rectangular histogram is corresponding, BlRepresent and sit for pole with background edge point x The mark center of circle, radius are the circle concentric circular number according to logarithm distance foundation of R, BθRepresent and angle of circumference division is waited number;
(5) background subtraction module, is connected with background modeling module, for the marginal point on current frame image is carried out attribute Classify and cut down the marginal point belonging to background, judging son including matching degree calculating sub module, constraints calculating sub module, attribute Module and abatement submodule, described matching degree calculating sub module, constraints calculating sub module are all connected to described attribute and judge Submodule, described attribute decision sub-module is connected to described abatement submodule, wherein:
A, matching degree calculating sub module, for calculating the Shape context rectangular histogram of current frame image up contour point with described Matching degree between the Shape context rectangular histogram of corresponding marginal point in background model, the computing formula of described matching degree is:
In formula,The Shape context rectangular histogram of the marginal point x on expression current frame image,Represent The Shape context rectangular histogram of corresponding marginal point x in background model, n=1 ... N;Represent marginal point x's Neighborhood,It is used for weighing the histogrammic difference of Shape context of two edges point,The least, show that the Shape context histogram difference of two edges point is the least;
B, constraints calculating sub module, for calculating Shape context rectangular histogram and the institute of current frame image up contour point Stating the constraints between the histogrammic difference of Shape context corresponding in background model, constraints formula is:
C, attribute decision sub-module, described attribute decision sub-module is for judging the genus of the marginal point on current frame image Property, the marginal point on described current frame image is that the decision condition of the marginal point belonging to background is:
And
Wherein, TPFor the matching degree threshold value set according to background model, TYFor the constraints threshold set according to background model Value;
D, abatement submodule, be judged to belong to the marginal point of background by attribute decision sub-module and output belongs to for rejecting The area image of moving target;
(6) characteristic matching module, is connected with abatement submodule, for by the described area image belonging to moving target and number Characteristic matching is carried out according to solid plate pre-in storehouse.
The present embodiment arranges image just processing module, for described original video image sequence information is carried out moving target Preliminary detection processes and exports the effective video image sequence information including moving target, it is possible to be greatly saved memory space, Improve the speed of detection;Filtration module is set, is filtered local shape processing, it is possible to effectively filter out environment noise, keep away Exempting from noise flase drop is moving target;Background modeling module is set, uses weighting Shape context rectangular histogram to by filtration module Filtered background is modeled, farthest decrease due to background noise and DE Camera Shake cause to moving target Flase drop;In modeling process, only the Shape context rectangular histogram of marginal point is calculated, is greatly saved memory space, Improve arithmetic speed, the real-time of system is strengthened;Background subtraction module is set, introduces matching degree and matching constraint condition Background is cut down, it is possible to fast and accurately moving target is registrated, complete detection;Wherein, N value is the biggest to background It is the strongest that dynamic adapts to ability, but can take and store resource more, increases amount of calculation, and real-time also can be deteriorated, the present embodiment Value N=8, compared with the video monitoring apparatus in relative skill, false drop rate reduces 4%, and arithmetic speed improves 3.7%.
Embodiment 5
Seeing Fig. 1, the useful monitoring massaging device that remotely obtains of the present embodiment includes remote transmitting device and video monitoring Device, wherein, video monitoring apparatus includes:
(1) image capture module, is used for gathering video monitoring image, and it is connected to video monitoring equipment and gathers therein Original video image sequence information;
(2) image just processing module, is connected with image capture module, for carrying out described original video image sequence information The Preliminary detection of moving target processes and exports to be located at the beginning of the effective video image sequence information including moving target, described image Reason module includes:
A, reference effective degree set submodule, for the effective degree reference threshold of the storage video image sample containing moving target Value, described effective degree represents for judging in original video image sequence information that m frame video image is whether as described effective video The judgement factor of image, described effective degree reference threshold includes rate of change of brightness reference threshold and target size reference threshold;
B, actually active degree calculating sub module, for calculating having of m frame video image in original video image sequence information Validity, the computing formula of effective degree is:
V = L m × ( M - m v M ) × | d - d p | d p
Wherein, V represents effective degree, LmBeing the rate of change of brightness of m frame video image, M represents that original video image sequence is believed Video image totalframes included in breath, m=1 ... M, mvFor rate of change of brightness in original video image sequence information more than bright The totalframes of the video image of degree rate of change reference threshold, d is the target size of m frame video image, dpJoin for target size Examine threshold value;
C, output sub-module, belong to the image information of effective video image sequence, when described current frame image for output Effective degree more than described effective degree reference threshold time, described output sub-module export described current frame image;
(3) filtration module, is connected with image just processing module, is used for receiving described effective video image sequence information right The background shape of effective video image sequence information is filtered processing, at the beginning of carrying out described background shape including using wiener ripple The first-level filtering of secondary filtering is except submodule and uses again be filtered first filtered background shape two grades of gaussian filtering Filter submodule;
(4) background modeling module, is connected with filtration module, is used for setting up filtered background model, described background model Set by N number of Weight represent marginal point Shape context rectangular histogram form, background model up contour point in shape under Literary composition histogram table is shown as:
{ w n , x h → n , x , n ∈ 1 , ... N , w n , x = ( B θ + n ) × ( B l + n ) B θ × B l Σ n = 1 N [ ( B θ + n ) × ( B l + n ) B θ × B l ] }
Wherein, x is background edge point coordinates, and N represents the histogrammic number of comprised Shape context, the value model of N Enclose for [5,10], wn,xRepresent the weight that the n-th Shape context rectangular histogram is corresponding, BlRepresent and sit for pole with background edge point x The mark center of circle, radius are the circle concentric circular number according to logarithm distance foundation of R, BθRepresent and angle of circumference division is waited number;
(5) background subtraction module, is connected with background modeling module, for the marginal point on current frame image is carried out attribute Classify and cut down the marginal point belonging to background, judging son including matching degree calculating sub module, constraints calculating sub module, attribute Module and abatement submodule, described matching degree calculating sub module, constraints calculating sub module are all connected to described attribute and judge Submodule, described attribute decision sub-module is connected to described abatement submodule, wherein:
A, matching degree calculating sub module, for calculating the Shape context rectangular histogram of current frame image up contour point with described Matching degree between the Shape context rectangular histogram of corresponding marginal point in background model, the computing formula of described matching degree is:
In formula,The Shape context rectangular histogram of the marginal point x on expression current frame image,Represent The Shape context rectangular histogram of corresponding marginal point x in background model, n=1 ... N;Represent marginal point x's Neighborhood,It is used for weighing the histogrammic difference of Shape context of two edges point,The least, show that the Shape context histogram difference of two edges point is the least;
B, constraints calculating sub module, for calculating Shape context rectangular histogram and the institute of current frame image up contour point Stating the constraints between the histogrammic difference of Shape context corresponding in background model, constraints formula is:
C, attribute decision sub-module, described attribute decision sub-module is for judging the genus of the marginal point on current frame image Property, the marginal point on described current frame image is that the decision condition of the marginal point belonging to background is:
And
Wherein, TPFor the matching degree threshold value set according to background model, TYFor the constraints threshold set according to background model Value;
D, abatement submodule, be judged to belong to the marginal point of background by attribute decision sub-module and output belongs to for rejecting The area image of moving target;
(6) characteristic matching module, is connected with abatement submodule, for by the described area image belonging to moving target and number Characteristic matching is carried out according to solid plate pre-in storehouse.
The present embodiment arranges image just processing module, for described original video image sequence information is carried out moving target Preliminary detection processes and exports the effective video image sequence information including moving target, it is possible to be greatly saved memory space, Improve the speed of detection;Filtration module is set, is filtered local shape processing, it is possible to effectively filter out environment noise, keep away Exempting from noise flase drop is moving target;Background modeling module is set, uses weighting Shape context rectangular histogram to by filtration module Filtered background is modeled, farthest decrease due to background noise and DE Camera Shake cause to moving target Flase drop;In modeling process, only the Shape context rectangular histogram of marginal point is calculated, is greatly saved memory space, Improve arithmetic speed, the real-time of system is strengthened;Background subtraction module is set, introduces matching degree and matching constraint condition Background is cut down, it is possible to fast and accurately moving target is registrated, complete detection;Wherein, N value is the biggest to background It is the strongest that dynamic adapts to ability, but can take and store resource more, increases amount of calculation, and real-time also can be deteriorated, the present embodiment Value N=10, compared with the video monitoring apparatus in relative skill, false drop rate reduces 4.2%, and arithmetic speed improves 3.5%.
Last it should be noted that, above example is only in order to illustrate technical scheme, rather than the present invention is protected Protecting the restriction of scope, although having made to explain to the present invention with reference to preferred embodiment, those of ordinary skill in the art should Work as understanding, technical scheme can be modified or equivalent, without deviating from the reality of technical solution of the present invention Matter and scope.

Claims (2)

1. a long-range acquisition useful monitoring massaging device, is characterized in that, including remote transmitting device and video monitoring apparatus, its In, video monitoring apparatus includes:
(1) image capture module, is used for gathering video monitoring image, and it is connected to video monitoring equipment and gathers therein former regard Frequently image sequence information;
(2) image just processing module, is connected with image capture module, for moving described original video image sequence information The Preliminary detection of target processes and exports the effective video image sequence information including moving target;
(3) filtration module, is connected with image just processing module, is used for receiving described effective video image sequence information and to effectively The background shape of sequence of video images information is filtered processing, and filters described background shape for the first time including using wiener ripple The first-level filtering of ripple filters except submodule and use gaussian filtering to be again filtered first filtered background shape two grades Submodule;
(4) background modeling module, is connected with filtration module, is used for setting up filtered background model, and described background model sets Being made up of the Shape context rectangular histogram representing marginal point of N number of Weight, the Shape context of background model up contour point is straight Side's figure is expressed as:
{ w n , x h ~ n , x , n ∈ 1 , ... N , w n , x = ( B θ + n ) × ( B l + n ) B θ × B l Σ n = 1 N [ ( B θ + n ) × ( B l + n ) B θ × B l ] }
Wherein, x is background edge point coordinates, and N represents the histogrammic number of comprised Shape context, and the span of N is [5,10], wn,xRepresent the weight that the n-th Shape context rectangular histogram is corresponding, BlRepresent with background edge point x for polar coordinate circle The heart, radius are the circle concentric circular number according to logarithm distance foundation of R, BθRepresent and angle of circumference division is waited number;
(5) background subtraction module, is connected with background modeling module, for the marginal point on current frame image is carried out attributive classification And cut down the marginal point belonging to background, including matching degree calculating sub module, constraints calculating sub module, attribute decision sub-module With abatement submodule, described matching degree calculating sub module, constraints calculating sub module are all connected to described attribute and judge submodule Block, described attribute decision sub-module is connected to described abatement submodule, wherein:
A, matching degree calculating sub module, for calculating the Shape context rectangular histogram of current frame image up contour point and described background Matching degree between the Shape context rectangular histogram of corresponding marginal point on model, the computing formula of described matching degree is:
In formula,The Shape context rectangular histogram of the marginal point x on expression current frame image,Represent in background model The Shape context rectangular histogram of corresponding marginal point x, n=1 ... N;Represent the neighborhood of marginal point x, It is used for weighing the histogrammic difference of Shape context of two edges point,The least, show two The Shape context histogram difference of marginal point is the least;
B, constraints calculating sub module, for calculating the Shape context rectangular histogram of current frame image up contour point and the described back of the body Constraints between the histogrammic difference of Shape context corresponding on scape model, constraints formula is:
C, attribute decision sub-module, described attribute decision sub-module is for judging the attribute of the marginal point on current frame image, institute Stating the decision condition that the marginal point on current frame image is the marginal point belonging to background is:
And
Wherein, TPFor the matching degree threshold value set according to background model, TYFor the constraints threshold value set according to background model;
D, abatement submodule, be judged to belong to the marginal point of background by attribute decision sub-module and output belongs to motion for rejecting The area image of target;
(6) characteristic matching module, is connected with abatement submodule, for by the described area image belonging to moving target and data base In pre-solid plate carry out characteristic matching.
One the most according to claim 1 remotely obtains useful monitoring massaging device, it is characterized in that, processes at the beginning of described image Module includes:
A, reference effective degree set submodule, for the effective degree reference threshold of the storage video image sample containing moving target, Described effective degree represents for judging in original video image sequence information that m frame video image is whether as described effective video image The judgement factor, described effective degree reference threshold includes rate of change of brightness reference threshold and target size reference threshold;
B, actually active degree calculating sub module, for calculating the effective degree of m frame video image in original video image sequence information, The computing formula of effective degree is:
V = L m × ( M - m v M ) × | d - d p | d p
Wherein, V represents effective degree, LmBeing the rate of change of brightness of m frame video image, M represents institute in original video image sequence information The video image totalframes comprised, m=1 ... M, mvFor rate of change of brightness in original video image sequence information more than brightness flop The totalframes of the video image of rate reference threshold, d is the target size of m frame video image, dpFor target size reference threshold;
C, output sub-module, belong to the image information of effective video image sequence, when having of described current frame image for output When validity is more than described effective degree reference threshold, described output sub-module exports described current frame image.
CN201610237899.8A 2016-04-15 2016-04-15 Device for remotely acquiring useful monitoring information Pending CN105957101A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610237899.8A CN105957101A (en) 2016-04-15 2016-04-15 Device for remotely acquiring useful monitoring information

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610237899.8A CN105957101A (en) 2016-04-15 2016-04-15 Device for remotely acquiring useful monitoring information

Publications (1)

Publication Number Publication Date
CN105957101A true CN105957101A (en) 2016-09-21

Family

ID=56918145

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610237899.8A Pending CN105957101A (en) 2016-04-15 2016-04-15 Device for remotely acquiring useful monitoring information

Country Status (1)

Country Link
CN (1) CN105957101A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113743856A (en) * 2021-01-05 2021-12-03 北京京东乾石科技有限公司 Article sorting method and device, and storage medium

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101467893A (en) * 2007-12-26 2009-07-01 株式会社东芝 Ultrasonic diagonstic apparatus, ultrasonic image processing apparatus, and ultrasonic image processing method
CN102902819A (en) * 2012-10-30 2013-01-30 浙江宇视科技有限公司 Intelligent video analysis method and device
CN102968802A (en) * 2012-11-28 2013-03-13 无锡港湾网络科技有限公司 Moving target analyzing and tracking method and system based on video monitoring

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101467893A (en) * 2007-12-26 2009-07-01 株式会社东芝 Ultrasonic diagonstic apparatus, ultrasonic image processing apparatus, and ultrasonic image processing method
CN102902819A (en) * 2012-10-30 2013-01-30 浙江宇视科技有限公司 Intelligent video analysis method and device
CN102968802A (en) * 2012-11-28 2013-03-13 无锡港湾网络科技有限公司 Moving target analyzing and tracking method and system based on video monitoring

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
刘乐元: "面向有限资源平台人机交互的人手检测与跟踪", 《中国博士学位论文全文数据库 信息科技辑》 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113743856A (en) * 2021-01-05 2021-12-03 北京京东乾石科技有限公司 Article sorting method and device, and storage medium

Similar Documents

Publication Publication Date Title
CN108446617B (en) Side face interference resistant rapid human face detection method
WO2022188379A1 (en) Artificial intelligence system and method serving electric power robot
CN106897698B (en) Classroom people number detection method and system based on machine vision and binocular collaborative technology
CN103546726B (en) Method for automatically discovering illegal land use
CN111666944B (en) Infrared weak and small target detection method and device
CN106530281B (en) Unmanned plane image fuzzy Judgment method and system based on edge feature
CN104463117A (en) Sample collection method and system used for face recognition and based on video
CN111222478A (en) Construction site safety protection detection method and system
CN102426646A (en) Multi-angle human face detection device and method
CN109241814A (en) Pedestrian detection method based on YOLO neural network
CN109145708A (en) A kind of people flow rate statistical method based on the fusion of RGB and D information
CN103020992A (en) Video image significance detection method based on dynamic color association
CN103593679A (en) Visual human-hand tracking method based on online machine learning
CN110334660A (en) A kind of forest fire monitoring method based on machine vision under the conditions of greasy weather
CN102565103B (en) Tracking detection method for weld defects based on X-ray image
CN109558790B (en) Pedestrian target detection method, device and system
CN110276321A (en) Remote sensing video target tracking method and system
CN105869185A (en) Automatic door
CN105957098A (en) Unmanned reservoir monitoring system
CN105957101A (en) Device for remotely acquiring useful monitoring information
CN107748621A (en) A kind of intelligent interaction robot
CN105933645A (en) Unmanned warehouse monitoring system
CN110378935A (en) Parabolic recognition methods based on image, semantic information
CN112183287A (en) People counting method of mobile robot under complex background
CN111126230A (en) Smoke concentration quantitative evaluation method and electronic equipment applying same

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20160921