CN105957101A - Device for remotely acquiring useful monitoring information - Google Patents
Device for remotely acquiring useful monitoring information Download PDFInfo
- Publication number
- CN105957101A CN105957101A CN201610237899.8A CN201610237899A CN105957101A CN 105957101 A CN105957101 A CN 105957101A CN 201610237899 A CN201610237899 A CN 201610237899A CN 105957101 A CN105957101 A CN 105957101A
- Authority
- CN
- China
- Prior art keywords
- module
- background
- video image
- image
- sequence information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10016—Video; Image sequence
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20024—Filtering details
Abstract
The invention provides a device for remotely acquiring useful monitoring information. The device comprises a remote transmission device and a video monitoring device, wherein the video monitoring device comprises the components of (1), an image acquisition module which is used for acquiring a video monitoring image; (2), an image preprocessing module which is used for performing moving object preliminary detection on original video image sequence information and outputting effective video image sequence information that comprises a moving object; (3), a filtering module which is used for receiving the effective video image sequence information and filtering the background shape of the effective video image sequence information; (4), a background modeling module which is used for establishing a background model after filtering, wherein the background module is composed of N shape context histograms which comprise weights and represent edge points; (5), a background subtraction module which is used for performing attribute classifying on the edge points on the current image frame and subtracting the edge points that belong to the background; and (6), a characteristic matching module. The device can maximally reduce moving object error detection caused by background noise and camera jitter, and furthermore has high real-time performance.
Description
Technical field
The present invention relates to field of intelligent monitoring, be specifically related to a kind of remotely useful monitoring massaging device of acquisition.
Background technology
Video monitoring apparatus in correlation technique, there is problems in that (1) in video monitoring image series due to background
The existence of noise and be moving target by background flase drop;(2) during video monitoring, there is slight jitter, can be by background flase drop
For moving target;(3) during the detection to moving target, exist computationally intensive, the problem of poor real and can not be timely
Moving target detected.
Summary of the invention
For the problems referred to above, the present invention provides a kind of and remotely obtains useful monitoring massaging device, the video prison in this device
Control device can farthest reduce the flase drop to moving target caused due to background noise and DE Camera Shake, and real-time
Good.
The purpose of the present invention realizes by the following technical solutions:
Provide a kind of remotely useful monitoring massaging device of acquisition, including remote transmitting device and video monitoring apparatus, its
In, video monitoring apparatus includes:
(1) image capture module, is used for gathering video monitoring image, and it is connected to video monitoring equipment and gathers therein
Original video image sequence information;
(2) image just processing module, is connected with image capture module, for carrying out described original video image sequence information
The Preliminary detection of moving target processes and exports the effective video image sequence information including moving target;
(3) filtration module, is connected with image just processing module, is used for receiving described effective video image sequence information right
The background shape of effective video image sequence information is filtered processing, at the beginning of carrying out described background shape including using wiener ripple
The first-level filtering of secondary filtering is except submodule and uses again be filtered first filtered background shape two grades of gaussian filtering
Filter submodule;
(4) background modeling module, is connected with filtration module, is used for setting up filtered background model, described background model
Set by N number of Weight represent marginal point Shape context rectangular histogram form, background model up contour point in shape under
Literary composition histogram table is shown as:
Wherein, x is background edge point coordinates, and N represents the histogrammic number of comprised Shape context, the value model of N
Enclose for [5,10], wn,xRepresent the weight that the n-th Shape context rectangular histogram is corresponding, BlRepresent and sit for pole with background edge point x
The mark center of circle, radius are the circle concentric circular number according to logarithm distance foundation of R, BθRepresent and angle of circumference division is waited number;
(5) background subtraction module, is connected with background modeling module, for the marginal point on current frame image is carried out attribute
Classify and cut down the marginal point belonging to background, judging son including matching degree calculating sub module, constraints calculating sub module, attribute
Module and abatement submodule, described matching degree calculating sub module, constraints calculating sub module are all connected to described attribute and judge
Submodule, described attribute decision sub-module is connected to described abatement submodule, wherein:
A, matching degree calculating sub module, for calculating the Shape context rectangular histogram of current frame image up contour point with described
Matching degree between the Shape context rectangular histogram of corresponding marginal point in background model, the computing formula of described matching degree is:
In formula,The Shape context rectangular histogram of the marginal point x on expression current frame image,Represent the back of the body
The Shape context rectangular histogram of corresponding marginal point x on scape model, n=1 ... N;Represent marginal point x's
Neighborhood,It is used for weighing the histogrammic difference of Shape context of two edges point,The least, show that the Shape context histogram difference of two edges point is the least;
B, constraints calculating sub module, for calculating Shape context rectangular histogram and the institute of current frame image up contour point
Stating the constraints between the histogrammic difference of Shape context corresponding in background model, constraints formula is:
C, attribute decision sub-module, described attribute decision sub-module is for judging the genus of the marginal point on current frame image
Property, the marginal point on described current frame image is that the decision condition of the marginal point belonging to background is:
And
Wherein, TPFor the matching degree threshold value set according to background model, TYFor the constraints threshold set according to background model
Value;
D, abatement submodule, be judged to belong to the marginal point of background by attribute decision sub-module and output belongs to for rejecting
The area image of moving target;
(6) characteristic matching module, is connected with abatement submodule, for by the described area image belonging to moving target and number
Characteristic matching is carried out according to solid plate pre-in storehouse.
Preferably, described image just processing module includes:
A, reference effective degree set submodule, for the effective degree reference threshold of the storage video image sample containing moving target
Value, described effective degree represents for judging in original video image sequence information that m frame video image is whether as described effective video
The judgement factor of image, described effective degree reference threshold includes rate of change of brightness reference threshold and target size reference threshold;
B, actually active degree calculating sub module, for calculating having of m frame video image in original video image sequence information
Validity, the computing formula of effective degree is:
Wherein, V represents effective degree, LmBeing the rate of change of brightness of m frame video image, M represents that original video image sequence is believed
Video image totalframes included in breath, m=1 ... M, mvFor rate of change of brightness in original video image sequence information more than bright
The totalframes of the video image of degree rate of change reference threshold, d is the target size of m frame video image, dpJoin for target size
Examine threshold value;
C, output sub-module, belong to the image information of effective video image sequence, when described current frame image for output
Effective degree more than described effective degree reference threshold time, described output sub-module export described current frame image.
The invention have the benefit that
1, image just processing module is set, for described original video image sequence information carries out the preliminary inspection of moving target
Survey processes and exports the effective video image sequence information including moving target, it is possible to be greatly saved memory space, improves inspection
The speed surveyed;
2, filtration module is set, is filtered local shape processing, it is possible to effectively filter out environment noise, it is to avoid will make an uproar
Sound flase drop is moving target;
3, background modeling module is set, uses weighting Shape context rectangular histogram to enter by the filtered background of filtration module
Row modeling, farthest decreases the flase drop to moving target caused due to background noise and DE Camera Shake;
4, in modeling process, only the Shape context rectangular histogram of marginal point is calculated, be greatly saved storage sky
Between, improve arithmetic speed, the real-time of system is strengthened;
5, background subtraction module is set, introduces matching degree and background is cut down by matching constraint condition, it is possible to be quickly accurate
True registrates moving target, completes detection.
Accompanying drawing explanation
The invention will be further described to utilize accompanying drawing, but the embodiment in accompanying drawing does not constitute any limit to the present invention
System, for those of ordinary skill in the art, on the premise of not paying creative work, it is also possible to obtain according to the following drawings
Other accompanying drawing.
Fig. 1 is the connection diagram of each module of the present invention.
Detailed description of the invention
The invention will be further described with the following Examples.
Embodiment 1
Seeing Fig. 1, the useful monitoring massaging device that remotely obtains of the present embodiment includes remote transmitting device and video monitoring
Device, wherein, video monitoring apparatus includes:
(1) image capture module, is used for gathering video monitoring image, and it is connected to video monitoring equipment and gathers therein
Original video image sequence information;
(2) image just processing module, is connected with image capture module, for carrying out described original video image sequence information
The Preliminary detection of moving target processes and exports to be located at the beginning of the effective video image sequence information including moving target, described image
Reason module includes:
A, reference effective degree set submodule, for the effective degree reference threshold of the storage video image sample containing moving target
Value, described effective degree represents for judging in original video image sequence information that m frame video image is whether as described effective video
The judgement factor of image, described effective degree reference threshold includes rate of change of brightness reference threshold and target size reference threshold;
B, actually active degree calculating sub module, for calculating having of m frame video image in original video image sequence information
Validity, the computing formula of effective degree is:
Wherein, V represents effective degree, LmBeing the rate of change of brightness of m frame video image, M represents that original video image sequence is believed
Video image totalframes included in breath, m=1 ... M, mvFor rate of change of brightness in original video image sequence information more than bright
The totalframes of the video image of degree rate of change reference threshold, d is the target size of m frame video image, dpJoin for target size
Examine threshold value;
C, output sub-module, belong to the image information of effective video image sequence, when described current frame image for output
Effective degree more than described effective degree reference threshold time, described output sub-module export described current frame image;
(3) filtration module, is connected with image just processing module, is used for receiving described effective video image sequence information right
The background shape of effective video image sequence information is filtered processing, at the beginning of carrying out described background shape including using wiener ripple
The first-level filtering of secondary filtering is except submodule and uses again be filtered first filtered background shape two grades of gaussian filtering
Filter submodule;
(4) background modeling module, is connected with filtration module, is used for setting up filtered background model, described background model
Set by N number of Weight represent marginal point Shape context rectangular histogram form, background model up contour point in shape under
Literary composition histogram table is shown as:
Wherein, x is background edge point coordinates, and N represents the histogrammic number of comprised Shape context, the value model of N
Enclose for [5,10], wn,xRepresent the weight that the n-th Shape context rectangular histogram is corresponding, BlRepresent and sit for pole with background edge point x
The mark center of circle, radius are the circle concentric circular number according to logarithm distance foundation of R, BθRepresent and angle of circumference division is waited number;
(5) background subtraction module, is connected with background modeling module, for the marginal point on current frame image is carried out attribute
Classify and cut down the marginal point belonging to background, judging son including matching degree calculating sub module, constraints calculating sub module, attribute
Module and abatement submodule, described matching degree calculating sub module, constraints calculating sub module are all connected to described attribute and judge
Submodule, described attribute decision sub-module is connected to described abatement submodule, wherein:
A, matching degree calculating sub module, for calculating the Shape context rectangular histogram of current frame image up contour point with described
Matching degree between the Shape context rectangular histogram of corresponding marginal point in background model, the computing formula of described matching degree is:
In formula,The Shape context rectangular histogram of the marginal point x on expression current frame image,Represent the back of the body
The Shape context rectangular histogram of corresponding marginal point x on scape model, n=1 ... N;Represent marginal point x's
Neighborhood,It is used for weighing the histogrammic difference of Shape context of two edges point,The least, show that the Shape context histogram difference of two edges point is the least;
B, constraints calculating sub module, for calculating Shape context rectangular histogram and the institute of current frame image up contour point
Stating the constraints between the histogrammic difference of Shape context corresponding in background model, constraints formula is:
C, attribute decision sub-module, described attribute decision sub-module is for judging the genus of the marginal point on current frame image
Property, the marginal point on described current frame image is that the decision condition of the marginal point belonging to background is:
And
Wherein, TPFor the matching degree threshold value set according to background model, TYFor the constraints threshold set according to background model
Value;
D, abatement submodule, be judged to belong to the marginal point of background by attribute decision sub-module and output belongs to for rejecting
The area image of moving target;
(6) characteristic matching module, is connected with abatement submodule, for by the described area image belonging to moving target and number
Characteristic matching is carried out according to solid plate pre-in storehouse.
The present embodiment arranges image just processing module, for described original video image sequence information is carried out moving target
Preliminary detection processes and exports the effective video image sequence information including moving target, it is possible to be greatly saved memory space,
Improve the speed of detection;Filtration module is set, is filtered local shape processing, it is possible to effectively filter out environment noise, keep away
Exempting from noise flase drop is moving target;Background modeling module is set, uses weighting Shape context rectangular histogram to by filtration module
Filtered background is modeled, farthest decrease due to background noise and DE Camera Shake cause to moving target
Flase drop;In modeling process, only the Shape context rectangular histogram of marginal point is calculated, is greatly saved memory space,
Improve arithmetic speed, the real-time of system is strengthened;Background subtraction module is set, introduces matching degree and matching constraint condition
Background is cut down, it is possible to fast and accurately moving target is registrated, complete detection;Wherein, N value is the biggest to background
It is the strongest that dynamic adapts to ability, but can take and store resource more, increases amount of calculation, and real-time also can be deteriorated, the present embodiment
Value N=5, compared with the video monitoring apparatus in relative skill, false drop rate reduces 1%, and arithmetic speed improves 5%.
Embodiment 2
Seeing Fig. 1, the useful monitoring massaging device that remotely obtains of the present embodiment includes remote transmitting device and video monitoring
Device, wherein, video monitoring apparatus includes:
(1) image capture module, is used for gathering video monitoring image, and it is connected to video monitoring equipment and gathers therein
Original video image sequence information;
(2) image just processing module, is connected with image capture module, for carrying out described original video image sequence information
The Preliminary detection of moving target processes and exports to be located at the beginning of the effective video image sequence information including moving target, described image
Reason module includes:
A, reference effective degree set submodule, for the effective degree reference threshold of the storage video image sample containing moving target
Value, described effective degree represents for judging in original video image sequence information that m frame video image is whether as described effective video
The judgement factor of image, described effective degree reference threshold includes rate of change of brightness reference threshold and target size reference threshold;
B, actually active degree calculating sub module, for calculating having of m frame video image in original video image sequence information
Validity, the computing formula of effective degree is:
Wherein, V represents effective degree, LmBeing the rate of change of brightness of m frame video image, M represents that original video image sequence is believed
Video image totalframes included in breath, m=1 ... M, mvFor rate of change of brightness in original video image sequence information more than bright
The totalframes of the video image of degree rate of change reference threshold, d is the target size of m frame video image, dpJoin for target size
Examine threshold value;
C, output sub-module, belong to the image information of effective video image sequence, when described current frame image for output
Effective degree more than described effective degree reference threshold time, described output sub-module export described current frame image;
(3) filtration module, is connected with image just processing module, is used for receiving described effective video image sequence information right
The background shape of effective video image sequence information is filtered processing, at the beginning of carrying out described background shape including using wiener ripple
The first-level filtering of secondary filtering is except submodule and uses again be filtered first filtered background shape two grades of gaussian filtering
Filter submodule;
(4) background modeling module, is connected with filtration module, is used for setting up filtered background model, described background model
Set by N number of Weight represent marginal point Shape context rectangular histogram form, background model up contour point in shape under
Literary composition histogram table is shown as:
Wherein, x is background edge point coordinates, and N represents the histogrammic number of comprised Shape context, the value model of N
Enclose for [5,10], wn,xRepresent the weight that the n-th Shape context rectangular histogram is corresponding, BlRepresent and sit for pole with background edge point x
The mark center of circle, radius are the circle concentric circular number according to logarithm distance foundation of R, BθRepresent and angle of circumference division is waited number;
(5) background subtraction module, is connected with background modeling module, for the marginal point on current frame image is carried out attribute
Classify and cut down the marginal point belonging to background, judging son including matching degree calculating sub module, constraints calculating sub module, attribute
Module and abatement submodule, described matching degree calculating sub module, constraints calculating sub module are all connected to described attribute and judge
Submodule, described attribute decision sub-module is connected to described abatement submodule, wherein:
A, matching degree calculating sub module, for calculating the Shape context rectangular histogram of current frame image up contour point with described
Matching degree between the Shape context rectangular histogram of corresponding marginal point in background model, the computing formula of described matching degree is:
In formula,The Shape context rectangular histogram of the marginal point x on expression current frame image,Represent
The Shape context rectangular histogram of corresponding marginal point x in background model, n=1 ... N;Represent marginal point x's
Neighborhood,It is used for weighing the histogrammic difference of Shape context of two edges point,The least, show that the Shape context histogram difference of two edges point is the least;
B, constraints calculating sub module, for calculating Shape context rectangular histogram and the institute of current frame image up contour point
Stating the constraints between the histogrammic difference of Shape context corresponding in background model, constraints formula is:
C, attribute decision sub-module, described attribute decision sub-module is for judging the genus of the marginal point on current frame image
Property, the marginal point on described current frame image is that the decision condition of the marginal point belonging to background is:
And
Wherein, TPFor the matching degree threshold value set according to background model, TYFor the constraints threshold set according to background model
Value;
D, abatement submodule, be judged to belong to the marginal point of background by attribute decision sub-module and output belongs to for rejecting
The area image of moving target;
(6) characteristic matching module, is connected with abatement submodule, for by the described area image belonging to moving target and number
Characteristic matching is carried out according to solid plate pre-in storehouse.
The present embodiment arranges image just processing module, for described original video image sequence information is carried out moving target
Preliminary detection processes and exports the effective video image sequence information including moving target, it is possible to be greatly saved memory space,
Improve the speed of detection;Filtration module is set, is filtered local shape processing, it is possible to effectively filter out environment noise, keep away
Exempting from noise flase drop is moving target;Background modeling module is set, uses weighting Shape context rectangular histogram to by filtration module
Filtered background is modeled, farthest decrease due to background noise and DE Camera Shake cause to moving target
Flase drop;In modeling process, only the Shape context rectangular histogram of marginal point is calculated, is greatly saved memory space,
Improve arithmetic speed, the real-time of system is strengthened;Background subtraction module is set, introduces matching degree and matching constraint condition
Background is cut down, it is possible to fast and accurately moving target is registrated, complete detection;Wherein, N value is the biggest to background
It is the strongest that dynamic adapts to ability, but can take and store resource more, increases amount of calculation, and real-time also can be deteriorated, the present embodiment
Value N=6, compared with the video monitoring apparatus in relative skill, false drop rate reduces 2%, and arithmetic speed improves 4.5%.
Embodiment 3
Seeing Fig. 1, the useful monitoring massaging device that remotely obtains of the present embodiment includes remote transmitting device and video monitoring
Device, wherein, video monitoring apparatus includes:
(1) image capture module, is used for gathering video monitoring image, and it is connected to video monitoring equipment and gathers therein
Original video image sequence information;
(2) image just processing module, is connected with image capture module, for carrying out described original video image sequence information
The Preliminary detection of moving target processes and exports to be located at the beginning of the effective video image sequence information including moving target, described image
Reason module includes:
A, reference effective degree set submodule, for the effective degree reference threshold of the storage video image sample containing moving target
Value, described effective degree represents for judging in original video image sequence information that m frame video image is whether as described effective video
The judgement factor of image, described effective degree reference threshold includes rate of change of brightness reference threshold and target size reference threshold;
B, actually active degree calculating sub module, for calculating having of m frame video image in original video image sequence information
Validity, the computing formula of effective degree is:
Wherein, V represents effective degree, LmBeing the rate of change of brightness of m frame video image, M represents that original video image sequence is believed
Video image totalframes included in breath, m=1 ... M, mvFor rate of change of brightness in original video image sequence information more than bright
The totalframes of the video image of degree rate of change reference threshold, d is the target size of m frame video image, dpJoin for target size
Examine threshold value;
C, output sub-module, belong to the image information of effective video image sequence, when described current frame image for output
Effective degree more than described effective degree reference threshold time, described output sub-module export described current frame image;
(3) filtration module, is connected with image just processing module, is used for receiving described effective video image sequence information right
The background shape of effective video image sequence information is filtered processing, at the beginning of carrying out described background shape including using wiener ripple
The first-level filtering of secondary filtering is except submodule and uses again be filtered first filtered background shape two grades of gaussian filtering
Filter submodule;
(4) background modeling module, is connected with filtration module, is used for setting up filtered background model, described background model
Set by N number of Weight represent marginal point Shape context rectangular histogram form, background model up contour point in shape under
Literary composition histogram table is shown as:
Wherein, x is background edge point coordinates, and N represents the histogrammic number of comprised Shape context, the value model of N
Enclose for [5,10], wn,xRepresent the weight that the n-th Shape context rectangular histogram is corresponding, BlRepresent and sit for pole with background edge point x
The mark center of circle, radius are the circle concentric circular number according to logarithm distance foundation of R, BθRepresent and angle of circumference division is waited number;
(5) background subtraction module, is connected with background modeling module, for the marginal point on current frame image is carried out attribute
Classify and cut down the marginal point belonging to background, judging son including matching degree calculating sub module, constraints calculating sub module, attribute
Module and abatement submodule, described matching degree calculating sub module, constraints calculating sub module are all connected to described attribute and judge
Submodule, described attribute decision sub-module is connected to described abatement submodule, wherein:
A, matching degree calculating sub module, for calculating the Shape context rectangular histogram of current frame image up contour point with described
Matching degree between the Shape context rectangular histogram of corresponding marginal point in background model, the computing formula of described matching degree is:
In formula,The Shape context rectangular histogram of the marginal point x on expression current frame image,Represent
The Shape context rectangular histogram of corresponding marginal point x in background model, n=1 ... N;Represent marginal point x
Neighborhood,It is used for weighing the histogrammic difference of Shape context of two edges point,The least, show that the Shape context histogram difference of two edges point is the least;
B, constraints calculating sub module, for calculating Shape context rectangular histogram and the institute of current frame image up contour point
Stating the constraints between the histogrammic difference of Shape context corresponding in background model, constraints formula is:
C, attribute decision sub-module, described attribute decision sub-module is for judging the genus of the marginal point on current frame image
Property, the marginal point on described current frame image is that the decision condition of the marginal point belonging to background is:
And
Wherein, TPFor the matching degree threshold value set according to background model, TYFor the constraints threshold set according to background model
Value;
D, abatement submodule, be judged to belong to the marginal point of background by attribute decision sub-module and output belongs to for rejecting
The area image of moving target;
(6) characteristic matching module, is connected with abatement submodule, for by the described area image belonging to moving target and number
Characteristic matching is carried out according to solid plate pre-in storehouse.
The present embodiment arranges image just processing module, for described original video image sequence information is carried out moving target
Preliminary detection processes and exports the effective video image sequence information including moving target, it is possible to be greatly saved memory space,
Improve the speed of detection;Filtration module is set, is filtered local shape processing, it is possible to effectively filter out environment noise, keep away
Exempting from noise flase drop is moving target;Background modeling module is set, uses weighting Shape context rectangular histogram to by filtration module
Filtered background is modeled, farthest decrease due to background noise and DE Camera Shake cause to moving target
Flase drop;In modeling process, only the Shape context rectangular histogram of marginal point is calculated, is greatly saved memory space,
Improve arithmetic speed, the real-time of system is strengthened;Background subtraction module is set, introduces matching degree and matching constraint condition
Background is cut down, it is possible to fast and accurately moving target is registrated, complete detection;Wherein, N value is the biggest to background
It is the strongest that dynamic adapts to ability, but can take and store resource more, increases amount of calculation, and real-time also can be deteriorated, the present embodiment
Value N=7, compared with the video monitoring apparatus in relative skill, false drop rate reduces 3.5%, and arithmetic speed improves 4%.
Embodiment 4
Seeing Fig. 1, the useful monitoring massaging device that remotely obtains of the present embodiment includes remote transmitting device and video monitoring
Device, wherein, video monitoring apparatus includes:
(1) image capture module, is used for gathering video monitoring image, and it is connected to video monitoring equipment and gathers therein
Original video image sequence information;
(2) image just processing module, is connected with image capture module, for carrying out described original video image sequence information
The Preliminary detection of moving target processes and exports to be located at the beginning of the effective video image sequence information including moving target, described image
Reason module includes:
A, reference effective degree set submodule, for the effective degree reference threshold of the storage video image sample containing moving target
Value, described effective degree represents for judging in original video image sequence information that m frame video image is whether as described effective video
The judgement factor of image, described effective degree reference threshold includes rate of change of brightness reference threshold and target size reference threshold;
B, actually active degree calculating sub module, for calculating having of m frame video image in original video image sequence information
Validity, the computing formula of effective degree is:
Wherein, V represents effective degree, LmBeing the rate of change of brightness of m frame video image, M represents that original video image sequence is believed
Video image totalframes included in breath, m=1 ... M, mvFor rate of change of brightness in original video image sequence information more than bright
The totalframes of the video image of degree rate of change reference threshold, d is the target size of m frame video image, dpJoin for target size
Examine threshold value;
C, output sub-module, belong to the image information of effective video image sequence, when described current frame image for output
Effective degree more than described effective degree reference threshold time, described output sub-module export described current frame image;
(3) filtration module, is connected with image just processing module, is used for receiving described effective video image sequence information right
The background shape of effective video image sequence information is filtered processing, at the beginning of carrying out described background shape including using wiener ripple
The first-level filtering of secondary filtering is except submodule and uses again be filtered first filtered background shape two grades of gaussian filtering
Filter submodule;
(4) background modeling module, is connected with filtration module, is used for setting up filtered background model, described background model
Set by N number of Weight represent marginal point Shape context rectangular histogram form, background model up contour point in shape under
Literary composition histogram table is shown as:
Wherein, x is background edge point coordinates, and N represents the histogrammic number of comprised Shape context, the value model of N
Enclose for [5,10], wn,xRepresent the weight that the n-th Shape context rectangular histogram is corresponding, BlRepresent and sit for pole with background edge point x
The mark center of circle, radius are the circle concentric circular number according to logarithm distance foundation of R, BθRepresent and angle of circumference division is waited number;
(5) background subtraction module, is connected with background modeling module, for the marginal point on current frame image is carried out attribute
Classify and cut down the marginal point belonging to background, judging son including matching degree calculating sub module, constraints calculating sub module, attribute
Module and abatement submodule, described matching degree calculating sub module, constraints calculating sub module are all connected to described attribute and judge
Submodule, described attribute decision sub-module is connected to described abatement submodule, wherein:
A, matching degree calculating sub module, for calculating the Shape context rectangular histogram of current frame image up contour point with described
Matching degree between the Shape context rectangular histogram of corresponding marginal point in background model, the computing formula of described matching degree is:
In formula,The Shape context rectangular histogram of the marginal point x on expression current frame image,Represent
The Shape context rectangular histogram of corresponding marginal point x in background model, n=1 ... N;Represent marginal point x's
Neighborhood,It is used for weighing the histogrammic difference of Shape context of two edges point,The least, show that the Shape context histogram difference of two edges point is the least;
B, constraints calculating sub module, for calculating Shape context rectangular histogram and the institute of current frame image up contour point
Stating the constraints between the histogrammic difference of Shape context corresponding in background model, constraints formula is:
C, attribute decision sub-module, described attribute decision sub-module is for judging the genus of the marginal point on current frame image
Property, the marginal point on described current frame image is that the decision condition of the marginal point belonging to background is:
And
Wherein, TPFor the matching degree threshold value set according to background model, TYFor the constraints threshold set according to background model
Value;
D, abatement submodule, be judged to belong to the marginal point of background by attribute decision sub-module and output belongs to for rejecting
The area image of moving target;
(6) characteristic matching module, is connected with abatement submodule, for by the described area image belonging to moving target and number
Characteristic matching is carried out according to solid plate pre-in storehouse.
The present embodiment arranges image just processing module, for described original video image sequence information is carried out moving target
Preliminary detection processes and exports the effective video image sequence information including moving target, it is possible to be greatly saved memory space,
Improve the speed of detection;Filtration module is set, is filtered local shape processing, it is possible to effectively filter out environment noise, keep away
Exempting from noise flase drop is moving target;Background modeling module is set, uses weighting Shape context rectangular histogram to by filtration module
Filtered background is modeled, farthest decrease due to background noise and DE Camera Shake cause to moving target
Flase drop;In modeling process, only the Shape context rectangular histogram of marginal point is calculated, is greatly saved memory space,
Improve arithmetic speed, the real-time of system is strengthened;Background subtraction module is set, introduces matching degree and matching constraint condition
Background is cut down, it is possible to fast and accurately moving target is registrated, complete detection;Wherein, N value is the biggest to background
It is the strongest that dynamic adapts to ability, but can take and store resource more, increases amount of calculation, and real-time also can be deteriorated, the present embodiment
Value N=8, compared with the video monitoring apparatus in relative skill, false drop rate reduces 4%, and arithmetic speed improves 3.7%.
Embodiment 5
Seeing Fig. 1, the useful monitoring massaging device that remotely obtains of the present embodiment includes remote transmitting device and video monitoring
Device, wherein, video monitoring apparatus includes:
(1) image capture module, is used for gathering video monitoring image, and it is connected to video monitoring equipment and gathers therein
Original video image sequence information;
(2) image just processing module, is connected with image capture module, for carrying out described original video image sequence information
The Preliminary detection of moving target processes and exports to be located at the beginning of the effective video image sequence information including moving target, described image
Reason module includes:
A, reference effective degree set submodule, for the effective degree reference threshold of the storage video image sample containing moving target
Value, described effective degree represents for judging in original video image sequence information that m frame video image is whether as described effective video
The judgement factor of image, described effective degree reference threshold includes rate of change of brightness reference threshold and target size reference threshold;
B, actually active degree calculating sub module, for calculating having of m frame video image in original video image sequence information
Validity, the computing formula of effective degree is:
Wherein, V represents effective degree, LmBeing the rate of change of brightness of m frame video image, M represents that original video image sequence is believed
Video image totalframes included in breath, m=1 ... M, mvFor rate of change of brightness in original video image sequence information more than bright
The totalframes of the video image of degree rate of change reference threshold, d is the target size of m frame video image, dpJoin for target size
Examine threshold value;
C, output sub-module, belong to the image information of effective video image sequence, when described current frame image for output
Effective degree more than described effective degree reference threshold time, described output sub-module export described current frame image;
(3) filtration module, is connected with image just processing module, is used for receiving described effective video image sequence information right
The background shape of effective video image sequence information is filtered processing, at the beginning of carrying out described background shape including using wiener ripple
The first-level filtering of secondary filtering is except submodule and uses again be filtered first filtered background shape two grades of gaussian filtering
Filter submodule;
(4) background modeling module, is connected with filtration module, is used for setting up filtered background model, described background model
Set by N number of Weight represent marginal point Shape context rectangular histogram form, background model up contour point in shape under
Literary composition histogram table is shown as:
Wherein, x is background edge point coordinates, and N represents the histogrammic number of comprised Shape context, the value model of N
Enclose for [5,10], wn,xRepresent the weight that the n-th Shape context rectangular histogram is corresponding, BlRepresent and sit for pole with background edge point x
The mark center of circle, radius are the circle concentric circular number according to logarithm distance foundation of R, BθRepresent and angle of circumference division is waited number;
(5) background subtraction module, is connected with background modeling module, for the marginal point on current frame image is carried out attribute
Classify and cut down the marginal point belonging to background, judging son including matching degree calculating sub module, constraints calculating sub module, attribute
Module and abatement submodule, described matching degree calculating sub module, constraints calculating sub module are all connected to described attribute and judge
Submodule, described attribute decision sub-module is connected to described abatement submodule, wherein:
A, matching degree calculating sub module, for calculating the Shape context rectangular histogram of current frame image up contour point with described
Matching degree between the Shape context rectangular histogram of corresponding marginal point in background model, the computing formula of described matching degree is:
In formula,The Shape context rectangular histogram of the marginal point x on expression current frame image,Represent
The Shape context rectangular histogram of corresponding marginal point x in background model, n=1 ... N;Represent marginal point x's
Neighborhood,It is used for weighing the histogrammic difference of Shape context of two edges point,The least, show that the Shape context histogram difference of two edges point is the least;
B, constraints calculating sub module, for calculating Shape context rectangular histogram and the institute of current frame image up contour point
Stating the constraints between the histogrammic difference of Shape context corresponding in background model, constraints formula is:
C, attribute decision sub-module, described attribute decision sub-module is for judging the genus of the marginal point on current frame image
Property, the marginal point on described current frame image is that the decision condition of the marginal point belonging to background is:
And
Wherein, TPFor the matching degree threshold value set according to background model, TYFor the constraints threshold set according to background model
Value;
D, abatement submodule, be judged to belong to the marginal point of background by attribute decision sub-module and output belongs to for rejecting
The area image of moving target;
(6) characteristic matching module, is connected with abatement submodule, for by the described area image belonging to moving target and number
Characteristic matching is carried out according to solid plate pre-in storehouse.
The present embodiment arranges image just processing module, for described original video image sequence information is carried out moving target
Preliminary detection processes and exports the effective video image sequence information including moving target, it is possible to be greatly saved memory space,
Improve the speed of detection;Filtration module is set, is filtered local shape processing, it is possible to effectively filter out environment noise, keep away
Exempting from noise flase drop is moving target;Background modeling module is set, uses weighting Shape context rectangular histogram to by filtration module
Filtered background is modeled, farthest decrease due to background noise and DE Camera Shake cause to moving target
Flase drop;In modeling process, only the Shape context rectangular histogram of marginal point is calculated, is greatly saved memory space,
Improve arithmetic speed, the real-time of system is strengthened;Background subtraction module is set, introduces matching degree and matching constraint condition
Background is cut down, it is possible to fast and accurately moving target is registrated, complete detection;Wherein, N value is the biggest to background
It is the strongest that dynamic adapts to ability, but can take and store resource more, increases amount of calculation, and real-time also can be deteriorated, the present embodiment
Value N=10, compared with the video monitoring apparatus in relative skill, false drop rate reduces 4.2%, and arithmetic speed improves
3.5%.
Last it should be noted that, above example is only in order to illustrate technical scheme, rather than the present invention is protected
Protecting the restriction of scope, although having made to explain to the present invention with reference to preferred embodiment, those of ordinary skill in the art should
Work as understanding, technical scheme can be modified or equivalent, without deviating from the reality of technical solution of the present invention
Matter and scope.
Claims (2)
1. a long-range acquisition useful monitoring massaging device, is characterized in that, including remote transmitting device and video monitoring apparatus, its
In, video monitoring apparatus includes:
(1) image capture module, is used for gathering video monitoring image, and it is connected to video monitoring equipment and gathers therein former regard
Frequently image sequence information;
(2) image just processing module, is connected with image capture module, for moving described original video image sequence information
The Preliminary detection of target processes and exports the effective video image sequence information including moving target;
(3) filtration module, is connected with image just processing module, is used for receiving described effective video image sequence information and to effectively
The background shape of sequence of video images information is filtered processing, and filters described background shape for the first time including using wiener ripple
The first-level filtering of ripple filters except submodule and use gaussian filtering to be again filtered first filtered background shape two grades
Submodule;
(4) background modeling module, is connected with filtration module, is used for setting up filtered background model, and described background model sets
Being made up of the Shape context rectangular histogram representing marginal point of N number of Weight, the Shape context of background model up contour point is straight
Side's figure is expressed as:
Wherein, x is background edge point coordinates, and N represents the histogrammic number of comprised Shape context, and the span of N is
[5,10], wn,xRepresent the weight that the n-th Shape context rectangular histogram is corresponding, BlRepresent with background edge point x for polar coordinate circle
The heart, radius are the circle concentric circular number according to logarithm distance foundation of R, BθRepresent and angle of circumference division is waited number;
(5) background subtraction module, is connected with background modeling module, for the marginal point on current frame image is carried out attributive classification
And cut down the marginal point belonging to background, including matching degree calculating sub module, constraints calculating sub module, attribute decision sub-module
With abatement submodule, described matching degree calculating sub module, constraints calculating sub module are all connected to described attribute and judge submodule
Block, described attribute decision sub-module is connected to described abatement submodule, wherein:
A, matching degree calculating sub module, for calculating the Shape context rectangular histogram of current frame image up contour point and described background
Matching degree between the Shape context rectangular histogram of corresponding marginal point on model, the computing formula of described matching degree is:
In formula,The Shape context rectangular histogram of the marginal point x on expression current frame image,Represent in background model
The Shape context rectangular histogram of corresponding marginal point x, n=1 ... N;Represent the neighborhood of marginal point x,
It is used for weighing the histogrammic difference of Shape context of two edges point,The least, show two
The Shape context histogram difference of marginal point is the least;
B, constraints calculating sub module, for calculating the Shape context rectangular histogram of current frame image up contour point and the described back of the body
Constraints between the histogrammic difference of Shape context corresponding on scape model, constraints formula is:
C, attribute decision sub-module, described attribute decision sub-module is for judging the attribute of the marginal point on current frame image, institute
Stating the decision condition that the marginal point on current frame image is the marginal point belonging to background is:
And
Wherein, TPFor the matching degree threshold value set according to background model, TYFor the constraints threshold value set according to background model;
D, abatement submodule, be judged to belong to the marginal point of background by attribute decision sub-module and output belongs to motion for rejecting
The area image of target;
(6) characteristic matching module, is connected with abatement submodule, for by the described area image belonging to moving target and data base
In pre-solid plate carry out characteristic matching.
One the most according to claim 1 remotely obtains useful monitoring massaging device, it is characterized in that, processes at the beginning of described image
Module includes:
A, reference effective degree set submodule, for the effective degree reference threshold of the storage video image sample containing moving target,
Described effective degree represents for judging in original video image sequence information that m frame video image is whether as described effective video image
The judgement factor, described effective degree reference threshold includes rate of change of brightness reference threshold and target size reference threshold;
B, actually active degree calculating sub module, for calculating the effective degree of m frame video image in original video image sequence information,
The computing formula of effective degree is:
Wherein, V represents effective degree, LmBeing the rate of change of brightness of m frame video image, M represents institute in original video image sequence information
The video image totalframes comprised, m=1 ... M, mvFor rate of change of brightness in original video image sequence information more than brightness flop
The totalframes of the video image of rate reference threshold, d is the target size of m frame video image, dpFor target size reference threshold;
C, output sub-module, belong to the image information of effective video image sequence, when having of described current frame image for output
When validity is more than described effective degree reference threshold, described output sub-module exports described current frame image.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610237899.8A CN105957101A (en) | 2016-04-15 | 2016-04-15 | Device for remotely acquiring useful monitoring information |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610237899.8A CN105957101A (en) | 2016-04-15 | 2016-04-15 | Device for remotely acquiring useful monitoring information |
Publications (1)
Publication Number | Publication Date |
---|---|
CN105957101A true CN105957101A (en) | 2016-09-21 |
Family
ID=56918145
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201610237899.8A Pending CN105957101A (en) | 2016-04-15 | 2016-04-15 | Device for remotely acquiring useful monitoring information |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN105957101A (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113743856A (en) * | 2021-01-05 | 2021-12-03 | 北京京东乾石科技有限公司 | Article sorting method and device, and storage medium |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101467893A (en) * | 2007-12-26 | 2009-07-01 | 株式会社东芝 | Ultrasonic diagonstic apparatus, ultrasonic image processing apparatus, and ultrasonic image processing method |
CN102902819A (en) * | 2012-10-30 | 2013-01-30 | 浙江宇视科技有限公司 | Intelligent video analysis method and device |
CN102968802A (en) * | 2012-11-28 | 2013-03-13 | 无锡港湾网络科技有限公司 | Moving target analyzing and tracking method and system based on video monitoring |
-
2016
- 2016-04-15 CN CN201610237899.8A patent/CN105957101A/en active Pending
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101467893A (en) * | 2007-12-26 | 2009-07-01 | 株式会社东芝 | Ultrasonic diagonstic apparatus, ultrasonic image processing apparatus, and ultrasonic image processing method |
CN102902819A (en) * | 2012-10-30 | 2013-01-30 | 浙江宇视科技有限公司 | Intelligent video analysis method and device |
CN102968802A (en) * | 2012-11-28 | 2013-03-13 | 无锡港湾网络科技有限公司 | Moving target analyzing and tracking method and system based on video monitoring |
Non-Patent Citations (1)
Title |
---|
刘乐元: "面向有限资源平台人机交互的人手检测与跟踪", 《中国博士学位论文全文数据库 信息科技辑》 * |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113743856A (en) * | 2021-01-05 | 2021-12-03 | 北京京东乾石科技有限公司 | Article sorting method and device, and storage medium |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN108446617B (en) | Side face interference resistant rapid human face detection method | |
WO2022188379A1 (en) | Artificial intelligence system and method serving electric power robot | |
CN106897698B (en) | Classroom people number detection method and system based on machine vision and binocular collaborative technology | |
CN103546726B (en) | Method for automatically discovering illegal land use | |
CN111666944B (en) | Infrared weak and small target detection method and device | |
CN106530281B (en) | Unmanned plane image fuzzy Judgment method and system based on edge feature | |
CN104463117A (en) | Sample collection method and system used for face recognition and based on video | |
CN111222478A (en) | Construction site safety protection detection method and system | |
CN102426646A (en) | Multi-angle human face detection device and method | |
CN109241814A (en) | Pedestrian detection method based on YOLO neural network | |
CN109145708A (en) | A kind of people flow rate statistical method based on the fusion of RGB and D information | |
CN103020992A (en) | Video image significance detection method based on dynamic color association | |
CN103593679A (en) | Visual human-hand tracking method based on online machine learning | |
CN110334660A (en) | A kind of forest fire monitoring method based on machine vision under the conditions of greasy weather | |
CN102565103B (en) | Tracking detection method for weld defects based on X-ray image | |
CN109558790B (en) | Pedestrian target detection method, device and system | |
CN110276321A (en) | Remote sensing video target tracking method and system | |
CN105869185A (en) | Automatic door | |
CN105957098A (en) | Unmanned reservoir monitoring system | |
CN105957101A (en) | Device for remotely acquiring useful monitoring information | |
CN107748621A (en) | A kind of intelligent interaction robot | |
CN105933645A (en) | Unmanned warehouse monitoring system | |
CN110378935A (en) | Parabolic recognition methods based on image, semantic information | |
CN112183287A (en) | People counting method of mobile robot under complex background | |
CN111126230A (en) | Smoke concentration quantitative evaluation method and electronic equipment applying same |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20160921 |