CN110636281A - Real-time monitoring camera shielding detection method based on background model - Google Patents

Real-time monitoring camera shielding detection method based on background model Download PDF

Info

Publication number
CN110636281A
CN110636281A CN201910899899.8A CN201910899899A CN110636281A CN 110636281 A CN110636281 A CN 110636281A CN 201910899899 A CN201910899899 A CN 201910899899A CN 110636281 A CN110636281 A CN 110636281A
Authority
CN
China
Prior art keywords
monitoring camera
background model
detected
monitoring
shielding
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201910899899.8A
Other languages
Chinese (zh)
Other versions
CN110636281B (en
Inventor
易云
徐林楠
肖伟
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
JIANGXI YIYUAN MULTIMEDIA TECHNOLOGY Co Ltd
Original Assignee
JIANGXI YIYUAN MULTIMEDIA TECHNOLOGY Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by JIANGXI YIYUAN MULTIMEDIA TECHNOLOGY Co Ltd filed Critical JIANGXI YIYUAN MULTIMEDIA TECHNOLOGY Co Ltd
Priority to CN201910899899.8A priority Critical patent/CN110636281B/en
Publication of CN110636281A publication Critical patent/CN110636281A/en
Application granted granted Critical
Publication of CN110636281B publication Critical patent/CN110636281B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N17/00Diagnosis, testing or measuring for television systems or their details
    • H04N17/002Diagnosis, testing or measuring for television systems or their details for television cameras

Abstract

The invention discloses a real-time detection method for shielding of a monitoring camera based on a background model, which aims to solve the technical problems that the shielding of the existing monitoring camera is difficult to judge in real time through human eyes, the detection by using the current computer vision technology auxiliary algorithm requires a large-scale server for adaptation, the firmware occupation is large, and the false alarm rate is high. The detection method comprises the following steps: firstly, establishing a background model under the condition of no shielding, then acquiring a monitoring image of a monitoring camera in real time, then carrying out image comparison, judging whether the monitoring camera is shielded, if so, notifying a user, and if not, updating the background model. The detection method is based on the background model technology, the latest environmental state information is timely overlapped, the extremely high accuracy of detection is realized, and meanwhile, the high-speed real-time high-accuracy detection of whether the monitoring camera is shielded or not is finally realized by combining the shielding judgment algorithm set in each step in a breakthrough manner.

Description

Real-time monitoring camera shielding detection method based on background model
Technical Field
The invention belongs to the field of intelligent monitoring, and particularly relates to a real-time monitoring camera shielding detection method based on a background model.
Background
In order to ensure social security and maintain social stability, and carry out legal affair execution objectively and fairly, video monitoring becomes one of the very common technical means at present and is also an important component of a security system. Nowadays, aiming at the requirements of social security, the public security department is always dedicated to monitoring public areas, namely, the construction of a skynet monitoring project is completed, the skynet monitoring project is that a plurality of monitoring cameras are reasonably installed in the public areas, all-weather and all-around monitoring is realized on the areas through background control of a public security department, and currently, the world largest video monitoring network is built in China.
However, due to the influence of human or natural conditions, some monitoring cameras may be shielded by some objects under certain conditions, so that the normal use of video monitoring is influenced. In the total area, due to the existence of a large number of video monitoring cameras, the uninterrupted inspection of whether all the monitoring cameras are shielded is difficult to realize through the observation of human eyes, and the feasibility is extremely low; meanwhile, a computer vision technology auxiliary algorithm can be used for detection, but a detection method in the prior art cannot distinguish whether an object in a monitoring video is a normal object or a blocking object, so that the situation of false alarm often occurs.
Disclosure of Invention
(1) Technical problem to be solved
Aiming at the defects of the prior art, the invention aims to provide a monitoring camera shielding real-time detection method based on a background model, which aims to solve the technical problems that the shielding of the existing monitoring camera is difficult to judge in real time through human eyes, the detection by using the existing computer vision technology auxiliary algorithm needs a large-scale server for adaptation, the occupancy of firmware is large, and the false alarm rate is high; the detection method is based on the background model technology, the latest environmental state information is timely overlapped, the extremely high accuracy of detection is realized, and meanwhile, the high-speed real-time high-accuracy detection of whether the monitoring camera is shielded or not is finally realized by combining the shielding judgment algorithm set in each step in a breakthrough manner.
(2) Technical scheme
In order to solve the technical problem, the invention provides a real-time detection method for shielding of a monitoring camera based on a background model, which comprises the following specific steps:
firstly, establishing a background model M of a monitoring camera to be detected under the condition of no shielding when a system is initialized;
step two, acquiring the monitoring image of the monitoring camera to be detected in real time when the system normally operates;
comparing the background model M with the monitoring image of the monitoring camera to be detected, and judging whether the monitoring camera to be detected is shielded;
step four, if the monitoring camera to be detected is judged to be blocked, reminding a user; and if the monitoring camera to be detected is judged not to be shielded, updating the background model M according to the monitoring image acquired by the monitoring camera to be detected at present, and continuing to perform the step two.
The background model M for establishing the monitoring camera to be detected under the condition of no shielding can use various background modeling algorithms, such as Vibe background modeling, Gaussian mixture background modeling, CodeBook background modeling and the like.
Preferably, in the step one, the specific steps are as follows:
(1.1) acquiring an N-frame color image of the monitoring camera to be detected under the condition of no shielding when a system is initialized;
(1.2) converting the N-frame color image into a gray scale image, and recording as G ═ Gi|i∈[1,N]};
(1.3) calculating the average value of G in time series according to pixel positions, the background model is
Figure BDA0002211488990000021
Thereby obtaining a background model M of the monitoring camera to be detected under the condition of no shielding.
In the second step, the specific steps are as follows:
(2.1) acquiring K frame color images at the same time interval when the system is in normal operation;
(2.2) converting the K frame color images into gray scale images respectively, and recording the gray scale imagesG′={gi|i∈[1,K]And obtaining the monitoring image of the monitoring camera to be detected.
In the third step, the concrete steps are as follows:
(3.1) in the horizontal and vertical directions, the background model M is averagely divided into regions with the same size as the P block and the Q block, which are marked as { Mij|i∈[1,P],j∈[1,Q]};
(3.2) the following steps (3.3) to (3.9) are repeated to determine the K-frame gray scale map G' ═ Gi|i∈[1,K]Whether it is occluded;
(3.3) separately treating g in the horizontal and vertical directionsiAveragely cutting the P block and the Q block into regions to be detected with the same size, and recording the regions as { aij|i∈[1,P],j∈[1,Q]};
(3.4) the following steps (3.5) to (3.7) are repeated to judge aijWhether it is occluded or not;
(3.5) calculation of aijMean of gray scale Mean (a)ij) And standard deviation Std (a)ij);
(3.6) if Mean (a)ij) < Tm and Std (a)ij) < Ts, the area a is calculated by positionijWith background model MijThe absolute value of the difference, denoted as abs (a)ij-Mij);
(3.7) if Mean (abs (a)ij-Mij) Ta), then return to aijThe area is occluded, otherwise return to aijIs not occluded;
(3.8) if giIn which there is a certain area aijIs shielded, then returns to giIs occluded, otherwise returns to giIs not occluded;
(3.9) calculating the occluded G in GiThe number is marked as L; and if L is more than Tl, returning to the monitoring camera to be shielded, otherwise, returning to the monitoring camera to be normal.
Wherein Mean () and Std () are Mean and standard deviation functions, respectively; tm and Ts are a mean threshold and a standard deviation threshold, respectively; ta is the fixed threshold in step (3.7), and Tl is the fixed threshold in step (3.9).
In the fourth step, if the monitored camera to be detected is judged to be blocked, the user is reminded, and the specific steps are as follows:
(4.11) reminding the user by calling a short message sending module, sending a short message notice to a specified mobile phone number, and/or popping up a window on a monitoring server for reminding;
and (4.12) calling the storage module to store the relevant information into the database.
In the fourth step, if it is determined that the monitoring camera to be detected is not shielded, the specific step of updating the background model M according to the monitoring image obtained by the current monitoring camera to be detected includes:
(4.21) calculating G' ═ { G) by position in time seriesi|i∈[1,K]Mean of { fraction (v) }, denoted Mean (G');
(4.22) updating the background model according to the formula M ═ M + Mean (G')/2.
(3) Advantageous effects
Compared with the prior art, the invention has the beneficial effects that:
based on the background model technology, the invention utilizes the monitoring image obtained by the monitoring camera to be detected to update the background model in real time and timely update the latest environmental state information, thereby realizing extremely high accuracy of detection; meanwhile, by combining the shielding judgment algorithm set in each step in a breakthrough manner, the algorithm is low in calculation complexity, does not need a large-scale server for adaptation, is small in firmware occupation amount, can be used for rapidly detecting multiple paths of monitoring cameras in real time by one server, and finally realizes high-speed, real-time and high-accuracy detection on whether the monitoring cameras are shielded or not.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the embodiments or the technical solutions in the prior art will be briefly described below, it is obvious that the drawings in the following description are only one embodiment of the present invention, and other drawings can be obtained by those skilled in the art without creative efforts.
Fig. 1 is a schematic view of a flow framework of an embodiment of a real-time monitoring camera occlusion detection method according to the present invention.
Detailed Description
In order to make the technical means, the original characteristics, the achieved purposes and the effects of the invention easily understood and obvious, the technical solutions in the embodiments of the present invention are clearly and completely described below to further illustrate the invention, and obviously, the described embodiments are only a part of the embodiments of the present invention, but not all the embodiments.
The embodiment is a method for detecting whether a monitoring camera is shielded in real time, a schematic flow frame diagram of a judging process is shown in fig. 1, and the specific process is as follows:
(1.1) acquiring an N-frame color image of the monitoring camera to be detected under the condition of no shielding when a system is initialized;
(1.2) converting the N-frame color image into a gray scale image, and recording as G ═ Gi|i∈[1,N]};
(1.3) calculating the average value of G in time series according to pixel positions, the background model is
Figure BDA0002211488990000051
Thereby obtaining a background model M of the monitoring camera to be detected under the condition of no shielding.
(2.1) acquiring K frame color images at the same time interval when the system is in normal operation;
(2.2) converting the K-frame color image into a gray scale image, which is marked as G ═ Gi|i∈[1,K]And obtaining the monitoring image of the monitoring camera to be detected.
(3.1) in the horizontal and vertical directions, the background model M is averagely divided into regions with the same size as the P block and the Q block, which are marked as { Mij|i∈[1,P],j∈[1,Q]};
(3.2) the following steps (3.3) to (3.9) are repeated to determine the K-frame gray scale map G' ═ Gi|i∈[1,K]Whether it is occluded;
(3.3) separately treating g in the horizontal and vertical directionsiThe average cutting is that P blocks are the same as Q blocksThe size of the region to be detected is marked as { aij|i∈[1,P],j∈[1,Q]};
(3.4) the following steps (3.5) to (3.7) are repeated to judge aijWhether it is occluded or not;
(3.5) calculation of aijMean of gray scale Mean (a)ij) And standard deviation Std (a)ij);
(3.6) if Mean (a)ij)<Tm and Std (a)ij) < Ts, the area a is calculated by positionijWith background model MijThe absolute value of the difference, denoted as abs (a)ij-Mij);
(3.7) if Mean (abs (a)ij-Mij) Ta), then return to aijThe area is occluded, otherwise return to aijIs not occluded;
(3.8) if giIn which there is a certain area aijIs shielded, then returns to giIs occluded, otherwise returns to giIs not occluded;
(3.9) calculating the occluded G in GiThe number is marked as L; and if L is more than Tl, returning to the monitoring camera to be shielded, otherwise, returning to the monitoring camera to be normal.
(4.1) if the monitoring camera to be detected is judged to be blocked, reminding a user by calling a short message sending module to send a short message notice to a specified mobile phone number, or popping up a window on a monitoring server to remind, or both; and the storage module is called to store the relevant information in the database.
(4.2) if the monitoring camera to be detected is judged not to be shielded, calculating G' ═ G according to positions on the time sequencei|i∈[1,K]Mean of { fraction (v) }, denoted Mean (G'); and updating the background model according to the formula M ═ (M + Mean (G'))/2.
Therefore, the background model is updated in real time based on the background model technology, and whether the monitoring camera is shielded or not is finally detected in real time at high speed and with high accuracy.
Having thus described the principal technical features and basic principles of the invention, and the advantages associated therewith, it will be apparent to those skilled in the art that the invention is not limited to the details of the foregoing illustrative embodiments, but is capable of other specific forms without departing from the spirit or essential characteristics thereof. The present embodiments are therefore to be considered in all respects as illustrative and not restrictive, the scope of the invention being indicated by the appended claims rather than by the foregoing description, and all changes which come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein.
Furthermore, it should be understood that although the present description is described in terms of various embodiments, not every embodiment includes only a single embodiment, and such descriptions are provided for clarity only, and those skilled in the art will recognize that the embodiments described herein can be combined as a whole to form other embodiments as would be understood by those skilled in the art.

Claims (2)

1. A real-time detection method for shielding of a monitoring camera based on a background model is characterized by comprising the following specific steps:
firstly, establishing a background model M of a monitoring camera to be detected under the condition of no shielding when a system is initialized;
step two, acquiring the monitoring image of the monitoring camera to be detected in real time when the system normally operates;
comparing the background model M with the monitoring image of the monitoring camera to be detected, and judging whether the monitoring camera to be detected is shielded;
step four, if the monitoring camera to be detected is judged to be blocked, reminding a user; and if the monitoring camera to be detected is judged not to be shielded, updating the background model M according to the monitoring image acquired by the monitoring camera to be detected at present, and continuing to perform the step two.
2. The real-time monitoring camera occlusion detection method based on the background model is characterized in that;
in the first step, the specific steps are as follows:
(1.1) acquiring an N-frame color image of the monitoring camera to be detected under the condition of no shielding when a system is initialized;
(1.2) converting the N-frame color image into a gray scale image, and recording as G ═ Gi|i∈[1,N]};
(1.3) calculating the average value of G in time series according to pixel positions, the background model is
Figure FDA0002211488980000011
Thereby obtaining a background model M of the monitoring camera to be detected under the condition of no shielding;
in the second step, the specific steps are as follows:
(2.1) acquiring K frame color images at the same time interval when the system is in normal operation;
(2.2) converting the K-frame color image into a gray scale image, which is marked as G ═ Gi|i∈[1,K]Obtaining a monitoring image of the monitoring camera to be detected;
in the third step, the concrete steps are as follows:
(3.1) in the horizontal and vertical directions, the background model M is averagely divided into regions with the same size as the P block and the Q block, which are marked as { Mij|i∈[1,P],j∈[1,Q]};
(3.2) the following steps (3.3) to (3.9) are repeated to determine the K-frame gray scale map G' ═ Gi|i∈[1,K]Whether it is occluded;
(3.3) separately treating g in the horizontal and vertical directionsiAveragely cutting the P block and the Q block into regions to be detected with the same size, and recording the regions as { aij|i∈[1,P],j∈[1,Q]};
(3.4) the following steps (3.5) to (3.7) are repeated to judge aijWhether it is occluded or not;
(3.5) calculation of aijMean of gray scale Mean (a)ij) And standard deviation Std (a)ij);
(3.6) if Mean (a)ij) < Tm and Std (a)ij) < Ts, the area a is calculated by positionijWith background model MijThe absolute value of the difference, denoted as abs (a)ij-Mij);
(3.7) if Mean (abs (a)ij-Mij) Ta), then return to aijThe area is occluded, otherwise return to aijIs not occluded;
(3.8) if giIn which there is a certain area aijIs shielded, then returns to giIs occluded, otherwise returns to giIs not occluded;
(3.9) calculating the occluded G in GiThe number is marked as L; if L is larger than Tl, returning to the monitoring camera to be shielded, otherwise returning to the monitoring camera to be normal;
in the fourth step, if the monitored camera to be detected is judged to be blocked, the user is reminded, and the specific steps are as follows:
(4.11) reminding the user by calling a short message sending module, sending a short message notice to a specified mobile phone number, and/or popping up a window on a monitoring server for reminding;
(4.12) calling a storage module to store the related information into a database;
in the fourth step, if it is determined that the monitoring camera to be detected is not shielded, the specific step of updating the background model M according to the monitoring image obtained by the current monitoring camera to be detected includes:
(4.21) calculating G' ═ { G) by position in time seriesi|i∈[1,K]Mean of { fraction (v) }, denoted Mean (G');
(4.22) updating the background model according to the formula M ═ M + Mean (G')/2.
CN201910899899.8A 2019-09-23 2019-09-23 Real-time monitoring camera shielding detection method based on background model Active CN110636281B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910899899.8A CN110636281B (en) 2019-09-23 2019-09-23 Real-time monitoring camera shielding detection method based on background model

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910899899.8A CN110636281B (en) 2019-09-23 2019-09-23 Real-time monitoring camera shielding detection method based on background model

Publications (2)

Publication Number Publication Date
CN110636281A true CN110636281A (en) 2019-12-31
CN110636281B CN110636281B (en) 2021-06-18

Family

ID=68972365

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910899899.8A Active CN110636281B (en) 2019-09-23 2019-09-23 Real-time monitoring camera shielding detection method based on background model

Country Status (1)

Country Link
CN (1) CN110636281B (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112261402A (en) * 2020-09-22 2021-01-22 北京紫光展锐通信技术有限公司 Image detection method and system and camera shielding monitoring method and system
CN112422953A (en) * 2020-10-22 2021-02-26 深圳云天励飞技术股份有限公司 Method and device for identifying whether camera is shielded or not and terminal equipment
CN112597952A (en) * 2020-12-28 2021-04-02 深圳市捷顺科技实业股份有限公司 Method, device and system for identifying monitoring state of camera and storage medium
CN117557969A (en) * 2024-01-12 2024-02-13 盛视科技股份有限公司 Real-time detection method for shielding monitoring

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090060278A1 (en) * 2007-09-04 2009-03-05 Objectvideo, Inc. Stationary target detection by exploiting changes in background model
CN102231223A (en) * 2011-06-02 2011-11-02 深圳中兴力维技术有限公司 Foreign object blocking and alarming method used for camera
CN104079886A (en) * 2014-07-09 2014-10-01 李任鸿 Method for detecting whether monitoring camera shielded or disturbed
CN107316312A (en) * 2017-06-30 2017-11-03 深圳信路通智能技术有限公司 A kind of video image occlusion detection method and system
CN206894785U (en) * 2017-07-13 2018-01-16 来邦科技股份公司 The talkback unit that the guard mechanism and camera of a kind of camera can block

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090060278A1 (en) * 2007-09-04 2009-03-05 Objectvideo, Inc. Stationary target detection by exploiting changes in background model
CN102231223A (en) * 2011-06-02 2011-11-02 深圳中兴力维技术有限公司 Foreign object blocking and alarming method used for camera
CN104079886A (en) * 2014-07-09 2014-10-01 李任鸿 Method for detecting whether monitoring camera shielded or disturbed
CN107316312A (en) * 2017-06-30 2017-11-03 深圳信路通智能技术有限公司 A kind of video image occlusion detection method and system
CN206894785U (en) * 2017-07-13 2018-01-16 来邦科技股份公司 The talkback unit that the guard mechanism and camera of a kind of camera can block

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112261402A (en) * 2020-09-22 2021-01-22 北京紫光展锐通信技术有限公司 Image detection method and system and camera shielding monitoring method and system
CN112422953A (en) * 2020-10-22 2021-02-26 深圳云天励飞技术股份有限公司 Method and device for identifying whether camera is shielded or not and terminal equipment
CN112422953B (en) * 2020-10-22 2023-03-03 深圳云天励飞技术股份有限公司 Method and device for identifying whether camera is shielded or not and terminal equipment
CN112597952A (en) * 2020-12-28 2021-04-02 深圳市捷顺科技实业股份有限公司 Method, device and system for identifying monitoring state of camera and storage medium
CN117557969A (en) * 2024-01-12 2024-02-13 盛视科技股份有限公司 Real-time detection method for shielding monitoring

Also Published As

Publication number Publication date
CN110636281B (en) 2021-06-18

Similar Documents

Publication Publication Date Title
CN110636281B (en) Real-time monitoring camera shielding detection method based on background model
CN110136447B (en) Method for detecting lane change of driving and identifying illegal lane change
CN103729858B (en) A kind of video monitoring system is left over the detection method of article
CN107948465B (en) A kind of method and apparatus that detection camera is disturbed
Alpatov et al. Vehicle detection and counting system for real-time traffic surveillance
CN111047818A (en) Forest fire early warning system based on video image
KR20210078530A (en) Lane property detection method, device, electronic device and readable storage medium
KR20210080459A (en) Lane detection method, apparatus, electronic device and readable storage medium
CN103763515A (en) Video anomaly detection method based on machine learning
CN109886219A (en) Shed object detecting method, device and computer readable storage medium
CN101835035A (en) Regional invasion real-time detection method
CN107705326A (en) A kind of intrusion detection method that crosses the border in security sensitive region
CN111339905B (en) CIM well lid state visual detection system based on deep learning and multiple visual angles
CN103280052B (en) Be applied to the intrusion detection method of long distance track circuit intelligent video monitoring
CN110348343A (en) A kind of act of violence monitoring method, device, storage medium and terminal device
CN107610393A (en) A kind of intelligent office monitoring system
CN112184773A (en) Helmet wearing detection method and system based on deep learning
CN108846852A (en) Monitor video accident detection method based on more examples and time series
CN110490150A (en) A kind of automatic auditing system of picture violating the regulations and method based on vehicle retrieval
CN113139477A (en) Method, device and equipment for training well lid detection model and computer storage medium
CN106485697B (en) A kind of roadbed subsidence and foreign matter detecting method based on binocular vision
CN112633157A (en) AGV working area safety real-time detection method and system
CN112329515A (en) High-point video monitoring congestion event detection method
CN112927178A (en) Occlusion detection method, occlusion detection device, electronic device, and storage medium
He Intelligent video surveillance technology in intelligent transportation

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
PE01 Entry into force of the registration of the contract for pledge of patent right

Denomination of invention: A Real Time Occlusion Detection Method for Surveillance Cameras Based on Background Model

Effective date of registration: 20231107

Granted publication date: 20210618

Pledgee: Agricultural Bank of China Co.,Ltd. Ganzhou Zhanggong Sub branch

Pledgor: JIANGXI YIYUAN MULTI-MEDIA TECHNOLOGY Co.,Ltd.

Registration number: Y2023980064612

PE01 Entry into force of the registration of the contract for pledge of patent right