CN113014744A - Method for shielding monitoring picture in vehicle and eliminating light flicker interference - Google Patents

Method for shielding monitoring picture in vehicle and eliminating light flicker interference Download PDF

Info

Publication number
CN113014744A
CN113014744A CN201911318972.4A CN201911318972A CN113014744A CN 113014744 A CN113014744 A CN 113014744A CN 201911318972 A CN201911318972 A CN 201911318972A CN 113014744 A CN113014744 A CN 113014744A
Authority
CN
China
Prior art keywords
background
frame
frame difference
image
background frame
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201911318972.4A
Other languages
Chinese (zh)
Other versions
CN113014744B (en
Inventor
马艳
于康龙
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hefei Ingenic Technology Co ltd
Original Assignee
Hefei Ingenic Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hefei Ingenic Technology Co ltd filed Critical Hefei Ingenic Technology Co ltd
Priority to CN201911318972.4A priority Critical patent/CN113014744B/en
Publication of CN113014744A publication Critical patent/CN113014744A/en
Application granted granted Critical
Publication of CN113014744B publication Critical patent/CN113014744B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/14Picture signal circuitry for video frequency region
    • H04N5/21Circuitry for suppressing or minimising disturbance, e.g. moiré or halo
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/14Picture signal circuitry for video frequency region
    • H04N5/21Circuitry for suppressing or minimising disturbance, e.g. moiré or halo
    • H04N5/213Circuitry for suppressing or minimising impulsive noise

Abstract

The invention provides a method for shielding and eliminating light flicker interference of a monitoring picture in a vehicle, which comprises the following steps: buffering multi-frame background frame differences; linear smoothing processing is carried out on the fluctuating frame differences through linear smoothing processing of background frame differences, namely, the weighted mean value of the buffer frame differences is calculated, and the influence of the frame differences at different moments in the buffer is balanced by adopting unequal weight; and (5) filtering light flicker. Before the step of buffering the background frame differences of the multiple frames, the method further comprises: initializing parameters, and further comprising: initializing a background, wherein a counter cn is 0, and creating a background frame difference buffer empty vector; and calculating the background frame difference. After the step of filtering the light ray flicker, the method also comprises the steps of returning a detection result, waiting for the next frame, and calculating the background frame difference.

Description

Method for shielding monitoring picture in vehicle and eliminating light flicker interference
Technical Field
The invention relates to the technical field of intelligent monitoring video processing, in particular to a method for shielding and eliminating light flicker interference of a monitoring picture in a vehicle.
Background
With the continuous development of science and technology, particularly the development of intelligent technology and the wide application of the internet, particularly in recent years, the promises of the internet appointment vehicle provide convenience for the travel of the public, and in order to guarantee the personal safety of personnel in the vehicle, a monitoring camera is additionally arranged in the vehicle, so that lawless persons can be deterred, the on-site information in the vehicle can be effectively saved, and a powerful evidence is provided for the criminal marching. The in-vehicle monitoring camera generally determines whether the frame is blocked by comparing whether the frame difference between the current frame and the original non-blocked frame reaches a predetermined threshold. However, during the running of the vehicle, the environment outside the window is always in the change; in addition, sunlight can enter the vehicle through vehicle windows and the like in the daytime to cause the phenomenon of flickering of picture light; light flicker and the change of the external environment of the vehicle window at any moment can cause unstable fluctuation of the background frame difference value. In the frame difference fluctuation process, if the frame difference exceeds a set threshold value within a period of time, a shielding alarm is triggered, and therefore a shielding false alarm is generated. In particular, the phenomenon of light ray flickering in the vehicle caused by sunlight passing through the vehicle window in the daytime, the frame difference between the current frame image and the background image can generate an accumulation benefit due to factors such as the time change of a scene outside the vehicle window, and the like, so that the frame difference fluctuation is caused, and the occlusion misinformation is easily caused.
Disclosure of Invention
In order to solve the above problems, particularly to a problem of accumulated frame difference fluctuation caused by time change of scenery outside a vehicle window and light flicker interference, the invention provides a method for shielding and eliminating light flicker interference in a monitoring picture in a vehicle, which comprises the following steps: buffering multi-frame background frame differences; linear smoothing processing is carried out on the fluctuating frame differences through linear smoothing processing of background frame differences, namely, the weighted mean value of the buffer frame differences is calculated, and the influence of the frame differences at different moments in the buffer is balanced by adopting unequal weight; and (5) filtering light flicker.
Before the step of buffering the background frame differences of the multiple frames, the method further comprises: initializing parameters, and further comprising: initializing a background, wherein a counter cn is 0, and creating a background frame difference buffer empty vector; and calculating the background frame difference.
After the step of filtering the light ray flicker, the method also comprises the steps of returning a detection result, waiting for the next frame, and calculating the background frame difference.
Thus, the present application has the advantages that:
(1) by buffering multi-frame background frame differences and performing linear smoothing, the problem of large frame difference fluctuation caused by vehicle window scene change, light ray flicker and other problems can be solved.
(2) A linear smoothing processing method of unequal weight weighted average is provided, wherein the set unequal weight takes the time from the current frame as the basis: the closer to the current frame, the greater the weight and vice versa. Compared with the equal-weight average, the setting of the unequal weight can better reflect the influence of the frame difference in the cache and better accord with the actual situation.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the invention and together with the description serve to explain the principles of the invention.
Fig. 1 is a schematic block diagram of a method to which the present invention relates.
Fig. 2 is a schematic flow chart of an embodiment of the present invention.
Fig. 3 is a block flow diagram of a particular embodiment of the present invention relating to a method.
Detailed Description
In order that the technical contents and advantages of the present invention can be more clearly understood, the present invention will now be described in further detail with reference to the accompanying drawings.
As shown in fig. 1, the present invention relates to a method for shielding and eliminating light flicker interference in a monitoring picture in a vehicle, the method comprising: buffering multi-frame background frame differences; linear smoothing processing is carried out on the fluctuating frame differences through linear smoothing processing of background frame differences, namely, the weighted mean value of the buffer frame differences is calculated, and the influence of the frame differences at different moments in the buffer is balanced by adopting unequal weight; and (5) filtering light flicker.
Specifically, as shown in fig. 2, the steps of the method of the present invention can be expressed as follows:
the method comprises the following implementation steps:
s1, parameter initialization, including: initializing a background, wherein a counter cn is 0, and creating a background frame difference buffer empty vector; initializing related threshold values, wherein the initialization values of the threshold value 1, the threshold value 2 and the threshold value 3 are 0.5,0.4 and 10 respectively;
s2, solving a background frame difference;
s3, caching the background frame difference of n frames;
s4, linear smoothing processing of background frame difference;
s5, light ray flicker filtering;
s6, returning a detection result, waiting for the next frame, and executing the step S2.
Wherein, S2 includes:
2.1, according to the formula (1), making a difference between the background gray image and the current frame gray image and taking an absolute value to obtain a frame difference gray image;
d (I, j) ═ abS (B (I, j) -I (I, j)) 0. ltoreq. i.ltoreq.M, 0. ltoreq. j.ltoreq.N equation (1)
Wherein: m and N are the size of the row and the column of the image respectively; b (i, j) represents the pixel value of the ith row and the jth column of the background gray-scale image; i (I, j) represents the pixel value of the ith row and the jth column of the current frame gray image; d (i, j) represents the pixel value of the ith row and the jth column of the frame difference gray image;
2.2, carrying out binarization, corrosion and other treatments on the frame difference gray level image;
2.3, carrying out non-zero pixel accumulation on the frame difference binary image after corrosion;
wherein, S3 includes:
3.1, solving the background frame difference buffer vector size vector _ size, namely the background frame difference of how many frames are buffered;
3.2 if the vector _ size is larger than or equal to n, indicating that the buffer is full, deleting the background frame difference stored at the head of the vector, and then storing the background frame difference of the current frame image at the tail of the vector; otherwise, indicating that the buffer is not full, and directly storing the background frame difference of the current frame image at the tail part;
wherein, S4 includes:
4.1 calculating the weighted average value of the buffered n frames of background frame differences according to the formula (2);
Figure BDA0002326624880000041
4.2 wherein the expression of the weighting function in equation (2) is shown in equation (3);
Figure BDA0002326624880000042
wherein, S5 includes:
5.1 if the background frame difference of the current frame image is greater than a set threshold 1 and the buffered n frames of background frame difference mean value is greater than a set threshold 2, the counter cn is cn + 1; otherwise cn is 0;
5.2 if cn is larger than the set threshold 3, the detection result is that the current frame image is blocked; otherwise, the detection result is that the current frame image is not blocked.
The flow of the specific embodiment of the method of the present invention is shown in fig. 3, wherein the main implementation steps of the method are as follows:
step 1, initializing parameters, including: initializing a background, wherein a counter cn is 0, and creating a background frame difference buffer empty vector; initializing related threshold values, wherein the initialization values of the threshold value 1, the threshold value 2 and the threshold value 3 are 0.5,0.4 and 10 respectively;
step 2, calculating the background frame difference
2.1, according to the formula (1), making a difference between the background gray image and the current frame gray image and taking an absolute value to obtain a frame difference gray image;
d (I, j) ═ abs (B (I, j) -I (I, j))0 ≦ I ≦ M,0 ≦ j ≦ N equation (1)
Wherein: m and N are the size of the row and the column of the image respectively; b (i, j) represents the pixel value of the ith row and the jth column of the background gray-scale image; i (I, j) represents the pixel value of the ith row and the jth column of the current frame gray image; d (i, j) represents the pixel value of the ith row and the jth column of the frame difference gray image;
2.2, carrying out binarization, corrosion and other treatments on the frame difference gray level image;
2.3, carrying out non-zero pixel accumulation on the frame difference binary image after corrosion;
step 3, buffering the background frame difference of n frames
3.1, solving the background frame difference buffer vector size vector _ size, namely the background frame difference of how many frames are buffered;
3.2 if the vector _ size is larger than or equal to n, indicating that the buffer is full, deleting the background frame difference stored at the head of the vector, and then storing the background frame difference of the current frame image at the tail of the vector; otherwise, indicating that the buffer is not full, and directly storing the background frame difference of the current frame image at the tail part;
step 4, linear smoothing processing of background frame difference
Calculating a weighted average value of the buffered n frames of background frame differences according to a formula (2);
Figure BDA0002326624880000051
wherein: w is a weight vector satisfying
Figure BDA0002326624880000052
Considering that the weight of the background frame difference is larger closer to the current frame time, the weight function expression is set in the method as shown in formula (3);
Figure BDA0002326624880000053
step 5, light ray flicker filtering
5.1 if the background frame difference of the current frame image is greater than a set threshold 1 and the buffered n frames of background frame difference mean value is greater than a set threshold 2, the counter cn is cn + 1; otherwise cn is 0;
5.2 if cn is larger than the set threshold 3, the detection result is that the current frame image is blocked; otherwise, the detection result is that the current frame image is not blocked;
and 6, returning a detection result, waiting for the next frame, and executing the step 2.
The above description is only a preferred embodiment of the present invention, and is not intended to limit the present invention, and various modifications and changes may be made to the embodiment of the present invention by those skilled in the art. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims (8)

1. A method for shielding and eliminating light flicker interference of in-vehicle monitoring pictures is characterized by comprising the following steps: buffering multi-frame background frame differences; linear smoothing processing is carried out on the fluctuating frame differences through linear smoothing processing of background frame differences, namely, the weighted mean value of the buffer frame differences is calculated, and the influence of the frame differences at different moments in the buffer is balanced by adopting unequal weight; and (5) filtering light flicker.
2. The method for eliminating the light flicker interference by monitoring the picture occlusion in the vehicle as claimed in claim 1, wherein before the step of buffering the background frame differences of the plurality of frames, the method further comprises: initializing parameters, and further comprising: initializing a background, wherein a counter cn is 0, and creating a background frame difference buffer empty vector; initializing related threshold values, wherein the initialization values of the threshold value 1, the threshold value 2 and the threshold value 3 are 0.5,0.4 and 10 respectively; and calculating the background frame difference.
3. The method for eliminating the interference of the light flicker by the shielding of the monitoring picture in the vehicle as claimed in claim 2, wherein the step of calculating the background frame difference further comprises:
A. according to formula 1, making difference between the background gray image and the current frame gray image and taking an absolute value to obtain a frame difference gray image;
equation 1: d (I, j) ═ abs (B (I, j) -I (I, j)) 0. ltoreq. i.ltoreq.m, 0. ltoreq. j.ltoreq.n,
wherein: m and N are the size of the row and the column of the image respectively; b (i, j) represents the pixel value of the ith row and the jth column of the background gray-scale image; i (I, j) represents the pixel value of the ith row and the jth column of the current frame gray image; d (i, j) represents the pixel value of the ith row and the jth column of the frame difference gray image;
B. carrying out binarization and corrosion treatment on the frame difference gray level image;
C. and performing non-zero pixel accumulation on the frame difference binary image after corrosion.
4. The method for eliminating the interference of the light flicker caused by the shielding of the monitoring pictures in the vehicle as claimed in claim 1, wherein the step of filtering the light flicker further comprises the step of returning a detection result, waiting for the next frame, and performing the step of calculating the background frame difference.
5. The method for eliminating the light flicker interference by monitoring the picture occlusion in the vehicle as claimed in claim 1, wherein the step of buffering the background frame differences of the plurality of frames further comprises:
H. solving the background frame difference buffer vector size vector _ size, namely the background frame difference of how many frames are buffered;
I. if the vector _ size is larger than or equal to n, the buffer is full, the background frame difference stored at the head of the vector needs to be deleted, and then the background frame difference of the current frame image is stored at the tail of the vector; otherwise, the buffer is not full, and the background frame difference of the current frame image is directly stored at the tail part.
6. The method for eliminating the light flicker interference for the in-vehicle monitoring picture occlusion according to claim 1, wherein the step of the linear smoothing of the background frame difference further comprises:
calculating a weighted average value of the buffered n frames of background frame differences according to a formula 2;
equation 2:
Figure FDA0002326624870000021
wherein: w is a weight vector satisfying
Figure FDA0002326624870000022
In the method, a weight function expression is set as shown in a formula (3);
equation 3:
Figure FDA0002326624870000023
7. the method for shielding and eliminating the light flicker interference of the in-vehicle monitoring picture according to claim 1, wherein the step of light flicker filtering further comprises:
if the background frame difference of the current frame image is greater than a set threshold value 1 and the buffered n frames of background frame difference mean value is greater than a set threshold value 2, the counter cn is cn + 1; otherwise cn is 0;
y, if cn is larger than a set threshold value 3, the detection result is that the current frame image is blocked;
otherwise, the detection result is that the current frame image is not blocked.
8. The method for shielding and eliminating the light flicker interference of the in-vehicle monitoring picture according to claim 1, wherein the unequal weight is based on the time from the current frame: the closer to the current frame, the greater the weight.
CN201911318972.4A 2019-12-19 2019-12-19 Method for detecting shielding of monitoring picture in vehicle Active CN113014744B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911318972.4A CN113014744B (en) 2019-12-19 2019-12-19 Method for detecting shielding of monitoring picture in vehicle

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911318972.4A CN113014744B (en) 2019-12-19 2019-12-19 Method for detecting shielding of monitoring picture in vehicle

Publications (2)

Publication Number Publication Date
CN113014744A true CN113014744A (en) 2021-06-22
CN113014744B CN113014744B (en) 2022-07-22

Family

ID=76382221

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911318972.4A Active CN113014744B (en) 2019-12-19 2019-12-19 Method for detecting shielding of monitoring picture in vehicle

Country Status (1)

Country Link
CN (1) CN113014744B (en)

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050069207A1 (en) * 2002-05-20 2005-03-31 Zakrzewski Radoslaw Romuald Method for detection and recognition of fog presence within an aircraft compartment using video images
CN102111532A (en) * 2010-05-27 2011-06-29 周渝斌 Camera lens occlusion detecting system and method
CN103150736A (en) * 2012-11-16 2013-06-12 佳都新太科技股份有限公司 Camera motion detecting method based on video monitoring
CN107249122A (en) * 2017-07-26 2017-10-13 杨建伟 A kind of moving target monitoring system for intelligent monitoring
CN107274674A (en) * 2017-06-28 2017-10-20 深圳市金溢科技股份有限公司 A kind of parking area management method based on video identification, apparatus and system
US20180027224A1 (en) * 2016-07-19 2018-01-25 Fotonation Limited Systems and Methods for Estimating and Refining Depth Maps
CN108765393A (en) * 2018-05-21 2018-11-06 西南交通大学 A kind of high-speed railway touching net vibration behavioral value method
CN109063602A (en) * 2018-07-13 2018-12-21 北京理工大学 Method for tracking target and device under Celestial Background based on path continuity function
CN110233991A (en) * 2019-06-03 2019-09-13 上海眼控科技股份有限公司 A kind of detection method and system for video shelter in video monitoring

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050069207A1 (en) * 2002-05-20 2005-03-31 Zakrzewski Radoslaw Romuald Method for detection and recognition of fog presence within an aircraft compartment using video images
CN102111532A (en) * 2010-05-27 2011-06-29 周渝斌 Camera lens occlusion detecting system and method
CN103150736A (en) * 2012-11-16 2013-06-12 佳都新太科技股份有限公司 Camera motion detecting method based on video monitoring
US20180027224A1 (en) * 2016-07-19 2018-01-25 Fotonation Limited Systems and Methods for Estimating and Refining Depth Maps
CN107274674A (en) * 2017-06-28 2017-10-20 深圳市金溢科技股份有限公司 A kind of parking area management method based on video identification, apparatus and system
CN107249122A (en) * 2017-07-26 2017-10-13 杨建伟 A kind of moving target monitoring system for intelligent monitoring
CN108765393A (en) * 2018-05-21 2018-11-06 西南交通大学 A kind of high-speed railway touching net vibration behavioral value method
CN109063602A (en) * 2018-07-13 2018-12-21 北京理工大学 Method for tracking target and device under Celestial Background based on path continuity function
CN110233991A (en) * 2019-06-03 2019-09-13 上海眼控科技股份有限公司 A kind of detection method and system for video shelter in video monitoring

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
MA LI等: "The Research and Implementation of Moving Object Detecting and Tracking in Intelligence Video Monitor System", 《2011 INTERNATIONAL CONFERENCE ON MULTIMEDIA AND SIGNAL PROCESSING》 *
马艳: "基于单目视觉的运动目标跟踪算法研究与实现", 《中国优秀硕士学位论文全文数据库(电子期刊)》 *

Also Published As

Publication number Publication date
CN113014744B (en) 2022-07-22

Similar Documents

Publication Publication Date Title
CN105631831B (en) Video image enhancing method under the conditions of a kind of haze
CN109859126B (en) Video noise reduction method and device, electronic equipment and storage medium
US9454805B2 (en) Method and apparatus for reducing noise of image
JP4203736B2 (en) Image motion detection apparatus and computer program
CN108805265B (en) Neural network model processing method and device, image processing method and mobile terminal
CN111539265B (en) Method for detecting abnormal behavior in elevator car
CN110378861B (en) Image fusion method and device
KR100229376B1 (en) Image processing method
US20220156949A1 (en) Information processing method and system
CN113706414B (en) Training method of video optimization model and electronic equipment
CN108877009A (en) A kind of intelligent access control system based on recognition of face
CN114586337A (en) Video anti-shake optimization processing method and device and electronic equipment
CN104796580B (en) A kind of real-time steady picture video routing inspection system integrated based on selection
US7983510B2 (en) Noise reduction device and method
US20220019821A1 (en) Method for generating a monitoring image
CN113014744B (en) Method for detecting shielding of monitoring picture in vehicle
JP2015158796A (en) Object detection device
TWI425446B (en) A method for object detection system in day-and-night environment
US20160300357A1 (en) System and method for identifying an object in an image
JP2010226646A (en) Video processing apparatus
CN116506741A (en) Method and device for removing flicker of monitoring video, electronic equipment and computer readable medium
CN111062272A (en) Image processing and pedestrian identification method and device based on color recovery and readable storage medium
JPH10302171A (en) Monitoring picture recording device
CN108961293A (en) A kind of method, apparatus of background subtraction, equipment and storage medium
CN106780646B (en) Parameter-free background modeling method suitable for multiple scenes

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant