CN110782432B - Automatic defogging method for image monitoring device - Google Patents

Automatic defogging method for image monitoring device Download PDF

Info

Publication number
CN110782432B
CN110782432B CN201910977788.4A CN201910977788A CN110782432B CN 110782432 B CN110782432 B CN 110782432B CN 201910977788 A CN201910977788 A CN 201910977788A CN 110782432 B CN110782432 B CN 110782432B
Authority
CN
China
Prior art keywords
matrix
image
characteristic value
front glass
lens
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910977788.4A
Other languages
Chinese (zh)
Other versions
CN110782432A (en
Inventor
孙英良
张锐
颜廷萌
杨帆
刘振龙
陶宗娇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhiyang Innovation Technology Co Ltd
Original Assignee
Zhiyang Innovation Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhiyang Innovation Technology Co Ltd filed Critical Zhiyang Innovation Technology Co Ltd
Priority to CN201910977788.4A priority Critical patent/CN110782432B/en
Publication of CN110782432A publication Critical patent/CN110782432A/en
Application granted granted Critical
Publication of CN110782432B publication Critical patent/CN110782432B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03BAPPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B17/00Details of cameras or camera bodies; Accessories therefor
    • G03B17/55Details of cameras or camera bodies; Accessories therefor with provision for heating or cooling, e.g. in aircraft
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50Constructional details
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10004Still image; Photographic image
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20024Filtering details

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • Quality & Reliability (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)

Abstract

The invention relates to the technical field of image monitoring of power transmission lines, in particular to an automatic defogging method of an image monitoring device sum And the dispersion sigma of the matrix T, and then judging the total intensity T of the characteristic value sum And a set characteristic value threshold value theta th Dispersion sigma of matrix T and set dispersion threshold sigma th If the dispersion sigma of the matrix T is smaller than the dispersion threshold sigma th And the total intensity of the characteristic value T sum Less than a set threshold value theta th The water mist is condensed on the front glass of the lens of the image monitoring device, and the front glass of the lens is electrified and heated, so that the water mist or water drops on the front glass of the lens are evaporated, the accuracy of judging the water mist or water drops in the front glass of the lens is improved, and meanwhile, the automatic defogging control function is realized.

Description

Automatic defogging method for image monitoring device
Technical Field
The invention relates to the technical field of image monitoring of power transmission lines, in particular to an automatic defogging method for an image monitoring device.
Background
In recent years, with the development of science and technology, high-voltage transmission lines in China make great progress in monitoring intellectualization and visualization. At present, most of special image monitoring devices for electric power have AI identification capability, and can identify external damage risk factors such as tower cranes, ultrahigh trees and the like. The image monitoring device of the power transmission line is generally arranged on a field power transmission tower and is powered by solar energy and a battery. Day and night temperature difference and local environment's meteorological change lead to condensation drop on the monitoring device lens glass board easily and produce the water smoke, can seriously influence the camera lens formation of image, and the monitoring image can become very fuzzy unclear. If at this moment, illegal operation or other external force damage behaviors exist around the power transmission line, if the problem cannot be found in time, the consequences will be serious.
Most of the prior electric transmission line image monitoring devices do not have corresponding demisting measures. Like the individual security camera of the image monitoring device, the heater and the fan are arranged inside the individual security camera, and the defogging function can only be manually started and closed, so that the individual security camera is very inconvenient in practical application. In the field of security, a great number of cameras adopt a camera system similar to the camera system in the patent application number: 201210302406.6, which automatically controls the defogging function to be turned on or off by combining a temperature and humidity sensor with different judgment logics. According to the scheme, misjudgment is easy to occur, electric energy is wasted, or a defogging effect cannot be achieved.
Disclosure of Invention
The technical problem to be solved by the invention is as follows: the method overcomes the defects of the prior art and provides the automatic defogging method of the image monitoring device with the automatic defogging control function.
The technical scheme adopted by the invention for solving the technical problem is as follows: the automatic defogging method for the image monitoring device comprises the following steps:
step 1: collecting an image;
and 2, step: calculating a characteristic value matrix T of the image pixel;
and 3, step 3: calculating the total eigenvalue intensity T of the eigenvalue matrix T sum And the dispersion σ of the matrix T;
and 4, step 4: respectively judging the total intensity T of the characteristic values sum And a set characteristic value threshold value theta th Dispersion sigma of matrix T and set dispersion threshold sigma th If the dispersion sigma of the matrix T is smaller than the dispersion threshold sigma th And the total intensity of the characteristic value T sum Less than a set threshold value theta th The water mist is condensed on the front glass of the lens of the image monitoring device, otherwise, the water mist does not exist;
and 5: when the water mist is condensed on the lens front glass of the image monitoring device, judging whether the lens front glass is heated or not, and if the lens front glass is not heated, electrifying and heating the lens front glass;
and 6: mirror with mirror headContinuous statistical analysis of total intensity T of characteristic value in heating process of front glass sum If the total intensity T of the characteristic value is sum And when no obvious change exists in the set time period, the front glass of the lens is powered off and heating is stopped.
The method calculates the total intensity T of the characteristic value of the acquired image sum Comparing the dispersion sigma of the matrix T with a correspondingly set threshold value to judge whether the front glass of the lens condenses the water fog column, wherein the total intensity T of the characteristic value sum The comparative analysis of the matrix T is mainly used for eliminating abnormal conditions of lens shielding, haze weather and the like similar to water mist condensation and reducing the probability of misjudgment. When judging that glass condenses to have the water smoke before the camera lens, to glass ohmic heating before the camera lens for the water smoke, the drop evaporation that glass condenses before the camera lens, thereby realize the function of image prison device defogging, make the image of prison shooting clear, the staff of being convenient for discerns the hidden danger that exists in the image.
The step 2 comprises the following substeps:
2-1): acquiring gray data of an image and expressing the gray data by using a two-dimensional matrix to obtain a gray image matrix Y;
Figure BDA0002234212420000021
where w represents the image width and h represents the image height.
2-2): multiplying the gray level image matrix Y with a set filter matrix M to obtain a characteristic value of each pixel point of the image;
2-3): the image matrix is divided into a plurality of n multiplied by n dimensional sub-windows, and a characteristic value matrix T of each sub-window is obtained, wherein n is a natural number.
The filtering matrix M is an enhanced filtering matrix obtained by sequentially cascading a plurality of k x k dimensionality filtering matrixes, and k is a natural number.
The filter matrix M is obtained by sequentially cascading 3 filter matrices of 5 multiplied by 5 dimensionalities, and the calculation formula of the filter matrix M is as follows:
Figure BDA0002234212420000022
wherein:
Figure BDA0002234212420000023
a. b and c are corresponding 5 multiplied by 5 dimension filter matrixes respectively.
The sub-window is an 8 x 8 dimensional sub-window.
Calculating the total intensity T of the characteristic value in the step 3 sum Obtained by summing the eigenvalue matrix T of each sub-window.
According to the characteristic value total intensity T sum Calculating the mean value T avg According to the mean value T avg Calculating the dispersion sigma of the eigenvalue matrix T of each sub-window, wherein the calculation formula of the dispersion sigma is as follows:
Figure BDA0002234212420000031
in the formula, i is the row number of the eigenvalue matrix T, and j is the column number of the eigenvalue matrix T.
Compared with the prior art, the invention has the following beneficial effects:
the automatic defogging method of the image monitoring device provided by the invention realizes a full-automatic defogging control function, does not need human interference, detects and analyzes whether water mist or water drops exist in the front glass of the lens according to the collected image, and further can heat the front glass of the lens when the water mist or water drops exist, so that the water mist or water drops are evaporated, the accuracy of detecting whether the water mist or water drops exist is higher, and electric power operation and maintenance personnel can save worry and labor and work conveniently.
Drawings
FIG. 1 is a flow chart of the present invention.
Detailed Description
Embodiments of the invention are further described below with reference to the accompanying drawings:
examples
As shown in fig. 1, the method for automatically defogging an image surveillance device includes the following steps:
step 1: collecting an image;
step 2: calculating a characteristic value matrix T of the image pixel, wherein the step 2 comprises the following sub-steps:
2-1): acquiring gray scale data of an image and expressing the gray scale data by a two-dimensional matrix to obtain a gray scale image matrix Y,
Figure BDA0002234212420000032
wherein w represents the image width and h represents the image height;
2-2): and multiplying the gray level image matrix Y with a set filter matrix M to obtain a characteristic value of each pixel point of the image, wherein the filter matrix M is an enhanced filter matrix obtained by sequentially cascading a plurality of k multiplied by k dimensionality filter matrices, and k is a natural number. The filter matrix M in this embodiment is obtained by sequentially cascading 3 filter matrices of 5 × 5 dimensions, and the calculation formula of the filter matrix M is as follows:
Figure BDA0002234212420000041
wherein:
Figure BDA0002234212420000042
a. b and c are corresponding 5 multiplied by 5 dimension filter matrixes respectively.
If 3 filtering matrixes of 3 × 3 dimensions are sequentially cascaded to obtain the filtering matrix M, the characteristic effect of obtaining the characteristic value of each pixel point is not good as that of the filtering matrix M obtained by sequentially cascading the filtering matrixes of 5 × 5 dimensions, but the filtering matrix M obtained by sequentially cascading the filtering matrixes of 7 × 7 and other larger dimensions is adopted, so that the resource cost is high, and the calculation time is long, therefore, the filtering matrix M obtained by sequentially cascading the filtering matrixes of 3 × 5 dimensions is preferred, the characteristic effect of the extracted characteristic value can be ensured, and the resource cost and the calculation time can be controlled within a reasonable range.
2-3): the image matrix is divided into a plurality of n × n dimensional sub-windows, a characteristic value matrix T of each sub-window is obtained, n is a natural number, and the sub-window is set to be an 8 × 8 dimensional sub-window in this embodiment.
And step 3: calculating the total eigenvalue intensity T of the eigenvalue matrix T sum And the dispersion sigma of the matrix T, and calculating the total intensity T of the characteristic value sum Obtained by summing the eigenvalue matrix T of each sub-window according to the total intensity T of the eigenvalues sum Calculating the mean value T avg According to the mean value T avg Calculating the dispersion sigma of the eigenvalue matrix T of each sub-window, wherein the calculation formula of the dispersion sigma is as follows:
Figure BDA0002234212420000043
in the formula, i is the row number of the eigenvalue matrix T, j is the column number of the eigenvalue matrix T, in this embodiment, since an 8 × 8 dimensional sub-window is set, i < 8 and j < 8 are set in the calculation formula of the dispersion σ, that is, the values of i and j in the formula are both smaller than the dimension n of the actual sub-window.
And 4, step 4: respectively judging the total intensity T of the characteristic values sum With a set threshold value theta of the characteristic value th Dispersion sigma and a set dispersion threshold sigma th If the dispersion sigma is smaller than the dispersion threshold sigma th And total intensity of characteristic value T sum Less than a set threshold value theta th The water mist is condensed on the front glass of the lens of the image monitoring device, otherwise, the water mist does not exist;
and 5: when the water mist is condensed on the lens front glass of the image monitoring device, judging whether the lens front glass is heated or not, and if the lens front glass is not heated, electrifying and heating the lens front glass;
step 6: continuous statistical analysis of total intensity T of characteristic value in heating process of front glass of lens sum If the total intensity T of the characteristic value is sum And if no obvious change exists in the set time period, the lens front glass is powered off and heating is stopped.
The image monitoring device comprises a power supply battery, a main control module, an image acquisition module, a lens and lens front glass, wherein the image acquisition module adopts a CMOS image sensor, the main control module is used for carrying out ISP processing, image analysis, logic operation, control instruction sending and the like on an image, the lens front glass is electric heating transparent glass, and the power supply battery supplies power to each module.
The method calculates the total intensity T of the characteristic value of the acquired image sum Comparing the dispersion sigma of the matrix T with a correspondingly set threshold value to judge whether the front glass of the lens condenses the water fog column, wherein the total intensity T of the characteristic value sum The comparative analysis of the dispersion sigma mainly aims to eliminate abnormal conditions of lens shielding, haze weather and the like similar to water mist condensation, and reduces the probability of misjudgment. When judging that glass condenses to have the water smoke before the camera lens, to glass ohmic heating before the camera lens for the water smoke, the drop evaporation that glass condenses before the camera lens, thereby realize the function of image prison device defogging, make the image of prison shooting clear, the staff of being convenient for discerns the hidden danger that exists in the image.

Claims (5)

1. An automatic defogging method for an image monitoring device is characterized by comprising the following steps:
step 1: collecting an image;
step 2: calculating a characteristic value matrix T of the image pixel; the step 2 comprises the following substeps:
2-1): acquiring gray data of an image and expressing the gray data by using a two-dimensional matrix to obtain a gray image matrix Y;
2-2): multiplying the gray level image matrix Y with a set filter matrix M to obtain a characteristic value of each pixel point of the image;
2-3): dividing an image matrix into a plurality of n multiplied by n dimensional sub-windows, and acquiring a characteristic value matrix T of each sub-window, wherein n is a natural number;
and step 3: calculating the total eigenvalue intensity T of the eigenvalue matrix T sum And the dispersion σ of the matrix T; calculating the total intensity T of the characteristic value in the step 3 sum The eigenvalue matrix T of each sub-window is summed;
and 4, step 4: respectively judging the total intensity T of the characteristic values sum With a set threshold value theta of the characteristic value th Dispersion sigma of matrix T and set dispersion threshold sigma th If the dispersion σ of the matrix T is smaller than the dispersion threshold σ th And the total intensity of the characteristic value T sum Less than a set threshold value theta th The water mist is condensed on the front glass of the lens of the image monitoring device, otherwise, the water mist does not exist;
and 5: when the water mist is condensed on the lens front glass of the image monitoring device, judging whether the lens front glass is heated or not, and electrifying and heating the lens front glass if the lens front glass is not heated;
and 6: continuous statistical analysis of total intensity T of characteristic value in heating process of front glass of lens sum If the total intensity T of the characteristic value is sum And when no obvious change exists in the set time period, the front glass of the lens is powered off and heating is stopped.
2. The method for automatically defogging an image surveillance device according to claim 1, wherein said filter matrix M is an enhanced filter matrix obtained by sequentially cascading a plurality of k x k dimensional filter matrices, k being a natural number.
3. The method for automatically defogging an image surveillance device according to claim 2, wherein the filter matrix M is obtained by sequentially cascading 3 filter matrices of 5 × 5 dimensions, and the calculation formula of the filter matrix M is as follows:
Figure FDA0003802565890000011
wherein:
Figure FDA0003802565890000021
a. b and c are corresponding 5 multiplied by 5 dimension filter matrixes respectively.
4. The method of claim 3, wherein the sub-window is an 8 x 8 dimensional sub-window.
5. A method for automatically defogging an image capture device according to claim 4 wherein said total intensity T is based on said characteristic value sum Calculating the mean value T avg According to the mean value T avg And calculating the dispersion sigma of the eigenvalue matrix T of each sub-window.
CN201910977788.4A 2019-10-15 2019-10-15 Automatic defogging method for image monitoring device Active CN110782432B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910977788.4A CN110782432B (en) 2019-10-15 2019-10-15 Automatic defogging method for image monitoring device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910977788.4A CN110782432B (en) 2019-10-15 2019-10-15 Automatic defogging method for image monitoring device

Publications (2)

Publication Number Publication Date
CN110782432A CN110782432A (en) 2020-02-11
CN110782432B true CN110782432B (en) 2022-10-04

Family

ID=69385634

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910977788.4A Active CN110782432B (en) 2019-10-15 2019-10-15 Automatic defogging method for image monitoring device

Country Status (1)

Country Link
CN (1) CN110782432B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113077601B (en) * 2021-03-29 2022-09-06 湖南汽车工程职业学院 WeChat-controlled intelligent home security system and computer-readable storage medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104143185A (en) * 2014-06-25 2014-11-12 东软集团股份有限公司 Blemish zone detecting method
CN105966358A (en) * 2015-11-06 2016-09-28 武汉理工大学 Detection algorithm for raindrops on automobile front windshield
CN106657716A (en) * 2016-12-29 2017-05-10 惠州华阳通用电子有限公司 Field of view clearing method and device for electronic in-car rearview mirror
CN108259708A (en) * 2018-01-17 2018-07-06 国家安全生产监督管理总局通信信息中心 There are mist method for processing video frequency and computer readable storage medium

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104143185A (en) * 2014-06-25 2014-11-12 东软集团股份有限公司 Blemish zone detecting method
CN105966358A (en) * 2015-11-06 2016-09-28 武汉理工大学 Detection algorithm for raindrops on automobile front windshield
CN106657716A (en) * 2016-12-29 2017-05-10 惠州华阳通用电子有限公司 Field of view clearing method and device for electronic in-car rearview mirror
CN108259708A (en) * 2018-01-17 2018-07-06 国家安全生产监督管理总局通信信息中心 There are mist method for processing video frequency and computer readable storage medium

Also Published As

Publication number Publication date
CN110782432A (en) 2020-02-11

Similar Documents

Publication Publication Date Title
CN104966372B (en) The forest fire intelligent identifying system and method for multi-data fusion
CN109359697A (en) Graph image recognition methods and inspection system used in a kind of power equipment inspection
CN111882810B (en) Fire identification and early warning method and system
CN101587606A (en) Method and system for detecting staff flow in exhibition venue
CN104581076A (en) Mountain fire monitoring and recognizing method and device based on 360-degree panoramic infrared fisheye camera
CN112134934B (en) Campus management and control system based on cloud data and artificial intelligence application
CN103323460A (en) Insulator detection method and device based on visible light image
CN210119205U (en) Power transmission line icing on-line monitoring device based on image recognition
CN110782432B (en) Automatic defogging method for image monitoring device
CN111899452A (en) Forest fire prevention early warning system based on edge calculation
CN116301091B (en) Temperature control intelligent management system suitable for radiation cold and warm window
CN103945197A (en) Electric power facility external damage prevention warming scheme based on video motion detecting technology
CN106933110A (en) The gesture identifying device of household electrical appliance and its recognition methods
CN110996055A (en) Self-cleaning device and method for lens of image monitoring system of power transmission line
CN209560381U (en) A kind of intelligent environment observing and controlling control system
CN107977531A (en) A kind of method that ground resistance hard measurement is carried out based on image procossing and field mathematical model
CN203275313U (en) Insulator detection device based on visible light image
CN110608674A (en) Power transmission line icing on-line monitoring device based on image recognition
CN112802298A (en) Auxiliary monitoring management system in unattended substation
CN107065721A (en) A kind of electric power facility monitoring early-warning system and method
CN202661864U (en) Centralized control station running environment remote comprehensive monitoring system
CN210959570U (en) Indoor plant intelligent monitoring device
TWI732682B (en) An analyzed system and method for failures of solar power module
TWM609396U (en) Dirt diagnosis system for solar cell panel
CN208155907U (en) A kind of infrared scan detection forest-tree survives the device of situation

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant