CN111597909A - Fire detection and judgment method based on visual saliency - Google Patents
Fire detection and judgment method based on visual saliency Download PDFInfo
- Publication number
- CN111597909A CN111597909A CN202010319755.3A CN202010319755A CN111597909A CN 111597909 A CN111597909 A CN 111597909A CN 202010319755 A CN202010319755 A CN 202010319755A CN 111597909 A CN111597909 A CN 111597909A
- Authority
- CN
- China
- Prior art keywords
- image
- suspicious region
- visual saliency
- fire detection
- fire
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000001514 detection method Methods 0.000 title claims abstract description 38
- 238000000034 method Methods 0.000 title claims abstract description 35
- 230000000007 visual effect Effects 0.000 title claims abstract description 25
- 238000012545 processing Methods 0.000 claims abstract description 4
- PXFBZOLANLWPMH-UHFFFAOYSA-N 16-Epiaffinine Natural products C1C(C2=CC=CC=C2N2)=C2C(=O)CC2C(=CC)CN(C)C1C2CO PXFBZOLANLWPMH-UHFFFAOYSA-N 0.000 claims description 6
- 230000009466 transformation Effects 0.000 claims description 6
- 239000011159 matrix material Substances 0.000 claims description 4
- 238000012216 screening Methods 0.000 claims description 2
- 238000000638 solvent extraction Methods 0.000 claims description 2
- 230000035945 sensitivity Effects 0.000 abstract description 3
- 238000012544 monitoring process Methods 0.000 description 5
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 230000002349 favourable effect Effects 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 230000002265 prevention Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/10—Terrestrial scenes
- G06V20/13—Satellite images
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/02—Affine transformations
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
- G06T7/33—Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods
- G06T7/337—Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods involving reference images or patches
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/25—Determination of region of interest [ROI] or a volume of interest [VOI]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/56—Extraction of image or video features relating to colour
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10032—Satellite or aerial image; Remote sensing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10032—Satellite or aerial image; Remote sensing
- G06T2207/10036—Multispectral image; Hyperspectral image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20212—Image combination
- G06T2207/20221—Image fusion; Image merging
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Astronomy & Astrophysics (AREA)
- Remote Sensing (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Image Analysis (AREA)
- Fire-Detection Mechanisms (AREA)
- Closed-Circuit Television Systems (AREA)
Abstract
A fire detection judgment method based on visual saliency relates to the technical field of fire detection judgment, solves the problem of low accuracy, and comprises the following steps: s1, acquiring a high-resolution remote sensing image of the area to be detected; s2, processing the high-resolution remote sensing image to obtain a color enhanced image; s3, obtaining a suspicious region I according to the priori knowledge that R is more than or equal to G and more than B and a visual saliency detection algorithm; s1 and S2 are executed again, after S2 is finished, a suspicious region II is obtained according to the priori knowledge that R is more than or equal to G and more than B and the visual saliency detection algorithm, and S5 is carried out; s5, comparing the first suspicious region with the second suspicious region, and if the second suspicious region is judged to be overlapped with the first suspicious region and the second suspicious region is larger than the first suspicious region, judging that the fire disaster happens; otherwise, the suspicion of the suspicious region one is released, and the suspicious region two is returned as the suspicious region one to S4. The fire detection and judgment system has high sensitivity and high accuracy for fire detection and judgment.
Description
Technical Field
The invention relates to the technical field of fire detection and judgment, in particular to a fire detection and judgment method based on visual saliency.
Background
Fire prevention is the hot problem that is favorable to the country's citizen, and at present, fire monitoring and judging technique mainly includes artifical monitoring, lookout tower monitoring, someone/unmanned aerial vehicle monitoring and satellite monitoring etc. then mainly relies on experienced operating personnel naked eye observation or the semi-automatic supplementary interpretation of computer in the aspect of detection discernment judgement. The artificial naked eyes can only detect large-area fire, and are difficult to detect small-range forest fire. Meanwhile, during manual identification, the problems of fatigue, negligence and low observation efficiency are easy to appear in workers, so that timely discovery of fire disasters is influenced. Fire detection and judgment methods based on visual saliency are gradually generated to overcome the problems, but the problem of low detection accuracy still exists.
Disclosure of Invention
The invention provides a fire detection and judgment method based on visual saliency, aiming at solving the problem that the existing fire detection and judgment method is low in detection accuracy.
The technical scheme adopted by the invention for solving the technical problem is as follows:
a fire detection and judgment method based on visual saliency comprises the following steps:
s1, acquiring a high-resolution remote sensing image of the area to be detected;
s2, processing the high-resolution remote sensing image to obtain a color enhanced image;
s3, extracting the color-enhanced image obtained in the S2 by using a visual saliency detection algorithm according to the priori knowledge that R is greater than or equal to G and greater than B in the RGB image of the real fire, wherein the area where R is greater than or equal to G and greater than B is a suspicious area I, and carrying out S4; if there is no region where R.gtoreq.G > B, the process returns to S1.
S4, executing S1 and S2 again, after S2 is finished, extracting the color-enhanced image by using a visual saliency detection algorithm according to the priori knowledge that R is more than or equal to G and more than B in the RGB image of the real fire to obtain a suspicious region II, and performing S5;
s5, comparing the suspicious region I with the suspicious region II, and if the suspicious region II is judged to be overlapped with the suspicious region I and the suspicious region II is larger than the suspicious region I, judging that the fire disaster happens; otherwise, the suspicion of the suspicious region one is released, and the suspicious region two is returned as the suspicious region one to S4.
The invention has the beneficial effects that:
the fire detection judging method based on the visual saliency replaces manual observation, the fire judgment through the method is high in sensitivity and accuracy, the detection precision is improved through S2, and the accuracy of the fire detection judgment is improved through the comparison judgment of suspicious regions in S3-S5.
Drawings
Fig. 1 is a flowchart of a fire detection and determination method based on visual saliency according to the present invention.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings and examples.
In order that the above objects, features and advantages of the present invention can be more clearly understood, a more particular description of the invention will be rendered by reference to the appended drawings.
In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present invention, however, the present invention may be practiced in other ways than those specifically described herein, and therefore the scope of the present invention is not limited by the specific embodiments disclosed below.
A fire detection and judgment method based on visual saliency, as shown in figure 1, comprises the following steps:
and S1, acquiring a high-resolution remote sensing image of the to-be-detected area, and performing S2. The high-resolution remote sensing image is a panchromatic image and a multispectral image.
And S2, processing the high-resolution remote sensing image to obtain a color enhanced image. The specific process is as follows:
and S2.1, correcting the panchromatic image and the multispectral image by adopting a collinear equation model to obtain a corrected panchromatic image and a corrected multispectral image.
And S2.2, registering the corrected multispectral image by taking the corrected panchromatic image as a reference to obtain a registered image.
Graying the corrected multispectral image, and partitioning the corrected panchromatic image and the grayed multispectral image; calculating the information entropy of each image block, extracting SURF (speeded up robust features) feature points of the image blocks meeting the information entropy threshold, matching the feature points, and screening the feature points after matching is completed; and calculating an affine transformation matrix by using the reserved matching characteristic points, and performing multispectral image affine transformation according to the affine transformation matrix to complete registration to obtain a registered image.
S2.3, fusing the registered images by adopting an HIS method to obtain fused images;
and transferring the multispectral image from RGB to an HIS space by adopting an HIS method, performing histogram regulation division on the registered panchromatic image according to the I component, replacing the original I component with the regulation division result, and then performing HIS conversion on the RGB space to obtain a final fusion image.
And S2.4, performing color enhancement on the fused image by adopting a McCann method to obtain a color enhanced image.
S3, extracting the color-enhanced image obtained in the S2.4 by using a visual saliency detection algorithm according to the priori knowledge that R is greater than or equal to G and greater than B in the real fire RGB image, wherein the area where R is greater than or equal to G and greater than B is a suspicious area I, and then obtaining the suspicious area I, and S4 is carried out; if there is no region where R.gtoreq.G > B, the process returns to S1.
S4, executing S1 and S2 again, after S2 is finished, extracting the color-enhanced image by using a visual saliency detection algorithm according to the priori knowledge that R is more than or equal to G and more than B in the RGB image of the real fire to obtain a suspicious region II, and performing S5;
s2 referred to in S4 is completed and is not performed in S3, but is directly performed in S4 to extract suspicious region two.
S5, comparing the suspicious region I with the suspicious region II, if the suspicious region II is judged to be overlapped with the suspicious region I and the suspicious region II is larger than the suspicious region I, judging that the fire disaster happens, otherwise, removing the suspicious property of the suspicious region I, and taking the suspicious region II as the suspicious region I to return to S4.
The overlapping rate of the high-resolution remote sensing images of the region to be detected obtained by carrying out S1 twice before and after is more than 40%.
The fire detection and judgment method based on the visual saliency replaces manual observation. The fire disaster judgment detected and judged by the method has high sensitivity and high accuracy. The method ensures high geometric correction precision through the collinear equation model, fuses large-range search images through the HIS method, has high registration efficiency and high registration precision, improves detection precision through color enhancement, shortens calculation time when being applied to fire detection through the McCann method, and improves accuracy of fire detection judgment through comparison judgment of suspicious regions.
Claims (6)
1. A fire detection and judgment method based on visual saliency is characterized by comprising the following steps:
s1, acquiring a high-resolution remote sensing image of the area to be detected;
s2, processing the high-resolution remote sensing image to obtain a color enhanced image;
s3, extracting the color-enhanced image obtained in S2 by using a visual saliency detection algorithm according to the priori knowledge that R is greater than or equal to G and greater than B in the RGB image of the real fire, wherein the region where R is greater than or equal to G and greater than B is a suspicious region I, and performing S4; if there is no region where R.gtoreq.G > B, the process returns to S1.
S4, executing S1 and S2 again, after S2 is finished, extracting the color-enhanced image by using a visual saliency detection algorithm according to the priori knowledge that R is more than or equal to G and more than B in the RGB image of the real fire to obtain a suspicious region II, and performing S5;
s5, comparing the suspicious region I with the suspicious region II, and if the suspicious region II is judged to be overlapped with the suspicious region I and the suspicious region II is larger than the suspicious region I, judging that the fire disaster happens; otherwise, the suspicion of the suspicious region one is released, and the suspicious region two is returned as the suspicious region one to S4.
2. The fire detection and judgment method based on visual saliency as claimed in claim 1, wherein said high resolution remote sensing image is panchromatic image and multispectral image.
3. The fire detection and determination method based on visual saliency of claim 1, wherein said S2 includes the steps of:
s2.1, correcting the panchromatic image and the multispectral image by adopting a collinear equation model to obtain a corrected panchromatic image and a corrected multispectral image;
s2.2, registering the corrected multispectral image by taking the corrected panchromatic image as a reference to obtain a registered image;
s2.3, fusing the registered images by adopting an HIS method to obtain fused images;
and S2.4, performing color enhancement on the fused image by adopting a McCann method to obtain a color enhanced image.
4. The fire detection and judgment method based on the visual saliency as claimed in claim 3, characterized in that the specific process of S2.2 is as follows: graying the corrected multispectral image, and partitioning the corrected panchromatic image and the grayed multispectral image; calculating the information entropy of each image block, extracting SURF (speeded up robust features) feature points of the image blocks meeting the information entropy threshold, matching the feature points, and screening the feature points after matching is completed; and calculating an affine transformation matrix by using the reserved matching characteristic points, and performing multispectral image affine transformation according to the affine transformation matrix to complete registration to obtain a registered image.
5. The fire detection and judgment method based on visual saliency as claimed in claim 3, wherein said S2.3 is embodied as converting multispectral image from RGB to HIS space by HIS method, performing histogram rule division on the registered panchromatic image according to I component, replacing original I component with rule division result, and then performing HIS to convert RGB space to obtain final fused image.
6. The fire detection and judgment method based on visual saliency as claimed in claim 1, wherein when S1 is executed twice, the overlap ratio of said high resolution remote sensing images is greater than 40%.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010319755.3A CN111597909B (en) | 2020-04-22 | 2020-04-22 | Fire detection judging method based on visual saliency |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010319755.3A CN111597909B (en) | 2020-04-22 | 2020-04-22 | Fire detection judging method based on visual saliency |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111597909A true CN111597909A (en) | 2020-08-28 |
| CN111597909B CN111597909B (en) | 2023-05-02 |
Family
ID=72185180
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010319755.3A Active CN111597909B (en) | 2020-04-22 | 2020-04-22 | Fire detection judging method based on visual saliency |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111597909B (en) |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070269102A1 (en) * | 2006-05-20 | 2007-11-22 | Zheng Wang | Method and System of Generating 3D Images with Airborne Oblique/Vertical Imagery, GPS/IMU Data, and LIDAR Elevation Data |
| US20120269430A1 (en) * | 2011-04-22 | 2012-10-25 | Michael Paul Deskevich | System and method for combining color information with spatial information in multispectral images |
| US20130148854A1 (en) * | 2011-12-12 | 2013-06-13 | Canon Kabushiki Kaisha | Method, system and apparatus for determining a subject and a distractor in an image |
| CN108765860A (en) * | 2018-05-02 | 2018-11-06 | 北京准视科技有限公司 | A kind of image-type fire detecting and alarm method |
| CN109118461A (en) * | 2018-07-06 | 2019-01-01 | 航天星图科技（北京）有限公司 | A kind of HIS fusion method based on Distributed Architecture |
| CN109766763A (en) * | 2018-12-15 | 2019-05-17 | 中国科学院长春光学精密机械与物理研究所 | A kind of forest fire detection method and system |
| CN110853058A (en) * | 2019-11-12 | 2020-02-28 | 电子科技大学 | High-resolution remote sensing image road extraction method based on visual saliency detection |
| CN110930439A (en) * | 2019-12-04 | 2020-03-27 | 长光卫星技术有限公司 | High-grade product automatic production system suitable for high-resolution remote sensing image |
| CN111046827A (en) * | 2019-12-20 | 2020-04-21 | 哈尔滨理工大学 | Video smoke detection method based on convolutional neural network |
-
2020
- 2020-04-22 CN CN202010319755.3A patent/CN111597909B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070269102A1 (en) * | 2006-05-20 | 2007-11-22 | Zheng Wang | Method and System of Generating 3D Images with Airborne Oblique/Vertical Imagery, GPS/IMU Data, and LIDAR Elevation Data |
| US20120269430A1 (en) * | 2011-04-22 | 2012-10-25 | Michael Paul Deskevich | System and method for combining color information with spatial information in multispectral images |
| US20130148854A1 (en) * | 2011-12-12 | 2013-06-13 | Canon Kabushiki Kaisha | Method, system and apparatus for determining a subject and a distractor in an image |
| CN108765860A (en) * | 2018-05-02 | 2018-11-06 | 北京准视科技有限公司 | A kind of image-type fire detecting and alarm method |
| CN109118461A (en) * | 2018-07-06 | 2019-01-01 | 航天星图科技（北京）有限公司 | A kind of HIS fusion method based on Distributed Architecture |
| CN109766763A (en) * | 2018-12-15 | 2019-05-17 | 中国科学院长春光学精密机械与物理研究所 | A kind of forest fire detection method and system |
| CN110853058A (en) * | 2019-11-12 | 2020-02-28 | 电子科技大学 | High-resolution remote sensing image road extraction method based on visual saliency detection |
| CN110930439A (en) * | 2019-12-04 | 2020-03-27 | 长光卫星技术有限公司 | High-grade product automatic production system suitable for high-resolution remote sensing image |
| CN111046827A (en) * | 2019-12-20 | 2020-04-21 | 哈尔滨理工大学 | Video smoke detection method based on convolutional neural network |
Non-Patent Citations (2)
| Title |
|---|
| 余东行等: "联合显著性特征与卷积神经网络的遥感影像舰船检测", 《中国图象图形学报》 * |
| 张增: "无人机森林火灾监测中火情检测方法研究", 《遥感信息》 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111597909B (en) | 2023-05-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109657632B (en) | Lane line detection and identification method | |
| WO2018216629A1 (en) | Information processing device, information processing method, and program | |
| CN111666834A (en) | Forest fire automatic monitoring and recognizing system and method based on image recognition technology | |
| CN102708691B (en) | False license plate identification method based on matching between license plate and automobile type | |
| CN110033431B (en) | Non-contact detection device and detection method for detecting corrosion area on surface of steel bridge | |
| CN104778721A (en) | Distance measuring method of significant target in binocular image | |
| CN112149514B (en) | Method and system for detecting safety dressing of construction worker | |
| CN112686835B (en) | Road obstacle detection device, method and computer readable storage medium | |
| CN108898782B (en) | Smoke detection method and system for infrared image temperature information identification for tunnel fire prevention | |
| CN112907626A (en) | Moving object extraction method based on satellite time-exceeding phase data multi-source information | |
| CN107507140B (en) | Method for suppressing vehicle shadow interference in open scene of highway based on feature fusion | |
| CN111563896A (en) | Image processing method for catenary anomaly detection | |
| CN114495068A (en) | Road surface health detection 'element' method based on man-machine interaction and deep learning | |
| KR20180127567A (en) | System for unmanned aircraft image auto geometric correction | |
| CN108803651B (en) | Unmanned aerial vehicle road inspection method based on image characteristics | |
| CN111985436B (en) | Workshop ground marking recognition fitting method based on LSD | |
| CN112528994B (en) | Free angle license plate detection method, license plate recognition method and recognition system | |
| CN111597909A (en) | Fire detection and judgment method based on visual saliency | |
| CN112101260A (en) | Method, device, equipment and storage medium for identifying safety belt of operator | |
| A Farrag et al. | Detecting land cover changes using VHR satellite images: A comparative study | |
| CN112116561B (en) | Power grid transmission line detection method and device based on image processing fusion network weight | |
| CN101782967B (en) | Method for extracting brightness characteristic quantity of face image and method for identifying face image | |
| CN112200769B (en) | Fixed point monitoring new and old time phase image change detection method for illegal building detection | |
| CN112381747A (en) | Terahertz and visible light image registration method and device based on contour feature points | |
| KR101934317B1 (en) | System for automatic registration of images using association analysis of linear features |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |