CN111339997A - Method and apparatus for determining ignition region, storage medium, and electronic apparatus - Google Patents
Method and apparatus for determining ignition region, storage medium, and electronic apparatus Download PDFInfo
- Publication number
- CN111339997A CN111339997A CN202010203030.8A CN202010203030A CN111339997A CN 111339997 A CN111339997 A CN 111339997A CN 202010203030 A CN202010203030 A CN 202010203030A CN 111339997 A CN111339997 A CN 111339997A
- Authority
- CN
- China
- Prior art keywords
- region
- determining
- image
- temperature distribution
- fire
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 47
- 238000001514 detection method Methods 0.000 claims abstract description 58
- 238000004422 calculation algorithm Methods 0.000 claims abstract description 49
- 239000011159 matrix material Substances 0.000 claims description 31
- 238000012545 processing Methods 0.000 claims description 22
- 238000004590 computer program Methods 0.000 claims description 18
- 238000012549 training Methods 0.000 claims description 8
- 238000010801 machine learning Methods 0.000 claims description 4
- 238000012544 monitoring process Methods 0.000 abstract description 15
- 230000000694 effects Effects 0.000 abstract description 3
- 238000001931 thermography Methods 0.000 description 18
- 238000010586 diagram Methods 0.000 description 9
- 230000005540 biological transmission Effects 0.000 description 6
- 238000004364 calculation method Methods 0.000 description 4
- 241001465754 Metazoa Species 0.000 description 3
- 238000004891 communication Methods 0.000 description 2
- 238000013527 convolutional neural network Methods 0.000 description 2
- 230000007613 environmental effect Effects 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000007689 inspection Methods 0.000 description 2
- 238000002372 labelling Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000002265 prevention Effects 0.000 description 2
- 230000015572 biosynthetic process Effects 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 238000013135 deep learning Methods 0.000 description 1
- 230000001066 destructive effect Effects 0.000 description 1
- 239000000428 dust Substances 0.000 description 1
- 238000002329 infrared spectrum Methods 0.000 description 1
- 239000010977 jade Substances 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 230000000149 penetrating effect Effects 0.000 description 1
- 238000001228 spectrum Methods 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/40—Scenes; Scene-specific elements in video content
- G06V20/41—Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V2201/00—Indexing scheme relating to image or video recognition or understanding
- G06V2201/07—Target detection
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02A—TECHNOLOGIES FOR ADAPTATION TO CLIMATE CHANGE
- Y02A40/00—Adaptation technologies in agriculture, forestry, livestock or agroalimentary production
- Y02A40/10—Adaptation technologies in agriculture, forestry, livestock or agroalimentary production in agriculture
- Y02A40/28—Adaptation technologies in agriculture, forestry, livestock or agroalimentary production in agriculture specially adapted for farming
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Computational Linguistics (AREA)
- Software Systems (AREA)
- Fire-Detection Mechanisms (AREA)
- Alarm Systems (AREA)
- Fire Alarms (AREA)
Abstract
The invention provides a method and a device for determining a fire point area, a storage medium and an electronic device, wherein the method comprises the following steps: acquiring an image frame sequence acquired by image shooting equipment and temperature distribution information corresponding to each frame of image in the image frame sequence; determining a first region in the image frame sequence according to the temperature distribution information, wherein the temperature in the first region is greater than or equal to a first preset threshold value; taking the image frame sequence as the input of a target detection algorithm, and acquiring a second region output by the target detection algorithm; a fire zone is determined from the first zone and the second zone. By the method and the device, the problem of low accuracy of the fire monitoring method is solved, and the effect of improving the fire monitoring accuracy is achieved.
Description
Technical Field
The invention relates to the field of video monitoring, in particular to a method and a device for determining a fire point area, a storage medium and an electronic device.
Background
The fire disaster is an artificial disaster or a natural disaster which has strong destructive power, strong burst property and great difficulty in fighting. In the field, such as forest, plain, field, etc., the phenomena of fire formation caused by the spread of fire points and loss of control are not rare every year because the fire points are not found and alarmed in time. Therefore, the fire early warning device can find the fire point in the field in time and trigger the fire early warning alarm in time, so that the fire fighter can take measures to put out the fire point in time, and the fire early warning device is very important for field fire prevention and forest fire prevention.
At present, based on the traditional field fire monitoring method, whether a fire exists is mainly monitored through manual inspection, or whether the fire occurs is monitored through videos. The manual inspection has certain hysteresis, and the fire can be discovered only when the fire reaches a certain degree. The current video monitoring method mainly utilizes a visible light camera to shoot images and determines whether a fire disaster occurs according to image information. But images taken by visible light cameras are susceptible to weather. Weather and environment that visibility is low such as fog, haze, raise dust can reduce the penetrating power of visible light to a great extent, and visible light camera can not clear acquire the firework image of waiting to examine the region to lead to leaking the warning.
Therefore, no effective solution exists at present for the problem of low accuracy of the fire monitoring method in the related art.
Disclosure of Invention
The embodiment of the invention provides a method and a device for determining a fire point area, a storage medium and an electronic device, which are used for at least solving the problem of low accuracy of a fire monitoring method in the related art.
According to an embodiment of the present invention, there is provided a method of determining a fire zone, including: acquiring an image frame sequence acquired by image shooting equipment and temperature distribution information corresponding to each frame of image in the image frame sequence; determining a first region in the image frame sequence according to the temperature distribution information, wherein the temperature in the first region is greater than or equal to a first preset threshold value; taking the image frame sequence as an input of a target detection algorithm, and acquiring a second region output by the target detection algorithm; and determining a fire point region according to the first region and the second region.
Optionally, determining a first region in the sequence of image frames according to the temperature distribution information comprises: performing binarization processing on a temperature distribution matrix of each frame of image in the image frame sequence to obtain a first distribution matrix, wherein the temperature distribution information comprises the temperature distribution matrix; and carrying out connected domain marking processing on the first distribution matrix to obtain the first area.
Optionally, taking the image frame sequence as an input of an object detection algorithm, acquiring a second region output by the object detection algorithm, including: inputting the sequence of image frames to the object detection algorithm, wherein the object detection algorithm is trained by machine learning using a plurality of sets of training data, wherein each of the plurality of sets of training data comprises: a sequence of image frames; and acquiring the second area output by the target detection algorithm and the target object class positioned in the second area.
Optionally, determining a fire zone from the first zone and the second zone comprises: determining that the intersection of the first region and the second region is a third region, and the union of the first region and the second region is a fourth region; and determining the fire point region according to the third region and the fourth region.
Optionally, determining the fire zone from the third zone and the fourth zone comprises: determining a region area ratio of the third region to the fourth region; and determining the first region as the fire point region when the region area ratio is smaller than or equal to a second preset threshold value.
Optionally, after the fire point region is determined, the method further comprises: and sending alarm information.
According to another embodiment of the present invention, there is provided a fire point region determination apparatus including: the device comprises a first acquisition module, a second acquisition module and a third acquisition module, wherein the first acquisition module is used for acquiring an image frame sequence acquired by image shooting equipment and temperature distribution information corresponding to each frame of image in the image frame sequence; a first determining module, configured to determine a first region in the image frame sequence according to the temperature distribution information, where a temperature in the first region is greater than or equal to a first preset threshold; a second obtaining module, configured to obtain a second region output by a target detection algorithm with the image frame sequence as an input of the target detection algorithm; and the second determining module is used for determining the fire point area according to the first area and the second area.
Optionally, the first determining module includes: the first processing unit is used for carrying out binarization processing on a temperature distribution matrix of each frame of image in the image frame sequence to obtain a first distribution matrix, wherein the temperature distribution information comprises the temperature distribution matrix; and the second processing unit is used for carrying out connected domain marking processing on the first distribution matrix to obtain the first area.
According to a further embodiment of the present invention, there is also provided a storage medium having a computer program stored therein, wherein the computer program is arranged to perform the steps of any of the above method embodiments when executed.
According to yet another embodiment of the present invention, there is also provided an electronic device, including a memory in which a computer program is stored and a processor configured to execute the computer program to perform the steps in any of the above method embodiments.
According to the invention, the image frame sequence collected by the image shooting equipment and the temperature distribution information corresponding to each frame of image in the image frame sequence are obtained; determining a first region in the image frame sequence according to the temperature distribution information, wherein the temperature in the first region is greater than or equal to a first preset threshold value; taking the image frame sequence as the input of a target detection algorithm, and acquiring a second region output by the target detection algorithm; a fire zone is determined from the first zone and the second zone. Therefore, the problem of low accuracy of the fire monitoring method can be solved, and the effect of improving the fire monitoring accuracy is achieved.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the invention and together with the description serve to explain the invention without limiting the invention. In the drawings:
fig. 1 is a block diagram of a hardware configuration of a mobile terminal of a method for determining a fire zone according to an embodiment of the present invention;
FIG. 2 is a flow chart of a method of determining a fire zone according to an embodiment of the invention;
FIG. 3 is a first schematic diagram illustrating a method for determining a fire zone in accordance with an alternative embodiment of the present invention;
FIG. 4 is a second schematic diagram of a method for determining a fire zone in accordance with an alternative embodiment of the present invention;
FIG. 5 is a third schematic illustration of a method of determining a fire zone in accordance with an alternative embodiment of the present invention;
FIG. 6 is a fourth schematic illustration of a method of determining a fire zone in accordance with an alternative embodiment of the present invention;
FIG. 7 is a fifth schematic illustration of a method of determining a fire zone in accordance with an alternative embodiment of the present invention;
fig. 8 is a block diagram of the structure of a fire zone determination apparatus according to an embodiment of the present invention.
Detailed Description
The invention will be described in detail hereinafter with reference to the accompanying drawings in conjunction with embodiments. It should be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict.
It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order.
The method provided by the first embodiment of the present application may be executed in a mobile terminal, a computer terminal, or a similar computing device. Taking the mobile terminal as an example, fig. 1 is a hardware block diagram of the mobile terminal of a method for determining a fire zone according to an embodiment of the present invention. As shown in fig. 1, the mobile terminal 10 may include one or more (only one shown in fig. 1) processors 102 (the processor 102 may include, but is not limited to, a processing device such as a microprocessor MCU or a programmable logic device FPGA) and a memory 104 for storing data, and optionally may also include a transmission device 106 for communication functions and an input-output device 108. It will be understood by those skilled in the art that the structure shown in fig. 1 is only an illustration, and does not limit the structure of the mobile terminal. For example, the mobile terminal 10 may also include more or fewer components than shown in FIG. 1, or have a different configuration than shown in FIG. 1.
The memory 104 may be used for storing computer programs, for example, software programs and modules of application software, such as a computer program corresponding to the method for determining a fire point region in the embodiment of the present invention, and the processor 102 executes various functional applications and data processing by running the computer programs stored in the memory 104, so as to implement the method described above. The memory 104 may include high speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some instances, the memory 104 may further include memory located remotely from the processor 102, which may be connected to the mobile terminal 10 via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The transmission device 106 is used for receiving or transmitting data via a network. Specific examples of the network described above may include a wireless network provided by a communication provider of the mobile terminal 10. In one example, the transmission device 106 includes a Network adapter (NIC), which can be connected to other Network devices through a base station so as to communicate with the internet. In one example, the transmission device 106 may be a Radio Frequency (RF) module, which is used for communicating with the internet in a wireless manner.
In this embodiment, a method for determining a fire zone of the mobile terminal is provided, and fig. 2 is a flowchart of the method for determining a fire zone according to the embodiment of the present invention, as shown in fig. 2, the flowchart includes the following steps:
step S202, acquiring an image frame sequence collected by an image shooting device and temperature distribution information corresponding to each frame of image in the image frame sequence;
the image shooting equipment can be an infrared thermal imaging camera, the infrared thermal imaging camera can collect video images and thermal imaging spectrograms of monitoring areas in real time, the thermal imaging spectrograms comprise temperature detection data of the video images, and temperature distribution information of each frame of image can be reflected through the thermal imaging spectrograms.
Step S204, determining a first region in the image frame sequence according to the temperature distribution information, wherein the temperature in the first region is greater than or equal to a first preset threshold value;
the first preset threshold value may be determined according to actual conditions, and the area exceeding the first preset threshold value is used as a high-temperature area of the suspicious fire point.
Step S206, taking the image frame sequence as the input of a target detection algorithm, and acquiring a second region output by the target detection algorithm;
due to the influence of environmental factors, such as people, motor vehicles, non-motor vehicles, animals, street lamps and the like, the high-temperature area is not necessarily completely a fire point area, the interference of other environmental factors can be eliminated through a target detection algorithm, and the accuracy of a monitoring result is improved.
And step S208, determining a fire point area according to the first area and the second area.
Through the steps, the image frame sequence collected by the image shooting device and the temperature distribution information corresponding to each frame of image in the image frame sequence are obtained; determining a first region in the image frame sequence according to the temperature distribution information, wherein the temperature in the first region is greater than or equal to a first preset threshold value; taking the image frame sequence as the input of a target detection algorithm, and acquiring a second region output by the target detection algorithm; a fire zone is determined from the first zone and the second zone. Therefore, the problem of low accuracy of the fire monitoring method can be solved, and the effect of improving the fire monitoring accuracy is achieved.
Alternatively, the execution subject of the above steps may be a terminal or the like, but is not limited thereto.
As an alternative embodiment, determining a first region in the sequence of image frames from the temperature distribution information comprises: performing binarization processing on a temperature distribution matrix of each frame of image in the image frame sequence to obtain a first distribution matrix, wherein the temperature distribution information comprises the temperature distribution matrix; and carrying out connected domain marking processing on the first distribution matrix to obtain the first area. In this embodiment, the following steps may be performed by the high temperature detection module:
step 1: and acquiring a video image sequence and a corresponding temperature distribution matrix sequence of each monitoring point thermal imaging camera in the field in real time. The image sequence can be pseudo-colors such as white heat, black heat, amber, jade and the like, and if the thermal imaging camera is a double-spectrum camera, the video image sequence can also be a visible light image;
step 2: processing each frame of image in the image frame sequence according to the following modes: taking the image I as an example, taking the temperature distribution matrix corresponding to the image I as T, and taking the temperature T as a threshold value to perform binarization processing, where a value of T may be adjusted according to an actual situation, specifically, may be: 100 ℃, 80 ℃, 60 ℃ and the like to obtain a temperature distribution matrix Tbin after binarizationij：
Where M and N are the matrix width and length of the temperature matrix T, or the length and width of the thermographic image I, respectively.
And step 3: for the temperature distribution matrix Tbin after binarizationijExecuting connected domain labeling algorithm to obtain labeling frames (id, Tx1, Ty1, Tx2 and Ty2) of the binarized high-temperature region, wherein (Tx1, Ty1) and (Tx2, Ty2) are divided intoThe coordinates of the upper left corner and the lower right corner of the marking frame are distinguished, and id is the number of the marking frame. Among them, the mark frame (id, Tx1, Ty1, Tx2, Ty2) of the determined high temperature region is the first region. Fig. 3 is a schematic diagram of the first region in this embodiment. The high-temperature area can be marked through the embodiment, and the suspicious high-temperature area in the monitoring range is determined.
As an alternative embodiment, taking the sequence of image frames as an input to an object detection algorithm, obtaining a second region output by the object detection algorithm, comprises: inputting the sequence of image frames to the object detection algorithm, wherein the object detection algorithm is trained by machine learning using a plurality of sets of training data, wherein each of the plurality of sets of training data comprises: a sequence of image frames; and acquiring the second area output by the target detection algorithm and the target object class positioned in the second area. In this embodiment, the following steps may be performed by the high temperature detection module:
step 1: and inputting the video image sequence shot by the thermal imaging camera into a thermal imaging image target detection module for thermal imaging image target detection. The thermal imaging image target detection algorithm is a pre-trained deep convolutional neural network, and the detection categories include but are not limited to: human, automotive, non-automotive, animal, street light, etc. Thermal imaging image target detection algorithms include, but are not limited to: target detection algorithms such as R-CNN, R-FCN, SSD, YOLO series and the like.
Step 2: the thermal imaging image target detection algorithm is executed for the thermal imaging image frame I corresponding to the temperature distribution matrix T in the high-temperature region detection module, and each detected target and corresponding coordinates (class, Ix1, Iy1, Ix2 and Iy2) in the thermal imaging image are obtained. Wherein, (Ix1, Iy1) and (Ix2, Iy2) are the top left pixel coordinate and the bottom right pixel coordinate of the target, respectively, and class is the detected class. The second region is composed of (Ix1, Iy1) and (Ix2, Iy2), and is schematically detected by the target detection algorithm as shown in fig. 4.
As an alternative embodiment, determining a fire zone from the first zone and the second zone comprises: determining that the intersection of the first region and the second region is a third region, and the union of the first region and the second region is a fourth region; and determining the fire point region according to the third region and the fourth region. In this embodiment, as shown in fig. 5, the third region is a schematic diagram formed by an intersection of the first region and the second region; fig. 6 is a schematic diagram of a fourth region formed by a union of the first region and the second region.
As an alternative embodiment, determining the fire zone from the third zone and the fourth zone comprises: determining a region area ratio of the third region to the fourth region; and determining the first region as the fire point region when the region area ratio is smaller than or equal to a second preset threshold value. In the present embodiment, the high-temperature region flag boxes (id, Tx1, Ty1, Tx2, Ty2) are subjected to the degree of overlap calculation with the detection boxes (class, Ix1, Iy1, Ix2, Iy2) of the thermal imaging target detection algorithm. The proposed overlap degree calculation method adopts an intersection ratio IoU calculation method, and the calculation flow is as follows: calculating the intersection overlap of the mark frame and the detection frame:
overlap＝(min(Tx2,Ix2)-max(Tx1,Ix1))×(min(Ty2,Iy2)-max(Ty1,Iy1))
and (3) calculating a union unit of the mark frame and the detection frame:
union＝w1×h1+w2×h2-overlap
wherein, w1＝Tx2-Tx1，h1＝Ty2-Ty1，w2＝Ix2-Ix1，h2＝Iy2-Iy1。
Calculating the intersection ratio IoU:
when IoU is greater than or equal to iou _ thresh, the high temperature flag box corresponding to the id is judged as a negative sample, and the high temperature area is excluded from the suspicious fire.
When IoU < iou _ thresh, the high-temperature mark box corresponding to the id is judged to be a positive sample, namely, the area is a suspicious fire point, and alarm output is triggered in time. Specifically, the second preset threshold iou _ thresh may be determined according to actual situations, and may be, for example: 0.2, 0.3, or 0.5, etc.
As an alternative embodiment, after determining the fire zone, the method further comprises: and sending alarm information. In this embodiment, as shown in fig. 7, a flowchart of the overall scheme according to the embodiment of the present invention is shown. The embodiment is based on a computer vision and deep learning method, and utilizes an infrared thermal imaging camera to monitor suspicious heat sources in the field such as forest, plain and other environments in real time, and can find suspicious fire points timely and accurately and alarm for output. The infrared spectrum thermal imaging camera is utilized, so that the environment anti-interference capability is very strong, and a suspicious heat source can be monitored in real time under the condition of low visibility; the fire alarm can be found and alarmed in time before open fire occurs, so that fire is avoided; the target detection algorithm is used for generating the negative sample, so that non-fire heat sources such as motor vehicles, pedestrians, non-motor vehicles, field animals and the like can be eliminated, and the alarm accuracy is improved.
Through the above description of the embodiments, those skilled in the art can clearly understand that the method according to the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but the former is a better implementation mode in many cases. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (e.g., ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal device (e.g., a mobile phone, a computer, a server, or a network device) to execute the method according to the embodiments of the present invention.
In this embodiment, a device for determining a fire point region is further provided, and the device is used to implement the foregoing embodiments and preferred embodiments, which have already been described and will not be described again. As used below, the term "module" may be a combination of software and/or hardware that implements a predetermined function. Although the means described in the embodiments below are preferably implemented in software, an implementation in hardware, or a combination of software and hardware is also possible and contemplated.
Fig. 8 is a block diagram showing the structure of an apparatus for determining a fire zone according to an embodiment of the present invention, as shown in fig. 8, the apparatus including: a first obtaining module 82, configured to obtain a sequence of image frames collected by an image capturing device and temperature distribution information corresponding to each frame of image in the sequence of image frames; a first determining module 84, configured to determine a first region in the image frame sequence according to the temperature distribution information, where a temperature in the first region is greater than or equal to a first preset threshold; a second obtaining module 86, configured to obtain a second region output by the target detection algorithm with the image frame sequence as an input of the target detection algorithm; a second determination module 88 for determining a fire zone based on the first zone and the second zone.
As an alternative embodiment, the first determining module includes: the first processing unit is used for carrying out binarization processing on a temperature distribution matrix of each frame of image in the image frame sequence to obtain a first distribution matrix, wherein the temperature distribution information comprises the temperature distribution matrix; and the second processing unit is used for carrying out connected domain marking processing on the first distribution matrix to obtain the first area.
As an alternative embodiment, the second obtaining module includes: an input unit configured to input the image frame sequence to the target detection algorithm, wherein the target detection algorithm is trained by machine learning using a plurality of sets of training data, wherein each of the plurality of sets of training data includes: a sequence of image frames; an obtaining unit, configured to obtain the second region output by the target detection algorithm, and a target object class located in the second region.
As an alternative embodiment, the second determination module is further configured to determine the fire zone from the first zone and the second zone by: determining that the intersection of the first region and the second region is a third region, and the union of the first region and the second region is a fourth region; and determining the fire point region according to the third region and the fourth region.
As an alternative embodiment, the second determination module is further configured to determine the fire area according to the third area and the fourth area by: determining a region area ratio of the third region to the fourth region; and determining the first region as the fire point region when the region area ratio is smaller than or equal to a second preset threshold value.
As an alternative embodiment, after determining the fire zone, the method further comprises: and sending alarm information.
It should be noted that, the above modules may be implemented by software or hardware, and for the latter, the following may be implemented, but not limited to: the modules are all positioned in the same processor; alternatively, the modules are respectively located in different processors in any combination.
Embodiments of the present invention also provide a storage medium having a computer program stored therein, wherein the computer program is arranged to perform the steps of any of the above method embodiments when executed.
Alternatively, in the present embodiment, the storage medium may be configured to store a computer program for executing the steps of:
s1, acquiring an image frame sequence collected by an image shooting device and temperature distribution information corresponding to each frame of image in the image frame sequence;
s2, determining a first region in the image frame sequence according to the temperature distribution information, wherein the temperature in the first region is greater than or equal to a first preset threshold value;
s3, taking the image frame sequence as the input of the target detection algorithm, and obtaining a second region output by the target detection algorithm;
and S4, determining a fire point area according to the first area and the second area.
Optionally, in this embodiment, the storage medium may include, but is not limited to: various media capable of storing computer programs, such as a usb disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic disk, or an optical disk.
Embodiments of the present invention also provide an electronic device comprising a memory having a computer program stored therein and a processor arranged to run the computer program to perform the steps of any of the above method embodiments.
Optionally, the electronic apparatus may further include a transmission device and an input/output device, wherein the transmission device is connected to the processor, and the input/output device is connected to the processor.
Optionally, in this embodiment, the processor may be configured to execute the following steps by a computer program:
s1, acquiring an image frame sequence collected by an image shooting device and temperature distribution information corresponding to each frame of image in the image frame sequence;
s2, determining a first region in the image frame sequence according to the temperature distribution information, wherein the temperature in the first region is greater than or equal to a first preset threshold value;
s3, taking the image frame sequence as the input of the target detection algorithm, and obtaining a second region output by the target detection algorithm;
and S4, determining a fire point area according to the first area and the second area.
Optionally, the specific examples in this embodiment may refer to the examples described in the above embodiments and optional implementation manners, and this embodiment is not described herein again.
It will be apparent to those skilled in the art that the modules or steps of the present invention described above may be implemented by a general purpose computing device, they may be centralized on a single computing device or distributed across a network of multiple computing devices, and alternatively, they may be implemented by program code executable by a computing device, such that they may be stored in a storage device and executed by a computing device, and in some cases, the steps shown or described may be performed in an order different than that described herein, or they may be separately fabricated into individual integrated circuit modules, or multiple ones of them may be fabricated into a single integrated circuit module. Thus, the present invention is not limited to any specific combination of hardware and software.
The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, or improvement made within the principle of the present invention should be included in the protection scope of the present invention.
Claims (10)
1. A method of determining a fire zone, comprising:
acquiring an image frame sequence acquired by image shooting equipment and temperature distribution information corresponding to each frame of image in the image frame sequence;
determining a first region in the image frame sequence according to the temperature distribution information, wherein the temperature in the first region is greater than or equal to a first preset threshold value;
taking the image frame sequence as an input of a target detection algorithm, and acquiring a second region output by the target detection algorithm;
and determining a fire point region according to the first region and the second region.
2. The method of claim 1, wherein determining a first region in the sequence of image frames from the temperature distribution information comprises:
performing binarization processing on a temperature distribution matrix of each frame of image in the image frame sequence to obtain a first distribution matrix, wherein the temperature distribution information comprises the temperature distribution matrix;
and carrying out connected domain marking processing on the first distribution matrix to obtain the first area.
3. The method of claim 1, wherein taking the sequence of image frames as an input to an object detection algorithm, obtaining a second region output by the object detection algorithm comprises:
inputting the sequence of image frames to the object detection algorithm, wherein the object detection algorithm is trained by machine learning using a plurality of sets of training data, wherein each of the plurality of sets of training data comprises: a sequence of image frames;
and acquiring the second area output by the target detection algorithm and the target object class positioned in the second area.
4. The method of claim 1, wherein determining a fire zone from the first zone and the second zone comprises:
determining that the intersection of the first region and the second region is a third region, and the union of the first region and the second region is a fourth region;
and determining the fire point region according to the third region and the fourth region.
5. The method of claim 4, wherein determining the fire zone from the third zone and the fourth zone comprises:
determining a region area ratio of the third region to the fourth region;
and determining the first region as the fire point region when the region area ratio is smaller than or equal to a second preset threshold value.
6. The method of any one of claims 1 to 5, wherein after determining the fire zone, the method further comprises:
and sending alarm information.
7. A fire zone determination apparatus, comprising:
the device comprises a first acquisition module, a second acquisition module and a third acquisition module, wherein the first acquisition module is used for acquiring an image frame sequence acquired by image shooting equipment and temperature distribution information corresponding to each frame of image in the image frame sequence;
a first determining module, configured to determine a first region in the image frame sequence according to the temperature distribution information, where a temperature in the first region is greater than or equal to a first preset threshold;
a second obtaining module, configured to obtain a second region output by a target detection algorithm with the image frame sequence as an input of the target detection algorithm;
and the second determining module is used for determining the fire point area according to the first area and the second area.
8. The apparatus of claim 7, further comprising the first determining module comprising:
the first processing unit is used for carrying out binarization processing on a temperature distribution matrix of each frame of image in the image frame sequence to obtain a first distribution matrix, wherein the temperature distribution information comprises the temperature distribution matrix;
and the second processing unit is used for carrying out connected domain marking processing on the first distribution matrix to obtain the first area.
9. A storage medium, in which a computer program is stored, wherein the computer program is arranged to perform the method of any of claims 1 to 6 when executed.
10. An electronic device comprising a memory and a processor, wherein the memory has stored therein a computer program, and wherein the processor is arranged to execute the computer program to perform the method of any of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010203030.8A CN111339997B (en) | 2020-03-20 | 2020-03-20 | Fire point area determination method and device, storage medium and electronic device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010203030.8A CN111339997B (en) | 2020-03-20 | 2020-03-20 | Fire point area determination method and device, storage medium and electronic device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111339997A true CN111339997A (en) | 2020-06-26 |
| CN111339997B CN111339997B (en) | 2023-05-09 |
Family
ID=71184506
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010203030.8A Active CN111339997B (en) | 2020-03-20 | 2020-03-20 | Fire point area determination method and device, storage medium and electronic device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111339997B (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112347874A (en) * | 2020-10-26 | 2021-02-09 | 创泽智能机器人集团股份有限公司 | Fire detection method, device, equipment and storage medium |
| CN112362164A (en) * | 2020-11-10 | 2021-02-12 | 广东电网有限责任公司 | Temperature monitoring method and device of equipment, electronic equipment and storage medium |
| CN113192038A (en) * | 2021-05-07 | 2021-07-30 | 北京科技大学 | Method for identifying and monitoring abnormal smoke and fire in existing flame environment based on deep learning |
| CN113205178A (en) * | 2021-04-27 | 2021-08-03 | 特斯联科技集团有限公司 | Artificial intelligent infrared image sensing system and method |
| CN113298025A (en) * | 2021-06-11 | 2021-08-24 | 浙江华消科技有限公司 | Target object determination method and device, storage medium and electronic device |
| CN113343859A (en) * | 2021-06-10 | 2021-09-03 | 浙江大华技术股份有限公司 | Smoking behavior detection method and device, storage medium and electronic device |
| CN113536918A (en) * | 2021-06-10 | 2021-10-22 | 浙江大华技术股份有限公司 | Smoke and fire detection method, system, electronic device and storage medium |
| CN115862296A (en) * | 2023-02-14 | 2023-03-28 | 山东铁路投资控股集团有限公司 | Fire risk early warning method, system, equipment and medium for railway construction site |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20080065833A (en) * | 2007-01-10 | 2008-07-15 | 한국서부발전 주식회사 | Fire alarm method and system |
| CN106897653A (en) * | 2015-12-17 | 2017-06-27 | 北京林业大学 | Forest zone firework detecting method and its detecting system based on the fusion of infrared and visible light video |
| US20190050667A1 (en) * | 2017-03-10 | 2019-02-14 | TuSimple | System and method for occluding contour detection |
| CN109726620A (en) * | 2017-10-31 | 2019-05-07 | 北京国双科技有限公司 | A kind of video flame detecting method and device |
| US20190258878A1 (en) * | 2018-02-18 | 2019-08-22 | Nvidia Corporation | Object detection and detection confidence suitable for autonomous driving |
-
2020
- 2020-03-20 CN CN202010203030.8A patent/CN111339997B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20080065833A (en) * | 2007-01-10 | 2008-07-15 | 한국서부발전 주식회사 | Fire alarm method and system |
| CN106897653A (en) * | 2015-12-17 | 2017-06-27 | 北京林业大学 | Forest zone firework detecting method and its detecting system based on the fusion of infrared and visible light video |
| US20190050667A1 (en) * | 2017-03-10 | 2019-02-14 | TuSimple | System and method for occluding contour detection |
| CN109726620A (en) * | 2017-10-31 | 2019-05-07 | 北京国双科技有限公司 | A kind of video flame detecting method and device |
| US20190258878A1 (en) * | 2018-02-18 | 2019-08-22 | Nvidia Corporation | Object detection and detection confidence suitable for autonomous driving |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112347874A (en) * | 2020-10-26 | 2021-02-09 | 创泽智能机器人集团股份有限公司 | Fire detection method, device, equipment and storage medium |
| CN112362164A (en) * | 2020-11-10 | 2021-02-12 | 广东电网有限责任公司 | Temperature monitoring method and device of equipment, electronic equipment and storage medium |
| CN113205178A (en) * | 2021-04-27 | 2021-08-03 | 特斯联科技集团有限公司 | Artificial intelligent infrared image sensing system and method |
| CN113192038A (en) * | 2021-05-07 | 2021-07-30 | 北京科技大学 | Method for identifying and monitoring abnormal smoke and fire in existing flame environment based on deep learning |
| CN113343859A (en) * | 2021-06-10 | 2021-09-03 | 浙江大华技术股份有限公司 | Smoking behavior detection method and device, storage medium and electronic device |
| CN113536918A (en) * | 2021-06-10 | 2021-10-22 | 浙江大华技术股份有限公司 | Smoke and fire detection method, system, electronic device and storage medium |
| CN113536918B (en) * | 2021-06-10 | 2024-04-16 | 浙江华感科技有限公司 | Firework detection method, system, electronic device and storage medium |
| CN113298025A (en) * | 2021-06-11 | 2021-08-24 | 浙江华消科技有限公司 | Target object determination method and device, storage medium and electronic device |
| CN115862296A (en) * | 2023-02-14 | 2023-03-28 | 山东铁路投资控股集团有限公司 | Fire risk early warning method, system, equipment and medium for railway construction site |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111339997B (en) | 2023-05-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111339997A (en) | Method and apparatus for determining ignition region, storage medium, and electronic apparatus | |
| US11443498B2 (en) | Target object recognition method and apparatus, storage medium, and electronic device | |
| KR101825045B1 (en) | Alarm method and device | |
| ES2277316T3 (en) | PROCEDURE AND DEVICE FOR AUTOMATIC RECOGNITION OF FOREST FIRE. | |
| CN103726879B (en) | Utilize camera automatic capturing mine ore deposit to shake and cave in and the method for record warning in time | |
| JP4681043B2 (en) | System and method for locating an imaging device | |
| CN110235890B (en) | Harmful organism detection and driving method, device, equipment and system | |
| CN111062281A (en) | Abnormal event monitoring method and device, storage medium and electronic equipment | |
| CN112068111A (en) | Unmanned aerial vehicle target detection method based on multi-sensor information fusion | |
| CN111354024B (en) | Behavior prediction method of key target, AI server and storage medium | |
| CN106485868A (en) | The monitoring server of the monitoring method of the condition of a fire, system and the condition of a fire | |
| US11429820B2 (en) | Methods for inter-camera recognition of individuals and their properties | |
| CN110956118B (en) | Target object detection method and device, storage medium and electronic device | |
| CN110473375A (en) | Monitoring method, device, equipment and the system of forest fire | |
| CN112215037B (en) | Object tracking method and device, electronic equipment and computer readable storage medium | |
| CN112733690A (en) | High-altitude parabolic detection method and device and electronic equipment | |
| CN210110004U (en) | Oil field behavior monitoring system based on artificial intelligence | |
| CN115170792B (en) | Infrared image processing method, device and equipment and storage medium | |
| CN112017323A (en) | Patrol alarm method and device, readable storage medium and terminal equipment | |
| CN111125382A (en) | Personnel track real-time monitoring method and terminal equipment | |
| CN114120171A (en) | Fire smoke detection method, device and equipment based on video frame and storage medium | |
| KR101366198B1 (en) | Image processing method for automatic early smoke signature of forest fire detection based on the gaussian background mixture models and hsl color space analysis | |
| CN115100732A (en) | Fishing detection method and device, computer equipment and storage medium | |
| CN111540020A (en) | Method and device for determining target behavior, storage medium and electronic device | |
| CN113627321A (en) | Image identification method and device based on artificial intelligence and computer equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20231026 Address after: Room 201, Building A, Integrated Circuit Design Industrial Park, No. 858, Jianshe 2nd Road, Economic and Technological Development Zone, Xiaoshan District, Hangzhou City, Zhejiang Province, 311200 Patentee after: Zhejiang Huagan Technology Co.,Ltd. Address before: No.1187 Bin'an Road, Binjiang District, Hangzhou City, Zhejiang Province Patentee before: ZHEJIANG DAHUA TECHNOLOGY Co.,Ltd. |
|
| TR01 | Transfer of patent right |