CN114511984B

CN114511984B - Fire monitoring camera, fire monitoring method and fire automatic alarm system

Info

Publication number: CN114511984B
Application number: CN202210193302.XA
Authority: CN
Inventors: 揭小容
Original assignee: Beijing Huayubafang Technology Co ltd
Current assignee: Beijing Huayubafang Technology Co ltd
Priority date: 2022-03-01
Filing date: 2022-03-01
Publication date: 2024-05-03
Anticipated expiration: 2042-03-01
Also published as: CN114511984A

Abstract

The application provides a fire monitoring camera, a fire monitoring method and an automatic fire alarm system, wherein the fire monitoring camera comprises an infrared thermal imaging detector, a CCD (charge coupled device) image sensor, a storage module, a processing module and an alarm module, and the infrared thermal imaging detector acquires thermal imaging images; a CCD image sensor acquires a scene image; the storage module stores a thermal imaging image and a scene image; the processing module detects fire conditions of the thermal imaging image and the scene image, generates an image and alarm data corresponding to the alarm moment when the fire conditions in the specific area are detected, and sends the image and the alarm data corresponding to the alarm moment to the alarm module; and when receiving the image and the alarm data corresponding to the alarm time, the alarm module generates a fire distribution map and alarm information based on the image and the alarm data corresponding to the alarm time. According to the fire monitoring camera, the fire monitoring method and the fire automatic alarm system, the accuracy of fire monitoring is improved.

Description

Fire monitoring camera, fire monitoring method and fire automatic alarm system

Technical Field

The application relates to the technical field of fire monitoring, in particular to a fire monitoring camera, a fire monitoring method and an automatic fire alarm system.

Background

With the rapid development of social economy, security accidents such as high-rise building fires, forest fires and the like are increasingly prominent and are receiving more attention.

The traditional fire alarming mode is to judge whether a fire happens or not through a smoke alarm or a temperature alarm, which effectively judges the fire to a certain extent, but can not effectively observe the fire condition of the fire scene. And when there is external interference, the judgment of the smoke alarm or the temperature alarm may not be accurate, which causes that the fire cannot be found at the first time, and serious loss is caused.

Disclosure of Invention

In view of the above, the application aims to provide a fire monitoring camera, a fire monitoring method and an automatic fire alarm system, wherein an infrared thermal imaging detector acquires a thermal imaging image in a specific area, a CCD image sensor acquires a scene image in the specific area, and a processing module can monitor the thermal imaging condition and the scene condition in the specific area at the same time, so that the accuracy rate of fire monitoring is improved; and the alarm module can also generate a fire distribution diagram and alarm information, so that a user can effectively know the fire condition of the fire scene through the fire distribution diagram and the alarm information.

In a first aspect, an embodiment of the present application provides a fire monitoring camera, where the fire monitoring camera includes an infrared thermal imaging detector, a CCD image sensor, a storage module, a processing module, and an alarm module, where the fire monitoring camera is configured to send a fire distribution map and alarm information to a server when a fire occurs, so that the server alarms according to the fire distribution map and the alarm information;

the infrared thermal imaging detector is used for acquiring thermal imaging images in a specific area and sending the thermal imaging images to the storage module and the processing module;

the CCD image sensor is used for acquiring the scene image in the specific area and sending the scene image to the storage module and the processing module;

the storage module is used for storing the received thermal imaging image and the scene image;

The processing module is used for detecting fire conditions of the thermal imaging image and the scene image, generating an image and alarm data corresponding to the alarm moment when the fire conditions in the specific area are detected, and sending the image and the alarm data corresponding to the alarm moment to the alarm module;

and the alarm module is used for generating the fire distribution map and the alarm information based on the image corresponding to the alarm time and the alarm data when the image corresponding to the alarm time and the alarm data are received.

Further, the processing module comprises a thermal imaging processing unit, a behavior analysis unit and a smoke and fire identification unit:

The thermal imaging processing unit is used for detecting the temperature of a region based on the received thermal imaging image, generating an image corresponding to the alarm time and the alarm data when detecting that a region higher than a first temperature threshold or lower than a second temperature threshold exists in the specific region, and sending the image corresponding to the alarm time and the alarm data to the alarm module;

The behavior analysis unit is used for detecting personnel behaviors based on the received scene images, generating images corresponding to alarm time and the alarm data when detecting that personnel in the specific area perform preset actions, and sending the images corresponding to the alarm time and the alarm data to the alarm module;

The smoke and fire recognition unit is used for detecting smoke and fire based on the received scene image, generating an image corresponding to the alarm time and the alarm data when detecting that smoke or open fire appears in the specific area, and sending the image corresponding to the alarm time and the alarm data to the alarm module.

Further, the thermal imaging processing unit is specifically configured to:

determining at least one image area to be detected in the thermal imaging image; the image area to be detected is used for representing the position of equipment to be detected in the thermal imaging image in the specific area;

Temperature detection is carried out on the at least one image area to be detected by using a temperature detection algorithm, and a temperature value of equipment to be detected corresponding to each image area to be detected is determined;

For each device to be detected, if the temperature value of the device to be detected is higher than the first temperature threshold value or lower than the second temperature threshold value, determining an alarm temperature and an alarm state based on the temperature value;

Determining an alarm position based on the name of the equipment to be detected;

marking the area of the equipment to be detected in the thermal imaging image, and determining the marked thermal imaging image as an image corresponding to the alarm moment;

determining the acquisition time of the image corresponding to the alarm time as alarm time;

and generating the alarm data based on the alarm temperature, the alarm position and the alarm time.

Further, the behavior analysis unit is specifically configured to:

Performing behavior recognition on the scene image by using a behavior recognition algorithm, and determining the behavior type based on an image area when the image area of the preset action exists in the scene image; wherein the preset actions include personnel fall and personnel alarm;

marking the image area in the scene image, and determining the marked scene image as an image corresponding to the alarm moment;

determining the acquisition time of the image corresponding to the alarm time as the alarm time;

and determining the alarm time and the behavior type as the alarm data.

Further, the firework recognition unit is specifically configured to:

Carrying out smoke and fire recognition on the scene image by using a smoke and fire recognition algorithm, and determining a smoke and fire type based on an image area when the image area with smoke or open fire is recognized to exist in the scene image; wherein the pyrotechnic types include thin smoke, thick smoke, and open flame;

Marking the image area in the scene image; determining the marked scene image as an image corresponding to the alarm moment;

And determining the alarm time and the smoke type as alarm data.

Further, when receiving the image and the alarm data corresponding to the alarm time sent by the thermal imaging processing unit, the alarm module is specifically configured to:

Retrieving a scene image within the alarm time from the storage module based on the alarm time in the alarm data;

Splicing the image corresponding to the alarm time and the scene image in the alarm time to generate the fire distribution map;

determining an alarm type based on the alarm data; wherein the alarm type is thermal imaging identification alarm;

determining an alarm location based on the infrared thermal imaging detector; wherein the alarm location is used for representing the location of a fire;

and determining the alarm data, the alarm type and the alarm place as the alarm information.

Further, when receiving the image corresponding to the alarm time and the alarm data sent by the behavior analysis unit or the smoke and fire recognition unit, the alarm module is specifically configured to:

retrieving a thermal imaging image from the memory module during the alarm time based on the alarm time in the alarm data;

splicing the image corresponding to the alarm time and the thermal imaging image in the alarm time to generate the fire distribution map;

Determining an alarm type based on the alarm data; wherein the alarm types are behavior recognition alarm and smoke fire recognition alarm;

determining an alarm location based on the CCD image sensor; wherein the alarm location is used for representing the location of a fire;

In a second aspect, an embodiment of the present application provides a fire monitoring method, where the fire monitoring method is applied to a fire monitoring camera, and the fire monitoring camera includes an infrared thermal imaging detector, a CCD image sensor, a storage module, a processing module, and an alarm module;

Controlling the infrared thermal imaging detector to acquire a thermal imaging image in a specific area, and sending the thermal imaging image to the storage module and the processing module;

Controlling the CCD image sensor to acquire a scene image in the specific area and sending the scene image to the storage module and the processing module;

controlling the storage module to store the received thermal imaging image and the scene image;

Controlling the processing module to detect fire of the thermal imaging image and the scene image, generating an image and alarm data corresponding to the alarm moment when the fire is detected in the specific area, and sending the image and the alarm data corresponding to the alarm moment to the alarm module;

and controlling the alarm module to generate the fire distribution map and the alarm information based on the image corresponding to the alarm time and the alarm data when the image corresponding to the alarm time and the alarm data are received.

In a third aspect, an embodiment of the present application provides an automatic fire alarm system, where the automatic fire alarm system includes a fire monitoring camera and a server, where the fire monitoring camera is connected to the server in a communication manner;

the fire monitoring camera is used for sending the generated fire distribution diagram and alarm information to the server;

the server is used for alarming according to the received fire distribution diagram and the alarm information;

The server is specifically configured to:

displaying the alarm information in a monitoring interface, and carrying out voice alarm according to the alarm information;

Sending the alarm information and the fire distribution map to a client;

When the alarm information comprises the alarm temperature, if the ratio between the alarm temperature and a first temperature threshold or the ratio between the alarm temperature and a second temperature threshold reaches a preset ratio, closing specific equipment in a specific area; wherein the specific devices include a power supply device, a ventilation device, and a gas supply device.

In a fourth aspect, an embodiment of the present application provides a fire automatic alarm method, where the fire automatic alarm method is applied to a fire automatic alarm system, and the fire automatic alarm system includes a fire monitoring camera and a server;

Controlling the fire monitoring camera to send the generated fire distribution diagram and alarm information to the server;

Controlling the server to alarm according to the received fire distribution diagram and the alarm information;

The server alarms according to the received fire distribution diagram and the alarm information, and the method comprises the following steps:

Sending the alarm information and the fire distribution map to a client;

When the alarm information comprises alarm temperature, if the ratio between the alarm temperature and a first temperature threshold or the ratio between the alarm temperature and a second temperature threshold reaches a preset ratio, closing specific equipment in a specific area; wherein the specific devices include a power supply device, a ventilation device, and a gas supply device.

In a fifth aspect, an embodiment of the present application further provides an electronic device, including: the fire monitoring system comprises a processor, a memory and a bus, wherein the memory stores machine-readable instructions executable by the processor, the processor and the memory are communicated through the bus when the electronic device is running, and the machine-readable instructions are executed by the processor to perform the steps of the fire monitoring method.

In a sixth aspect, embodiments of the present application also provide a computer readable storage medium having a computer program stored thereon, which when executed by a processor performs the steps of a fire monitoring method as described above.

According to the fire monitoring camera provided by the embodiment of the application, the fire monitoring camera comprises the infrared thermal imaging detector, the CCD image sensor, the storage module, the processing module and the alarm module, and the fire monitoring camera is used for sending a fire distribution map and alarm information to the server when a fire occurs, so that the server can directly alarm according to the fire distribution map and the alarm information sent by the fire monitoring camera. The infrared thermal imaging detector acquires thermal imaging images in a specific area, the CCD image sensor acquires scene images in the specific area and sends the thermal imaging images and the scene images to the storage module and the processing module, so that the processing module can detect thermal imaging conditions and scene conditions in the specific area at the same time, multiple algorithm functions of thermal imaging, behavior recognition and smoke and fire recognition are realized, and an integral alarm method can be provided for events such as smoke and fire, high-energy consumption and high-temperature instruments, falling of people, help seeking and alarming of people and the like in the specific area. And because the storage module is arranged, the alarm module can integrate the thermal imaging image and the scene image at the alarm moment according to the image stored in the storage module. According to the fire monitoring camera provided by the embodiment of the application, the functions of data processing, AI video analysis, image integration and the like are placed at the front end of the camera to be processed, a special server is not needed to be used at the rear end for processing, the processing speed is higher, the fire monitoring speed is improved, and the fire can be discovered more timely.

In order to make the above objects, features and advantages of the present application more comprehensible, preferred embodiments accompanied with figures are described in detail below.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are needed in the embodiments will be briefly described below, it being understood that the following drawings only illustrate some embodiments of the present application and therefore should not be considered as limiting the scope, and other related drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.

Fig. 1 is a schematic structural diagram of a fire monitoring camera according to an embodiment of the present application;

FIG. 2 is a schematic diagram of a processing module according to an embodiment of the present application;

FIG. 3 is a flow chart of a fire monitoring method according to an embodiment of the present application;

FIG. 4 is a schematic diagram of an automatic fire alarm system according to an embodiment of the present application;

Fig. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present application.

In the embodiment of the present invention, reference numerals are as follows, in combination with the accompanying drawings:

10-an automatic fire alarm system; 100-a fire monitoring camera; 110-an infrared thermal imaging detector; a 120-CCD image sensor; 130-a memory module; 140-a processing module; 150-an alarm module; 141-a thermal imaging processing unit; 142-a behavior analysis unit; 143-a pyrotechnic recognition unit; 200-a server; 500-an electronic device; 510-a processor; 520-memory; 530-bus.

Detailed Description

For the purpose of making the objects, technical solutions and advantages of the embodiments of the present application more apparent, the technical solutions of the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application, and it is apparent that the described embodiments are only some embodiments of the present application, not all embodiments. The components of the embodiments of the present application generally described and illustrated in the figures herein may be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of the embodiments of the application, as presented in the figures, is not intended to limit the scope of the application, as claimed, but is merely representative of selected embodiments of the application. Based on the embodiments of the present application, every other embodiment obtained by a person skilled in the art without making any inventive effort falls within the scope of protection of the present application.

Based on the above, the embodiment of the application provides a fire monitoring camera to solve the problem that whether fire occurs or not is possibly inaccurate by using a smoke alarm or a temperature alarm in the prior art.

Referring to fig. 1, fig. 1 is a schematic structural diagram of a fire monitoring camera according to an embodiment of the application. As shown in fig. 1, a fire monitoring camera 100 according to an embodiment of the present application includes: the fire monitoring camera 100 is used for sending a fire distribution map and alarm information to the server when a fire occurs, so that the server alarms according to the fire distribution map and the alarm information.

The infrared thermal imaging detector 110 is configured to acquire a thermal imaging image in a specific area, and send the thermal imaging image to the storage module 130 and the processing module 140.

It should be noted that, the infrared thermal imaging detector 110, i.e., the infrared thermal imager, may convert invisible infrared energy emitted by the object into a visible thermal image. The thermal imaging image is a thermal image generated by the infrared thermal imaging detector 110, and different colors on the thermal image represent different temperatures of the measured object. The specific area refers to an area for monitoring whether a fire occurs, and may be, for example, a laboratory, a classroom, or an office area, to which the present application is not limited.

Specifically, the infrared thermal imaging detector 110 is installed in a specific area, for example, when the specific area is a laboratory, the infrared thermal imaging detector 110 may be installed at a corner of a ceiling of the laboratory, and no photographing dead angle may exist, so that the infrared thermal imaging detector 110 can photograph the whole laboratory. The infrared thermal imaging detector 110 acquires a thermal imaging image in a specific area, and after the infrared thermal imaging detector 110 acquires the thermal imaging image in the specific area, the acquired thermal imaging image is sent to the storage module 130 and the processing module 140.

Here, it should be noted that the above-described example of the mounting position of the infrared thermal imaging detector 110 is only an example, and in practice, the mounting position of the infrared thermal imaging detector 110 is not limited to the above-described example.

The CCD image sensor 120 is configured to collect an image of a scene in the specific area and send the image of the scene to the storage module 130 and the processing module 140.

It should be noted that, the generation of the image is mainly from the CCD (Charge Coupled Device ) image sensor 120, and the CCD can change light into electric charge, store and transfer the electric charge, and also can take out the stored electric charge to change the voltage, so that the CCD image sensor is an ideal CCD image sensor element, and the CCD image sensor formed by the CCD image sensor element has the characteristics of small volume, light weight, no influence of magnetic field, shock resistance and impact resistance, and is widely used. The CCD image sensor 120 can directly convert the optical signal into an analog current signal, and the current signal is amplified and analog-to-digital converted to obtain, store, transmit, process and reproduce the image. The scene image refers to a real scene image within a specific area photographed by the CCD image sensor 120.

Specifically, the CCD image sensor 120 is installed in a specific area, for example, when the specific area is a laboratory, the CCD image sensor 120 may be installed at a corner of a ceiling of the laboratory, and no photographing dead angle may exist, so that the CCD image sensor 120 can photograph the whole laboratory. The CCD image sensor 120 collects the scene image in the specific area, and after the CCD image sensor 120 collects the scene image in the specific area, the collected scene image is sent to the storage module 130 and the processing module 140.

Here, it should be noted that the above-described example of the mounting position of the CCD image sensor 120 is only an example, and in practice, the mounting position of the CCD image sensor 120 is not limited to the above-described example.

The storage module 130 is configured to store the received thermal imaging image and the scene image.

The storage module 130 refers to a module for storing a thermal imaging image and a scene image.

Specifically, after the storage module 130 receives the thermal imaging image and the scene image transmitted from the infrared thermal imaging detector 110 and the CCD image sensor 120, the received thermal imaging image and scene image are stored.

The processing module 140 is configured to perform fire detection on the thermal imaging image and the scene image, generate an image and alarm data corresponding to an alarm time when a fire is detected in the specific area, and send the image and the alarm data corresponding to the alarm time to the alarm module 150.

The alarm time refers to the time when the processing module detects the fire in the specific area, and the image corresponding to the alarm time refers to the image in the specific area when the fire occurs, where the image corresponding to the alarm time may be a thermal imaging image in the specific area when the fire occurs or a scene image in the specific area when the fire occurs. The alarm data refers to some scene data generated in a specific area when a fire occurs, for example, the alarm data may be an alarm temperature, an alarm state or an alarm position, etc., which is not particularly limited in the present application.

Specifically, the processing module 140 monitors the thermal imaging image and the scene image after receiving the thermal imaging image and the scene image sent by the infrared thermal imaging detector 110 and the CCD image sensor 120, generates an image and alarm data corresponding to an alarm time when detecting a fire in a specific area, and sends the image and the alarm data corresponding to the alarm time to the alarm module 150. For example, processing module 140 may employ a HI3516D SOC processing chip.

Here, it should be noted that the above-described examples of the model of the processing module 140 are merely examples, and in practice, the model of the processing module 140 is not limited to the above-described examples.

According to the embodiment provided by the application, the infrared thermal imaging detector 110 and the CCD image sensor 120 are respectively provided with a signal processor, the storage module 130 and the processing module 140 are respectively provided with a decoding module, when the infrared thermal imaging detector 110 and the CCD image sensor 120 acquire real-time thermal imaging images and scene images, the signal processor arranged in the infrared thermal imaging detector 110 and the CCD image sensor 120 firstly convert the acquired thermal imaging images and scene images into digital signals, and then the digital signals are sent to the storage module 130 and the processing module 140, and then the decoding module arranged in the storage module 130 and the processing module 140 encodes and decodes the digital signals to obtain the thermal imaging images and the scene images.

The alarm module 150 is configured to generate the fire distribution map and the alarm information based on the image corresponding to the alarm time and the alarm data when the image corresponding to the alarm time and the alarm data are received.

It should be noted that the fire distribution map refers to an image in a specific area at the alarm time, which is finally sent to the server, where the fire distribution map is an image obtained by stitching a thermal imaging image and a scene image, and a user can quickly locate a position where a fire occurs according to the fire distribution map. The alarm information refers to information finally transmitted to the server, and the server can alarm according to the alarm information. The alarm information may include alarm time, alarm place, alarm position, alarm type, etc., and the present application is not particularly limited thereto.

Specifically, when receiving the image and the alarm data corresponding to the alarm time sent by the processing module 140, the alarm module 150 generates the fire distribution map and the alarm information based on the image and the alarm data corresponding to the alarm time. Thus, the user can effectively know the fire situation of the fire scene through the fire distribution diagram and the alarm information.

Referring to fig. 2, fig. 2 is a schematic structural diagram of a processing module according to an embodiment of the application. As shown in fig. 2, the processing module 140 provided by the embodiment of the present application includes a thermal imaging processing unit 141, a behavior analysis unit 142, and a smoke and fire recognition unit 143.

The thermal imaging processing unit 141 is configured to perform region temperature detection based on the received thermal imaging image, generate an image corresponding to the alarm time and the alarm data when detecting that a region higher than a first temperature threshold or lower than a second temperature threshold exists in the specific region, and send the image corresponding to the alarm time and the alarm data to the alarm module.

The region temperature detection means that the region corresponding to the thermal imaging image is subjected to temperature detection. The first temperature threshold is a preset temperature threshold for judging whether a high temperature area exists in the specific area. The second temperature threshold is a preset temperature threshold for judging whether a low-temperature region exists in the specific region. According to the embodiments provided by the application, for example, the specific area is a chemical laboratory, and equipment instruments such as a reaction kettle, a high-temperature furnace, liquid nitrogen, equipment cables and the like may be contained in the chemical laboratory. The temperature of the reactor, the high-temperature furnace, the equipment cable and other instruments and equipment can cause fire if the temperature is too high, so that whether the temperature exceeds a first temperature threshold value or not needs to be detected. However, if the temperature of the liquid nitrogen is too low, unpredictable results will occur, so that it is necessary to detect whether the temperature of the liquid nitrogen is below the second temperature threshold.

Here, the thermal imaging processing unit 141 performs region temperature detection based on the received thermal imaging image after receiving the thermal imaging image, generates an image and alarm data corresponding to an alarm time if it detects that a region higher than a first temperature threshold or lower than a second temperature threshold exists in a specific region, and transmits the image and alarm data corresponding to the alarm time to the alarm module 150.

The thermal imaging processing unit 141 is specifically configured to:

(1) At least one image area to be detected in the thermographic image is determined.

It should be noted that, the image area to be detected refers to an image area in the thermal imaging image, and is used to characterize the position of the device to be detected in the specific area in the thermal imaging image.

For the above step (1), at least one image area to be detected in the thermal imaging image is determined when it is implemented. Specifically, the image area to be detected may be determined according to the position of the device to be detected in the thermographic image. Continuing the above embodiment, when the specific area is a chemical laboratory, the equipment to be detected may be equipment such as a reaction kettle, a high temperature furnace, liquid nitrogen, an equipment cable, and the like, which is not particularly limited in the present application. When determining the image area to be detected in the thermal imaging image, for at least one device to be detected, the position of the device to be detected in the thermal imaging image needs to be determined first, and then the position area of the device to be detected in the thermal imaging image is determined as the image area to be checked.

(2) And carrying out temperature detection on the at least one region to be detected by using a temperature detection algorithm, and determining a temperature value of equipment to be detected corresponding to each image region to be detected.

For the step (2), after at least one to-be-detected area in the thermal imaging image is determined, for each to-be-detected area, temperature detection is performed on the to-be-detected area by using a temperature detection algorithm, so as to determine a temperature value of to-be-detected equipment corresponding to the to-be-detected image area. How to determine the temperature values corresponding to each image area in the thermal imaging image by using the temperature detection algorithm is described in detail in the prior art, and is not described herein.

(3) For each device to be detected, if the temperature value of the device to be detected is higher than the first temperature threshold value or lower than the second temperature threshold value, determining an alarm temperature and an alarm state based on the temperature value.

It should be noted that the alarm temperature refers to a temperature value of the device to be checked when a fire occurs. The alarm state refers to the temperature state of the equipment to be checked when a fire occurs. In particular, the alarm condition may be an over-temperature and an under-temperature.

For the step (3), in implementation, for each device to be detected, if the temperature value of the device to be detected is higher than the first temperature threshold or lower than the second temperature threshold, the device to be detected is considered to be abnormal, and the temperature value of the device to be detected is determined to be the alarm temperature. If the temperature value of the equipment to be detected is higher than the first temperature threshold value, the alarm state is considered to be over-high; and if the temperature value of the equipment to be detected is lower than the second temperature threshold value, the alarm state is considered to be too low.

(4) And determining the alarm position based on the name of the equipment to be detected.

It should be noted that the alarm position refers to a position where abnormality occurs in the device to be detected in the specific area.

For the step (4), when the temperature value of the device to be detected is higher than the first temperature threshold value or lower than the second temperature threshold value, the name of the device to be detected is determined as the alarm position. For example, the equipment to be detected is a high-temperature furnace, and when the temperature value of the high-temperature furnace is higher than the first temperature threshold value, the alarm position is the high-temperature furnace. For example, the device to be detected is liquid nitrogen, and when the temperature value of the liquid nitrogen is determined to be lower than the second temperature threshold value, the alarm position is liquid nitrogen.

(5) And marking an image area corresponding to the equipment to be detected in the thermal imaging image, and determining the marked thermal imaging image as an image corresponding to the alarm moment.

For the step (5), in implementation, if the device to be detected is detected to be abnormal, an image area corresponding to the device to be detected is determined in the thermal imaging image, and the image area is marked, for example, a box can be used for marking, which is not particularly limited. And determining the marked thermal imaging image as an image corresponding to the alarm time. Therefore, when a user views the image corresponding to the alarm time, the position with the abnormality can be rapidly positioned directly through the mark in the image corresponding to the alarm time.

(6) And determining the acquisition time of the image corresponding to the alarm time as alarm time.

For the above step (6), in the implementation, after the image corresponding to the alarm time is determined, the acquisition time of the image corresponding to the alarm time acquired by the infrared thermal imaging detector 110 is determined, and the acquisition time is determined as the alarm time.

(7) And generating the alarm data based on the alarm temperature, the alarm position and the alarm time.

For the step (7), in the specific implementation, after the alarm temperature, the alarm position and the alarm time are all determined, the alarm temperature, the alarm position and the alarm time are determined to be alarm data.

The behavior analysis unit is configured to perform personnel behavior detection based on the received scene image, generate an image corresponding to an alarm time and the alarm data when detecting that a person in the specific area performs a preset action, and send the image corresponding to the alarm time and the alarm data to the alarm module 150.

The person behavior detection refers to detecting a person in an image according to a scene image, and judging whether the person in the image performs a preset action. The preset actions are set in advance and are used for analyzing whether dangerous personnel work occurs in a specific scene. For example, the preset actions may be a personal fall and a personal alarm.

Here, the behavior analysis unit performs the person behavior detection on the scene image after receiving the scene image, and if it detects that a person in the specific area performs the preset action, generates an image and alarm data corresponding to the alarm time, and sends the image and alarm data corresponding to the alarm time to the alarm module 150.

The behavior analysis unit is specifically configured to:

a: and performing behavior recognition on the scene image by using a behavior recognition algorithm, and determining the behavior type based on the image area if the image area of the preset action exists in the scene image.

The preset actions include personal fall and personal alarm. The behavior types may also include personal falls and personal alarms.

In the specific implementation of the step a, the behavior recognition algorithm is utilized to recognize the scene image, and if the scene image is recognized that the person falls down or the person uses the help-seeking alarm action agreed in advance, the scene image is considered to have the image area with the preset action. If the action of the person in the image area is a fall, the behavior type is that the person falls; if the action of the person in the image area is an alarm, the action type is a person alarm.

B: and marking the image area in the scene image, and determining the marked scene image as the image corresponding to the alarm time.

For the above step B, in implementation, if an image area with a preset action is detected in the scene image, the image area is marked in the field Jing Tuxiang, for example, a box may be used for marking, which is not particularly limited to the present application. And determining the marked scene image as an image corresponding to the alarm time. Therefore, when a user views the image corresponding to the alarm time, the position with the abnormality can be rapidly positioned directly through the mark in the image corresponding to the alarm time.

C: and determining the acquisition time of the image corresponding to the alarm time as the alarm time.

For the above step C, in the implementation, after the image corresponding to the alarm time is determined, the acquisition time of the image corresponding to the alarm time acquired by the CCD image sensor 120 is determined, and the acquisition time is determined as the alarm time.

D: and determining the alarm time and the behavior type as the alarm data.

For the step D, in the implementation, after the alarm time and the behavior type are determined, the alarm time and the behavior type are determined as alarm data.

The smoke and fire recognition unit is configured to perform smoke and fire detection based on the received scene image, generate an image corresponding to the alarm time and the alarm data when detecting that smoke or open fire occurs in the specific area, and send the image corresponding to the alarm time and the alarm data to the alarm module 150.

The smoke and fire detection refers to determining whether there is smoke or open fire in a scene image according to the scene image, that is, determining whether there is smoke or open fire in a specific area.

Here, after receiving the scene image, the smoke and fire recognition unit determines whether smoke or open fire appears in the scene image, and if it detects that smoke or open fire appears in the specific area, generates an image and alarm data corresponding to the alarm time, and sends the image and alarm data corresponding to the alarm time to the alarm module 150.

The firework identification unit is specifically used for:

a: and carrying out smoke and fire recognition on the scene image by using a smoke and fire recognition algorithm, and if the scene image is recognized to have an image area where smoke or open fire appears, determining the smoke and fire type based on the image area.

The type of smoke includes thin smoke, thick smoke, and open flame.

In the specific implementation of the step a, the smoke and fire recognition algorithm is utilized to recognize smoke and fire of the scene image, and if the smoke or fire image is recognized in the scene image, the image area where the smoke or fire appears is considered to exist in the scene image. If the thin smoke appears in the image area, the smoke type is the thin smoke; if the smoke appears in the image area, the smoke type is the smoke; if an open flame is present in the image region, the pyrotechnic type is an open flame.

B: marking the image area in the scene image; and determining the marked scene image as an image corresponding to the alarm time.

In the implementation of the above step b, if an image area where smoke or open fire appears in the scene image is detected, the image area is marked in the field Jing Tuxiang, for example, a box may be used for marking, which is not particularly limited to the present application. And determining the marked scene image as an image corresponding to the alarm time. Therefore, when a user views the image corresponding to the alarm time, the position where the smoke and fire appear can be rapidly positioned directly through the mark in the image corresponding to the alarm time.

D: and determining the alarm time and the smoke type as alarm data.

For the step d, in the implementation, after the alarm time and the smoke type are determined, the alarm time and the smoke type are determined as alarm data.

When receiving the image and the alarm data corresponding to the alarm time sent by the thermal imaging processing unit 141, the alarm module 150 is specifically configured to:

Based on the alarm time in the alarm data, the scene image within the alarm time is retrieved from the storage module 130.

Here, since all the thermal imaging images and the scene images acquired by the infrared thermal imaging detector 110 and the CCD image sensor 120 are stored in the storage module 130, after the alarm module 150 receives the image and the alarm data corresponding to the alarm time transmitted by the thermal imaging processing unit 141, the scene image within the alarm time is retrieved from the storage module 130 according to the alarm time in the alarm data.

And splicing the image corresponding to the alarm time and the scene image in the alarm time to generate the fire distribution map.

After the images corresponding to the alarm time and the scene images in the alarm time are determined, the images corresponding to the alarm time and the scene images in the alarm time are spliced to generate a fire distribution diagram.

And determining the alarm type based on the alarm data.

The alarm type is thermal imaging identification alarm. Here, since the alarm temperature is included in the alarm data, it can be determined that the alarm data is generated from the thermal imaging processing unit 141, and thus the alarm type is a thermal imaging recognition alarm.

An alert location is determined based on the infrared thermal imaging detector 110.

The alarm place is used to indicate the place where the fire occurs. Here, the alarm location may be determined based on the location of the infrared thermal imaging detector 110. For example, the infrared thermal imaging detector 110 is installed in a chemical laboratory, and the alarm site can be determined to be the chemical laboratory according to the position of the infrared thermal imaging detector 110, so that related personnel can quickly locate the place where the fire occurs according to the alarm site, and the fire can be extinguished in time.

Here, after the alarm data, the alarm type, and the alarm place are all determined, the alarm data, the alarm type, and the alarm place are taken as alarm information.

When receiving the image corresponding to the alarm time and the alarm data sent by the behavior analysis unit 142 or the smoke and fire recognition unit 143, the alarm module is specifically configured to:

and based on the alarm time in the alarm data, retrieving a thermal imaging image in the alarm time from the storage module.

Here, since all the thermal imaging images and the scene images acquired by the infrared thermal imaging detector 110 and the CCD image sensor 120 are stored in the storage module 130, after the alarm module 150 receives the image and the alarm data corresponding to the alarm time transmitted by the behavior analysis unit 142 or the smoke recognition unit 143, the thermal imaging image within the alarm time is retrieved from the storage module 130 according to the alarm time in the alarm data.

And splicing the image corresponding to the alarm time and the thermal imaging image in the alarm time to generate the fire distribution map.

After the image corresponding to the alarm time and the thermal imaging image in the alarm time are determined, the image corresponding to the alarm time and the thermal imaging image in the alarm time are spliced to generate a fire distribution diagram.

And determining the alarm type based on the alarm data.

The alarm types are behavior recognition alarm and smoke recognition alarm. Here, when the behavior type is included in the alarm data, it can be determined that the alarm data is generated from the behavior analysis unit 142, and thus the alarm type is a behavior recognition alarm. When the smoke type is included in the alarm data, it can be determined that the alarm data is generated from the smoke identification unit 143, and thus the alarm type is a smoke identification alarm.

An alarm location is determined based on the CCD image sensor 120.

The alarm location is used to indicate the location of the fire. Here, the alarm place may be determined according to the position where the CCD image sensor 120 is located. For example, the CCD image sensor 120 is installed in a chemical laboratory, and the alarm place can be determined to be the chemical laboratory according to the position of the CCD image sensor 120, so that related personnel can quickly locate the place where the fire occurs according to the alarm place, and the fire can be extinguished in time.

And determining alarm data, the alarm type and the alarm place in the behavior alarm signal or the smoke alarm signal as the alarm information.

As an alternative embodiment, the alarm device number may also be determined according to the fire monitoring camera 100, and the alarm device number may also be used as alarm information, so that the alarm device may be checked according to the alarm device number.

According to the fire monitoring camera 100 provided by the embodiment of the application, the fire monitoring camera 100 comprises an infrared thermal imaging detector 110, a CCD image sensor 120, a storage module 130, a processing module 140 and an alarm module 150, wherein the fire monitoring camera 100 is used for sending a fire distribution map and alarm information to a server when a fire occurs, so that the server can directly alarm according to the fire distribution map and alarm information sent by the fire monitoring camera 100. The infrared thermal imaging detector 110 collects thermal imaging images in a specific area, the CCD image sensor 120 collects scene images in the specific area, and sends the thermal imaging images and the scene images to the storage module 130 and the processing module 140, so that the processing module 140 can detect thermal imaging conditions and scene conditions in the specific area at the same time, multiple algorithm functions of thermal imaging, behavior recognition and smoke and fire recognition are realized, and an integral alarm method can be provided for events such as smoke and fire, high-energy consumption and high-temperature instruments, personnel fall, personnel help seeking alarm and the like in the specific area. And because the storage module 130 is arranged, the alarm module can integrate the thermal imaging image and the scene image at the alarm time according to the image stored in the storage module 130. According to the fire monitoring camera 100 provided by the embodiment of the application, the functions of data processing, AI video analysis, image integration and the like are placed at the front end of the camera to complete processing, a special server is not required to be used at the rear end for processing, the processing speed is higher, the fire monitoring speed is improved, and the fire can be discovered more timely.

Referring to fig. 3, fig. 3 is a flowchart of a fire monitoring method according to an embodiment of the application. As shown in fig. 3, the fire monitoring method is applied to a fire monitoring camera, and the fire monitoring camera comprises an infrared thermal imaging detector, a CCD image sensor, a storage module, a processing module and an alarm module, and the fire monitoring method provided by the embodiment of the application comprises the following steps:

s301, controlling the infrared thermal imaging detector to acquire a thermal imaging image in a specific area, and sending the thermal imaging image to the storage module and the processing module.

S302, controlling the CCD image sensor to collect the scene image in the specific area, and sending the scene image to the storage module and the processing module.

S303, controlling the storage module to store the received thermal imaging image and the scene image.

S304, controlling the processing module to detect fire of the thermal imaging image and the scene image, generating an image and alarm data corresponding to the alarm time when the fire is detected in the specific area, and sending the image and the alarm data corresponding to the alarm time to the alarm module.

S305, controlling the alarm module to generate the fire distribution map and the alarm information based on the image corresponding to the alarm time and the alarm data when the image corresponding to the alarm time and the alarm data are received.

Further, the processing module includes a thermal imaging processing unit, a behavior analysis unit, and a smoke and fire recognition unit, and controls the processing module to perform fire detection on the thermal imaging image and the scene image, and when a fire is detected in the specific area, generate an image and alarm data corresponding to an alarm time, including:

Controlling the thermal imaging processing unit to detect the region temperature based on the received thermal imaging image, if detecting that a region higher than a first temperature threshold or lower than a second temperature threshold exists in the specific region, generating an image corresponding to the alarm time and the alarm data, and sending the image corresponding to the alarm time and the alarm data to the alarm module;

Controlling the behavior analysis unit to detect personnel behaviors based on the received scene images, generating images corresponding to the alarm time and the alarm data when detecting that personnel in the specific area perform preset actions, and sending the images corresponding to the alarm time and the alarm data to the alarm module;

And controlling the smoke and fire recognition unit to detect smoke and fire based on the received scene image, generating an image corresponding to the alarm time and the alarm data when detecting that smoke or open fire appears in the specific area, and sending the image corresponding to the alarm time and the alarm data to the alarm module.

Further, controlling the thermal imaging processing unit to detect the region temperature based on the received thermal imaging image, and generating the image corresponding to the alarm time and the alarm data if detecting that the region higher than the first temperature threshold or lower than the second temperature threshold exists in the specific region, including:

Determining at least one image area to be detected in the thermal imaging image; the image area to be detected is used for representing the position of equipment to be detected in the specific area in the thermal imaging image;

Temperature detection is carried out on the at least one region to be detected by using a temperature detection algorithm, and a temperature value of equipment to be detected corresponding to each region to be detected is determined;

Marking an image area corresponding to the equipment to be detected in the thermal imaging image, and determining the marked thermal imaging image as an image corresponding to the alarm moment;

Further, controlling the behavior analysis unit to perform personnel behavior detection based on the received scene image, and generating an image corresponding to the alarm time and the alarm data if a person in the specific area is detected to perform a preset action, including:

and determining the alarm time and the behavior type as the alarm data.

Further, controlling the smoke and fire recognition unit to perform smoke and fire detection based on the received scene image, and generating an image corresponding to the alarm time and the alarm data if detecting that smoke or open fire occurs in the specific area, including:

And determining the alarm time and the smoke type as alarm data.

Further, when the alarm module is controlled to receive the image corresponding to the alarm time and the alarm data, generating the fire distribution map and the alarm information based on the image corresponding to the alarm time and the alarm data, including:

The embodiment of the application also provides a fire automatic alarm method which is applied to the fire automatic alarm system, wherein the fire automatic alarm system comprises a fire monitoring camera and a server;

And controlling the fire monitoring camera to send the generated fire distribution diagram and alarm information to the server.

And controlling the server to alarm according to the received fire distribution diagram and the alarm information.

Sending the alarm information and the fire distribution map to a client;

Referring to fig. 4, fig. 4 is a schematic structural diagram of an automatic fire alarm system according to an embodiment of the present application. As shown in fig. 4, the fire automatic alarm system 10 includes: the fire monitoring camera 100 is in communication connection with the server 200, and the server 200 is connected with the fire monitoring camera 100.

The fire monitoring camera 100 is configured to send the generated fire distribution map and alarm information to the server.

Here, the description of the fire monitoring camera 100 may refer to the description corresponding to the embodiment shown in fig. 1 and 2, and will not be repeated.

The server 200 is configured to alarm according to the received fire distribution diagram and the alarm information.

Here, after the server 200 receives the fire profile and the alarm information transmitted from the fire monitoring camera 100, an alarm may be given according to the fire profile and the alarm information to inform the relevant responsible person to perform the process.

The server 200 is specifically configured to:

and displaying the alarm information in a monitoring interface, and carrying out voice alarm according to the alarm information.

It should be noted that, the monitoring interface refers to an interface for monitoring an environment in a specific area, where the monitoring interface may be a computer interface, a mobile phone interface, or a monitoring screen, which is not limited to the applicant.

Here, the server 200 displays the alarm information in the monitoring interface after receiving the alarm information, for example, may display the alarm information in a pop-up window form on the monitoring screen. And voice alarm is carried out according to the alarm information.

And sending the alarm information and the fire distribution map to a client.

Here, after receiving the alarm information and the fire distribution diagram, the server 200 also uses the mobile terminal APP to pop the window for the relevant responsible person.

And when the alarm information comprises alarm temperature, if the ratio between the alarm temperature and a first temperature threshold or the ratio between the alarm temperature and a second temperature threshold reaches a preset ratio, closing the specific equipment in the specific area.

The specific devices include a power supply device, a ventilation device, and a gas supply device.

Here, when the alarm temperature is included in the alarm information, the alarm information needs to be performed. Here, the alarm temperature needs to be compared with the first temperature threshold or the second temperature threshold, and if the ratio exceeds the predetermined ratio, the specific equipment in the specific area needs to be turned off. For example, after the alarm temperature exceeds the first temperature threshold and the data rise exceeds 20%, the server 200 remotely controls the power supply, ventilation, air supply, etc. systems of the specific area to be turned off. And secondary alarm is carried out, and besides the alarm information displayed on the monitoring interface, the voice alarm and the APP popup window alarm at the mobile terminal of the mobile phone, the alarm channel also adds a short message alarm to timely inform related responsible persons.

Referring to fig. 5, fig. 5 is a schematic structural diagram of an electronic device according to an embodiment of the application. As shown in fig. 5, the electronic device 500 includes a processor 510, a memory 520, and a bus 530.

The memory 520 stores machine-readable instructions executable by the processor 510, when the electronic device 500 is running, the processor 510 communicates with the memory 520 through the bus 530, and when the machine-readable instructions are executed by the processor 510, the steps of the fire monitoring method in the method embodiment shown in fig. 4 can be executed, so as to solve the problem that whether a fire is possibly inaccurate when a smoke alarm or a temperature alarm is used to determine whether the fire is generated in the prior art, and the specific implementation will be referred to the method embodiment and will not be repeated herein.

The embodiment of the application also provides a computer readable storage medium, and a computer program is stored on the computer readable storage medium, and when the computer program is run by a processor, the computer program can execute the steps of the fire monitoring method in the method embodiment shown in fig. 4, so that the problem that whether fire is possibly inaccurate is judged by using a smoke alarm or a temperature alarm in the prior art is solved, and the specific implementation manner can refer to the method embodiment and is not repeated herein.

It will be clear to those skilled in the art that, for convenience and brevity of description, specific working procedures of the above-described systems, apparatuses and units may refer to corresponding procedures in the foregoing method embodiments, and are not repeated herein.

In the several embodiments provided by the present application, it should be understood that the disclosed systems, devices, and methods may be implemented in other manners. The above-described apparatus embodiments are merely illustrative, for example, the division of the units is merely a logical function division, and there may be other manners of division in actual implementation, and for example, multiple units or components may be combined or integrated into another system, or some features may be omitted, or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be through some communication interface, device or unit indirect coupling or communication connection, which may be in electrical, mechanical or other form.

The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in the embodiments of the present application may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit.

The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a non-volatile computer readable storage medium executable by a processor. Based on this understanding, the technical solution of the present application may be embodied essentially or in a part contributing to the prior art or in a part of the technical solution, in the form of a software product stored in a storage medium, comprising several instructions for causing a computer device (which may be a personal computer, a server, a network device, etc.) to perform all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), a magnetic disk, or an optical disk, or other various media capable of storing program codes.

It should be noted that: like reference numerals and letters in the following figures denote like items, and thus once an item is defined in one figure, no further definition or explanation of it is required in the following figures, and furthermore, the terms "first," "second," "third," etc. are used merely to distinguish one description from another and are not to be construed as indicating or implying relative importance.

Finally, it should be noted that: the above examples are only specific embodiments of the present application, and are not intended to limit the scope of the present application, but it should be understood by those skilled in the art that the present application is not limited thereto, and that the present application is described in detail with reference to the foregoing examples: any person skilled in the art may modify or easily conceive of the technical solution described in the foregoing embodiments, or perform equivalent substitution of some of the technical features, while remaining within the technical scope of the present disclosure; such modifications, changes or substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present application, and are intended to be included in the scope of the present application. Therefore, the protection scope of the application is subject to the protection scope of the claims.

Claims

1. The fire monitoring camera is characterized by comprising an infrared thermal imaging detector, a CCD image sensor, a storage module, a processing module and an alarm module, wherein the fire monitoring camera is used for sending a fire distribution map and alarm information to a server when a fire occurs, so that the server alarms according to the fire distribution map and the alarm information;

The alarm module is used for generating the fire distribution map and the alarm information based on the image corresponding to the alarm time and the alarm data when the image corresponding to the alarm time and the alarm data are received;

The processing module comprises a thermal imaging processing unit, a behavior analysis unit and a smoke and fire identification unit:

2. The fire monitoring camera of claim 1, wherein the thermal imaging processing unit is specifically configured to:

3. The fire monitoring camera according to claim 1, wherein the behavior analysis unit is specifically configured to:

Performing behavior recognition on the scene image by using a behavior recognition algorithm, and determining a behavior type based on an image area when the image area of the preset action exists in the scene image; wherein the preset actions include personnel fall and personnel alarm;

and determining the alarm time and the behavior type as the alarm data.

4. The fire monitoring camera according to claim 1, wherein the smoke and fire identification unit is specifically configured to:

And determining the alarm time and the smoke type as alarm data.

5. The fire monitoring camera according to claim 2, wherein when receiving the image corresponding to the alarm time and the alarm data sent by the thermal imaging processing unit, the alarm module is specifically configured to:

6. The fire monitoring camera according to any one of claims 3-4, wherein when receiving the image corresponding to the alarm time and the alarm data sent by the behavior analysis unit or the smoke and fire recognition unit, the alarm module is specifically configured to:

7. A fire monitoring method, characterized in that the fire monitoring method is applied to the fire monitoring camera according to any one of claims 1-6, and the fire monitoring camera comprises an infrared thermal imaging detector, a CCD image sensor, a storage module, a processing module and an alarm module;

when the alarm module is controlled to receive the image corresponding to the alarm time and the alarm data, generating the fire distribution map and the alarm information based on the image corresponding to the alarm time and the alarm data;

The processing module comprises a thermal imaging processing unit, a behavior analysis unit and a smoke and fire identification unit, and is used for controlling the processing module to detect fire of the thermal imaging image and the scene image, and generating an image and alarm data corresponding to alarm time when the fire is detected in the specific area, and the processing module comprises:

8. An automatic fire alarm system, comprising a fire monitoring camera and a server according to any one of claims 1-6, wherein the fire monitoring camera is in communication connection with the server;

The server is specifically configured to:

Sending the alarm information and the fire distribution map to a client;

9. An automatic fire alarm method, which is characterized in that the automatic fire alarm method is applied to the automatic fire alarm system as claimed in claim 8, and the automatic fire alarm system comprises a fire monitoring camera and a server;

Sending the alarm information and the fire distribution map to a client;