CN110673739A - Method for realizing intelligent safety protection wearable equipment for firefighter emergency rescue - Google Patents
Method for realizing intelligent safety protection wearable equipment for firefighter emergency rescue Download PDFInfo
- Publication number
- CN110673739A CN110673739A CN201910952351.5A CN201910952351A CN110673739A CN 110673739 A CN110673739 A CN 110673739A CN 201910952351 A CN201910952351 A CN 201910952351A CN 110673739 A CN110673739 A CN 110673739A
- Authority
- CN
- China
- Prior art keywords
- fire
- module
- thermal imaging
- information
- intelligent
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- A—HUMAN NECESSITIES
- A41—WEARING APPAREL
- A41D—OUTERWEAR; PROTECTIVE GARMENTS; ACCESSORIES
- A41D13/00—Professional, industrial or sporting protective garments, e.g. surgeons' gowns or garments protecting against blows or punches
- A41D13/002—Professional, industrial or sporting protective garments, e.g. surgeons' gowns or garments protecting against blows or punches with controlled internal environment
- A41D13/005—Professional, industrial or sporting protective garments, e.g. surgeons' gowns or garments protecting against blows or punches with controlled internal environment with controlled temperature
-
- A—HUMAN NECESSITIES
- A41—WEARING APPAREL
- A41D—OUTERWEAR; PROTECTIVE GARMENTS; ACCESSORIES
- A41D27/00—Details of garments or of their making
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/24—Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
- A61B5/316—Modalities, i.e. specific diagnostic methods
- A61B5/369—Electroencephalography [EEG]
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01D—MEASURING NOT SPECIALLY ADAPTED FOR A SPECIFIC VARIABLE; ARRANGEMENTS FOR MEASURING TWO OR MORE VARIABLES NOT COVERED IN A SINGLE OTHER SUBCLASS; TARIFF METERING APPARATUS; MEASURING OR TESTING NOT OTHERWISE PROVIDED FOR
- G01D21/00—Measuring or testing not otherwise provided for
- G01D21/02—Measuring two or more variables by means not covered by a single other subclass
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
- G06Q10/063—Operations research, analysis or management
- G06Q10/0635—Risk analysis of enterprise or organisation activities
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/10—Image acquisition
- G06V10/12—Details of acquisition arrangements; Constructional details thereof
- G06V10/14—Optical characteristics of the device performing the acquisition or on the illumination arrangements
- G06V10/143—Sensing or illuminating at different wavelengths
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/25—Determination of region of interest [ROI] or a volume of interest [VOI]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/40—Scenes; Scene-specific elements in video content
- G06V20/49—Segmenting video sequences, i.e. computational techniques such as parsing or cutting the sequence, low-level clustering or determining units such as shots or scenes
Abstract
The invention discloses a method for realizing intelligent safety protection wearing equipment for firefighter emergency rescue, which comprises a fire fighting AR intelligent helmet and a multifunctional firefighter tactical vest; the implementation method is that the gas concentration detector, the thermal imaging module, the Beidou positioning module, the AR display module, the wireless networking module, the multi-information real-time communication transmission module, the brain wave information monitoring module and the vital sign monitoring module are integrated in the fire-fighting AR intelligent helmet and the multifunctional tactical vest, so that support is provided for the command center to judge the on-site rescue condition and develop scientific command decision. The intelligent sensing and judging system can intelligently sense and judge the environmental temperature, environmental position information, site suffocation, explosion, poisoning accident risk, personnel search and rescue and other information of a disaster accident site before a fireman enters an unknown disaster accident site, can also monitor the psychological, physiological and other vital sign information of the fireman at the same time, and provides site real-time information and rescue command decision basis for rescue command of the accident site.
Description
Technical Field
The invention relates to design of fire safety equipment in a disaster accident emergency rescue site, in particular to a method for realizing intelligent safety protection wearing equipment for emergency rescue of firemen, and specifically the intelligent safety protection wearing equipment is integrated digital portable individual equipment.
Background
At present, in the process of carrying out fire fighting and rescue by firemen in complex fire and explosion accident sites, fire scene reconnaissance is carried out mainly by a handheld thermal infrared imager or an independent thermal infrared imager integrated on a helmet, and the firemen are often difficult to be widely applied to fire fighting troops due to the fact that fire fighting and rescue operations are affected by inconvenient operation or the structure is clumsy and difficult to be applied to complex fire scene environments. In addition, in a fire scene environment, factors such as high temperature and dense smoke can also influence the search and rescue of firemen, and the thermal imager used by the fire department at present is difficult to distinguish the personnel to be rescued and the fire scene environment in the high temperature and dense smoke environment. In addition, in the process of fire fighting and rescue, the firefighter bears huge psychological and physiological pressure, knows and masters the psychological and physiological changes of the firefighter in the fire scene environment in time, and has very important significance for guaranteeing the safety and health of the firefighter and developing scientific rescue command. At present, firefighter intelligent equipment mainly adopts civilian technical products such as bracelets as information such as firefighter's rhythm of the heart, pulse of firefighter physiological monitoring equipment main monitoring firefighter, because in the fire rescue operation process, the bracelet often can influence the firefighter operation to there is the inaccurate scheduling problem of monitoring data.
Disclosure of Invention
In view of the above prior art situation and the problems and disadvantages, the present invention provides a method for implementing an intelligent safety protection wearing device for firefighters in emergency rescue. By adopting the method, the intelligent wearable equipment and the comprehensive information management system which can intelligently sense real-time risks at an accident site, process comprehensive information communication and display visual multifunctional over-the-horizon for firemen can be provided for the firemen at the emergency rescue site of the disaster accident, combustible and toxic harmful gases at the emergency disposal site of the firemen can be detected, the suffocation, explosion and poisoning accident risks at the accident site can be rapidly predicted, risk early warning prompt is carried out, and the intelligent wearable equipment and the comprehensive information management system have the functions of carrying out real-time synchronous point-to-point or multi-person simultaneous communication with a command center and cooperative rescuers, and monitoring the physiological state information of the firemen.
The technical scheme adopted by the invention is as follows: an implementation method of intelligent safety protection wearing equipment for firefighter emergency rescue is characterized in that the intelligent safety protection wearing equipment comprises a fire fighting AR intelligent helmet and a multifunctional firefighter tactical vest; the implementation method is characterized in that a gas concentration detector, an infrared thermal imaging module, a Beidou positioning module, an AR display module, a wireless networking module, multi-information real-time communication transmission module, brain wave information monitoring module and vital sign monitoring module are integrated in a fire-fighting AR intelligent helmet and a multifunctional tactical vest, and real-time information of a disaster accident site is intelligently sensed and judged in fire accident rescue and comprehensive emergency rescue sites for firefighters; support is provided for a command center to judge the on-site rescue condition and develop scientific command decisions; the method comprises the following steps:
first, based on infrared thermal imaging recognition algorithm of thermal imaging module real-time operation of fire control AR intelligent helmet to thermal imaging video frame image extraction key information of fire control scene and analysis and early warning
First, detection of temperature area of fire field
Firstly, acquiring a thermal imaging image, acquiring an infrared thermal imaging image by a thermal imaging module, processing the thermal imaging image by adopting an infrared thermal imaging recognition algorithm, namely extracting personnel, objects or environment recognition pixel points contained in a temperature area according to the collected infrared thermal imaging image, searching color information in the corresponding temperature area, judging which area the thermal imaging image belongs to currently, and judging whether a detected temperature threshold value is less than T when the detected temperature threshold value is less than T0When the temperature is lower than T, the system judges the temperature is a safe area1Is greater than T0When the temperature is higher than T, the system judges the temperature is a dangerous area, and when the detected temperature threshold is higher than T1And judging the system to be a high-risk area, and alarming at different levels according to the displayed area.
(II) moving object detection based on shape and area characteristics
(1) After dark-area background points and thermal noise pixel points are processed through an infrared thermal imaging identification algorithm, further searching bright-area pixels row by row and column by column in each frame of an infrared thermal imaging video, and if the bright-area pixels are found, starting the infrared thermal imaging identification algorithm from the pixel points; determining the contour of the moving target by analyzing an infrared thermal imaging image of the moving target by using an infrared thermal imaging algorithm, and dividing a processed video image of the moving target into a plurality of independent bright color areas according to frame amplitude; and detecting the divided different areas according to the temperatures of the different areas, distinguishing and highlighting the high-temperature and low-temperature boundary areas in the image by different colors, and displaying specific temperature values in the different areas.
(2) And screening the human body shape from the moving target according to the shape and area characteristics of the independent bright area, adopting an area screening and human body shape height/width ratio screening algorithm, when the focal length of the camera and the range of the object distance of the pedestrian are determined substantially, the image area of the human body in the video frame is also in a certain range, and the human body image height/width ratio is between certain values, screening out the personnel or survivors in the smoke from the independent bright area through the characteristics, and further obtaining the scanning detection information of the position of the search and rescue personnel.
Secondly, harmful gas detection module based on fire control AR intelligence helmet measures and analyzes the distribution of poisonous inflammable explosive gas concentration in the scene of a fire environment, through thermal imagery temperature analysis to the scene of a fire environment, and then obtains scene of a fire environment danger area information.
And the brain wave information monitoring module based on the fire fighting AR intelligent helmet tracks the brain wave change of the firefighter in the fire scene fire extinguishing rescue process in real time, analyzes the mental state and emotion change condition of the firefighter on line, and provides support for analyzing and judging the rescue physical ability and the psychological state of the firefighter.
Monitoring the real-time physiological indexes of the firemen through the multifunctional firemen tactical vest, accurately positioning the positions of the firemen, providing constant temperature protection for the firemen wearing the fire-fighting rescue suit, improving the body comfort level of the firemen in the rescue process, ensuring the physical safety of the firemen, and improving the fire-fighting rescue efficiency of the firemen.
And fifthly, processing environmental gas detection information, thermal imaging temperature detection information, life detection information of search and rescue personnel, physiological monitoring information of firemen and brain wave detection information of the firemen obtained on the fire scene through an emergency rescue comprehensive information management system, finally transmitting the processed information to a fire-fighting remote command center, and sending out early warning and decision instructions.
The structural component of the fire-fighting AR intelligent helmet comprises an automatic lifting AR display module subsystem, wherein the automatic lifting AR display module subsystem consists of an AR display mirror lifting key, a stepping motor, an AR display module and a Hall switch component which are fixed on a helmet shell, the AR display module is a binocular array optical waveguide display module, a magnet is fixed on the AR display module, and the position of the magnet corresponds to that of the Hall switch component; wherein step motor links to each other with the gear, gear and rack toothing, the rack is together fixed with AR display module group, fire control AR intelligence helmet still including fix harmful gas detection module on helmet shell, by thermal imaging and the visible light camera module of making a video recording and brain ripples collection system that thermal imaging and visible light camera are constituteed.
The fire fighting AR intelligent helmet further comprises an AR intelligent system component, wherein the thermal imaging module, the visible light camera, the harmful gas detection module and the brain wave information acquisition device are all AR intelligent system components, the AR intelligent system component further comprises an ad hoc network communication module, a display drive board, a lithium battery and a core board, the display drive board is connected with the binocular array optical waveguide display module, and the core board is in wireless connection with the multifunctional fireman tactical vest and the emergency rescue comprehensive information management system.
The core board is composed of an ARM main processor, wherein the ARM main processor is connected with a brain wave acquisition device through a high-speed USB2.0 interface, is connected with a harmful gas detection module through a universal asynchronous receiving and transmitting transmitter interface, is connected with Wi-Fi through a safe digital input and output interface, is connected with Bluetooth through the universal asynchronous receiving and transmitting transmitter interface, is connected with an ad hoc network communication module through the high-speed USB2.0 interface, is respectively connected with a read-only memory and a random access memory through a memory controller, is connected with a coprocessor AI chip through the high-speed USB2.0 interface, is connected with a thermal imaging module through a parallel interface, is connected with a visible light camera through a mobile industry processor interface, is connected with various sensors arranged on a fire fighting AR intelligent helmet through the universal input and output interface, and is connected with an AR display mirror lifting key through the universal input and output interface, the intelligent helmet comprises a digital microphone interface, a lithium battery, a display controller interface, a display drive board, an audio/loudspeaker, a binocular array optical waveguide display module, a stepping motor, a gear rack and a Hall switch assembly, wherein the microphone is connected with the fire fighting AR intelligent helmet through the digital microphone interface, the lithium battery is connected with the charge controller, the display drive board is connected with the left display screen and the right display screen of the binocular array optical waveguide display module through the pulse code modulation interface, the lithium battery is connected with the stepping motor, the stepping motor is respectively connected with the gear rack and the Hall switch assembly, and the gear.
The multifunctional fireman tactical vest of the invention is characterized in that a flexible silica gel radiating pipe is wound on a fixed disc in an interlayer and is connected with a constant temperature regulator in a functional pocket at the lower end of the multifunctional fireman tactical vest, is used for keeping constant temperature and automatically adjusting after being worn, a flexible physiological information detecting piece is pasted on the neckline of the multifunctional fireman tactical vest, be used for monitoring fire fighter's physiological index, flexible physiological information detects piece and flexible silica gel cooling tube wireless connection, multi-functional fire fighter's tactics undershirt mid-mounting has radiator fan, the lower part is installed miniature heat pump and intelligent equipment stand-by power supply, radiator fan and miniature heat pump are connected with flexible silica gel cooling tube respectively, intelligent positioner is installed to multi-functional fire fighter's tactics undershirt collarband, intelligent equipment stand-by power supply is connected with constant temperature regulator, radiator fan, miniature heat pump and intelligent positioner.
The invention has the beneficial effects that: the system adopts a gas concentration detector of laser/infrared spectrum or electrochemistry, thermal imaging, vital sign monitoring, Beidou positioning, a head-mounted AR (augmented Reality) display module, wireless networking, a multi-information real-time communication transmission technology, a brain wave information monitoring technology and a vital sign monitoring technology, is integrally applied to a fire fighting AR intelligent helmet and a multifunctional fireman tactical back center, carries out intelligent perception and judgment on information such as the environmental temperature, the environmental position information, the scene asphyxia, explosion, the poisoning accident risk, personnel search and rescue and the like of a disaster accident scene for the fireman in the fire accident rescue and comprehensive emergency rescue scene, fully perceives the fire hazard, the risks of asphyxia, explosion and poisoning accident in the scene before the fireman enters the unknown disaster accident scene, and can also simultaneously monitor the psychology of the fireman, And vital sign information such as physiology and the like provides on-site real-time information and rescue command decision basis for rescue command in accident sites.
The fire protection AR intelligent helmet meets the related requirements of GA44, has the function of interconnection and intercommunication with a fire protection command vehicle in a fire protection and rescue site, provides a site fire protection command instruction for a fire fighter, rescues site environment geographic information, building BIM information and indoor navigation, can acquire an accident site image through a thermal imaging module according to the temperature of the accident site environment and the concentration distribution of toxic, combustible and explosive gases around the accident site environment, analyzes and judges the image in real time and displays the image on a virtual screen of a head-mounted AR display module, provides early prediction and early warning of the risk of fire, suffocation, explosion and toxic accidents occurring in the accident site for the fire fighter, and assists the fire fighter to search the person to be rescued in low-visibility environments such as dense smoke and the like, thereby providing multi-information data support and safety guarantee for the fire fighter to carry out safe, scientific and effective rescue. A brain wave information monitoring module arranged in the intelligent fire-fighting helmet tracks the psychological fluctuation change of a fireman in the fire-fighting rescue process in real time, and provides support for a command center to judge the field rescue condition and develop scientific command decision.
The integrated fire fighter rhythm of the heart and body temperature monitoring module of multi-functional fire fighter's tactics undershirt, positioner, thermostatic control device to and emergency power supply, multi-functional module socket can realize monitoring the physiological index such as the real-time rhythm of the heart of fire fighter, body temperature, can carry out accurate location to the fire fighter position simultaneously, provide invariable body temperature control, intelligent equipment power supply and additional function module for the fire fighter and insert.
Drawings
FIG. 1 is a flow chart of the intelligent safety protection wearing equipment and system of the present invention;
FIG. 2 is a schematic diagram of an infrared thermal imaging identification algorithm based on temperature threshold according to the present invention;
FIG. 3 is a schematic structural view of the fire fighting AR smart helmet of the present invention;
FIG. 4 is a block diagram of the components of the fire protection AR intelligence system of the fire protection AR intelligence helmet of the present invention;
FIG. 5 is a diagram of the core board hardware framework of FIG. 4;
FIG. 6 is a pictorial view of the multi-functional firefighter tactical vest of the present invention;
fig. 7 is a schematic diagram of the circuit connections of the components of fig. 6.
Detailed Description
The invention is further described below with reference to the accompanying drawings.
As shown in fig. 1 and 2, the thermal imaging module is a thermal imaging image recognition subsystem based on a fire fighting AR intelligent helmet, and is a method for extracting key information from a thermal imaging video frame image of a fire fighting scene and analyzing and early warning the key information based on a computer vision technology and an infrared thermal imaging recognition algorithm based on digital and networked video monitoring. The thermal imaging image recognition subsystem based on the fire-fighting AR intelligent helmet mainly has the functions of environmental detection early warning, rescue detection recognition, infrared thermal imaging AR image enhancement and target locking and tracking.
The method comprises the following specific steps:
first, thermal imaging module based on fire protection AR intelligent helmet utilizes the infrared thermal imaging recognition algorithm running on AI chip in real time to extract key information from thermal imaging video frame image of fire protection scene and analyze and early warn
First, detection of temperature area of fire field
Firstly, acquiring a thermal imaging image, acquiring an infrared thermal imaging image by a thermal imaging module, processing the thermal imaging image by adopting an infrared thermal imaging recognition algorithm, namely extracting personnel, objects or environment recognition pixel points contained in a temperature area according to the collected infrared thermal imaging image, searching color information in the corresponding temperature area, judging which area the thermal imaging image belongs to currently, and judging whether a detected temperature threshold value is less than T when the detected temperature threshold value is less than T0When the detected temperature threshold is smaller than T1 and larger than T0, the system judges that the system is a dangerous area and displays the dangerous area by an orange line; when the detection temperature threshold is larger than T1, the system judges that the area is a high-risk area and displays the area by a red line; and performing alarm at different levels according to the displayed area.
(II) moving object detection based on shape and area characteristics
(1) After dark-area background points and thermal noise pixel points are processed through an infrared thermal imaging identification algorithm, further searching bright-area pixels row by row and column by column in each frame of an infrared thermal imaging video, and if the bright-area pixels are found, starting the infrared thermal imaging identification algorithm from the pixel points; determining the contour of the moving target by analyzing an infrared thermal imaging image of the moving target by using an infrared thermal imaging algorithm, and dividing a processed video image of the moving target into a plurality of independent bright color areas according to frame amplitude; and detecting the divided different areas according to the temperatures of the different areas, distinguishing and highlighting the high-temperature and low-temperature boundary areas in the image by different colors, and displaying specific temperature values in the different areas.
The independent bright areas may be formed by several factors: one is large-size heat source interference (high temperature ignition point of wooden structure); second, other moving objects (moving objects); and thirdly, pedestrians (including rescuers, survivors and the like). The pedestrians can be screened out according to the shape and area characteristics of the independent bright areas.
(2) And screening the human body shape from the moving target according to the shape and area characteristics of the independent bright area, adopting an area screening algorithm and a human body shape height/width ratio screening algorithm, when the focal length of the camera and the range of the object distance of the pedestrian are determined substantially, the image forming area of the human body in the video frame is also in a certain range, and the human body image height/width ratio is between certain values (the threshold values can be detected through experiments in specific scenes), screening out the personnel or survivors in the smoke from the independent bright area through the characteristics (as shown in figure 2), and further obtaining the scanning detection information of the positions of the search and rescue personnel.
Secondly, harmful gas detection module based on fire control AR intelligence helmet measures and analyzes the distribution of poisonous inflammable explosive gas concentration in the scene of a fire environment, through thermal imagery temperature analysis to the scene of a fire environment, and then obtains scene of a fire environment danger area information.
And the brain wave information monitoring module based on the fire fighting AR intelligent helmet tracks the brain wave change of the firefighter in the fire scene fire extinguishing rescue process in real time, analyzes the mental state and emotion change condition of the firefighter on line, and provides support for analyzing and judging the rescue physical ability and the psychological state of the firefighter.
Monitoring the real-time physiological indexes of the firemen through the multifunctional firemen tactical vest, accurately positioning the positions of the firemen, providing constant temperature protection for the firemen wearing the fire-fighting rescue suit, improving the body comfort level of the firemen in the rescue process, ensuring the physical safety of the firemen, and improving the fire-fighting rescue efficiency of the firemen.
And fifthly, processing environmental gas detection information, thermal imaging temperature detection information, life detection information of search and rescue personnel, physiological monitoring information of firemen and brain wave detection information of the firemen obtained on the fire scene through an emergency rescue comprehensive information management system, finally transmitting the processed information to a fire-fighting remote command center, and sending out early warning and decision instructions.
As shown in fig. 3, the structural component of the fire-fighting AR intelligent helmet comprises an automatic lifting AR display module subsystem, wherein the automatic lifting AR display module subsystem is composed of an AR display mirror lifting key 1 fixed on a helmet shell 2, a stepping motor 4, an AR display module 8 and a hall switch component 10, the AR display module 8 is a binocular array optical waveguide display module, a magnet 9 is fixed on the AR display module 8, and the position of the magnet 9 corresponds to that of the hall switch component 10; wherein step motor 4 links to each other with gear 5, and gear 5 and rack 6 mesh, rack 6 and AR display module 8 are fixed together, and fire control AR intelligence helmet still includes the harmful gas detection module 3 of fixing on helmet shell 2, the thermal imaging and the visible light camera module 7 and the brain wave collection system 11 of constituteing by thermal imaging module and visible light camera.
As shown in FIG. 4, fire control AR intelligence helmet still includes AR intelligent system component, and thermal imaging module, visible light camera, harmful gas detection module, brain wave information acquisition device are AR intelligent system component, and AR intelligent system component still includes from network deployment communication module, display drive board, lithium cell and nuclear core plate, and binocular array optical waveguide display module is connected to display drive board wherein, and the information management system is synthesized in multi-functional fire fighter's tactics undershirt of nuclear core plate wireless connection and emergency rescue.
As shown in fig. 5, the core board is mainly composed of an ARM main processor, wherein the ARM main processor is connected with a brain wave collecting device through a high-speed USB2.0 interface, connected with a harmful gas detecting module through a universal asynchronous transceiver transmitter interface, connected with Wi-Fi through a secure digital input/output interface, connected with bluetooth through a universal asynchronous transceiver transmitter interface, and simultaneously connected with an ad hoc network communication module through a high-speed USB2.0 interface, respectively connected with a rom and a ram through a memory controller, connected with an AI chip through a high-speed USB2.0 interface, connected with a thermal imaging module through a parallel interface, connected with a visible light camera through a mobile industry processor interface, the ARM main processor is connected with various sensors arranged on the fire fighting AR intelligence through a universal input/output interface, and simultaneously connected with an AR display mirror lifting key through a universal input/output interface, the intelligent helmet comprises a digital microphone interface, a lithium battery, a display controller interface, a display drive board, an audio/loudspeaker, a binocular array optical waveguide display module, a stepping motor, a gear rack and a Hall switch assembly, wherein the microphone is connected with the fire fighting AR intelligent helmet through the digital microphone interface, the lithium battery is connected with the charge controller, the display drive board is connected with the left display screen and the right display screen of the binocular array optical waveguide display module through the pulse code modulation interface, the lithium battery is connected with the stepping motor, the stepping motor is respectively connected with the gear rack and the Hall switch assembly, and the gear.
The coprocessor AI chip is an artificial intelligence chip based on a deep learning architecture, and the core board processor adopts a main processor based on an ARM or x86 architecture.
As shown in fig. 3 and 5, the magnet is fixed on the AR display module, all other components are fixed on the AR intelligent helmet shell, the lifting key, the stepping motor and the AR display module are connected with the core board through a Flexible Printed Circuit (FPC), the core board supplies power to the AR display module and provides data of display contents through the Flexible Circuit board, the core board provides power supply and control signal communication to the hall switch assembly through the Flexible Circuit board, and the core board supplies power and controls the stepping motor through the Flexible Circuit board; a lifting key is designed on the outer side of the helmet, the lifting key is connected with the core board through a flexible circuit board, and the lifting key transmits a control signal to the core board through the flexible circuit board; step motor also links to each other with nuclear core plate through flexible circuit board, and nuclear core plate passes through flexible circuit board control step motor and rotates, and step motor and gear link to each other, gear and rack toothing, and rack and AR display module assembly are fixed together. The Hall switch assembly is connected with the core board through the flexible circuit board, when the AR display module is hidden inside the helmet, a magnet mounted on the AR display module is fixed with the Hall switch IC face to face. When fire control AR intelligence helmet did not work, AR display module hidden inside the helmet. When the fire fighter uses fire control AR intelligence helmet, press the lift button once, lift button transmission control signal gives nuclear core plate, nuclear core plate is according to the signal drive step motor work of lift button, then step motor rotates and drives the gear rotatory, because gear and rack toothing, the rack just moves down and drives AR display module and move down out helmet shell, treat that AR display module removes out helmet shell after, because magnet on the AR display module removes, hall switch IC detects and does not have magnetic field, consequently, transmission control signal gives nuclear core plate, nuclear core plate begins drive thermal imaging module and AR display module work, AR display module automatic display thermal imaging module's image and object identification etc. operation. If work finishes, the fire fighter is as long as press the lift button again, the lift button is given nuclear core plate transmission control signal, nuclear core plate will control step motor reverse rotation, drive the corresponding rotation of gear, the rack drives AR display module upward movement and gets into inside the helmet until AR display module gets into the helmet completely, treat that magnet resumes the positive and opposite of hall switch IC, hall switch detects magnetic field, then hall switch transmission control signal gives nuclear core plate, nuclear core plate stops to give AR display module power supply and transmission data signal.
As shown in figures 6 and 7, a flexible silica gel heat radiation pipe 13 is wound on a fixed disc of the multifunctional fireman tactical vest in an interlayer, the flexible silica gel heat radiation pipe 13 is connected with a constant temperature regulator 15 in a functional pocket 14 at the lower end of the multifunctional fireman tactical vest and is used for keeping constant temperature and automatically regulating after being worn, a flexible physiological information detection sheet 12 is pasted at the neckline of the multifunctional fireman tactical vest and is used for monitoring the physiological indexes of the fireman, the flexible physiological information detection sheet 12 is wirelessly connected with the flexible silica gel heat radiation pipe 13, a heat radiation fan 16 is arranged in the middle of the multifunctional fireman tactical vest, a micro heat pump 17 and an intelligent equipment standby power supply 18 are arranged at the lower part of the multifunctional fireman tactical vest, the heat radiation fan 16 and the micro heat pump 17 are respectively connected with the flexible silica gel heat radiation pipe 13, an intelligent positioning device 19 is arranged at, The micro heat pump 17 is connected with the intelligent positioning device 19.
Multifunctional fireman's tactics undershirt mainly wears in fire-entry suit such as the combat uniform of putting out a fire, antichemical clothes, and its inlayer adopts nanometer graphite alkene compound fabric, and the outer functional surface fabric of blending that adopts glued nylon, the fixed flexible silica gel cooling tube that coils of intermediate layer, the multi-functional constant temperature adjusting device in cooling tube and the undershirt lower extreme function bag is connected, can realize that the fireman keeps constant temperature automatically regulated after wearing. The multifunctional vest neckline is pasted with a flexible physiological information detection piece for monitoring physiological indexes of firemen such as heart rate, pulse, body temperature and the like. In addition, an emergency portable breathing mask can be arranged in the functional pocket of the tactical vest for emergency escape of rescued people.
Claims (5)
1. An implementation method of intelligent safety protection wearing equipment for firefighter emergency rescue is characterized in that the intelligent safety protection wearing equipment comprises a fire fighting AR intelligent helmet and a multifunctional firefighter tactical vest; the implementation method is characterized in that a gas concentration detector, a thermal imaging module, a Beidou positioning module, an AR display module, a wireless networking module, multi-information real-time communication transmission module, brain wave information monitoring module and vital sign monitoring module are integrated in a fire protection AR intelligent helmet and a multifunctional tactical vest, and real-time information of a disaster accident site is intelligently sensed and judged in the fire accident rescue and comprehensive emergency rescue site for a fire fighter; support is provided for a command center to judge the on-site rescue condition and develop scientific command decisions; the method comprises the following steps:
firstly, extracting key information from a thermal imaging video frame image of a fire scene by an infrared thermal imaging recognition algorithm operated in real time by a thermal imaging module based on a fire protection AR intelligent helmet, and analyzing and early warning;
first, detection of temperature area of fire field
Firstly, a thermal imaging image is collected, and a thermal imaging module acquires infrared raysProcessing the thermal imaging image by adopting an infrared thermal imaging recognition algorithm, namely extracting personnel, objects or environment recognition pixel points contained in a temperature area according to the collected infrared thermal imaging image, searching color information in the corresponding temperature area, judging which area the thermal imaging image belongs to at present, and when a detected temperature threshold is less than T0When the temperature is lower than T, the system judges the temperature is a safe area1Is greater than T0When the temperature is higher than T, the system judges the temperature is a dangerous area, and when the detected temperature threshold is higher than T1Judging the system to be a high-risk area, and alarming at different levels according to the displayed area;
(II) moving object detection based on shape and area characteristics
(1) After dark-area background points and thermal noise pixel points are processed through an infrared thermal imaging identification algorithm, further searching bright-area pixels row by row and column by column in each frame of an infrared thermal imaging video, and if the bright-area pixels are found, starting the infrared thermal imaging identification algorithm from the pixel points; determining the contour of the moving target by analyzing an infrared thermal imaging image of the moving target by using an infrared thermal imaging algorithm, and dividing a processed video image of the moving target into a plurality of independent bright color areas according to frame amplitude; detecting different areas divided according to the temperatures of the different areas, distinguishing and highlighting the high-temperature and low-temperature demarcation areas in the image by different colors, and displaying specific temperature values in the different areas;
(2) screening the human body shape from a moving target according to the shape and area characteristics of the independent bright area, adopting an area screening algorithm and a human body shape height/width ratio screening algorithm, when the focal length of a camera and the range of the object distance of pedestrians are determined substantially, the image forming area of the human body in a video frame is also in a certain range, and the human body image height/width ratio is between certain values, screening out the personnel or survivors in the smoke from the independent bright area through the characteristics, and further obtaining the scanning detection information of the position of the search and rescue personnel;
secondly, a harmful gas detection module based on the fire fighting AR intelligent helmet measures and analyzes concentration distribution of toxic, flammable and explosive gases in the fire scene environment, and obtains information of a dangerous area of the fire scene environment by analyzing thermal image temperature of the fire scene environment;
the brain wave information monitoring module based on the fire fighting AR intelligent helmet tracks the brain wave change of a fireman in the fire scene fire fighting and rescue process in real time, analyzes the mental state and emotion change condition of the fireman on line, and provides support for analyzing and judging the physical and psychological states of the fireman;
monitoring real-time physiological indexes of the firemen through the multifunctional firemen tactical vest, simultaneously accurately positioning the positions of the firemen, providing constant temperature protection for the firemen wearing the fire-fighting rescue suit, improving the body comfort level of the firemen in the rescue process, ensuring the physical safety of the firemen and improving the fire-fighting rescue efficiency of the firemen;
and fifthly, processing environmental gas detection information, thermal imaging temperature detection information, life detection information of search and rescue personnel, physiological monitoring information of firemen and brain wave detection information of the firemen obtained on the fire scene through an emergency rescue comprehensive information management system, finally transmitting the processed information to a fire-fighting remote command center, and sending out early warning and decision instructions.
2. The method for realizing the intelligent safety protection wearing equipment for the firefighter emergency rescue according to claim 1, wherein the fire fighting AR intelligent helmet comprises a structural component, the structural component comprises an automatic lifting AR display module subsystem, the automatic lifting AR display module subsystem consists of an AR display mirror lifting key (1) fixed on a helmet shell (2), a stepping motor (4), an AR display module (8) and a Hall switch component (10), wherein the AR display module (8) is a binocular array optical waveguide display module, a magnet (9) is fixed on the AR display module (8), and the position of the magnet (9) corresponds to that of the Hall switch component (10); wherein step motor (4) link to each other with gear (5), gear (5) and rack (6) meshing, rack (6) are together fixed with AR display module (8), fire control AR intelligence helmet structure subassembly still including fixing harmful gas detection module (3) on helmet shell (2), thermal imaging and visible light camera module (7) and brain ripples collection system (11) of constituteing by thermal imaging module and visible light camera.
3. The method for realizing intelligent safety protection wearing equipment for firefighter emergency rescue according to claim 2, wherein the fire fighting AR intelligent helmet further comprises an AR intelligent system component, the thermal imaging module, the visible light camera, the harmful gas detection module and the brain wave information acquisition device are all AR intelligent system components, the AR intelligent system component further comprises an ad hoc network communication module, a display driving board, a lithium battery and a core board, the display driving board is connected with the binocular array optical waveguide display module, and the core board is wirelessly connected with the multifunctional firefighter tactical vest and the emergency rescue comprehensive information management system.
4. The method as claimed in claim 3, wherein the core board is composed of an ARM main processor, wherein the ARM main processor is connected to the brain wave collecting device through a high speed USB2.0 interface, the harmful gas detecting module through a universal asynchronous transceiver interface, the Wi-Fi through a secure digital input/output interface, the Bluetooth through a universal asynchronous transceiver interface, the self-networking communication module through a high speed USB2.0 interface, the ROM and the RAM through a memory controller, the coprocessor AI chip through a high speed USB2.0 interface, the thermal imaging module through a parallel interface, the visible light camera through a mobile industry processor interface, and the various sensors on the fire fighting AR intelligent helmet through a universal input/output interface, simultaneously through general input/output interface connection AR display mirror lift button, through the microphone that is equipped with on the digital microphone interface connection fire control AR intelligence helmet, connect the lithium cell through charge controller, connect the display drive board through display controller interface, connect audio frequency loudspeaker through pulse code modulation interface, the left display screen and the right display screen of binocular array optical waveguide display module assembly are connected to the display drive board, step motor is connected to the lithium cell, step motor connects rack and pinion and hall switch subassembly respectively, left display screen and right display screen are connected respectively to the rack and pinion.
5. The method for realizing the intelligent safety protection wearing equipment for the fire fighter in emergency rescue according to claim 1, wherein the multifunctional fire fighter tactical vest is fixedly wound with flexible silica gel radiating tubes (13) in an interlayer, the flexible silica gel radiating tubes (13) are connected with constant temperature regulators (15) in functional pockets (14) at the lower end of the multifunctional fire fighter tactical vest and are used for keeping constant temperature and automatically regulating after being worn, flexible physiological information detecting pieces (12) are attached to the collar of the multifunctional fire fighter tactical vest and are used for monitoring physiological indexes of the fire fighter, the flexible physiological information detecting pieces (12) are wirelessly connected with the flexible silica gel radiating tubes (13), a radiating fan (16) is installed in the middle of the multifunctional fire fighter tactical vest, a micro heat pump (17) and an intelligent equipment standby power supply (18) are installed at the lower part of the multifunctional fire fighter vest, and the radiating fan (16) and the micro, an intelligent positioning device (19) is installed at the collar of the multifunctional fireman tactical vest, and an intelligent equipment standby power supply (18) is connected with a constant temperature regulator (15), a cooling fan (16), a micro heat pump (17) and the intelligent positioning device (19).
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910952351.5A CN110673739A (en) | 2019-10-09 | 2019-10-09 | Method for realizing intelligent safety protection wearable equipment for firefighter emergency rescue |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910952351.5A CN110673739A (en) | 2019-10-09 | 2019-10-09 | Method for realizing intelligent safety protection wearable equipment for firefighter emergency rescue |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110673739A true CN110673739A (en) | 2020-01-10 |
Family
ID=69081067
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910952351.5A Pending CN110673739A (en) | 2019-10-09 | 2019-10-09 | Method for realizing intelligent safety protection wearable equipment for firefighter emergency rescue |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110673739A (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111383747A (en) * | 2020-03-06 | 2020-07-07 | 罗君浩 | Big data-based field rescue analysis system and method |
| CN111611439A (en) * | 2020-03-31 | 2020-09-01 | 深圳奇迹智慧网络有限公司 | Fire safety monitoring method and device, computer equipment and storage medium |
| CN112418004A (en) * | 2020-11-05 | 2021-02-26 | 烟台艾睿光电科技有限公司 | Fire safety detection method and related components |
| CN113259850A (en) * | 2021-05-11 | 2021-08-13 | 黔南民族师范学院 | Intelligent fire protection mask design based on Internet of things |
| CN114306971A (en) * | 2022-01-10 | 2022-04-12 | 应急管理部上海消防研究所 | Infrared wireless transmission fire-fighting AR mask and application method thereof |
| CN114894253A (en) * | 2022-05-18 | 2022-08-12 | 威海众合机电科技有限公司 | Emergency visual sense intelligent enhancement method, system and equipment |
| CN115050154A (en) * | 2022-06-10 | 2022-09-13 | 中国建设科技集团股份有限公司 | Multifunctional indoor security monitoring and alarming system |
-
2019
- 2019-10-09 CN CN201910952351.5A patent/CN110673739A/en active Pending
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111383747A (en) * | 2020-03-06 | 2020-07-07 | 罗君浩 | Big data-based field rescue analysis system and method |
| CN111383747B (en) * | 2020-03-06 | 2021-11-30 | 乐清市泰博恒电子科技有限公司 | Big data-based field rescue analysis system and method |
| CN111611439A (en) * | 2020-03-31 | 2020-09-01 | 深圳奇迹智慧网络有限公司 | Fire safety monitoring method and device, computer equipment and storage medium |
| CN111611439B (en) * | 2020-03-31 | 2023-08-25 | 深圳奇迹智慧网络有限公司 | Fire safety monitoring method, device, computer equipment and storage medium |
| CN112418004A (en) * | 2020-11-05 | 2021-02-26 | 烟台艾睿光电科技有限公司 | Fire safety detection method and related components |
| CN113259850A (en) * | 2021-05-11 | 2021-08-13 | 黔南民族师范学院 | Intelligent fire protection mask design based on Internet of things |
| CN114306971A (en) * | 2022-01-10 | 2022-04-12 | 应急管理部上海消防研究所 | Infrared wireless transmission fire-fighting AR mask and application method thereof |
| CN114894253A (en) * | 2022-05-18 | 2022-08-12 | 威海众合机电科技有限公司 | Emergency visual sense intelligent enhancement method, system and equipment |
| CN115050154A (en) * | 2022-06-10 | 2022-09-13 | 中国建设科技集团股份有限公司 | Multifunctional indoor security monitoring and alarming system |
| CN115050154B (en) * | 2022-06-10 | 2024-01-30 | 中国建设科技集团股份有限公司 | Multifunctional indoor security monitoring alarm system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110673739A (en) | Method for realizing intelligent safety protection wearable equipment for firefighter emergency rescue | |
| US10417497B1 (en) | Cognitive load reducing platform for first responders | |
| US8212211B2 (en) | System for protecting and/or guiding persons in dangerous situations | |
| US7298535B2 (en) | Digital situation indicator | |
| CN112107808A (en) | 5G fire rescue method and fire rescue helmet | |
| CN109512074B (en) | Novel fire-fighting helmet based on optical waveguide display technology | |
| CN210639588U (en) | Intelligent safety protection wearing equipment for firefighter emergency rescue | |
| CN112107074A (en) | Underground terminal intelligent safety helmet based on multi-sensor fusion | |
| CN207949044U (en) | A kind of Intelligent fire-fighting helmet based on blast accident perception and risk profile early warning | |
| CN213852830U (en) | Fire rescue helmet | |
| CN209449761U (en) | Novel fire fighting helmet based on optical waveguide display technology | |
| CN109672875A (en) | Fire-fighting and rescue intelligent helmet, fire-fighting and rescue method and Related product | |
| US20180233019A1 (en) | System and method for operational and exposure information recording and gesture activated communication | |
| CN111938251A (en) | Intelligent wearable fire rescue equipment | |
| CN111671193A (en) | Intelligent helmet | |
| CN209199300U (en) | A kind of comprehensive monitor system based on intelligent safety helmet | |
| CN109833047A (en) | Information acquisition terminal, system and the helmet | |
| KR20090123041A (en) | Ubiquitous guard system and service using helmet-type instrument | |
| CN112493605A (en) | Intelligent fire fighting helmet for planning path | |
| WO2021041990A1 (en) | Wearable assisted perception module for navigation and communication in hazardous environments | |
| CN208921868U (en) | Helmet | |
| CN114894253A (en) | Emergency visual sense intelligent enhancement method, system and equipment | |
| CN206896338U (en) | The control system and life detection equipment of life detection equipment | |
| CN204515841U (en) | A kind of fireman's security information management system | |
| DE10157114B4 (en) | Environmental sensing and work management system for working in aerosol contaminated environment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |