CN113730860A - Autonomous fire extinguishing method of fire-fighting robot in unknown environment - Google Patents

Autonomous fire extinguishing method of fire-fighting robot in unknown environment Download PDF

Info

Publication number
CN113730860A
CN113730860A CN202111054598.9A CN202111054598A CN113730860A CN 113730860 A CN113730860 A CN 113730860A CN 202111054598 A CN202111054598 A CN 202111054598A CN 113730860 A CN113730860 A CN 113730860A
Authority
CN
China
Prior art keywords
fire
fire source
source
fighting robot
robot
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202111054598.9A
Other languages
Chinese (zh)
Inventor
李�瑞
刘琦
顾保虎
戴慎超
袁文正
张克富
潘强辉
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nanyang Zhongtian Explosion Proof Electric Co ltd
Original Assignee
Nanyang Zhongtian Explosion Proof Electric Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nanyang Zhongtian Explosion Proof Electric Co ltd filed Critical Nanyang Zhongtian Explosion Proof Electric Co ltd
Priority to CN202111054598.9A priority Critical patent/CN113730860A/en
Publication of CN113730860A publication Critical patent/CN113730860A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A62LIFE-SAVING; FIRE-FIGHTING
    • A62CFIRE-FIGHTING
    • A62C31/00Delivery of fire-extinguishing material
    • A62C31/02Nozzles specially adapted for fire-extinguishing
    • A62C31/03Nozzles specially adapted for fire-extinguishing adjustable, e.g. from spray to jet or vice versa
    • AHUMAN NECESSITIES
    • A62LIFE-SAVING; FIRE-FIGHTING
    • A62CFIRE-FIGHTING
    • A62C31/00Delivery of fire-extinguishing material
    • A62C31/28Accessories for delivery devices, e.g. supports
    • AHUMAN NECESSITIES
    • A62LIFE-SAVING; FIRE-FIGHTING
    • A62CFIRE-FIGHTING
    • A62C37/00Control of fire-fighting equipment
    • A62C37/36Control of fire-fighting equipment an actuating signal being generated by a sensor separate from an outlet device
    • A62C37/38Control of fire-fighting equipment an actuating signal being generated by a sensor separate from an outlet device by both sensor and actuator, e.g. valve, being in the danger zone
    • A62C37/40Control of fire-fighting equipment an actuating signal being generated by a sensor separate from an outlet device by both sensor and actuator, e.g. valve, being in the danger zone with electric connection between sensor and actuator
    • AHUMAN NECESSITIES
    • A62LIFE-SAVING; FIRE-FIGHTING
    • A62CFIRE-FIGHTING
    • A62C37/00Control of fire-fighting equipment
    • A62C37/50Testing or indicating devices for determining the state of readiness of the equipment

Abstract

The invention discloses an autonomous fire extinguishing method for a fire-fighting robot in an unknown environment, and belongs to the technical field of fire-fighting robots. Target point locations are distributed, the robot carries out autonomous SLAM exploration, fire sources are identified and oriented, after the fire sources are found, the position and the course of the robot at the moment are recorded, fire source early warning, fire source temperature, the area size and the center coordinate information of the fire sources in the image are obtained, and early warning information is sent to a remote control terminal; the robot continues to walk for a set distance and then carries out fire source identification and orientation, the position and the course information of the robot at a new position are recorded, fire source early warning, fire source temperature, the area size of the fire source in an image and center coordinate information are obtained, the position coordinate of the fire source center is calculated through a triangulation method, and the position coordinate of the fire source center is sent to the remote control terminal. The invention enables the fire-fighting robot to walk and cross obstacles autonomously in an unknown environment, can realize autonomous fire source searching and fire extinguishing, and has good application prospect.

Description

Autonomous fire extinguishing method of fire-fighting robot in unknown environment
Technical Field
The invention relates to the technical field of fire-fighting robots, in particular to an autonomous fire-fighting method of a fire-fighting robot in an unknown environment.
Background
In some fire scene, there is a certain danger in fire fighting, and once the fire is complicated, some unexpected casualties are easily caused. Especially in some chemical industry parks and coal production occasions, because there may be the leakage or explosion risk of dangerous gas or chemical, the fire fighter can threaten their health and personal safety to touch or expose in this environment. The fire-fighting robot capable of assisting or partially replacing fire fighters to carry out fire-fighting and fire-extinguishing work is developed, so that casualties of the fire fighters can be effectively reduced, and the fire fighters are assisted to carry out fire-fighting and fire rescue.
At present, some fire-fighting robot products, including domestic JZX-GL/A fire-fighting reconnaissance robots, JMX-LT50 type fire-fighting and fire-extinguishing robots, foreign WALK-MAN humanoid fire-fighting robots, Bear rescue robots and the like, have been developed at home and abroad and are practically applied to fire rescue. However, most of these existing fire-fighting robots adopt a remote control mode, and both walking and fire source searching and fire extinguishing processes depend too much on the operation level of remote control personnel.
Patent document CN 107224692 a discloses an autonomous aiming fire extinguishing method for wheeled fire-fighting robot. It includes the focus of confirming the flame source through video flame detection, measure flame source focus and robot contained angle, one section distance is removed wantonly to the fire-fighting robot, measure fire-fighting robot and flame source focus contained angle once more, rising cloud platform is certain to certain height and is measured focus and robot contained angle once more, calculate the position of flame source focus in three-dimensional space according to trigonometric function, remove the fire-fighting robot through integrated control, the initial velocity and the flow of fire monitor, make the flame source focus be located the effect that reaches accurate fire extinguishing on the orbit of fire monitor water jet. The autonomous fire extinguishing system of the fire-fighting robot comprises a sliding steering moving platform, a CCD camera, a liftable holder system, a fire monitor and a control system. The fire-extinguishing device realizes the function of autonomous fire extinguishing by autonomously aiming at a fire source and controlling the fire monitor landing point. However, the invention is an autonomous aiming method for a known fire source point, which cannot identify the fire source, so that autonomous detection, fire source identification, fire source positioning and autonomous fire extinguishing cannot be realized in unknown environments such as chemical industrial parks and coal production occasions, and the technical problems cannot be solved.
Patent document CN 105944270 a discloses a fire extinguishing method, a fire extinguishing system and a fire-fighting robot which can automatically aim at a fire source and spray water, the fire extinguishing method comprises the steps of measuring an included angle between the fire source direction of the fire-fighting robot at the initial position and the moving route of the fire-fighting robot, an included angle between the fire source direction of the fire-fighting robot at the final position and the moving route of the fire-fighting robot, and the moving distance of the fire-fighting robot, calculating the distance between the fire-fighting robot and the fire source when starting at the terminal position according to the trigonometric function, calculating the water cannon elevation angle according to the relational expression of the distance between the fire source and the water cannon elevation angle, carrying out cannon launching and fire extinguishing by the fire-fighting robot according to the calculated distance between the fire source and the water cannon elevation angle, the fire extinguishing system comprises a thermal imager, a holder system, a chassis servo system, a servo electric control type fire water monitor, an electronic water pressure meter and a control system, and the fire-fighting robot comprises the fire extinguishing system. The invention realizes the function of self-extinguishing by self-aiming at the fire source and distributing water for extinguishing fire. However, on one hand, the invention also performs autonomous aiming under the condition that the fire source point is known, and on the other hand, the invention only adopts the thermal imager to detect the position of the fire source, so that the fire source cannot be accurately identified, and the technical problem cannot be solved.
Disclosure of Invention
In view of the above, the present invention provides an autonomous fire extinguishing method for a fire-fighting robot in an unknown environment, which is capable of autonomously searching for a fire source, locating and extinguishing a fire, aiming at the defects of the prior art.
In order to solve the technical problems, the technical scheme adopted by the invention is as follows: an autonomous fire extinguishing method of a fire-fighting robot in an unknown environment comprises the following steps:
step 1: distributing a target fire extinguishing location to a fire fighting robot;
step 2: autonomous SLAM exploration is carried out on the fire-fighting robot, and fire source identification and positioning are carried out;
and step 3: after finding and positioning a fire source, the fire-fighting robot records the current position and course of the fire-fighting robot, acquires fire source early warning, fire source temperature, area size and center coordinate information of the fire source in an image and sends early warning information to a remote control terminal;
and 4, step 4: after the fire-fighting robot continues to walk for a set distance, identifying and orienting the fire source again, recording the position and course information of the fire-fighting robot when the fire source is found again, acquiring the early warning of the fire source, the temperature of the fire source, the area of the fire source in the image and the central coordinate information, calculating the position coordinate of the point of the center of the fire source by a triangulation location method, and sending the position coordinate of the point of the center of the fire source to a remote control terminal;
and 5: estimating the distance between the fire source and the fire-fighting robot by using a triangulation method, and judging whether the distance between the fire source and the fire-fighting robot is smaller than the range of a water cannon or not;
step 6: if so, opening the water cannon to supply water, extinguishing the fire, otherwise, turning to the step 1, and prompting the remote control operator to reissue the target fire extinguishing position.
Furthermore, the dynamic navigation and autonomous obstacle avoidance functions of the fire-fighting robot are established based on the outdoor laser radar, the high-precision GPS and the SLAM technology, so that autonomous walking and obstacle avoidance can be realized in an unknown environment.
Furthermore, the three-light composite fire source detection sensor carries three cameras of visible light, infrared light and infrared thermal imaging, and in the process of fire source identification, the three cameras simultaneously acquire images, identify and process the images of the visible light and the infrared camera, and realize fire source identification and judgment by combining the processing technology of the infrared thermal imaging image.
Further, the method for identifying and positioning the fire source comprises the following steps:
s1: the water cannon is controlled to rotate left and right and drives the fire source detection camera carried by the water cannon to synchronously rotate, so that the three-light composite fire source detection sensor can detect the fire source in the range of 180 degrees right in front of the fire-fighting robot;
s2: on the basis of synchronously obtaining different images of three cameras, the three-light composite fire source detection sensor firstly compares an RGB color image obtained by a visible light camera with an infrared spectrum color image obtained by an infrared light camera, and preliminarily judges that the region is a suspected fire source region and positions the region when the two images simultaneously meet the matching requirements of a fire source characteristic template corresponding to visible light and a fire source characteristic template corresponding to infrared light;
s3: further judging the infrared thermal image at the same time according to a set temperature threshold value aiming at the suspected fire source area, and judging the area as the fire source area if the average temperature of the area reaches or exceeds the set temperature threshold value;
s4: stopping the water cannon from rotating and giving fire source alarm information;
s5: segmenting a high-temperature region from the infrared thermograph by image cutting, extracting the boundary of the region, and calculating pixel points to obtain pixel point area characteristics and a central position of a fire source region;
s6: and enabling the water cannon to point to the central position of the fire source area, and determining the direction of the fire source through position information fed back by the water cannon and real-time course information of the robot.
Further, a method for estimating the distance between the fire source and the fire-fighting robot comprises the following steps:
suppose a point F (X) for the center position of the firef,Yf) Indicating that the robot first makes a point A (X)a,Ya) Position-to-source identification and determination of source orientation, then at point B (X)b,Yb) Identifying and orienting the fire source again to construct a positioning triangle; wherein the coordinates of point A and point B in the global mapAs is known, the angle θ is the angle between the segment AB and the Y axis, so that the lengths l and θ of the segment AB can be determined, and can be expressed as
Figure BDA0003255334370000041
Figure BDA0003255334370000042
Firstly, a GPS positioning system is obtained to obtain a heading angle of the fire-fighting robot and a rotation angle of a gun barrel fed back by a water cannon relative to the heading of the fire-fighting robot, and an included angle theta between the gun barrel and a Y axis when the robot respectively locates at a point A and a point B can be calculated according to the two anglesaAnd thetabThe value of (B) can further calculate three internal angles of ^ A, < B and < F in < delta > ABF, as shown in formulas (3) to (5):
∠A=θa+θ (3)
∠B=π-(θb+θ) (4)
∠F=θba (5)
in Δ ABF, AF distance l can be calculated using sine theorem1And a distance l of BF2Thereby completing the estimation of the fire source distance,/1And l2Can be expressed as
Figure BDA0003255334370000051
Figure BDA0003255334370000052
Finally, the position coordinates (X) of the fire source in the global map can be obtained by the formula (6) or the formula (7)f,Yf) As shown in formulas (8) and (9):
Xf=Xb+l2·sin(θb) (8)
Yf=Yb-l2·cos(θb) (9)
the B coordinate (X) of the midpoint between the formula (8) and the formula (9)b,Yb) Derived from GPS positioning, variable θbCan be calculated to obtain2From the calculation of equation (7), it can be seen that by identifying and orienting the ignition source at two points by the robot, the coordinates of the point F of the ignition source can be calculated by equations (8) and (9), and the distance from the point F of the ignition source to the point a or B can be further obtained.
Because the existing fire-fighting robot moves to the vicinity of a fire source in a manual remote control mode to extinguish a fire, when designing an autonomous fire-fighting robot, a person skilled in the art generally thinks that the fire-fighting robot autonomously aims at the fire source to realize rapid fire extinguishing, for example, an autonomous aiming fire-source water-spraying fire-extinguishing method disclosed in the patent publication No. CN 105944270A, includes measuring an included angle between a fire source direction of the fire-fighting robot at an initial position and a moving route of the fire-fighting robot, an included angle between a fire source direction of the fire-fighting robot at a terminal position and a moving route of the fire-fighting robot, and a distance of the fire-fighting robot moving, calculating a distance between the fire-fighting robot at the terminal position and the fire source according to a trigonometric function, calculating a water monitor elevation angle according to a relational expression of the fire source distance and the water monitor elevation angle, the fire-fighting robot fire-fighting according to the calculated fire source distance and water monitor elevation angle, the fire extinguishing system comprises a thermal imager, a holder system, a chassis servo system, a servo electric control type fire water monitor, an electronic water pressure meter and a control system, and the fire-fighting robot comprises the fire extinguishing system. Also disclosed in patent publication No. CN 107224692 a is a method for self-aiming fire extinguishing by a wheeled fire-fighting robot. It includes the focus of confirming the flame source through video flame detection, measure flame source focus and robot contained angle, one section distance is removed wantonly to the fire-fighting robot, measure fire-fighting robot and flame source focus contained angle once more, rising cloud platform is certain to certain height and is measured focus and robot contained angle once more, calculate the position of flame source focus in three-dimensional space according to trigonometric function, remove the fire-fighting robot through integrated control, the initial velocity and the flow of fire monitor, make the flame source focus be located the effect that reaches accurate fire extinguishing on the orbit of fire monitor water jet. Since the autonomous fire extinguishing methods disclosed in the above two patent documents perform autonomous fire extinguishing when the location of the fire source is known, the technical solutions of autonomous search, fire source identification and location, and fire extinguishing according to the present application are not easy to be considered by those skilled in the art.
Compared with the prior art, the invention has the following beneficial effects:
the invention relates to an autonomous fire extinguishing method of a fire-fighting robot in an unknown environment. Firstly, distributing target point locations to fire-fighting robots according to a building map of a park, enabling the robots to conduct autonomous SLAM exploration around the park, and meanwhile conducting autonomous obstacle avoidance, fire source identification and orientation. After finding and positioning a fire source, the fire-fighting robot records the current position and course of the robot, acquires fire source early warning, fire source temperature, area size and center coordinate information of the fire source in an image and sends early warning information to a remote control terminal; and then, the robot continues to walk for a set distance and then carries out fire source identification and orientation again, the position and the course information of the robot at the new position are recorded again, fire source early warning, fire source temperature, the area size of the fire source in the image and center coordinate information are obtained, the position coordinate of the fire source center point is calculated through a triangulation method, and the position coordinate of the fire source center point is sent to the remote control terminal. When the distance between the fire source and the robot is less than the maximum range of the fire-fighting robot water cannon, the fire-fighting robot is directly stopped to carry out fire-fighting work; otherwise, prompting a remote control operator to release the target fire extinguishing position, and stopping the robot to perform fire extinguishing work after the robot reaches the target fire extinguishing position through autonomous navigation and identifying and orienting a fire source. Therefore, the fire-fighting robot can realize autonomous navigation, autonomous fire source searching, positioning and fire extinguishing in unknown environment, so that the fire-fighting robot can replace firemen to enter dangerous places such as chemical industrial parks, coal production occasions and the like for routing inspection and fire extinguishing, casualties of the firemen are effectively reduced, and the firemen are assisted to extinguish fire and rescue fire.
Drawings
FIG. 1 is a schematic flow diagram of an embodiment of the present invention;
FIG. 2 is a schematic flow chart of fire source identification and location in an embodiment of the present invention;
FIG. 3 is a schematic diagram of triangulation in an embodiment of the invention;
FIG. 4 is a software framework diagram of dynamic navigation of a fire fighting robot in an embodiment of the present invention;
fig. 5 is a hardware connection diagram of a fire-fighting robot control system in an embodiment of the invention.
Detailed Description
In order to better understand the present invention, the following examples are further provided to clearly illustrate the contents of the present invention, but the contents of the present invention are not limited to the following examples. In the following description, numerous specific details are set forth in order to provide a more thorough understanding of the present invention. It will be apparent, however, to one skilled in the art, that the present invention may be practiced without one or more of these specific details.
As shown in fig. 1, an autonomous fire extinguishing method for a fire-fighting robot in an unknown environment is implemented by combining autonomous obstacle avoidance, fire source identification and orientation technologies based on dynamic navigation, and includes the following steps:
step 1: distributing a target fire extinguishing location to a fire fighting robot;
step 2: autonomous SLAM exploration is carried out on the fire-fighting robot, and fire source identification and positioning are carried out;
and step 3: after finding and positioning a fire source, the fire-fighting robot records the current position and course of the fire-fighting robot, acquires fire source early warning, fire source temperature, area size and center coordinate information of the fire source in an image and sends early warning information to a remote control terminal;
and 4, step 4: after the fire-fighting robot continues to walk for a set distance, identifying and orienting the fire source again, recording the position and course information of the fire-fighting robot when the fire source is found again, acquiring the early warning of the fire source, the temperature of the fire source, the area of the fire source in the image and the central coordinate information, calculating the position coordinate of the point of the center of the fire source by a triangulation location method, and sending the position coordinate of the point of the center of the fire source to a remote control terminal;
and 5: estimating the distance between the fire source and the fire-fighting robot by using a triangulation method, and judging whether the distance between the fire source and the fire-fighting robot is smaller than the range of a water cannon or not;
step 6: if so, opening the water cannon to supply water, extinguishing the fire, otherwise, turning to the step 1, and prompting the remote control operator to reissue the target fire extinguishing position.
The dynamic navigation and autonomous obstacle avoidance functions of the fire-fighting robot are established based on an outdoor laser radar, a high-precision GPS (global positioning system) and an SLAM (SLAM) technology, so that autonomous walking and obstacle avoidance can be realized in an unknown environment.
The three-light composite fire source detection sensor carries three cameras of visible light, infrared light and infrared thermal imaging, and in the process of fire source identification, the three cameras simultaneously acquire images, identify and process the images of the visible light and the infrared light cameras, and realize fire source identification and judgment by combining the processing technology of the infrared thermal imaging images.
As shown in fig. 2, the method for identifying and locating a fire source includes the following steps:
s1: the water cannon is controlled to rotate left and right and drives the fire source detection camera carried by the water cannon to synchronously rotate, so that the three-light composite fire source detection sensor can detect the fire source in the range of 180 degrees right in front of the fire-fighting robot;
s2: on the basis of synchronously obtaining different images of three cameras, the three-light composite fire source detection sensor firstly compares an RGB color image obtained by a visible light camera with an infrared spectrum color image obtained by an infrared light camera, and preliminarily judges that the region is a suspected fire source region and positions the region when the two images simultaneously meet the matching requirements of a fire source characteristic template corresponding to visible light and a fire source characteristic template corresponding to infrared light;
s3: further judging the infrared thermal image at the same time according to a set temperature threshold value aiming at the suspected fire source area, and judging the area as the fire source area if the average temperature of the area reaches or exceeds the set temperature threshold value;
s4: stopping the water cannon from rotating and giving fire source alarm information;
s5: segmenting a high-temperature region from the infrared thermograph by image cutting, extracting the boundary of the region, and calculating pixel points to obtain pixel point area characteristics and a central position of a fire source region;
s6: and enabling the water cannon to point to the central position of the fire source area, and determining the direction of the fire source through position information fed back by the water cannon and real-time course information of the robot.
As shown in fig. 3, the method for estimating the distance between the fire source and the fire-fighting robot comprises the following steps:
assume the center of the fire for point F (Xf, Y)f) Indicating that the robot first makes a point A (X)a,Ya) Position-to-source identification and determination of source orientation, then at point B (X)b,Yb) Identifying and orienting the fire source again to construct a positioning triangle; wherein the coordinates of the point a and the point B are known in the global map, and the angle θ is the angle between the segment AB and the Y axis, so that the length l and θ of the segment AB can be determined, which can be expressed as
Figure BDA0003255334370000101
Figure BDA0003255334370000102
Firstly, a GPS positioning system is obtained to obtain a heading angle of the fire-fighting robot and a rotation angle of a gun barrel fed back by a water cannon relative to the heading of the fire-fighting robot, and an included angle theta between the gun barrel and a Y axis when the robot respectively locates at a point A and a point B can be calculated according to the two anglesaAnd thetabThe value of (B) can further calculate three internal angles of ^ A, < B and < F in < delta > ABF, as shown in formulas (3) to (5):
∠A=θa+θ (3)
∠B=π-(θb+θ) (4)
∠F=θba (5)
in Δ ABF, AF distance l can be calculated using sine theorem1And a distance l of BF2Thereby completing the estimation of the fire source distance,/1And l2Can be expressed as
l1 sin(θa+θ)=l2sin(π-(θb+θ))
l1cos(θa+θ)+l2cos(π-(θb+θ))=l
Figure BDA0003255334370000103
Figure BDA0003255334370000104
Finally, the position coordinates (X) of the fire source in the global map can be obtained by the formula (6) or the formula (7)f,Yf) As shown in formulas (8) and (9):
Xf=Xb+l2·sin(θb) (8)
Yf=Yb-l2·cos(θb) (9)
the B coordinate (X) of the midpoint between the formula (8) and the formula (9)b,Yb) Derived from GPS positioning, variable θbCan be calculated to obtain2From the calculation of equation (7), it can be seen that by identifying and orienting the ignition source at two points by the robot, the coordinates of the point F of the ignition source can be calculated by equations (8) and (9), and the distance from the point F of the ignition source to the point a or B can be further obtained.
The fire-fighting robot provided by the embodiment of the invention adopts a crawler-type travelling mechanism and is provided with a water cannon, a spraying device, a camera, an environment monitoring sensor, a wireless communication device and the like. The left side and the right side of the robot are respectively provided with a crawler belt, the robot is driven by a crawler belt driving module consisting of a driving wheel, a guide wheel, a tension wheel and a bearing wheel set, and the moving functions of advancing, retreating, steering and the like of the robot are realized by controlling the rotating speed and the steering of the driving wheels on the crawler belts at the two sides. Wherein, the driving wheel radius of setting in the robot rear portion is 150mm, and leading wheel and take-up pulley set up in the front portion of robot and form the rake angle of about 45 with the track together. Each wheel in the bearing wheel set is provided with an independent spring suspension for pressing the crawler belt and buffering the load fluctuation. The main parameters and performance indexes are shown in table 1.
TABLE 1 fire-fighting robot main parameters and Performance indexes
Figure BDA0003255334370000111
On the basis, in order to realize the functions of autonomous fire source searching and autonomous fire extinguishing of the robot in the unknown environment, a laser radar for outdoor navigation, a RTK-based GPS high-precision positioning system, a three-light composite fire source detection sensor and a wireless communication module are additionally arranged on the robot body, and the laser radar is used for realizing autonomous navigation, autonomous fire source searching and fire extinguishing of the robot in the unknown environment.
The software framework for the dynamic navigation of the fire-fighting robot is shown in fig. 4. The laser radar node is used for acquiring laser radar ranging data; the GPS odometer node is used for acquiring GPS data and converting the GPS data into odometer information required by autonomous navigation; the chassis control node is used for receiving the movement instruction and controlling the driving motor to realize the movement of the robot. In the dynamic navigation process, firstly, a target point position needs to be issued to the robot, the real-time construction of an environment map is completed through distance information acquired by a laser radar, positioning information acquired by a GPS and odometer positioning information, global path planning and local path planning of the robot on the real-time map are realized in a navigation node, and the path planning is updated in real time in the robot walking process. And simultaneously, issuing a speed control instruction, receiving the speed control instruction by the chassis control node, and driving the robot chassis to run according to the planned route to finish autonomous navigation in the unknown environment.
The three-light composite fire source detector is selected to accurately identify the fire source, and is fixedly installed on the water cannon barrel with the two-dimensional rotation function and keeps the same direction with the water cannon barrel. The water cannon barrel can rotate in two dimensions, and the relative angle between the water cannon barrel and the fire-fighting robot body at any moment can be detected in real time. Therefore, the fire source can be found by controlling the rotation of the water cannon barrel.
On the basis that the fire-fighting robot has the two capabilities, a remote operator can determine a proper target position and send the target position to the fire-fighting robot. And after receiving the target position, the robot performs autonomous navigation and obstacle avoidance in an unknown environment, and automatically controls the water cannon barrel to rotate at the specific target position to search for a fire source. After the robot identifies and positions the fire source, the included angle between the gun barrel of the water cannon and the ground is automatically adjusted upwards to a specified angle, and the azimuth information of the fire source is sent to a remote operator. The water source is controlled to be communicated with the water pressure by a remote operator, fire is put out, and meanwhile, the water pipe swings left and right in a small range according to a set program, so that the coverage range of the water faucet is expanded, and the water faucet direction deviation caused by errors of the wind direction and the angle is prevented.
As shown in fig. 5, the fire-fighting robot control system adopts a high-performance embedded industrial personal computer as a main controller, and a PCIE board card carried on the industrial personal computer sends a PWM pulse signal to a driving motor and receives a pulse generated in a motor rotation process. The motion control of the industrial personal computer on the water cannon is realized through a J1939 communication protocol based on a CAN bus. In the aspect of perceiving the self state and the surrounding environment, the current position and the course information of the robot obtained by the high-precision GPS and the surrounding environment obstacle information detected by the laser radar are respectively sent to the industrial personal computer through the RS232 interface and the network cable interface. The information of the gas sensor, the temperature and humidity sensor and the power management module is read by the single chip microcomputer board and then fed back to the industrial personal computer through the RS232 interface, and then the information is transmitted to the remote control box of the upper computer through the wireless data transmission module by the industrial personal computer. In addition, the fire source identification structure of the fire source detection sensor is sent to the industrial personal computer through the network port, and simultaneously, real-time video information of the fire source identification structure and video information obtained by the camera are transmitted to the upper computer remote control box through the wireless image transmission module, so that the field real-time condition is provided for remote control operators.
The three-light composite fire source detection sensor adopts a TCP communication mechanism to transmit a fire source identification and positioning result to the industrial personal computer, the communication data of the sensor adopts a pure json character string, and the information output mainly comprises the following two structural body data as shown in the following table 2.
TABLE 2 three light composite fire source detection sensor result output
Figure BDA0003255334370000141
As can be seen from table 2, the three-light composite fire source detection sensor can output fire source early warning, fire source temperature, and area size and center coordinate information of the fire source in the image after completing fire source identification and positioning.
Experiments and analyses
1. Experiment for identifying fire source
In the fire source identification experiment, burning waste wood and cardboard form the fire source, set up in the place of about 40m in front of fire-fighting robot. After the water cannon is fully combusted until the fire source is larger than 0.3m multiplied by 0.3m, the water cannon is controlled to swing in a reciprocating mode within 180 degrees right ahead, the three-light composite fire source detection sensor carried on the water cannon barrel is enabled to identify the fire source, and the feedback information of the sensor is read to verify the accuracy of fire source identification. The data of 10 replicates are shown in Table 3.
TABLE 3 fire source identification experimental data
Figure BDA0003255334370000151
As can be seen from the data in table 3, the identified fire source temperature is between 250 and 350 ℃, and the general wood burning temperature is above four hundred degrees celsius, and usually about six hundred degrees celsius. Considering that the heat radiation decreases with increasing distance, it is reasonable to experiment the data.
The information feedback frequency of the three-light composite fire source detector is about 0.67Hz, and the swing speed range of the water cannon is 5-20 degrees/s. The experimental result shows that under the condition that the size of the fire source meets the requirement, the fire source identification accuracy rate reaches 100 percent and is higher than the set index of 90 percent.
2. Robot obstacle avoidance and positioning experiment
In order to verify the obstacle avoidance performance and the positioning precision of the fire-fighting robot, the robot obstacle avoidance and positioning experiment is carried out in the dynamic navigation process, and the experiment method comprises the following steps: the robot is at initial position (0, 0), a target point position (x, y) is given, 2-3 obstacles are arranged between the two positions, the robot is required to avoid the arranged obstacles in autonomous navigation, and autonomous navigation is carried out to the target point. Then, the actual arrival position of the robot is measured, and the positioning accuracy of the robot is verified by comparing the given target positions. The experiment was repeated 10 times and the positioning data are shown in table 4.
Table 4 positioning experimental data
Figure BDA0003255334370000161
As can be seen from the data in Table 4, the positioning error of the robot in the dynamic navigation is within +/-0.4 m in the X direction and the Y direction, and the positioning precision can ensure that the function of self-extinguishing is realized in the dynamic navigation process of the fire-fighting robot.
3. Autonomous fire extinguishing experiment
In the autonomous fire extinguishing test, the fire-fighting robot firstly conducts autonomous SLAM exploration of a park environment and conducts fire source identification and orientation, after the fire source is detected, the fire source is navigated to a fire extinguishing point to conduct secondary fire source identification and orientation, the position of the fire source in a global map is determined through a triangular positioning method, meanwhile, the distance between the fire source and the fire extinguishing point is determined, the pitch angle of a water cannon is adjusted, and the fire extinguishing distance is controlled by matching with the pressure of a rear water pump to extinguish fire. The experimental data for 5 replicates are shown in table 5.
TABLE 5 autonomous fire extinguishing test data
Figure BDA0003255334370000162
As can be seen from the data in Table 5, in 5 experiments, the fire source orientation accuracy obtained by calculation according to the detection data is within 3 degrees, the maximum distance estimation error is about 8m, and the feasibility of the fire source identification orientation method and the triangular positioning method for estimating the fire source distance is verified.
Conclusion
According to the requirement that the fire-fighting robot carries out fire-fighting rescue in a chemical industry park with explosion possibility or a coal industry unit and other fire scenes instead of firemen, the autonomous fire source searching and fire-fighting technology of the fire-fighting robot is developed. Specifically, firstly, on the basis of introducing a structure and a control system of the fire-fighting robot, the technical requirements of the fire-fighting robot for independently searching a fire source and extinguishing fire in an unknown environment are determined; secondly, analyzing the working environment of the fire-fighting robot, and providing a technical scheme for the fire-fighting robot to independently find a fire source and extinguish fire; then, the autonomous walking and obstacle avoidance of the fire-fighting robot in an unknown environment are realized based on the SLAM technology, and a method and a technology suitable for the robot to autonomously find a fire source and position the fire source are developed; and finally, performing effectiveness verification on the fire source independently found and the fire extinguishing technology of the fire-fighting robot through simulation and experiments. Experimental results show that the developed fire-fighting robot autonomous fire source searching and extinguishing technology can enable the fire-fighting robot to independently walk and cross obstacles in an unknown environment, the positioning precision is less than 0.4m, the fire source identification rate is greater than 90%, autonomous fire source searching and extinguishing can be achieved, and the fire-fighting robot autonomous fire source searching and extinguishing device has a good application prospect.
Finally, the above embodiments are only used for illustrating the technical solutions of the present invention and not for limiting, and other modifications or equivalent substitutions made by the technical solutions of the present invention by those of ordinary skill in the art should be covered within the scope of the claims of the present invention as long as they do not depart from the spirit and scope of the technical solutions of the present invention.

Claims (5)

1. An autonomous fire extinguishing method of a fire-fighting robot in an unknown environment is characterized by comprising the following steps:
step 1: distributing a target fire extinguishing location to a fire fighting robot;
step 2: autonomous SLAM exploration is carried out on the fire-fighting robot, and fire source identification and positioning are carried out;
and step 3: after finding and positioning a fire source, the fire-fighting robot records the current position and course of the fire-fighting robot, acquires fire source early warning, fire source temperature, area size and center coordinate information of the fire source in an image and sends early warning information to a remote control terminal;
and 4, step 4: after the fire-fighting robot continues to walk for a set distance, identifying and orienting the fire source again, recording the position and course information of the fire-fighting robot when the fire source is found again, acquiring the early warning of the fire source, the temperature of the fire source, the area of the fire source in the image and the central coordinate information, calculating the position coordinate of the point of the center of the fire source by a triangulation location method, and sending the position coordinate of the point of the center of the fire source to a remote control terminal;
and 5: estimating the distance between the fire source and the fire-fighting robot by using a triangulation method, and judging whether the distance between the fire source and the fire-fighting robot is smaller than the range of a water cannon or not;
step 6: if so, opening the water cannon to supply water, extinguishing the fire, otherwise, turning to the step 1, and prompting the remote control operator to reissue the target fire extinguishing position.
2. A fire-fighting robot autonomous fire extinguishing method under unknown environment as recited in claim 1, characterized in that: the dynamic navigation and autonomous obstacle avoidance functions of the fire-fighting robot are established based on an outdoor laser radar, a high-precision GPS (global positioning system) and an SLAM (SLAM) technology, so that autonomous walking and obstacle avoidance can be realized in an unknown environment.
3. A fire-fighting robot autonomous fire extinguishing method under unknown environment as recited in claim 2, characterized in that: the three-light composite fire source detection sensor carries three cameras of visible light, infrared light and infrared thermal imaging, and in the process of fire source identification, the three cameras simultaneously acquire images, identify and process the images of the visible light and the infrared light cameras, and realize fire source identification and judgment by combining the processing technology of the infrared thermal imaging images.
4. A fire-fighting robot autonomous fire extinguishing method under unknown environment as recited in claim 3, characterized in that: the method for identifying and positioning the fire source comprises the following steps:
s1: the water cannon is controlled to rotate left and right and drives the fire source detection camera carried by the water cannon to synchronously rotate, so that the three-light composite fire source detection sensor can detect the fire source in the range of 180 degrees right in front of the fire-fighting robot;
s2: on the basis of synchronously obtaining different images of three cameras, the three-light composite fire source detection sensor firstly compares an RGB color image obtained by a visible light camera with an infrared spectrum color image obtained by an infrared light camera, and preliminarily judges that the region is a suspected fire source region and positions the region when the two images simultaneously meet the matching requirements of a fire source characteristic template corresponding to visible light and a fire source characteristic template corresponding to infrared light;
s3: further judging the infrared thermal image at the same time according to a set temperature threshold value aiming at the suspected fire source area, and judging the area as the fire source area if the average temperature of the area reaches or exceeds the set temperature threshold value;
s4: stopping the water cannon from rotating and giving fire source alarm information;
s5: segmenting a high-temperature region from the infrared thermograph by image cutting, extracting the boundary of the region, and calculating pixel points to obtain pixel point area characteristics and a central position of a fire source region;
s6: and enabling the water cannon to point to the central position of the fire source area, and determining the direction of the fire source through position information fed back by the water cannon and real-time course information of the robot.
5. A fire-fighting robot autonomous fire extinguishing method under unknown environment as recited in claim 4, characterized in that the distance estimation method of fire source and fire-fighting robot:
suppose a point F (X) for the center position of the firef,Yf) Indicating that the robot is first atPoint A (X)a,Ya) Position-to-source identification and determination of source orientation, then at point B (X)b,Yb) Identifying and orienting the fire source again to construct a positioning triangle; wherein the coordinates of the point a and the point B are known in the global map, and the angle θ is the angle between the segment AB and the Y axis, so that the length l and θ of the segment AB can be determined, which can be expressed as
Figure FDA0003255334360000031
Figure FDA0003255334360000032
Firstly, a GPS positioning system is obtained to obtain a heading angle of the fire-fighting robot and a rotation angle of a gun barrel fed back by a water cannon relative to the heading of the fire-fighting robot, and an included angle theta between the gun barrel and a Y axis when the robot respectively locates at a point A and a point B can be calculated according to the two anglesaAnd thetabThe value of (B) can further calculate three internal angles ≥ a, ≥ B and ≥ F in Δ ABF, as shown in equations (3) to (5):
∠A=θa+θ (3)
∠B=π-(θb+θ) (4)
∠F=θba (5)
in Δ ABF, AF distance l can be calculated using the sine theorem1And a distance l of BF2Thereby completing the estimation of the fire source distance,/1And l2Can be expressed as
Figure FDA0003255334360000033
Figure FDA0003255334360000034
Finally, the position coordinates (X) of the fire source in the global map can be obtained by the formula (6) or the formula (7)f,Yf) As shown in formulas (8) and (9):
Xf=Xb+l2·sin(θb) (8)
Yf=Yb-l2·cos(θb) (9)
the B coordinate (X) of the midpoint between the formula (8) and the formula (9)b,Yb) Derived from GPS positioning, variable θbCan be calculated to obtain2From the calculation of equation (7), it can be seen that by identifying and orienting the ignition source at two points by the robot, the coordinates of the point F of the ignition source can be calculated by equations (8) and (9), and the distance from the point F of the ignition source to the point a or B can be further obtained.
CN202111054598.9A 2021-09-09 2021-09-09 Autonomous fire extinguishing method of fire-fighting robot in unknown environment Pending CN113730860A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111054598.9A CN113730860A (en) 2021-09-09 2021-09-09 Autonomous fire extinguishing method of fire-fighting robot in unknown environment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111054598.9A CN113730860A (en) 2021-09-09 2021-09-09 Autonomous fire extinguishing method of fire-fighting robot in unknown environment

Publications (1)

Publication Number Publication Date
CN113730860A true CN113730860A (en) 2021-12-03

Family

ID=78737461

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111054598.9A Pending CN113730860A (en) 2021-09-09 2021-09-09 Autonomous fire extinguishing method of fire-fighting robot in unknown environment

Country Status (1)

Country Link
CN (1) CN113730860A (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114432635A (en) * 2021-12-27 2022-05-06 湖南中联重科应急装备有限公司 Method for identifying and positioning fire source of intelligent fire truck and intelligent fire truck
CN114602088A (en) * 2022-04-13 2022-06-10 创泽智能机器人集团股份有限公司 Robot automatic fire extinguishing method, equipment and storage medium
CN114712755A (en) * 2022-04-12 2022-07-08 季华实验室 Fire extinguishing method, robot, electronic equipment and storage medium
CN115006765A (en) * 2022-06-23 2022-09-06 中建八局第二建设有限公司 Robot rapid fire extinguishing method and rapid fire extinguishing robot
CN115591165A (en) * 2022-08-23 2023-01-13 国网上海市电力公司(Cn) Extremely early fire recognition system and recognition method for fire-fighting robot

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107193277A (en) * 2017-05-05 2017-09-22 宁波华狮智能科技有限公司 Autonomous detects the fire-fighting robot and control method of fire extinguishing automatically
CN107224692A (en) * 2017-06-26 2017-10-03 福州大学 The wheeled autonomous aiming extinguishing method of fire-fighting robot
CN110696003A (en) * 2019-09-17 2020-01-17 五邑大学 Water side rescue robot based on SLAM technology and deep learning
CN110860057A (en) * 2019-11-18 2020-03-06 燕山大学 Fire-fighting reconnaissance robot and reconnaissance method
CN113521616A (en) * 2021-07-30 2021-10-22 齐鲁工业大学 Fire-fighting robot, scheduling method and fire extinguishing system

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107193277A (en) * 2017-05-05 2017-09-22 宁波华狮智能科技有限公司 Autonomous detects the fire-fighting robot and control method of fire extinguishing automatically
CN107224692A (en) * 2017-06-26 2017-10-03 福州大学 The wheeled autonomous aiming extinguishing method of fire-fighting robot
CN110696003A (en) * 2019-09-17 2020-01-17 五邑大学 Water side rescue robot based on SLAM technology and deep learning
CN110860057A (en) * 2019-11-18 2020-03-06 燕山大学 Fire-fighting reconnaissance robot and reconnaissance method
CN113521616A (en) * 2021-07-30 2021-10-22 齐鲁工业大学 Fire-fighting robot, scheduling method and fire extinguishing system

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
(西)UAN-ANTONIOFERNANDEZ-MADRIGAL: "《移动机器人同步定位与地图构建》", 31 December 2017, 国防工业出版社 *
伍明: "《未知环境下移动机器人目标跟踪理论与方法》", 31 January 2018, 西北工业大学出版社 *

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114432635A (en) * 2021-12-27 2022-05-06 湖南中联重科应急装备有限公司 Method for identifying and positioning fire source of intelligent fire truck and intelligent fire truck
CN114712755A (en) * 2022-04-12 2022-07-08 季华实验室 Fire extinguishing method, robot, electronic equipment and storage medium
CN114602088A (en) * 2022-04-13 2022-06-10 创泽智能机器人集团股份有限公司 Robot automatic fire extinguishing method, equipment and storage medium
CN115006765A (en) * 2022-06-23 2022-09-06 中建八局第二建设有限公司 Robot rapid fire extinguishing method and rapid fire extinguishing robot
CN115591165A (en) * 2022-08-23 2023-01-13 国网上海市电力公司(Cn) Extremely early fire recognition system and recognition method for fire-fighting robot
CN115591165B (en) * 2022-08-23 2023-10-31 国网上海市电力公司 Extremely early fire identification system and method for fire-fighting robot

Similar Documents

Publication Publication Date Title
CN113730860A (en) Autonomous fire extinguishing method of fire-fighting robot in unknown environment
CN112774073B (en) Unmanned aerial vehicle guided multi-machine cooperation fire extinguishing method and fire extinguishing system thereof
CN107193277B (en) Autonomous mobile fire-fighting robot capable of automatically detecting and extinguishing fire and control method
CN110673603B (en) Fire scene autonomous navigation reconnaissance robot
CN110180112B (en) Cooperative reconnaissance fire-extinguishing operation method for unmanned aerial vehicle and fire-fighting robot
CN110180114B (en) Fire-fighting robot cooperative positioning, reconnaissance, fire source identification and aiming fire-extinguishing method
CN113189977B (en) Intelligent navigation path planning system and method for robot
Kim et al. Sensor fusion based seek-and-find fire algorithm for intelligent firefighting robot
CN214520204U (en) Port area intelligent inspection robot based on depth camera and laser radar
CN104953709A (en) Intelligent patrol robot of transformer substation
CN108593213A (en) The inspection of unmanned plane sub-terrain mines and odoriferous homing device
Quenzel et al. Autonomous fire fighting with a uav-ugv team at mbzirc 2020
CN110201340A (en) A kind of autonomous fire-fighting robot system having Online Map building and navigation feature
CN111617415A (en) Fully-autonomous fire-fighting robot operating system in complex environment and working method
CN111494847B (en) Safe and accurate fire extinguishing method based on intelligent fire extinguishing robot
Cho et al. Autonomous ship deck landing of a quadrotor UAV using feed-forward image-based visual servoing
CN110201333B (en) Full-automatic cooperative reconnaissance and fire extinguishing operation method for fire-fighting robot
Zhang et al. Mobile sentry robot for laboratory safety inspection based on machine vision and infrared thermal imaging detection
CN113521616A (en) Fire-fighting robot, scheduling method and fire extinguishing system
CN210228955U (en) Fire-fighting robot cooperative positioning, reconnaissance, fire source identification and aiming fire extinguishing system
CN116764147A (en) Carry on extinguishing device&#39;s explosion-proof unmanned car of patrolling and examining
CN110101996A (en) Fire-fighting robot co-located and AUTONOMOUS TASK method under complex environment
CN210233006U (en) Full-automatic cooperative reconnaissance and fire extinguishing system of fire-fighting robot
Gao et al. Design and Experimental Verification of an Intelligent Fire-fighting Robot
CN115373272A (en) Intelligent storage inspection robot control system and control method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20211203

RJ01 Rejection of invention patent application after publication