CN115518316B - Intelligent fire protection system based on interconnection of unmanned aerial vehicle, cloud platform and AR glasses - Google Patents
Intelligent fire protection system based on interconnection of unmanned aerial vehicle, cloud platform and AR glasses Download PDFInfo
- Publication number
- CN115518316B CN115518316B CN202211145003.5A CN202211145003A CN115518316B CN 115518316 B CN115518316 B CN 115518316B CN 202211145003 A CN202211145003 A CN 202211145003A CN 115518316 B CN115518316 B CN 115518316B
- Authority
- CN
- China
- Prior art keywords
- fire
- unmanned aerial
- aerial vehicle
- data
- cloud platform
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 239000011521 glass Substances 0.000 title claims abstract description 73
- 238000012545 processing Methods 0.000 claims abstract description 18
- 238000011835 investigation Methods 0.000 claims abstract description 7
- 238000004891 communication Methods 0.000 claims description 9
- 230000003993 interaction Effects 0.000 claims description 7
- PXHVJJICTQNCMI-UHFFFAOYSA-N Nickel Chemical compound [Ni] PXHVJJICTQNCMI-UHFFFAOYSA-N 0.000 claims description 6
- 238000013500 data storage Methods 0.000 claims description 6
- 230000004927 fusion Effects 0.000 claims description 6
- 238000012937 correction Methods 0.000 claims description 5
- 238000001514 detection method Methods 0.000 claims description 5
- WHXSMMKQMYFTQS-UHFFFAOYSA-N Lithium Chemical compound [Li] WHXSMMKQMYFTQS-UHFFFAOYSA-N 0.000 claims description 4
- 229910052744 lithium Inorganic materials 0.000 claims description 4
- 238000004806 packaging method and process Methods 0.000 claims description 4
- UFHFLCQGNIYNRP-UHFFFAOYSA-N Hydrogen Chemical compound [H][H] UFHFLCQGNIYNRP-UHFFFAOYSA-N 0.000 claims description 3
- 239000002253 acid Substances 0.000 claims description 3
- 229910052739 hydrogen Inorganic materials 0.000 claims description 3
- 239000001257 hydrogen Substances 0.000 claims description 3
- GELKBWJHTRAYNV-UHFFFAOYSA-K lithium iron phosphate Chemical compound [Li+].[Fe+2].[O-]P([O-])([O-])=O GELKBWJHTRAYNV-UHFFFAOYSA-K 0.000 claims description 3
- 229910052759 nickel Inorganic materials 0.000 claims description 3
- 238000003672 processing method Methods 0.000 claims description 3
- 230000000087 stabilizing effect Effects 0.000 claims description 3
- 230000000694 effects Effects 0.000 abstract description 4
- 238000000034 method Methods 0.000 description 5
- 230000005540 biological transmission Effects 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 230000003190 augmentative effect Effects 0.000 description 3
- 238000012544 monitoring process Methods 0.000 description 3
- 230000000007 visual effect Effects 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 2
- 238000012790 confirmation Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000004075 alteration Effects 0.000 description 1
- 230000004888 barrier function Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 238000007781 pre-processing Methods 0.000 description 1
- 230000001737 promoting effect Effects 0.000 description 1
- 239000000523 sample Substances 0.000 description 1
- 238000012216 screening Methods 0.000 description 1
- 239000000779 smoke Substances 0.000 description 1
Classifications
-
- A—HUMAN NECESSITIES
- A62—LIFE-SAVING; FIRE-FIGHTING
- A62C—FIRE-FIGHTING
- A62C3/00—Fire prevention, containment or extinguishing specially adapted for particular objects or places
- A62C3/02—Fire prevention, containment or extinguishing specially adapted for particular objects or places for area conflagrations, e.g. forest fires, subterranean fires
- A62C3/0228—Fire prevention, containment or extinguishing specially adapted for particular objects or places for area conflagrations, e.g. forest fires, subterranean fires with delivery of fire extinguishing material by air or aircraft
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B64—AIRCRAFT; AVIATION; COSMONAUTICS
- B64C—AEROPLANES; HELICOPTERS
- B64C39/00—Aircraft not otherwise provided for
- B64C39/02—Aircraft not otherwise provided for characterised by special use
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Aviation & Aerospace Engineering (AREA)
- Public Health (AREA)
- Business, Economics & Management (AREA)
- Ecology (AREA)
- Biodiversity & Conservation Biology (AREA)
- Emergency Management (AREA)
- Computing Systems (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Life Sciences & Earth Sciences (AREA)
- Forests & Forestry (AREA)
- Alarm Systems (AREA)
Abstract
The invention provides an intelligent fire protection system based on interconnection of an unmanned aerial vehicle, a cloud platform and AR glasses, which comprises: unmanned aerial vehicle, cloud platform and AR glasses; wherein: the unmanned aerial vehicle is used for automatically flying to go to a fire scene, completing intelligent obstacle avoidance, performing fire investigation in the fire scene, and uploading fire data to the cloud platform; the cloud platform is used for receiving fire data returned by the unmanned aerial vehicle, processing and storing the fire data, and sending the processed data to the decision terminal and the AR glasses as cloud data; the AR glasses are used for receiving cloud data pushed by the cloud platform and fire data transmitted by the unmanned aerial vehicle, acquiring the site information, integrating the information and feeding back to the decision end through the cloud platform; according to the system, through interconnection of the unmanned aerial vehicle, the cloud platform and the AR glasses, timeliness of information is enhanced, information loss is reduced, accuracy of decision making is effectively improved, and then success rate of rescue activities and safety of rescue workers can be improved.
Description
Technical Field
The invention belongs to the technical field of fire protection, and particularly relates to an intelligent fire protection system based on interconnection of an unmanned aerial vehicle, a cloud platform and AR glasses.
Background
Fire is a disaster caused by uncontrolled burning, and among various disasters, fire is one of the most frequent and most widespread disasters threatening public safety and social development. The fire scene has extremely high temperature and dense smoke which seriously affects the visibility. Therefore, the fire scene has the advantages of severe and complex environment, low information transmission effectiveness, high difficulty, and general great difficulty of fire scene rescue work, rescue teams are easy to be disjointed from the command platform, and can seriously obstruct the progress of the rescue work, and meanwhile, the safety of fire fighters is also required to be ensured to the greatest extent in the fire scene rescue work.
In modern fire-fighting systems, unmanned aerial vehicles are often used for auxiliary rescue, compared with the rescue of warriors when the warriors directly enter a fire scene, the unmanned aerial vehicles are used for fire exploration and information collection firstly, so that the success rate and safety of rescue actions can be effectively improved.
However, in the existing unmanned aerial vehicle auxiliary rescue system, the unmanned aerial vehicle is controlled by a flight hand to probe a fire scene to further acquire effective information. However, the method is influenced by various factors such as fire exploration capability of the flight crew, operation capability of the aircraft, severe fire scene environment and the like, and unmanned aerial vehicle rescue work is a great challenge to the operation capability and comprehensive quality of the flight crew; meanwhile, the flight hands judge the information collected by the unmanned aerial vehicle and then make a decision to carry out rescue activities, the links are complex, a certain amount of information loss exists in the middle, and meanwhile, the efficiency of rescue actions is also limited. In fire rescue, it is necessary to further improve the fault tolerance and stability of fire detection.
Therefore, how to solve the problems of low efficiency of collecting fire information and low information timeliness of the unmanned aerial vehicle operated by the fly hand, and improve the accuracy of decision making and rescue efficiency has become a technical problem to be solved by those skilled in the art.
Disclosure of Invention
In view of the above problems, the invention provides an intelligent fire protection system based on interconnection of an unmanned aerial vehicle, a cloud platform and AR glasses, which at least solves the above part of technical problems, and the intelligent fire protection system is used for cooperatively processing information through interconnection of the unmanned aerial vehicle, the cloud platform and the AR glasses and performing auxiliary positioning by utilizing the AR glasses, so that the information effectiveness is improved, accurate decision making is facilitated, and the rescue efficiency is improved.
In order to achieve the above purpose, the technical scheme adopted by the invention is as follows:
the embodiment of the invention provides an intelligent fire protection system based on interconnection of an unmanned aerial vehicle, a cloud platform and AR glasses, which comprises the following components: unmanned aerial vehicle, cloud platform and AR glasses; wherein:
the unmanned aerial vehicle is used for automatically flying to go to a fire scene, completing intelligent obstacle avoidance, performing fire investigation in the fire scene, and uploading fire data to the cloud platform;
the cloud platform is used for receiving the fire data returned by the unmanned aerial vehicle, processing and storing the fire data, and sending the processed data to the decision end and the AR glasses as cloud data;
the AR glasses are used for receiving cloud data pushed by the cloud platform and fire data transmitted by the unmanned aerial vehicle, acquiring the site information, integrating the information and feeding the information back to the decision terminal through the cloud platform.
Further, unmanned aerial vehicle contains sensor linkage module, data interconnection device, intelligent nuclear processor and power module.
Further, the sensor linkage module comprises: obstacle avoidance sensor, image acquisition device and cradle head; wherein:
the obstacle avoidance sensor is used for acquiring the speed of the unmanned aerial vehicle and the distance position information of the unmanned aerial vehicle and the obstacle;
the image acquisition device is used for acquiring a fire scene image;
the cradle head is used for stabilizing the obstacle avoidance sensor and the image acquisition device when the unmanned aerial vehicle flies.
Further, the data interconnection device includes: the cloud platform communication module and the AR glasses communication module are used for enabling the unmanned aerial vehicle to conduct data interaction with the cloud platform and the AR glasses.
Further, the smart core processor includes: the fire behavior detection device comprises an obstacle avoidance module, a fire behavior exploration module and a fusion identification module; wherein:
in the obstacle avoidance module, information acquired by the obstacle avoidance sensor is used as input, and an optimal flight path of the unmanned aerial vehicle is calculated by combining an intelligent obstacle avoidance algorithm to finish obstacle avoidance;
in the fire exploration module, a fire scene image acquired by the image acquisition device is used as input to judge and mark the position of a fire source in the fire scene image;
the fusion module is used for packaging the operation parameters of the unmanned aerial vehicle and the processed fire scene images, and transmitting the operation parameters and the processed fire scene images to the cloud platform and the AR glasses through the data interconnection device.
Further, the cloud platform comprises: the device comprises a data processing module, a data storage module and a data sending module; wherein:
the data processing module is used for processing the uploading fire data of the unmanned aerial vehicle, and the processing method comprises the following steps: correction of fire points, collection of information of trapped people in a fire scene and estimation of an optimal rescue route are carried out;
the data storage module is used for storing data received by the cloud platform;
the data sending module is used for sending the processed data to the AR glasses and the decision end as cloud data.
Further, the front end of AR glasses is provided with high definition digtal camera.
Further, the power module is a rechargeable battery, and is composed of any one of the following components: ternary lithium batteries, lithium iron phosphate batteries, nickel hydrogen batteries, and lead acid batteries.
Further, the obstacle avoidance sensor is a millimeter wave radar.
Further, the image acquisition device is a binocular vision camera.
Compared with the prior art, the intelligent fire protection system based on the interconnection of the unmanned aerial vehicle, the cloud platform and the AR glasses has the following beneficial effects:
1. according to the intelligent fire protection system based on interconnection of the unmanned aerial vehicle, the cloud platform and the AR glasses, the unmanned aerial vehicle, the cloud platform and the AR glasses are interconnected, information is cooperatively processed, auxiliary positioning is carried out by utilizing the AR glasses, information effectiveness is improved, accurate decision making is facilitated, and rescue efficiency is improved.
2. The system converts the functions of rescue workers, releases the functions from a flight crew, carries out information entanglement, reduces the false alarm rate after realizing the functions of autonomous obstacle avoidance and fire investigation of the unmanned aerial vehicle, and greatly improves the accuracy of information.
3. The data is processed at the cloud, so that a high-precision and high-performance data processing algorithm can be carried, and messages can be pushed in time, and a redundant information transmission process is omitted.
And 4, the AR glasses are cooperated with the unmanned aerial vehicle to integrate information, multi-dimensional data support is provided while rapid positioning is assisted, and information types are rich.
Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims thereof as well as the appended drawings.
The technical scheme of the invention is further described in detail through the drawings and the embodiments.
Drawings
The accompanying drawings are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate the invention and together with the embodiments of the invention, serve to explain the invention. In the drawings:
fig. 1 is a block diagram of an intelligent fire protection system based on interconnection of an unmanned aerial vehicle, a cloud platform and AR glasses, which is provided by an embodiment of the invention.
Fig. 2 is a functional schematic diagram of an unmanned aerial vehicle according to an embodiment of the present invention.
Fig. 3 is a schematic diagram of cloud platform data interaction according to an embodiment of the present invention.
Fig. 4 is a schematic diagram of AR glasses structure according to an embodiment of the present invention.
Detailed Description
The invention is further described in connection with the following detailed description, in order to make the technical means, the creation characteristics, the achievement of the purpose and the effect of the invention easy to understand.
In the description of the present invention, it should be noted that the directions or positional relationships indicated by the terms "upper", "lower", "inner", "outer", "front", "rear", "both ends", "one end", "the other end", etc. are based on the directions or positional relationships shown in the drawings, are merely for convenience of describing the present invention and simplifying the description, and do not indicate or imply that the devices or elements referred to must have a specific direction, be configured and operated in the specific direction, and thus should not be construed as limiting the present invention. Furthermore, the terms "first," "second," and the like, are used for descriptive purposes only and are not to be construed as indicating or implying relative importance.
In the description of the present invention, it should be noted that, unless explicitly stated or limited otherwise, the terms "comprise," "include," "have," "connect," etc. are to be construed broadly, as for example, "connect" may be a fixed connection, a removable connection, or an integral connection; can be mechanically or electrically connected; can be directly connected or indirectly connected through an intermediate medium, and can be communication between two elements. The specific meaning of the above terms in the present invention will be understood in specific cases by those of ordinary skill in the art.
Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.
Referring to fig. 1, an embodiment of the present invention provides an intelligent fire protection system based on interconnection of an unmanned aerial vehicle, a cloud platform and AR glasses, which specifically includes: unmanned aerial vehicle, cloud platform and AR glasses; wherein:
the unmanned plane is responsible for autonomously flying to go to a fire scene under the condition of no control of a flying hand, completing intelligent obstacle avoidance, performing fire investigation in the fire scene, collecting fire data, uploading the fire data to the cloud platform, and waiting for instructions such as movement, standby, return and the like of the cloud platform;
the cloud platform receives fire data returned by the unmanned aerial vehicle, processes and stores the fire data, and sends the processed data to the decision terminal and the AR glasses as cloud data;
the cloud platform is the core of information integration and processing, and the cloud platform can receive different data information from a decision-making end, an unmanned aerial vehicle side, an AR (augmented reality) glasses side and the like, and according to the information, the cloud platform needs to monitor the unmanned aerial vehicle state, execute the upper-level decision, receive the AR glasses side feedback information and finish the tasks of fire confirmation, fire grading, directional transmission of fire pictures and the like.
The AR glasses are augmented reality equipment worn by rescue workers and are used for receiving cloud data pushed by a cloud platform and field data transmitted by an unmanned aerial vehicle (wherein the field data comprise fire data); in the embodiment, the front end of the AR glasses is provided with the high-definition camera, so that the on-site information can be obtained at the same time, namely, the AR glasses obtain the on-site image of the environment where the firefighter rescue personnel is located; and packaging and integrating the information, and feeding back the information to the decision terminal through the cloud platform.
In this embodiment, the AR glasses are receiving ends of the visual data, and are input ends of the feedback data, for example; when the decision end is positioned in the rescue command center, the decision end is connected with the monitoring screen, and decision-making staff can more accurately and efficiently make decisions according to augmented reality, visual and visible data fed back by the AR glasses; and rescue personnel judge the fire information collected by the unmanned aerial vehicle in a safety area of the rescue site, so that a specific rescue scheme can be formulated more comprehensively.
As shown in fig. 2, the unmanned aerial vehicle includes a sensor linkage module, a data interconnection device, an intelligent core processor and a power module.
Wherein, at least, contain in unmanned aerial vehicle's the sensor linkage module: obstacle avoidance sensor, image acquisition device and cradle head; in this embodiment, the obstacle avoidance sensor preferably adopts a millimeter wave radar for accurately acquiring the speed of the unmanned aerial vehicle and the distance position information between the unmanned aerial vehicle and the obstacle; the image acquisition device preferably adopts a binocular vision camera and is used for effectively acquiring the fire scene image; the cradle head is a triaxial mechanical cradle head and is used for stabilizing the obstacle avoidance sensor and the image acquisition device when the unmanned aerial vehicle flies, and the cradle head is kept horizontal and does not shake.
As shown in fig. 2, the data interconnection device of the unmanned aerial vehicle includes: the cloud platform communication module and the AR glasses communication module are used for enabling the unmanned aerial vehicle to conduct data interaction with the cloud platform and the AR glasses.
As shown in fig. 2, the smart core processor of the unmanned aerial vehicle at least includes: the fire behavior detection device comprises an obstacle avoidance module, a fire behavior exploration module and a fusion identification module; wherein: in the obstacle avoidance module, information acquired by a millimeter wave radar is used as input, and an optimal flight path of the unmanned aerial vehicle is calculated by combining an intelligent obstacle avoidance algorithm to finish obstacle avoidance; in the fire exploration module, a fire scene image acquired by a binocular vision camera is used as input to judge and mark the position of a fire source in the fire scene image; the fusion module is used for packaging operation parameters (such as longitude and latitude height, electric quantity, speed and other key parameters) of the unmanned aerial vehicle and the processed fire scene image, and transmitting the operation parameters and the processed fire scene image to the cloud platform and the AR glasses through the cloud platform communication module and the AR glasses communication module.
In this embodiment, the power module of the unmanned aerial vehicle is a rechargeable battery, and may be any one of the following: ternary lithium batteries, lithium iron phosphate batteries, nickel hydrogen batteries and lead acid batteries are preferably employed as ternary lithium batteries in view of cost and weight.
Other functions and structural components of the unmanned aerial vehicle and AR glasses not shown in the present invention may be obtained from existing unmanned aerial vehicle technology and AR glasses technology, and are not described in any great detail herein.
In this embodiment, the cloud platform includes: the device comprises a data processing module, a data storage module and a data sending module; wherein: the data processing module processes the uploading fire data of the unmanned aerial vehicle, and the processing method at least comprises the following steps: correction of fire points, collection of information of trapped people in a fire scene, estimation of an optimal rescue route and the like are carried out; the data storage module stores the data received by the cloud platform; the data sending module is used for sending the processed data to the AR glasses and the decision-making end as cloud data; the data interaction of the cloud platform is shown in fig. 3.
In this embodiment, the decision end may be installed in a monitoring system of a command center, and the decision end performs data display through a large monitoring screen, or the decision end may also be a web end, or the decision end performs data viewing through APP installed in a mobile terminal device (for example, a mobile phone, an iPad, a notebook, etc.), and the decision end performs display and browse of fire data through clicking a web; or other clients, etc. receive the interaction of the data completion information of the cloud platform, and the interaction is not limited herein.
In the embodiment, the AR glasses are used as individual soldier devices of rescue workers, and are mainly provided with a camera which is in common view with the rescue team members and a module which is connected with the cloud platform; the AR glasses structure is shown in fig. 4.
Rescue personnel can intuitively and three-dimensionally receive fire information returned by the unmanned aerial vehicle by wearing the AR glasses, and can shoot an environment image where the rescue personnel is located, so that the functions of the rescue personnel are converted from flying hands to a person for correcting, decision making is facilitated, correct information is fed back in time under the condition that the unmanned aerial vehicle cannot complete tasks due to extreme conditions, and further loss is avoided.
Further, taking the example that the decision end is positioned in the fire control command center, the rescue steps of the intelligent fire control system using the invention are as follows:
the first step: unmanned aerial vehicle independently flies to go to the scene of a fire, accomplishes intelligent obstacle avoidance, and after completing the fire investigation in the scene of a fire, data are uploaded to the cloud platform.
And a second step of: and the cloud platform receives the data returned by the unmanned aerial vehicle, performs preliminary processing, and then sends the data to rescue workers and command centers following the rescue scene.
And a third step of: the command center makes decisions, uploads the cloud platform, on-site rescue workers feed back the information according to on-site conditions at any time, the AR glasses cooperate with the unmanned aerial vehicle to integrate the information, the geographic position and the fire scene temperature returned by the single machine side and the data of a plurality of airborne sensor information and the glasses end are arranged into a data packet, the detection condition of the single machine side fire is confirmed, the data packet and the confirmation result are transmitted to the platform, and the unmanned aerial vehicle is corrected to send information.
Fourth step: rescue work is carried out, and the unmanned aerial vehicle receives the instruction and smoothly returns to the navigation.
The following describes an intelligent fire protection system based on interconnection of an unmanned aerial vehicle, a cloud platform and AR glasses in detail by using a specific embodiment.
When a fire occurs, rescue workers arrive at the scene, and a flight area is established; unlocking unmanned aerial vehicle, unmanned aerial vehicle relies on millimeter wave radar and built-in intelligent obstacle avoidance module, independently goes to the scene of a fire and carries out information collection. When the unmanned aerial vehicle arrives at a fire scene, acquiring scene image data by using a configured binocular vision camera, preprocessing the scene image data, judging and marking the position of a suspected fire source in the image, and primarily screening the fire; and uploading the shot live image to the cloud platform.
When the cloud platform receives the image sent by the unmanned aerial vehicle, secondary processing is carried out, such as correction of fire points, collection of information of trapped personnel in a fire scene, estimation of an optimal rescue route and the like. After the secondary treatment, the information is respectively pushed to a command center and on-site rescue workers.
The rescue personnel receive the information pushed by the cloud platform through wearing the AR glasses, meanwhile, the rescue personnel also receive the information directly transmitted by the unmanned aerial vehicle side, the information obtained by the camera co-viewing with the rescue personnel is combined, the fire scene information is timely subjected to rectification, the accuracy of the information such as the fire occurrence condition and the fire classification by the single machine side is judged, the AR glasses and the information obtained by the unmanned aerial vehicle are cooperatively sent to the cloud platform, and the effectiveness of the information is guaranteed.
After the command center acquires information such as a fire scene image of the unmanned aerial vehicle through the decision-making end, a scientific decision-making and efficient rescue scheme is made, feedback information of rescue workers is received at any time in the making process, the decision-making is corrected, the decision-making is finally put down to the rescue workers, and finally, a fire scene rescue task is completed safely and efficiently.
According to the intelligent fire-fighting system based on interconnection of the unmanned aerial vehicle, the cloud platform and the AR glasses, provided by the embodiment of the invention, the success rate and the safety of fire-fighting rescue activities are effectively improved through the interconnection of the unmanned aerial vehicle, the cloud platform and the AR glasses. The system has the advantages that the single machine can conduct fire investigation independently and intelligently, the big data cloud platform can process fire scene data efficiently, rescue workers wear AR glasses to realize information auxiliary decision making, and the concepts of intelligent fire fighting and scientific decision making are embodied. Through this system with the staff's of rescue function conversion, liberate from the flight crew, carry out information and entangle, after having realized unmanned aerial vehicle and independently kept away the barrier, reconnaissance the function of condition of a fire, reduced the false alarm rate, improved the accuracy of information greatly. The data is processed at the cloud, so that a high-precision and high-performance data processing algorithm can be carried, and messages can be pushed in time, and a redundant information transmission process is omitted. The AR glasses are cooperated with the unmanned aerial vehicle to integrate information, multi-dimensional data support is provided while rapid positioning is assisted, and information types are rich.
The intelligent fire control system based on the unmanned aerial vehicle has the innovation point that based on an intelligent algorithm of the unmanned aerial vehicle, information cooperative processing is carried out through the unmanned aerial vehicle, the cloud platform and the AR glasses from the role of converting a flight crew, visual and multidimensional data are received by the AR glasses, and auxiliary positioning is carried out, so that the purposes of improving information effectiveness, being more beneficial to decision making and promoting construction of an intelligent fire control system are achieved. Moreover, as the obstacle avoidance function and the fire recognition function are independently completed by the unmanned aerial vehicle, the functions of rescue workers are converted from flying hands to error correcting workers, fire information returned by the unmanned aerial vehicle is intuitively and three-dimensionally received through AR glasses, information error correction is performed while double insurance is formed, correct information is timely fed back under the condition that the unmanned aerial vehicle cannot complete tasks due to extreme conditions, and further loss is avoided; the invention is expected to play an irreplaceable role in a future intelligent fire-fighting system, and has strong guiding significance.
It will be apparent to those skilled in the art that various modifications and variations can be made to the present invention without departing from the spirit or scope of the invention. Thus, it is intended that the present invention also include such modifications and alterations insofar as they come within the scope of the appended claims or the equivalents thereof.
Claims (6)
1. Intelligent fire protection system based on unmanned aerial vehicle, cloud platform and AR glasses interconnection, its characterized in that, this system includes: unmanned aerial vehicle, cloud platform and AR glasses; wherein:
the unmanned aerial vehicle is used for automatically flying to go to a fire scene, completing intelligent obstacle avoidance, performing fire investigation in the fire scene, and uploading fire data to the cloud platform;
the cloud platform is used for receiving the fire data returned by the unmanned aerial vehicle, processing and storing the fire data, and sending the processed data to the decision end and the AR glasses as cloud data;
the AR glasses are used for receiving cloud data pushed by the cloud platform and fire data transmitted by the unmanned aerial vehicle, acquiring the site information, integrating the information and feeding the information back to the decision terminal through the cloud platform;
the unmanned aerial vehicle comprises a sensor linkage module, a data interconnection device, an intelligent nuclear processor and a power supply module;
the sensor linkage module comprises: obstacle avoidance sensor, image acquisition device and cradle head; wherein:
the obstacle avoidance sensor is used for acquiring the speed of the unmanned aerial vehicle and the distance position information of the unmanned aerial vehicle and the obstacle;
the image acquisition device is used for acquiring a fire scene image;
the cradle head is used for stabilizing the obstacle avoidance sensor and the image acquisition device when the unmanned aerial vehicle flies;
the intelligent core processor comprises the following components: the fire behavior detection device comprises an obstacle avoidance module, a fire behavior exploration module and a fusion identification module; wherein:
in the obstacle avoidance module, information acquired by the obstacle avoidance sensor is used as input, and an optimal flight path of the unmanned aerial vehicle is calculated by combining an intelligent obstacle avoidance algorithm to finish obstacle avoidance;
in the fire exploration module, a fire scene image acquired by the image acquisition device is used as input to judge and mark the position of a fire source in the fire scene image;
the fusion module is used for packaging the operation parameters of the unmanned aerial vehicle and the processed fire scene images, and transmitting the operation parameters and the processed fire scene images to the cloud platform and the AR glasses through the data interconnection device;
the cloud platform comprises: the device comprises a data processing module, a data storage module and a data sending module; wherein:
the data processing module is used for processing the uploading fire data of the unmanned aerial vehicle, and the processing method comprises the following steps: correction of fire points, collection of information of trapped people in a fire scene and estimation of an optimal rescue route are carried out;
the data storage module is used for storing data received by the cloud platform;
the data sending module is used for sending the processed data to the AR glasses and the decision end as cloud data.
2. The intelligent fire protection system based on the interconnection of the unmanned aerial vehicle, the cloud platform and the AR glasses according to claim 1, wherein the data interconnection device comprises: the cloud platform communication module and the AR glasses communication module are used for enabling the unmanned aerial vehicle to conduct data interaction with the cloud platform and the AR glasses.
3. The intelligent fire protection system based on the interconnection of the unmanned aerial vehicle, the cloud platform and the AR glasses according to claim 1, wherein the front end of the AR glasses is provided with a high-definition camera.
4. The intelligent fire protection system based on interconnection of unmanned aerial vehicle, cloud platform and AR glasses as claimed in claim 1, wherein the power module is a rechargeable battery, and is composed of any one of the following components: ternary lithium batteries, lithium iron phosphate batteries, nickel hydrogen batteries, and lead acid batteries.
5. The intelligent fire protection system based on the interconnection of the unmanned aerial vehicle, the cloud platform and the AR glasses according to claim 1, wherein the obstacle avoidance sensor is a millimeter wave radar.
6. The intelligent fire protection system based on the interconnection of the unmanned aerial vehicle, the cloud platform and the AR glasses according to claim 1, wherein the image acquisition device is a binocular vision camera.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211145003.5A CN115518316B (en) | 2022-09-20 | 2022-09-20 | Intelligent fire protection system based on interconnection of unmanned aerial vehicle, cloud platform and AR glasses |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211145003.5A CN115518316B (en) | 2022-09-20 | 2022-09-20 | Intelligent fire protection system based on interconnection of unmanned aerial vehicle, cloud platform and AR glasses |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115518316A CN115518316A (en) | 2022-12-27 |
| CN115518316B true CN115518316B (en) | 2024-02-20 |
Family
ID=84696911
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211145003.5A Active CN115518316B (en) | 2022-09-20 | 2022-09-20 | Intelligent fire protection system based on interconnection of unmanned aerial vehicle, cloud platform and AR glasses |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115518316B (en) |
Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106210627A (en) * | 2016-07-04 | 2016-12-07 | 广东天米教育科技有限公司 | A kind of unmanned plane fire dispatch system |
| CN205819557U (en) * | 2016-07-04 | 2016-12-21 | 广东天米教育科技有限公司 | A kind of fire-fighting early warning unmanned plane and dispatching patcher thereof |
| CN107451723A (en) * | 2017-07-11 | 2017-12-08 | 成都四平软件有限公司 | Emergency management and rescue things system |
| CN108566536A (en) * | 2018-05-15 | 2018-09-21 | 新疆习美人工智能科技有限公司 | Collection apparatus analysis system based on wearable device |
| KR101926557B1 (en) * | 2018-06-01 | 2018-12-07 | 전북대학교산학협력단 | Apparatus for detecting missing person in disaster scene using a drone and method by using the same |
| CN109388230A (en) * | 2017-08-11 | 2019-02-26 | 王占奎 | AR fire-fighting emergent commands deduction system platform, AR fire helmet |
| KR102017154B1 (en) * | 2018-03-09 | 2019-10-14 | 김석문 | Marine Observation System Using Drone |
| CN112464819A (en) * | 2020-11-27 | 2021-03-09 | 清华大学 | Forest fire spreading data assimilation method and device based on unmanned aerial vehicle video |
| CN113274664A (en) * | 2021-06-16 | 2021-08-20 | 泉州岭东科技有限公司 | Fire fighting fire emergency rescue device based on cloud computing and use method thereof |
| CN113595239A (en) * | 2021-06-17 | 2021-11-02 | 国电南瑞科技股份有限公司 | Cloud-side-end-collaborative intelligent substation management and control system |
| CN113842574A (en) * | 2021-10-14 | 2021-12-28 | 苏州大学 | Intelligent fire-fighting monitoring system of Firbot fire-fighting robot based on cloud platform |
| JP7040827B1 (en) * | 2021-01-14 | 2022-03-23 | 株式会社ロックガレッジ | Search support system and rescue support program |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11481979B2 (en) * | 2018-04-23 | 2022-10-25 | The Regents Of The University Of Colorado, A Body Corporate | Mobile and augmented reality based depth and thermal fusion scan |
-
2022
- 2022-09-20 CN CN202211145003.5A patent/CN115518316B/en active Active
Patent Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106210627A (en) * | 2016-07-04 | 2016-12-07 | 广东天米教育科技有限公司 | A kind of unmanned plane fire dispatch system |
| CN205819557U (en) * | 2016-07-04 | 2016-12-21 | 广东天米教育科技有限公司 | A kind of fire-fighting early warning unmanned plane and dispatching patcher thereof |
| CN107451723A (en) * | 2017-07-11 | 2017-12-08 | 成都四平软件有限公司 | Emergency management and rescue things system |
| CN109388230A (en) * | 2017-08-11 | 2019-02-26 | 王占奎 | AR fire-fighting emergent commands deduction system platform, AR fire helmet |
| KR102017154B1 (en) * | 2018-03-09 | 2019-10-14 | 김석문 | Marine Observation System Using Drone |
| CN108566536A (en) * | 2018-05-15 | 2018-09-21 | 新疆习美人工智能科技有限公司 | Collection apparatus analysis system based on wearable device |
| KR101926557B1 (en) * | 2018-06-01 | 2018-12-07 | 전북대학교산학협력단 | Apparatus for detecting missing person in disaster scene using a drone and method by using the same |
| CN112464819A (en) * | 2020-11-27 | 2021-03-09 | 清华大学 | Forest fire spreading data assimilation method and device based on unmanned aerial vehicle video |
| JP7040827B1 (en) * | 2021-01-14 | 2022-03-23 | 株式会社ロックガレッジ | Search support system and rescue support program |
| CN113274664A (en) * | 2021-06-16 | 2021-08-20 | 泉州岭东科技有限公司 | Fire fighting fire emergency rescue device based on cloud computing and use method thereof |
| CN113595239A (en) * | 2021-06-17 | 2021-11-02 | 国电南瑞科技股份有限公司 | Cloud-side-end-collaborative intelligent substation management and control system |
| CN113842574A (en) * | 2021-10-14 | 2021-12-28 | 苏州大学 | Intelligent fire-fighting monitoring system of Firbot fire-fighting robot based on cloud platform |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115518316A (en) | 2022-12-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106125747A (en) | Based on the servo-actuated Towed bird system in unmanned aerial vehicle onboard the first visual angle mutual for VR | |
| CN106210627A (en) | A kind of unmanned plane fire dispatch system | |
| CN114093111B (en) | Forest fire rescue air-ground integrated command scheduling system and method | |
| CN211890820U (en) | Air-ground cooperative intelligent inspection robot | |
| CN204925512U (en) | Intelligence glasses suitable for unmanned aerial vehicle control and formation of image | |
| CN112954599A (en) | Post-disaster unmanned aerial vehicle communication system | |
| CN113077561A (en) | Intelligent inspection system for unmanned aerial vehicle | |
| CN113778132A (en) | Integrated parallel control platform for sea-air collaborative heterogeneous unmanned system | |
| CN113516708A (en) | Power transmission line inspection unmanned aerial vehicle accurate positioning system and method based on image recognition and UWB positioning fusion | |
| CN110647170A (en) | Navigation mark inspection device and method based on unmanned aerial vehicle | |
| CN206485252U (en) | A kind of fire communication command car of use unmanned plane wireless video transmission system | |
| CN112052785A (en) | Intelligent monitoring system of inspection robot | |
| CN115518316B (en) | Intelligent fire protection system based on interconnection of unmanned aerial vehicle, cloud platform and AR glasses | |
| CN205721375U (en) | A kind of many rotor wing unmanned aerial vehicles communication and safety monitoring system | |
| CN106394918A (en) | Unmanned aerial vehicle carried panorama camera system and operation method thereof | |
| CN109218683A (en) | Monitoring unmanned system and electric power place monitoring system | |
| CN207399403U (en) | A kind of unmanned plane monitoring platform | |
| CN107628262A (en) | A kind of unmanned plane equipment cabin system | |
| CN108706101A (en) | A kind of medical treatment dedicated unmanned machine | |
| CN115793008B (en) | Real-time position tracking method and device based on unmanned plane crash and computer equipment | |
| CN111739346A (en) | Air-ground cooperative scheduling command method and platform system | |
| CN114200961A (en) | Air-ground cooperative system based on unmanned aerial vehicle and intelligent wearable equipment | |
| CN107977778A (en) | Internet of Things unmanned plane message scheduling service system | |
| CN105407319A (en) | Field single-soldier combat inspection tour system based on Beidou navigation satellite | |
| Zheng et al. | A somatosensory-operation-based unmanned aerial vehicle for power line inspection in first person of view |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20240409 Address after: Room 501, 5th Floor, Building 3, No. 6 Lize West Street, Chaoyang District, Beijing, 100000 Patentee after: Beijing Anqing Zhifei Technology Co.,Ltd. Country or region after: China Address before: 519075 5-214, Floor 5, Yunxi Valley Digital Industrial Park, No. 168, Youyou Road, Xiangzhou District, Zhuhai City, Guangdong Province (Block B, Meixi Commercial Plaza) (centralized office area) Patentee before: Zhuhai Anqing Technology Co.,Ltd. Country or region before: China |
|
| TR01 | Transfer of patent right |