CN114519472B - Emergency management monitoring method based on three-dimensional model - Google Patents

Emergency management monitoring method based on three-dimensional model Download PDF

Info

Publication number
CN114519472B
CN114519472B CN202210414037.3A CN202210414037A CN114519472B CN 114519472 B CN114519472 B CN 114519472B CN 202210414037 A CN202210414037 A CN 202210414037A CN 114519472 B CN114519472 B CN 114519472B
Authority
CN
China
Prior art keywords
aerial vehicle
unmanned aerial
potential field
area
module
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202210414037.3A
Other languages
Chinese (zh)
Other versions
CN114519472A (en
Inventor
梁越
刘云平
王巍学
解帅
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nanjing University of Information Science and Technology
Original Assignee
Nanjing University of Information Science and Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nanjing University of Information Science and Technology filed Critical Nanjing University of Information Science and Technology
Priority to CN202210414037.3A priority Critical patent/CN114519472B/en
Publication of CN114519472A publication Critical patent/CN114519472A/en
Application granted granted Critical
Publication of CN114519472B publication Critical patent/CN114519472B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/04Forecasting or optimisation specially adapted for administrative or management purposes, e.g. linear programming or "cutting stock problem"
    • G06Q10/047Optimisation of routes or paths, e.g. travelling salesman problem
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/20Instruments for performing navigational calculations
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01JMEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J5/00Radiation pyrometry, e.g. infrared or optical thermometry
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N33/00Investigating or analysing materials by specific methods not covered by groups G01N1/00 - G01N31/00
    • G01N33/0004Gaseous mixtures, e.g. polluted air
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
    • G06Q50/10Services
    • G06Q50/26Government or public services
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00Three dimensional [3D] modelling, e.g. data description of 3D objects
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01JMEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J5/00Radiation pyrometry, e.g. infrared or optical thermometry
    • G01J2005/0077Imaging

Landscapes

  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Resources & Organizations (AREA)
  • Tourism & Hospitality (AREA)
  • Theoretical Computer Science (AREA)
  • Economics (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Health & Medical Sciences (AREA)
  • Strategic Management (AREA)
  • Chemical & Material Sciences (AREA)
  • Remote Sensing (AREA)
  • Marketing (AREA)
  • General Business, Economics & Management (AREA)
  • General Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Development Economics (AREA)
  • Primary Health Care (AREA)
  • Computer Graphics (AREA)
  • Game Theory and Decision Science (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Operations Research (AREA)
  • Quality & Reliability (AREA)
  • Software Systems (AREA)
  • Geometry (AREA)
  • Automation & Control Theory (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Combustion & Propulsion (AREA)
  • Educational Administration (AREA)
  • Food Science & Technology (AREA)
  • Medicinal Chemistry (AREA)
  • Analytical Chemistry (AREA)
  • Biochemistry (AREA)
  • Immunology (AREA)
  • Pathology (AREA)
  • Emergency Alarm Devices (AREA)

Abstract

The invention discloses an emergency management monitoring method based on a three-dimensional model, and belongs to the technical field of unmanned aerial vehicle monitoring. It is through surveying the quick positioning danger source of unmanned aerial vehicle and assay out danger area, rescue area and safe region to set up and build the picture and keep away the artifical potential field algorithm behind the barrier module and the supplementary potential field of introduction, generate best three-dimensional emergency rescue route, reduced unmanned aerial vehicle's unnecessary and lost, help improving rescue personnel's search and rescue efficiency simultaneously, thereby can prevent to cause personnel to be meaningless casualties when rescue personnel clear away the danger source.

Description

Emergency management monitoring method based on three-dimensional model
Technical Field
The invention relates to an emergency management monitoring method based on a three-dimensional model, and belongs to the technical field of unmanned aerial vehicle monitoring.
Background
The pilotless plane is called unmanned plane for short, and is a pilotless plane controlled by radio remote control equipment and a self-contained program control device.
Various danger sources are piled in a chemical plant, the case of explosion of the chemical plant happens frequently, and the situation that the internal situation of the chemical plant cannot be understood usually causes the meaningless casualties of personnel and the heavy loss of trapped personnel and property when rescue workers remove the danger sources. Unmanned aerial vehicle installs equipment such as autopilot, program control device, has replaced personnel to get into the disaster scene, knows the inside condition, provides important information support for seeking help. However, the existing unmanned aerial vehicle is not positioned timely, has low accuracy, is damaged in emergency rescue at a disaster site, and cannot play an important role in the emergency rescue.
Disclosure of Invention
In order to overcome the defects of the prior art, the invention provides an emergency management monitoring method based on a three-dimensional model, so that a danger source is quickly positioned, a rescue route is generated, and meanwhile, unnecessary breakage of an unmanned aerial vehicle is reduced.
The technical scheme of the invention is as follows:
the invention provides an emergency management monitoring method based on a three-dimensional model, which specifically comprises the following steps:
step S1: preparing an emergency management monitoring system, wherein the emergency management monitoring system comprises a control console and a detection unmanned aerial vehicle, the detection unmanned aerial vehicle is provided with a central control module, a charging module, a navigation map building and obstacle avoiding module, a wireless transmission module, a gas sensor and an infrared camera, and the infrared camera, the gas sensor, the navigation map building and obstacle avoiding module, the wireless transmission module and the charging module are respectively and electrically connected with the central control module;
the navigation map building and obstacle avoiding module detects obstacles appearing on a disaster site, when an infrared camera scans an object obstructing a cruising route, the object is marked as the obstacle, and obstacle avoiding processing is carried out at the first time;
the central control module comprises an analysis unit, a storage unit and a transmission unit, wherein the analysis unit uses the temperature T1 measured by the infrared camera, the concentration w1 measured by the gas sensor, and the temperature threshold T0 and the gas concentration threshold w0 stored by the storage unit as input information of the console, judges whether the site belongs to a dangerous area, a rescue area or a slight dangerous area, and transmits the judgment result to the transmission unit, the transmission unit is connected with the wireless transmission module in a wired manner, and the input video information of the infrared camera and the judgment result output by the central control module are transmitted to the wireless transmission module;
the detection unmanned aerial vehicle is in information communication with the console through the wireless transmission module;
step S2: the control console comprises a three-dimensional live-action modeling software management layer and a three-dimensional live-action modeling software engine layer, a model building task is carried out, the building task comprises aerial triangulation and model three-dimensional reconstruction, the aerial triangulation is in stereo photogrammetry, a group of digital photos shot from different angles to a target chemical plant are input into the three-dimensional live-action modeling software management layer as input data sources, auxiliary data are input simultaneously, the auxiliary data comprise the attribute of a camera, the position of the photo, the angle of a rotating photo, a control point, a dangerous temperature threshold value and a gas concentration threshold value, a small number of field control points in the digital photos are encrypted through the control console indoors, the height and plane positions of the encrypted points are obtained, and the control point 23 is a position required to be reached by traversing the task;
step S3: the three-dimensional live-action modeling software management layer decomposes a construction task into basic operation and submits the basic operation to the three-dimensional live-action modeling software engine layer, the three-dimensional live-action modeling software engine layer processes the basic operation to construct a model, an emergency management monitoring model generated by the three-dimensional live-action modeling software engine layer is fed back to the three-dimensional live-action modeling software management layer, and then the three-dimensional live-action modeling software management layer derives a high-resolution emergency monitoring management model with real texture to complete a visual emergency management monitoring model;
step S4: the detection unmanned aerial vehicle adopts an obstacle avoidance and mapping algorithm to conduct autonomous navigation and obstacle avoidance; the infrared camera and the gas sensor collect information and synchronously transmit the collected information to the analysis unit;
step S5: evaluating the emergency management monitoring model, dividing the emergency management monitoring model into a dangerous area, a rescue area and a slight dangerous area, marking the rescue area and generating a rescue route;
step S6: obtaining an optimal three-dimensional emergency rescue path by introducing an artificial potential field algorithm of the auxiliary potential field of the dangerous area;
step S7: the console demonstrates the source of danger and the optimal rescue route in the building through animation.
Further, in step S4, the obstacle avoidance mapping algorithm is an algorithm that integrates a feature method and a direct method, and three threads are established for real-time tracking of the unmanned aerial vehicle, mapping of the emergency management monitoring system, and closed-loop detection, specifically:
step S41: detecting unmanned aerial vehicle pose initialization: when the unmanned aerial vehicle is detected to be started, taking a first frame image shot by an infrared camera as a key frame, and establishing an initialization map by taking the current three-dimensional coordinate as a base point;
step S42: the detection unmanned aerial vehicle executes real-time tracking and emergency management monitoring system mapping, calculates the corresponding relation between the initial pose shot by the infrared camera and the pixel points by minimizing luminosity errors, optimizes the pose of the infrared camera again by utilizing the reprojection errors of the minimized local map points, and tracks the local map; if the tracking fails, triggering a new tracking period;
the infrared camera shoots a current frame, and if the current frame is different from a previous frame, the current frame is judged as a key frame; if no difference exists, judging the current frame as a non-key frame; in a local mapping thread, ORB characteristics in a current key frame image are extracted and matched, then redundant map points in a current key frame are screened out, new map points are created according to the result of characteristic extraction and matching, and the ORB characteristics are the characteristics based on the combination of characteristic points of an accelerated segmentation test and a binary robust independent basic characteristic descriptor;
and after all key frames are processed, local BA optimization is executed, the poses of the surrounding key frames and the positions of map points are optimized to obtain more accurate positioning and mapping precision, and finally candidate key frames are screened and redundant key frames are removed.
Step S43: detecting an unmanned aerial vehicle to carry out closed-loop detection:
in the closed-loop detection thread, closed-loop detection is executed by retrieving the image recognition database, when a closed loop is detected, the closed-loop period is judged, if the current key frame and the closed-loop key frame do not belong to the same period, the period of the closed-loop key frame and the period of the current key frame are combined into the same period, and finally, global BA optimization is executed by taking all key frame positions and all map point positions in the period as optimization variables, so that an environment map and a camera motion track which are globally consistent are obtained.
Further, well accuse module and navigation are built the picture and are kept away barrier module fixed mounting in the top of surveying unmanned aerial vehicle's frame, the parallel fixed mounting of infrared camera and gas sensor is in the below of surveying unmanned aerial vehicle's frame, the module fixed mounting that charges is in a side of surveying unmanned aerial vehicle's frame.
Furthermore, the charging module comprises a short circuit unit and an overload unit, and the short circuit unit is used for providing short circuit protection for the charging module in the process of charging the detection unmanned aerial vehicle; the overload unit is used for the module of charging to provide overload protection in charging for surveying unmanned aerial vehicle.
Further, still include high temperature resistant protection film, high temperature resistant protection film parcel survey the last well accuse module, the module of charging, the navigation of carrying on of unmanned aerial vehicle and build the picture and keep away barrier module, wireless transmission module, gas sensor, infrared camera, only expose gas sensor's air vent, infrared camera's lens hole and the mouth that charges of the module of charging.
Further, the gas sensor includes a carbon monoxide sensor.
Further, the control points are areas for storing dangerous goods, areas for storing valuable goods, areas for storing important data and areas with a large crowd gathering.
Further, the control point includes a disaster site entrance and a disaster site exit.
Further, the console is a computer or a tablet computer.
Further, in step S6, the artificial potential field algorithm for the auxiliary potential field in the hazardous area refers to a potential field in which three forces exist at the disaster site: detecting a gravitational potential field of the unmanned aerial vehicle pointing to a rescue area, a repulsive potential field of a dangerous area and an auxiliary potential field of the dangerous area, wherein the gravitational potential field is reduced along with the reduction of the distance between the rescue area and the unmanned aerial vehicle; the repulsion force of the dangerous area pointing to the detecting unmanned aerial vehicle is increased along with the reduction of the distance between the detecting unmanned aerial vehicle and the dangerous area; the auxiliary potential field of the danger area is related to the speed of the danger area and the relative angle between the detection unmanned aerial vehicle and the danger area, the attraction potential field of the rescue area, the repulsion potential field of the danger area and the auxiliary potential field of the danger area are combined, the movement of the detection unmanned aerial vehicle is controlled by the superposed resultant force of the three potential fields of the attraction field, the repulsion field and the auxiliary potential field of the danger area, so that the danger area is avoided, and path planning is completed, specifically:
the function of the gravitational potential field of the rescue area is
Figure 98141DEST_PATH_IMAGE001
Wherein, the first and the second end of the pipe are connected with each other,
Figure 648202DEST_PATH_IMAGE002
is gravitational potential energy;
Figure 30641DEST_PATH_IMAGE003
is a gravity gain factor;
Figure 663748DEST_PATH_IMAGE004
detecting the Euclidean distance between the unmanned aerial vehicle and a dangerous area;
the repulsive potential field of the danger zone and the speed of the danger zone
Figure 449914DEST_PATH_IMAGE005
Function of (2)
Figure 849671DEST_PATH_IMAGE006
Figure 696405DEST_PATH_IMAGE007
The danger zone repulsive potential field function is:
Figure 844620DEST_PATH_IMAGE008
wherein the content of the first and second substances,
Figure 167017DEST_PATH_IMAGE009
the parameters are adjusted for the danger zone repulsive potential field gain,
Figure 58881DEST_PATH_IMAGE010
is the distance of the robot from the hazardous area,
Figure 773503DEST_PATH_IMAGE011
the influence range of the repulsive potential field of the danger area is defined;
and finally, constructing the auxiliary potential field function of the dangerous area as follows:
Figure 341887DEST_PATH_IMAGE012
wherein, the first and the second end of the pipe are connected with each other,
Figure 371154DEST_PATH_IMAGE013
it is an auxiliary potential field random gain adjustment function;
Figure 315977DEST_PATH_IMAGE014
is gain adjustment coefficient of 0 ≦
Figure 278248DEST_PATH_IMAGE015
1 or less is a random number;
Figure 751954DEST_PATH_IMAGE016
for the potential field to convert the angle matrix,
Figure 924310DEST_PATH_IMAGE017
the rotation angle is related to the relative angle between the unmanned aerial vehicle and the dangerous area and the speed of the dangerous area;
thus detecting the resultant force experienced by the drone
Figure 157976DEST_PATH_IMAGE018
The following:
Figure 958442DEST_PATH_IMAGE019
detecting resultant force borne by the unmanned aerial vehicle
Figure 806312DEST_PATH_IMAGE018
Gravity potential field from rescue area
Figure 565100DEST_PATH_IMAGE002
And repulsive force potential field of dangerous area
Figure 851725DEST_PATH_IMAGE020
And auxiliary potential field of dangerous area
Figure 319746DEST_PATH_IMAGE021
The direction of the negative gradient of the resultant potential field of the composition is calculated.
Advantageous effects
According to the emergency management monitoring method based on the three-dimensional model, disclosed by the invention, the unmanned aerial vehicle is detected to quickly position the hazard source, the danger area, the rescue area and the safe area are analyzed, the navigation map building and obstacle avoiding module is arranged, and the artificial potential field algorithm after the auxiliary potential field is introduced is arranged, so that the optimal three-dimensional emergency rescue path is generated, the unnecessary breakage of the unmanned aerial vehicle is reduced, the search and rescue efficiency of rescuers is improved, and the condition that the rescuers do not have casualties when the hazard source is removed can be prevented.
Drawings
FIG. 1 is a schematic flow chart of an emergency management monitoring method based on a three-dimensional model according to the present invention;
FIG. 2 is a schematic diagram of the operation of the emergency management monitoring system based on the three-dimensional model according to the present invention;
FIG. 3 is a structural diagram of a reconnaissance unmanned aerial vehicle for emergency management monitoring based on a three-dimensional model according to the present invention;
fig. 4 is a structural diagram of an obstacle avoidance and mapping algorithm system for detecting an unmanned aerial vehicle, which integrates a feature method and a direct method;
FIG. 5 is a flow chart of an obstacle avoidance and mapping algorithm for detecting an unmanned aerial vehicle, which combines a feature method and a direct method;
FIG. 6 is a flow chart of an artificial potential field algorithm after introduction of an auxiliary potential field;
wherein, survey unmanned aerial vehicle 10
Central control module 11
Navigation map building and obstacle avoidance module 13
Gas sensor 15
Infrared camera 17
Wireless transmission module 18
Disaster site portal 22
Control point 23
Obstacle 24
A disaster site exit 28.
Detailed Description
The present application will be described in further detail with reference to the drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the relevant invention and not restrictive of the invention. It should be noted that, for convenience of description, only the portions related to the related invention are shown in the drawings.
It should be noted that, in the present application, the embodiments and features of the embodiments may be combined with each other without conflict. The present application will be described in detail below with reference to the accompanying drawings in conjunction with embodiments.
The invention relates to an emergency management monitoring method based on a three-dimensional model, which specifically comprises the following steps as shown in figure 1:
step S1: prepare emergency management monitoring system, as shown in fig. 3, emergency management monitoring system includes the control cabinet and surveys unmanned aerial vehicle 10, surveys unmanned aerial vehicle 10 and is the little miniature unmanned vehicles of many rotor formulas, indicates with four rotor unmanned vehicles in fig. 3.
Survey unmanned aerial vehicle 10 and go up through frame carry-on central control module 11, the module of charging 19 and the navigation is built the picture and is kept away barrier module 13, wireless transmission module 18, gas sensor 15, infrared camera 17. The frame is the metal frame and the support plate of surveying on the unmanned aerial vehicle 10 for fixed small-size equipment or spare part. Central control module 11 and navigation are built the picture and are kept away barrier module 13 fixed mounting and be in the top of surveying the frame of unmanned aerial vehicle 10, infrared camera 17 and gas sensor 15 parallel fixed mounting are in the below of surveying the frame of unmanned aerial vehicle 10, and infrared camera 17 is used for detecting temperature and on-the-spot condition, surveys on-the-spot real-time temperature T1 and video information.
The charging module 19 is fixedly installed on one side of the frame of the unmanned aerial vehicle 10. The gas sensor 15 is generally a carbon monoxide sensor, but it is needless to say that a gas sensor for detecting sulfur, nitrogen, or the like may be used as the actual condition to measure the gas concentration w 1.
The infrared camera 17, the gas sensor 15, the navigation map building obstacle avoidance module 13, the wireless transmission module 18 and the charging module 19 are electrically connected with the central control module 11 respectively. The charging module comprises a short circuit unit and an overload unit, and the short circuit unit is used for providing short circuit protection for the charging module 19 in the process of charging the unmanned aerial vehicle 10; the overload unit is used for the charging module 19 to provide overload protection in charging the detecting drone 10.
Adopt high temperature resistant protection film parcel survey central control module 11, the module of charging 19, the navigation of carrying on unmanned aerial vehicle 10 and build the picture and keep away barrier module 13, wireless transmission module 18, gas sensor 15, infrared camera 17, only expose gas sensor 15's air vent, infrared camera 17's lens hole and the mouth that charges of the module of charging 19, not shown in fig. 3. Generally, the high-temperature resistant protective film adopts alumina fiber which is polycrystal inorganic fiber with the main component of alumina, is white, smooth, soft and elastic, is like absorbent cotton, integrates the characteristics of crystal materials and fiber materials, has the service temperature of 1450-1600 ℃, the melting point of 1840 ℃, better heat-resistant stability, the heat conductivity of 1/6 which is common refractory brick, the volume weight of 1/25 and the energy-saving rate of 15-45 percent. The high-temperature-resistant protective film wraps the central control module 11, the charging module 19, the navigation map building and obstacle avoiding module 13, the wireless transmission module 18, the gas sensor 15 and the infrared camera 17 which are carried on the unmanned detection vehicle 10, and only exposes the vent hole of the gas sensor 15, the lens hole of the infrared camera 17 and the charging port of the charging module 19.
The navigation, map building and obstacle avoidance module 13 detects an obstacle 24 appearing in a disaster site, when the infrared camera 17 scans an object on a route obstructing the cruising, the object is marked as the obstacle 24, and obstacle avoidance processing is performed at the first time, so that the effect of detecting the traversing danger source of the unmanned aerial vehicle 10 can be improved, and the speed of traversing the danger source is improved.
The central control module 11 comprises an analysis unit, a storage unit and a transmission unit, wherein the analysis unit uses the field real-time temperature T1 measured by the infrared camera 17, the concentration w1 measured by the gas sensor 15 and the temperature threshold T and the gas concentration threshold w0 stored in the storage unit as input information of a console to judge whether the field belongs to a dangerous area, a rescue area or a slight dangerous area, and transmits the judgment result to the transmission unit, the transmission unit is in wired connection with the wireless transmission module 18, inputs the video information of the infrared camera 17 and the judgment result output by the central control module 11, and transmits the video information and the judgment result to the wireless transmission module 18;
the detection unmanned aerial vehicle 10 is in information communication with the console through the wireless transmission module 18;
step S2: the control console is an intelligent electronic product such as a computer or a tablet personal computer and the like, smart 3d software is installed on the control console, the software comprises a three-dimensional live-action modeling software management layer and a three-dimensional live-action modeling software engine layer, a model building task is carried out, the building task comprises aerial triangulation and model three-dimensional reconstruction, the aerial triangulation is in stereo photogrammetry, a group of digital photos taken from different angles of a target chemical plant are input into the three-dimensional live-action modeling software management layer as input data sources, and auxiliary data are input simultaneously, the auxiliary data comprise the attribute of a camera, the position of the photo, the angle of a rotating photo, a control point 23, a dangerous temperature threshold value and a gas concentration threshold value, a small number of field control points in the digital photos are encrypted through the control console indoors, and the measurement method of the elevation and the plane position of an encryption point is obtained, the control point 23 is a position to which the traversal task needs to reach, such as an area for storing dangerous goods, an area for storing valuable goods, an area for storing important data, an area with a large crowd gathering, and the like. Control point 23 also includes disaster site entry 22 and disaster site exit 28, as shown in fig. 2.
Step S3: the three-dimensional live-action modeling software management layer decomposes a construction task into basic operation and submits the basic operation to a three-dimensional live-action modeling software engine layer, the three-dimensional live-action modeling software engine layer processes the basic operation to construct a model, an emergency management monitoring model generated by the three-dimensional live-action modeling software engine layer is fed back to the three-dimensional live-action modeling software management layer, and then the three-dimensional live-action modeling software management layer derives a high-resolution emergency monitoring management model with real texture to complete a visual emergency management monitoring model;
step S4: the unmanned detection vehicle 10 performs autonomous navigation and obstacle avoidance by adopting an obstacle avoidance and mapping algorithm; the infrared camera 17 and the gas sensor 15 collect information and synchronously transmit the collected information to the analysis unit; the flying height of the detection unmanned aerial vehicle 10 is set to be 2-3m, the safe flying temperature is 400 ℃, when the temperature of the dangerous source is higher than 400 ℃, the detection unmanned aerial vehicle 10 transfers the flying to the next dangerous source, so that the detection unmanned aerial vehicle 10 can be protected, and on the other hand, because the dangerous source is not necessary for rescue, the time can be saved for protecting the next dangerous source, and the protection efficiency is improved. The obstacle avoidance mapping algorithm is an algorithm integrating a feature method and a direct method, three threads are established, and the three threads are respectively used for detecting real-time tracking of the unmanned aerial vehicle 10, mapping of an emergency management monitoring system and closed-loop detection, and as shown in fig. 5, the method specifically comprises the following steps:
step S41: and (3) detecting initialization of the pose of the unmanned aerial vehicle 10: when the unmanned aerial vehicle 10 is detected to be started, taking a first frame image shot by the infrared camera 17 as a key frame, and taking the current three-dimensional coordinate as a base point to create an initialization map;
step S42: the detection unmanned aerial vehicle 10 executes real-time tracking and emergency management monitoring system mapping, the detection unmanned aerial vehicle 10 calculates the corresponding relation between the initial pose shot by the infrared camera 17 and the pixel points by minimizing photometric errors, and then optimizes the pose of the infrared camera 17 again by utilizing the reprojection errors of the minimized local map points to track the local map; if the tracking fails, triggering a new tracking period;
as shown in fig. 4, a current frame is shot by an infrared camera 17, and if the current frame is different from a previous frame, the current frame is determined as a key frame; if no difference exists, judging the current frame as a non-key frame; in a local mapping thread, ORB features in a current key frame image are extracted and matched, then redundant map points in a current key frame are screened out, new map points are created according to the results of feature extraction and matching, and the ORB features are features based on combination of feature points of an accelerated segmentation test and a binary robust independent basic feature descriptor.
And after all key frames are processed, local BA optimization is executed, the poses of the surrounding key frames and the positions of map points are optimized to obtain more accurate positioning and mapping precision, and finally candidate key frames are screened and redundant key frames are removed.
Step S43: detecting the unmanned aerial vehicle 10 for closed loop detection:
in the closed-loop detection thread, closed-loop detection is executed by retrieving an image recognition database, when a closed loop is detected, the closed-loop period is judged, if the current key frame and the closed-loop key frame do not belong to the same period, the period of the closed-loop key frame and the period of the current key frame are combined into the same period, and finally, global BA optimization is executed by taking the positions of all key frame positions and all map points in the period as optimization variables, so that a globally consistent environment map and camera motion track are obtained.
Step S5: and evaluating the emergency management monitoring model, dividing the emergency management monitoring model into a dangerous area, a rescue area and a slight dangerous area, marking the rescue area and generating a rescue route.
Step S6: and generating an optimal three-dimensional emergency rescue path by introducing an artificial potential field algorithm of the auxiliary potential field of the dangerous area.
The artificial potential field algorithm of the auxiliary potential field in the dangerous area refers to a potential field with three forces existing in a disaster field: detecting an attractive force potential field of the unmanned aerial vehicle 10 pointing to a rescue area, a repulsive force potential field of a dangerous area and a dangerous area auxiliary potential field, wherein the attractive force potential field is reduced along with the reduction of the distance between the rescue area and the unmanned aerial vehicle 10; the repulsive force of the dangerous area directed to the detecting unmanned aerial vehicle 10 increases with the decrease of the distance between the detecting unmanned aerial vehicle 10 and the dangerous area; the auxiliary potential field of the dangerous area is related to the speed of the dangerous area and the relative angle between the unmanned aerial vehicle 10 and the dangerous area, the attraction potential field of the rescue area, the repulsion potential field of the dangerous area and the auxiliary potential field of the dangerous area are combined, the movement of the unmanned aerial vehicle 10 is detected and controlled by the superposed resultant force of the three potential fields of the attraction field, the repulsion field and the auxiliary potential field of the dangerous area, so that the dangerous area is avoided, and path planning is completed, as shown in fig. 6, specifically:
the function of the gravitational potential field of the rescue area is
Figure 338518DEST_PATH_IMAGE022
Wherein, the first and the second end of the pipe are connected with each other,
Figure 32935DEST_PATH_IMAGE002
is gravitational potential energy;
Figure 919989DEST_PATH_IMAGE003
is a gravity gain factor;
Figure 649042DEST_PATH_IMAGE004
detecting the Euclidean distance between the unmanned aerial vehicle and a dangerous area;
the potential field of repulsive force of the dangerous area, the speed of the dangerous area
Figure 573135DEST_PATH_IMAGE005
Function of (2)
Figure 955182DEST_PATH_IMAGE006
Figure 334342DEST_PATH_IMAGE023
The danger zone repulsive potential field function is:
Figure 167168DEST_PATH_IMAGE024
wherein the content of the first and second substances,
Figure 603441DEST_PATH_IMAGE009
parameters are adjusted for the repulsive potential field gain of the danger zone,
Figure 459402DEST_PATH_IMAGE010
the distance of the robot from the hazardous area,
Figure 625941DEST_PATH_IMAGE011
the influence range of the repulsive potential field of the danger area is defined;
and finally, constructing the auxiliary potential field function of the dangerous area as follows:
Figure 126324DEST_PATH_IMAGE025
wherein, the first and the second end of the pipe are connected with each other,
Figure 985695DEST_PATH_IMAGE013
it is an auxiliary potential field random gain adjustment function;
Figure 63373DEST_PATH_IMAGE014
is gain adjustment coefficient of 0 ≦
Figure 377810DEST_PATH_IMAGE015
A random number is not less than 1;
Figure 122913DEST_PATH_IMAGE016
is a matrix of potential field-switching angles,
Figure 903918DEST_PATH_IMAGE017
the rotation angle is related to the relative angle between the unmanned aerial vehicle and the dangerous area and the speed of the dangerous area;
thus detecting the resultant force experienced by the drone 10
Figure 62367DEST_PATH_IMAGE018
The following were used:
Figure 115249DEST_PATH_IMAGE026
detecting resultant force applied to the unmanned aerial vehicle 10
Figure 42754DEST_PATH_IMAGE018
Gravity potential field from rescue area
Figure 650452DEST_PATH_IMAGE002
And repulsive force potential field of dangerous area
Figure 279886DEST_PATH_IMAGE020
And auxiliary potential field of dangerous area
Figure 654235DEST_PATH_IMAGE021
The direction of the negative gradient of the resultant potential field of the composition is calculated.
Step S7: and (4) demonstrating danger sources and optimal rescue routes in the building through the control console animation.
The danger source in the building and the generated optimal rescue route are demonstrated to the rescuers through the control console animation formed by other intelligent electronic products such as a computer or a tablet personal computer, the search and rescue efficiency of the rescuers is improved, and therefore the situation that the rescuers do not have casualties when clearing the danger source is avoided.
The above description is only a preferred embodiment of the present invention, but the scope of the present invention is not limited thereto, and any changes or substitutions that can be easily conceived by those skilled in the art within the technical scope of the embodiments of the present invention are included in the scope of the present invention. Therefore, the protection scope of the present invention should be subject to the protection scope of the claims.

Claims (9)

1. An emergency management monitoring method based on a three-dimensional model is characterized in that: the method specifically comprises the following steps:
step S1: preparing an emergency management monitoring system, wherein the emergency management monitoring system comprises a control console and a detection unmanned aerial vehicle (10), a central control module (11), a charging module (19), a navigation map building and obstacle avoiding module (13), a wireless transmission module (18), a gas sensor (15) and an infrared camera (17) are carried on the detection unmanned aerial vehicle (10), and the infrared camera (17), the gas sensor (15), the navigation map building and obstacle avoiding module (13), the wireless transmission module (18) and the charging module (19) are respectively and electrically connected with the central control module (11);
the navigation map building and obstacle avoiding module (13) detects obstacles (24) appearing in a disaster site, when an infrared camera (17) scans an object obstructing a cruising route, the object is marked as the obstacles (24), and obstacle avoiding processing is carried out at the first time;
the central control module (11) comprises an analysis unit, a storage unit and a transmission unit, wherein the analysis unit uses the temperature T1 measured by the infrared camera (17), the concentration w1 measured by the gas sensor (15), the temperature threshold T0 and the gas concentration threshold w0 stored in the storage unit as input information of a console to judge whether the site belongs to a dangerous area, a rescue area or a slight dangerous area, and transmits the judgment result to the transmission unit, the transmission unit is in wired connection with the wireless transmission module (18), inputs video information of the infrared camera (17) and the judgment result output by the central control module (11), and transmits the judgment result to the wireless transmission module (18);
the detection unmanned aerial vehicle (10) is in information communication with the control console through the wireless transmission module (18);
step S2: the console comprises a three-dimensional live-action modeling software management layer and a three-dimensional live-action modeling software engine layer for constructing a model, the construction task comprises aerial triangulation and model three-dimensional reconstruction, the aerial triangulation is in stereo photogrammetry, inputting a group of digital photos of a target chemical plant taken from different angles as input data sources in the three-dimensional live-action modeling software management layer, simultaneously inputting auxiliary data, wherein the auxiliary data comprises the attribute of a camera, the position of a photo, the angle of rotating the photo, a control point (23), a dangerous temperature threshold value and a gas concentration threshold value, and inputting a small number of field control points in the digital photo, encrypting control points indoors through a control console to obtain a measuring method of the elevation and the plane position of the encrypted points, wherein the control points (23) are positions required to be reached by traversing tasks;
step S3: the three-dimensional live-action modeling software management layer decomposes the set-up task into basic operation and submits the basic operation to a three-dimensional live-action modeling software engine layer, the three-dimensional live-action modeling software engine layer processes the basic operation to carry out three-dimensional reconstruction of a model, an emergency management monitoring model generated by the three-dimensional live-action modeling software engine layer is fed back to the three-dimensional live-action modeling software management layer, and then the three-dimensional live-action modeling software management layer derives a high-resolution emergency monitoring management model with real texture to complete a visual emergency management monitoring model;
step S4: the detection unmanned aerial vehicle (10) adopts an obstacle avoidance and mapping algorithm to conduct autonomous navigation and obstacle avoidance; the infrared camera (17) and the gas sensor (15) collect information and synchronously transmit the collected information to the analysis unit;
step S5: evaluating the emergency management monitoring model, dividing the emergency management monitoring model into a dangerous area, a rescue area and a slight dangerous area, marking the rescue area and generating a rescue route;
step S6: obtaining an optimal three-dimensional emergency rescue path by introducing an artificial potential field algorithm of the auxiliary potential field of the dangerous area; the artificial potential field algorithm of the auxiliary potential field in the dangerous area refers to a potential field with three forces existing in a disaster field: the method comprises the following steps that a gravitational potential field of a detection unmanned aerial vehicle (10) pointing to a rescue area, a repulsive potential field of a dangerous area and an auxiliary potential field of the dangerous area are detected, wherein the gravitational potential field is reduced along with the reduction of the distance between the rescue area and the detection unmanned aerial vehicle (10); the repulsive force of the dangerous area pointing to the detecting unmanned aerial vehicle (10) is increased along with the reduction of the distance between the detecting unmanned aerial vehicle (10) and the dangerous area; the speed of the supplementary potential field of danger area and survey unmanned aerial vehicle (10) and danger area are relevant, and the supplementary potential field of regional gravitation of rescue, danger area repulsion potential field and danger area merge, and the motion of surveying unmanned aerial vehicle (10) is controlled by the superimposed resultant force in three potential places of the supplementary potential field of gravitation field, repulsion field and danger area to avoid the danger area, accomplish the route planning, specifically do:
the function of the gravitational potential field of the rescue area is
Figure 760625DEST_PATH_IMAGE002
Wherein, the first and the second end of the pipe are connected with each other,
Figure DEST_PATH_IMAGE003
is gravitational potential energy;
Figure 280468DEST_PATH_IMAGE004
is a gravity gain factor;
Figure DEST_PATH_IMAGE005
detecting the Euclidean distance between the unmanned aerial vehicle and a dangerous area;
the repulsive potential field of the danger zone and the speed of the danger zone
Figure 953895DEST_PATH_IMAGE006
Function of (2)
Figure DEST_PATH_IMAGE007
Figure DEST_PATH_IMAGE009
The danger zone repulsive potential field function is:
Figure DEST_PATH_IMAGE011
wherein the content of the first and second substances,
Figure 500326DEST_PATH_IMAGE012
parameters are adjusted for the repulsive potential field gain of the danger zone,
Figure DEST_PATH_IMAGE013
is the distance of the robot from the hazardous area,
Figure 501780DEST_PATH_IMAGE014
the influence range of the repulsive potential field of the danger area is defined;
and finally, constructing the auxiliary potential field function of the dangerous area as follows:
Figure 887631DEST_PATH_IMAGE016
wherein the content of the first and second substances,
Figure DEST_PATH_IMAGE017
it is an auxiliary potential field random gain adjustment function;
Figure 274619DEST_PATH_IMAGE018
is gain adjustment coefficient, 0 ≦
Figure DEST_PATH_IMAGE019
A random number is not less than 1;
Figure 736824DEST_PATH_IMAGE020
is a matrix of potential field-switching angles,
Figure DEST_PATH_IMAGE021
the rotation angle is related to the relative angle between the unmanned aerial vehicle and the dangerous area and the speed of the dangerous area;
thus detecting the resultant force experienced by the drone 10
Figure 819050DEST_PATH_IMAGE022
The following:
Figure 352799DEST_PATH_IMAGE024
detecting resultant force applied to the unmanned aerial vehicle 10
Figure 797556DEST_PATH_IMAGE022
Gravity potential field of rescue area
Figure 899504DEST_PATH_IMAGE003
And repulsive force potential field of dangerous area
Figure DEST_PATH_IMAGE025
And auxiliary potential field of dangerous area
Figure 593659DEST_PATH_IMAGE026
Calculating the direction of the negative gradient of the formed potential field;
step S7: the console demonstrates the source of danger and the optimal rescue route in the building through animation.
2. The three-dimensional model-based emergency management monitoring method according to claim 1, wherein in step S4, the obstacle avoidance and mapping algorithm is a feature method and direct method fused algorithm, and three threads are established for real-time tracking of the detecting unmanned aerial vehicle (10), mapping of the emergency management monitoring system, and closed-loop detection, specifically:
step S41: and (2) detecting the pose initialization of the unmanned aerial vehicle (10): when the unmanned aerial vehicle (10) is detected to be started, a first frame image shot by the infrared camera (17) is used as a key frame, and an initialization map is created by taking the current three-dimensional coordinate as a base point;
step S42: the detection unmanned aerial vehicle (10) executes real-time tracking and emergency management monitoring system mapping, the detection unmanned aerial vehicle (10) calculates the corresponding relation between the initial pose shot by the infrared camera (17) and the pixel points by minimizing luminosity errors, and then optimizes the pose of the infrared camera (17) again by utilizing the reprojection errors of the minimized local map points to track the local map; if the tracking fails, triggering a new tracking period;
the infrared camera (17) shoots a current frame, and if the current frame is different from a previous frame, the current frame is judged as a key frame; if no difference exists, judging the current frame as a non-key frame; in a local mapping thread, extracting and matching ORB features in a current key frame image, screening redundant map points in a current key frame, and creating new map points according to the result of feature extraction and matching, wherein the ORB features are features based on accelerated segmentation test and combined with a binary robust independent basic feature descriptor;
after all key frames are processed, local BA optimization is executed, the poses of the surrounding key frames and the positions of map points are optimized so as to obtain more accurate positioning and mapping accuracy, and finally candidate key frames are screened out and redundant key frames are removed;
step S43: detecting the unmanned aerial vehicle (10) to carry out closed-loop detection:
in the closed-loop detection thread, closed-loop detection is executed by retrieving an image recognition database, when a closed loop is detected, the closed-loop period is judged, if the current key frame and the closed-loop key frame do not belong to the same period, the period of the closed-loop key frame and the period of the current key frame are combined into the same period, and finally, global BA optimization is executed by taking the positions of all key frame positions and all map points in the period as optimization variables, so that a globally consistent environment map and camera motion track are obtained.
3. The three-dimensional model-based emergency management monitoring method according to claim 1, wherein the central control module (11) and the navigation map building and obstacle avoidance module (13) are fixedly installed above the frame of the detecting unmanned aerial vehicle (10), the infrared camera (17) and the gas sensor (15) are fixedly installed below the frame of the detecting unmanned aerial vehicle (10) in parallel, and the charging module (19) is fixedly installed on one side of the frame of the detecting unmanned aerial vehicle (10).
4. The three-dimensional model-based emergency management monitoring method according to claim 1, wherein the charging module comprises a short circuit unit and an overload unit, and the short circuit unit is used for providing short circuit protection for the charging module (19) in charging the detection unmanned aerial vehicle (10); the overload unit is used for the charging module (19) to provide overload protection in charging for the detection unmanned aerial vehicle (10).
5. The three-dimensional model-based emergency management and monitoring method according to claim 1, further comprising a high temperature resistant protective film, wherein the high temperature resistant protective film wraps the central control module (11), the charging module (19), the navigation map building and obstacle avoiding module (13), the wireless transmission module (18), the gas sensor (15) and the infrared camera (17) which are carried on the detection unmanned aerial vehicle (10), and only exposes the vent hole of the gas sensor (15), the lens hole of the infrared camera (17) and the charging port of the charging module (19).
6. The three-dimensional model-based emergency management monitoring method according to claim 1, wherein the gas sensor (15) comprises a carbon monoxide sensor.
7. The three-dimensional model-based emergency management monitoring method according to claim 1, wherein the control points (23) are areas for storing dangerous goods, areas for storing valuable goods, areas for storing important data, and areas where a large crowd is gathered.
8. The three-dimensional model-based emergency management monitoring method according to claim 1, wherein the control point (23) comprises a disaster site entrance (22) and a disaster site exit (28).
9. The three-dimensional model-based emergency management monitoring method according to claim 1, wherein the console is a computer or a tablet computer.
CN202210414037.3A 2022-04-20 2022-04-20 Emergency management monitoring method based on three-dimensional model Active CN114519472B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210414037.3A CN114519472B (en) 2022-04-20 2022-04-20 Emergency management monitoring method based on three-dimensional model

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210414037.3A CN114519472B (en) 2022-04-20 2022-04-20 Emergency management monitoring method based on three-dimensional model

Publications (2)

Publication Number Publication Date
CN114519472A CN114519472A (en) 2022-05-20
CN114519472B true CN114519472B (en) 2022-07-22

Family

ID=81600340

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210414037.3A Active CN114519472B (en) 2022-04-20 2022-04-20 Emergency management monitoring method based on three-dimensional model

Country Status (1)

Country Link
CN (1) CN114519472B (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115035081B (en) * 2022-06-23 2024-03-01 西安交通大学 Industrial CT-based metal internal defect dangerous source positioning method and system
CN115752497A (en) * 2022-11-15 2023-03-07 中国科学院空天信息创新研究院 Forest fire rescue system based on fusion of video and three-dimensional real-scene technology
CN116972780B (en) * 2023-09-25 2024-01-26 北京锐达仪表有限公司 Three-dimensional scanning device with object table gas distribution measurement or object table temperature and gas distribution measurement function

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111583136A (en) * 2020-04-25 2020-08-25 华南理工大学 Method for simultaneously positioning and establishing image of autonomous mobile platform in rescue scene

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109238239B (en) * 2018-09-12 2021-04-06 成都坤舆空间科技有限公司 Digital measurement three-dimensional modeling method based on aerial photography
CN111462207A (en) * 2020-03-30 2020-07-28 重庆邮电大学 RGB-D simultaneous positioning and map creation method integrating direct method and feature method
CN111760228B (en) * 2020-07-13 2021-09-21 北京优锘科技有限公司 Intelligent deduction system and method for fire fighting and fire fighting rescue
CN112327914B (en) * 2020-10-30 2023-08-22 广东工业大学 Indoor collaborative path planning method and system for high-rise fire-fighting multiple unmanned aerial vehicles
CN113655810B (en) * 2021-08-20 2024-04-16 上海微电机研究所(中国电子科技集团公司第二十一研究所) Unmanned aerial vehicle obstacle avoidance method and system based on speed potential field
CN114020000A (en) * 2021-12-16 2022-02-08 辽宁工程技术大学 Unmanned aerial vehicle control system for hidden fire inspection of coal mine surface

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111583136A (en) * 2020-04-25 2020-08-25 华南理工大学 Method for simultaneously positioning and establishing image of autonomous mobile platform in rescue scene

Also Published As

Publication number Publication date
CN114519472A (en) 2022-05-20

Similar Documents

Publication Publication Date Title
CN114519472B (en) Emergency management monitoring method based on three-dimensional model
CN110446159B (en) System and method for accurate positioning and autonomous navigation of indoor unmanned aerial vehicle
CN106056075A (en) Important person identification and tracking system in community meshing based on unmanned aerial vehicle
US11415986B2 (en) Geocoding data for an automated vehicle
KR102203135B1 (en) Method and system for detecting disaster damage information based on artificial intelligence using drone
CN111595334B (en) Indoor autonomous positioning method based on tight coupling of visual point-line characteristics and IMU (inertial measurement Unit)
CN102190081B (en) Vision-based fixed point robust control method for airship
US11726501B2 (en) System and method for perceptive navigation of automated vehicles
CN111735445A (en) Monocular vision and IMU (inertial measurement Unit) integrated coal mine tunnel inspection robot system and navigation method
JP2015037937A (en) Flight vehicle flight control system
CN109035665A (en) A kind of novel forest fire early-warning system and fire alarm method
Cui et al. Search and rescue using multiple drones in post-disaster situation
Mansouri et al. Vision-based mav navigation in underground mine using convolutional neural network
Grehl et al. Mining-rox–mobile robots in underground mining
CN110162098A (en) A kind of mining unmanned plane
Azhari et al. A comparison of sensors for underground void mapping by unmanned aerial vehicles
Xiang et al. UAV based target tracking and recognition
CN116007609A (en) Positioning method and computing system for fusion of multispectral image and inertial navigation
CN114371725A (en) System suitable for automatic inspection of wind turbine generator
JP2005322002A (en) Compound artificial intelligence device
US11947354B2 (en) Geocoding data for an automated vehicle
Tsai et al. The development of a direct georeferencing ready UAV based photogrammetry platform
CN109702747A (en) A kind of robot dog system and its implementation
Kim et al. A study on generation of 3D model and mesh image of excavation work using UAV
CN114581603A (en) Unmanned aerial vehicle modeling method and device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
EE01 Entry into force of recordation of patent licensing contract

Application publication date: 20220520

Assignee: ZHEJIANG YIDE CULTURAL CREATIVE Co.,Ltd.

Assignor: Nanjing University of Information Science and Technology

Contract record no.: X2022980023735

Denomination of invention: A monitoring method of emergency management based on 3d model

Granted publication date: 20220722

License type: Common License

Record date: 20221130

Application publication date: 20220520

Assignee: Hangzhou Richangjing Industrial Co.,Ltd.

Assignor: Nanjing University of Information Science and Technology

Contract record no.: X2022980023732

Denomination of invention: A monitoring method of emergency management based on 3d model

Granted publication date: 20220722

License type: Common License

Record date: 20221130

EE01 Entry into force of recordation of patent licensing contract