WO2023168186A1 - Gestion de périmètre virtuel par véhicule aérien sans pilote - Google Patents
Gestion de périmètre virtuel par véhicule aérien sans pilote Download PDFInfo
- Publication number
- WO2023168186A1 WO2023168186A1 PCT/US2023/063192 US2023063192W WO2023168186A1 WO 2023168186 A1 WO2023168186 A1 WO 2023168186A1 US 2023063192 W US2023063192 W US 2023063192W WO 2023168186 A1 WO2023168186 A1 WO 2023168186A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- geofence
- uav
- location
- manager
- detected
- Prior art date
Links
- 238000000034 method Methods 0.000 claims abstract description 209
- 230000009471 action Effects 0.000 claims description 92
- 238000004590 computer program Methods 0.000 abstract description 25
- 238000007726 management method Methods 0.000 description 52
- 238000010586 diagram Methods 0.000 description 35
- 238000004891 communication Methods 0.000 description 32
- 238000001514 detection method Methods 0.000 description 27
- 238000012545 processing Methods 0.000 description 24
- 230000003213 activating effect Effects 0.000 description 18
- 238000003909 pattern recognition Methods 0.000 description 17
- 230000006870 function Effects 0.000 description 12
- 230000000007 visual effect Effects 0.000 description 11
- 238000003384 imaging method Methods 0.000 description 10
- 238000001931 thermography Methods 0.000 description 10
- 230000001105 regulatory effect Effects 0.000 description 9
- 241001465754 Metazoa Species 0.000 description 8
- 238000003708 edge detection Methods 0.000 description 8
- 230000009466 transformation Effects 0.000 description 8
- 230000006399 behavior Effects 0.000 description 6
- 238000004422 calculation algorithm Methods 0.000 description 6
- 230000000670 limiting effect Effects 0.000 description 6
- 230000003287 optical effect Effects 0.000 description 6
- 230000004044 response Effects 0.000 description 6
- RZVHIXYEVGDQDX-UHFFFAOYSA-N 9,10-anthraquinone Chemical compound C1=CC=C2C(=O)C3=CC=CC=C3C(=O)C2=C1 RZVHIXYEVGDQDX-UHFFFAOYSA-N 0.000 description 5
- 230000005540 biological transmission Effects 0.000 description 5
- 238000012423 maintenance Methods 0.000 description 5
- 241000283690 Bos taurus Species 0.000 description 4
- 238000013528 artificial neural network Methods 0.000 description 4
- 230000008859 change Effects 0.000 description 4
- 238000000605 extraction Methods 0.000 description 4
- 239000007788 liquid Substances 0.000 description 4
- 238000011022 operating instruction Methods 0.000 description 4
- 238000012015 optical character recognition Methods 0.000 description 4
- 239000000126 substance Substances 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 230000037308 hair color Effects 0.000 description 3
- 238000013507 mapping Methods 0.000 description 3
- 238000013439 planning Methods 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 238000012384 transportation and delivery Methods 0.000 description 3
- 239000008186 active pharmaceutical agent Substances 0.000 description 2
- 238000003491 array Methods 0.000 description 2
- 230000001413 cellular effect Effects 0.000 description 2
- 238000011960 computer-aided design Methods 0.000 description 2
- 238000010276 construction Methods 0.000 description 2
- 238000013527 convolutional neural network Methods 0.000 description 2
- 238000013135 deep learning Methods 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 230000001815 facial effect Effects 0.000 description 2
- 238000001914 filtration Methods 0.000 description 2
- 230000005021 gait Effects 0.000 description 2
- 230000033001 locomotion Effects 0.000 description 2
- 238000005259 measurement Methods 0.000 description 2
- 230000001902 propagating effect Effects 0.000 description 2
- 230000002829 reductive effect Effects 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- 239000000779 smoke Substances 0.000 description 2
- 241000894007 species Species 0.000 description 2
- 238000012706 support-vector machine Methods 0.000 description 2
- 230000029305 taxis Effects 0.000 description 2
- 238000012549 training Methods 0.000 description 2
- 239000013598 vector Substances 0.000 description 2
- RYGMFSIKBFXOCR-UHFFFAOYSA-N Copper Chemical compound [Cu] RYGMFSIKBFXOCR-UHFFFAOYSA-N 0.000 description 1
- 230000002411 adverse Effects 0.000 description 1
- 230000004931 aggregating effect Effects 0.000 description 1
- 230000003466 anti-cipated effect Effects 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 238000004883 computer application Methods 0.000 description 1
- 229910052802 copper Inorganic materials 0.000 description 1
- 239000010949 copper Substances 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 230000007123 defense Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 239000000446 fuel Substances 0.000 description 1
- 230000001939 inductive effect Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000003058 natural language processing Methods 0.000 description 1
- 238000005192 partition Methods 0.000 description 1
- 238000001556 precipitation Methods 0.000 description 1
- 230000002441 reversible effect Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G5/00—Traffic control systems for aircraft, e.g. air-traffic control [ATC]
- G08G5/0047—Navigation or guidance aids for a single aircraft
- G08G5/0069—Navigation or guidance aids for a single aircraft specially adapted for an unmanned aircraft
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G5/00—Traffic control systems for aircraft, e.g. air-traffic control [ATC]
- G08G5/0017—Arrangements for implementing traffic-related aircraft activities, e.g. arrangements for generating, displaying, acquiring or managing traffic information
- G08G5/0021—Arrangements for implementing traffic-related aircraft activities, e.g. arrangements for generating, displaying, acquiring or managing traffic information located in the aircraft
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
- G05D1/10—Simultaneous control of position or course in three dimensions
- G05D1/101—Simultaneous control of position or course in three dimensions specially adapted for aircraft
- G05D1/106—Change initiated in response to external conditions, e.g. avoidance of elevated terrain or of no-fly zones
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G5/00—Traffic control systems for aircraft, e.g. air-traffic control [ATC]
- G08G5/0017—Arrangements for implementing traffic-related aircraft activities, e.g. arrangements for generating, displaying, acquiring or managing traffic information
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G5/00—Traffic control systems for aircraft, e.g. air-traffic control [ATC]
- G08G5/0047—Navigation or guidance aids for a single aircraft
- G08G5/0052—Navigation or guidance aids for a single aircraft for cruising
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G5/00—Traffic control systems for aircraft, e.g. air-traffic control [ATC]
- G08G5/0047—Navigation or guidance aids for a single aircraft
- G08G5/006—Navigation or guidance aids for a single aircraft in accordance with predefined flight zones, e.g. to avoid prohibited zones
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/02—Services making use of location information
- H04W4/021—Services related to particular areas, e.g. point of interest [POI] services, venue services or geofences
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B64—AIRCRAFT; AVIATION; COSMONAUTICS
- B64U—UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
- B64U10/00—Type of UAV
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B64—AIRCRAFT; AVIATION; COSMONAUTICS
- B64U—UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
- B64U2101/00—UAVs specially adapted for particular uses or applications
- B64U2101/30—UAVs specially adapted for particular uses or applications for imaging, photography or videography
Definitions
- UAV Unmanned Aerial Vehicle
- the Unmanned Aircraft System Traffic Management is an initiative sponsored by the Federal Aviation Administration (FAA) to enable multiple beyond visual line-of-sight drone operations at low altitudes (under (400) feet above ground level (AGL) in airspace where FAA air traffic services are not provided.
- FAM Federal Aviation Administration
- AGL ground level
- a framework that extends beyond the (400) feet AGL limit is needed.
- unmanned aircraft that would be used by package delivery services and air taxis may need to travel at altitudes above (400) feet.
- Such a framework requires technology that will allow the FAA to safely regulate unmanned aircraft.
- a method of geofence management with a UAV includes a geofence manager utilizing a first set of sensor data collected by a first set of in-flight UAVs of the UAV system to detect a first object.
- the geofence manager also utilizes the first set of sensor data to determine a first location of the detected first object and determines whether the first location of the detected first object is within a geofence of an area.
- a method of geofence management with a UAV includes a geofence manager utilizing a first set of sensor data collected by a first set of in-flight UAVs of the UAV system, to detect a first object.
- the geofence manager utilizes the first set of sensor data to determine a first location of the detected first object and create a geofence around the first location of the detected first object.
- a method of geofence management with a UAV includes a geofence manager receiving location data indicating a first location of a tracking device.
- the geofence manager utilizes a first set of sensor data collected by a first set of in-flight UAVs of the UAV system, to detect a first object at the first location of the tracking device.
- the geofence manager also utilizes the first set of sensor data to determine a first identification of the detected first object and determine whether the first identification of the detected first object matches a stored identification of a particular object registered as being associated with the tracking device.
- FIG. 1 is a block diagram illustrating a particular implementation of a system of geofence management with an unmanned aerial vehicle (UAV) according to at least one embodiment of the present invention
- FIG. 2 is a block diagram illustrating a particular implementation of a system of geofence management with a UAV according to at least one embodiment of the present invention
- FIG. 3 A a block diagram illustrating a particular implementation of the blockchain used by the systems of FIGS. 1-2 to record data associated with an unmanned aerial vehicle;
- FIG. 3B is an additional view of the blockchain of FIG. 3 A;
- FIG. 4 is an additional view of the blockchain of FIG. 3 A;
- FIG. 5 is a block diagram illustrating a particular implementation of a method of geofence management with a UAV according to at least one embodiment of the present invention
- FIG. 6 is a block diagram illustrating a particular implementation of a method of geofence management with a UAV according to at least one embodiment of the present invention
- FIG. 7 is a block diagram illustrating a particular implementation of a method of geofence management with a UAV according to at least one embodiment of the present invention
- FIG. 8 is a block diagram illustrating a particular implementation of a method of geofence management with a UAV according to at least one embodiment of the present invention
- FIG. 9 is a block diagram illustrating a particular implementation of a method of geofence management with a UAV according to at least one embodiment of the present invention.
- FIG. 10 is a block diagram illustrating a particular implementation of a method of geofence management with a UAV according to at least one embodiment of the present invention.
- FIG. 11 is a block diagram illustrating a particular implementation of a method of geofence management with a UAV according to at least one embodiment of the present invention
- FIG. 12 is a block diagram illustrating a particular implementation of a method of geofence management with a UAV according to at least one embodiment of the present invention
- FIG. 13 is a block diagram illustrating a particular implementation of a method of geofence management with a UAV according to at least one embodiment of the present invention
- FIG. 14 is a block diagram illustrating a particular implementation of a method of geofence management with a UAV according to at least one embodiment of the present invention
- FIG. 15 is a block diagram illustrating a particular implementation of a method of geofence management with a UAV according to at least one embodiment of the present invention
- FIG. 16 is a block diagram illustrating a particular implementation of a method of geofence management with a UAV according to at least one embodiment of the present invention
- FIG. 17 is a block diagram illustrating a particular implementation of a method of geofence management with a UAV according to at least one embodiment of the present invention
- FIG. 18 is a block diagram illustrating a particular implementation of a method of geofence management with a UAV according to at least one embodiment of the present invention
- FIG. 19 is a block diagram illustrating a particular implementation of a method of geofence management with a UAV according to at least one embodiment of the present invention.
- FIG. 20 is a block diagram illustrating a particular implementation of a method of geofence management with a UAV according to at least one embodiment of the present invention
- FIG. 21 is a block diagram illustrating a particular implementation of a method of geofence management with a UAV according to at least one embodiment of the present invention
- FIG. 22 is a block diagram illustrating a particular implementation of a method of geofence management with a UAV according to at least one embodiment of the present invention
- FIG. 23 is a block diagram illustrating a particular implementation of a method of geofence management with a UAV according to at least one embodiment of the present invention.
- FIG. 24 is a block diagram illustrating a particular implementation of a method of geofence management with a UAV according to at least one embodiment of the present invention.
- an ordinal term e.g., “first,” “second,” “third,” etc.
- an element such as a structure, a component, an operation, etc.
- an ordinal term does not by itself indicate any priority or order of the element with respect to another element, but rather merely distinguishes the element from another element having a same name (but for use of the ordinal term).
- the term “set” refers to a grouping of one or more elements, and the term “plurality” refers to multiple elements.
- determining may be used to describe how one or more operations are performed. It should be noted that such terms are not to be construed as limiting and other techniques may be utilized to perform similar operations. Additionally, as referred to herein, “generating,” “calculating,” “estimating,” “using,” “selecting,” “accessing,” and “determining” may be used interchangeably. For example, “generating,” “calculating,” “estimating,” or “determining” a parameter (or a signal) may refer to actively generating, estimating, calculating, or determining the parameter (or the signal) or may refer to using, selecting, or accessing the parameter (or signal) that is already generated, such as by another component or device.
- Coupled may include “communicatively coupled,” “electrically coupled,” or “physically coupled,” and may also (or alternatively) include any combinations thereof
- Two devices (or components) may be coupled (e.g., communicatively coupled, electrically coupled, or physically coupled) directly or indirectly via one or more other devices, components, wires, buses, networks (e.g., a wired network, a wireless network, or a combination thereof), etc.
- Two devices (or components) that are electrically coupled may be included in the same device or in different devices and may be connected via electronics, one or more connectors, or inductive coupling, as illustrative, non-limiting examples.
- two devices may send and receive electrical signals (digital signals or analog signals) directly or indirectly, such as via one or more wires, buses, networks, etc.
- electrical signals digital signals or analog signals
- directly coupled may include two devices that are coupled (e.g., communicatively coupled, electrically coupled, or physically coupled) without intervening components.
- FIG. 1 sets forth a diagram of a system 100 configured of geofence management with a UAV according to embodiments of the present disclosure.
- the system 100 of FIG. 1 includes an unmanned aerial vehicle (UAV) 102, a user device 120, a server 140, a distributed computing network 151, an air traffic data server 160, a weather data server 170, a regulatory data server 180, and a topographic data server 190.
- UAV unmanned aerial vehicle
- a UAV commonly known as a drone, is a type of powered aerial vehicle that does not carry a human operator and uses aerodynamic forces to provide vehicle lift.
- UAVs are a component of an unmanned aircraft system (UAS), which typically include at least a UAV, a user device, and a system of communications between the two.
- the flight of a UAV may operate with various levels of autonomy including under remote control by a human operator or autonomously by onboard or ground computers.
- a UAV may not include a human operator pilot, some UAVs, such as passenger drones (drone taxi, flying taxi, or pilotless helicopter) carry human passengers.
- the UAV 102 is illustrated as one type of drone.
- any type of UAV may be used in accordance with embodiments of the present disclosure and unless otherwise noted, any reference to a UAV in this application is meant to encompass all types of UAVs. Readers of skill in the art will realize that the type of drone that is selected for a particular mission or excursion may depend on many factors, including but not limited to the type of payload that the UAV is required to carry, the distance that the UAV must travel to complete its assignment, and the types of terrain and obstacles that are anticipated during the assignment.
- the UAV 102 includes a processor 104 coupled to a memory 106, a camera 112, positioning circuitry 114, and communication circuitry 116.
- the communication circuitry 116 includes a transmitter and a receiver or a combination thereof (e.g., a transceiver).
- the communication circuitry' 116 (or the processor 104) is configured to encrypt outgoing message(s) using a private key associated with the UAV 102 and to decrypt incoming message(s) using a public key of a device (e.g., the user device 120 or the server 140 that sent the incoming message(s).
- the outgoing and incoming messages may be transaction messages that include information associated with the UAV.
- communications between the UAV 102, the user device 120, and the server 140 are secure and trustworthy (e.g., authenticated).
- the camera 112 is configured to capture image(s), video, or both, and can be used as part of a computer vision system.
- the camera 1 12 may capture images or video and provide the video or images to a pilot of the UAV 102 to aid with navigation.
- the camera 112 may be configured to capture images or video to be used by the processor 104 during performance of one or more operations, such as a landing operation, a takeoff operation, or object/collision avoidance, as non-limiting examples.
- a single camera 112 is shown in FIG. 1, in alternative implementations more and/or different sensors may be used (e.g., infrared, LIDAR, SONAR, etc.).
- the positioning circuitry 114 is configured to determine a position of the UAV 102 before, during, and/or after flight.
- the positioning circuitry 114 may include a global positioning system (GPS) interface or sensor that determines GPS coordinates of the UAV 102.
- GPS global positioning system
- the positioning circuitry 114 may also include gyroscope(s), accelerometer(s), pressure sensor(s), other sensors, or a combination thereof, that may be used to determine the position of the UAV 102.
- the processor 104 is configured to execute instructions stored in and retrieved from the memory 106 to perform various operations.
- the instructions include operation instructions 108 that include instructions or code that cause the UAV 102 to perform flight control operations.
- the flight control operations may include any operations associated with causing the UAV to fly from an origin to a destination.
- the flight control operations may include operations to cause the UAV to fly along a designated route (e.g., based on route information 110, as further described herein), to perform operations based on control data received from one or more user devices, to take off, land, hover, change altitude, change pitch/yaw/roll angles, or any other flight-related operations.
- the UAV 102 may include one or more actuators, such as one or more flight control actuators, one or more thrust actuators, etc., and execution of the operation instructions 108 may cause the processor 104 to control the one or more actuators to perform the flight control operations.
- the one or more actuators may include one or more electrical actuators, one or more magnetic actuators, one or more hydraulic actuators, one or more pneumatic actuators, one or more other actuators, or a combination thereof.
- the route information 110 may indicate a flight path for the UAV 102 to follow.
- the route information 110 may specify a starting point (e.g., an origin) and an ending point (e.g., a destination) for the UAV 102.
- the route information may also indicate a plurality of way points, zones, areas, regions between the starting point and the ending point.
- the route information 1 10 may also indicate a corresponding set of user devices for various points, zones, regions, areas of the flight path.
- the indicated sets of user devices may be associated with a pilot (and optionally one or more backup pilots) assigned to have control over the UAV 102 while the UAV 102 is in each zone.
- the route information 110 may also indicate time periods during which the UAV is scheduled to be in each of the zones (and thus time periods assigned to each pilot or set of pilots).
- the memory 106 of the UAV 102 may also include communication instructions 111 that when executed by the processor 104 cause the processor 104 to transmit to the distributed computing network 151, transaction messages that include telemetry data 107.
- Telemetry data may include any information that could be useful to identifying the location of the UAV, the operating parameters of the UAV, or the status of the UAV. Examples of telemetry data include but are not limited to GPS coordinates, instrument readings (e.g., airspeed, altitude, altimeter, turn, heading, vertical speed, attitude, turn and slip), and operational readings (e.g., pressure gauge, fuel gauge, battery level).
- the memory 106 of the UAV 102 further includes at least one UAV software module 103.
- the UAV software module 103 is defined as a group of computer executable code that, when executed by a processor, enables at least one specialized functionality of a UAV that may not normally be present on the UAV.
- the camera 112 may normally be configured to take pictures.
- the UAV software module 103 may be executed by processor 104 to enable additional functionality of the camera 112, such as object detection or tracking.
- the UAV software module 103 may work in conjunction with the existing hardware of the UAV 102, such as shown in FIG. 1, or in other examples, the UAV software module 103 may work in conjunction with optional hardware.
- a UAV software module 103 may work in combination with a sensor not normally present on the UAV 102.
- adding the sensor to the UAV 102 may only be enabled once the appropriate software module is enabled.
- the UAV software module 103 may not be functional unless the additional sensor is present on the UAV 103.
- Examples of functionality that may be enabled by a software module include, but are not limited to, object detection, automated flight patterns, object tracking, object counting, or responses to object detection.
- the memory 106 of the UAV 102 further includes a geofence manager 113.
- the geofence manager 113 includes computer program instructions that when executed by the processor 104 cause the processor 104 to carry out the operations of utilizing a first set of sensor data collected by a first set of the in-flight UAVs of the UAV system to detect a first object; utilizing the first set of sensor data to determine a first location of the detected first object: and determining whether the first location of the detected first object is within a geofence of an area.
- the geofence manager 113 includes computer program instructions that when executed by the processor 104 cause the processor 104 to carry out the operations of utilizing a first set of sensor data collected by a first set of the in-flight UAVs of the UAV system, to detect a first object; utilizing the first set of sensor data to determine a first location of the detected first object; and creating a geofence around the first location of the detected first object.
- the user device 120 includes a processor 122 coupled to a memory 124, a display device 132, and communication circuitry 134.
- the display device 132 may be a liquid crystal display (LCD) screen, a touch screen, another type of display device, or a combination thereof.
- the communication circuitry 134 includes a transmitter and a receiver or a combination thereof (e.g., a transceiver).
- the communication circuitry 134 (or the processor 122 is configured to encrypt outgoing message(s) using a private key associated with the user device 120 and to decrypt incoming message(s) using a public key of a device (e.g., the UAV 102 or the server 140 that sent the incoming message(s).
- a device e.g., the UAV 102 or the server 140 that sent the incoming message(s).
- communication between the UAV 102, the user device 120, and the server 140 are secure and trustworthy (e.g., authenticated).
- the processor 122 is configured to execute instructions from the memory 124 to perform various operations.
- the instructions include control instructions 130 that include instructions or code that cause the user device 120 to generate control data to transmit to the UAV 102 to enable the user device 120 to control one or more operations of the UAV 102 during a particular time period, as further described herein.
- the memory 124 of the user device 120 also includes communication instructions 131 that when executed by the processor 122 cause the processor 122 to transmit to the distributed computing network 151, messages that include control instructions 130 that are directed to the UAV 102.
- the transaction messages are also transmitted to the UAV and the UAV takes action (e g., adjusting flight operations), based on the information (e.g., control data) in the message.
- the memory 124 of the user device 120 may also include a geofence manager 139.
- the geofence manager 139 includes computer program instructions that when executed by the processor 122 cause the processor 122 to carry out the operations of utilizing a first set of sensor data collected by a first set of the inflight UAVs of the UAV system to detect a first object; utilizing the first set of sensor data to determine a first location of the detected first object; and determining whether the first location of the detected first object is within a geofence of an area.
- the geofence manager 139 includes computer program instructions that when executed by the processor 122 cause the processor 122 to carry out the operations of utilizing a first set of sensor data collected by a first set of the in-flight UAVs of the UAV system, to detect a first object; utilizing the first set of sensor data to determine a first location of the detected first object; and creating a geofence around the first location of the detected first object.
- the geofence manager 139 includes computer program instructions that when executed by the processor 122 cause the processor 122 to carry out the operations of receiving location data indicating a first location of a tracking device; utilizing a first set of sensor data collected by a first set of the in-flight UAVs of the UAV system, to detect a first object at the first location of the tracking device; utilizing the first set of sensor data to determine a first identification of the detected first object; and determining whether the first identification of the detected first object matches a stored identification of a particular object registered as being associated with the tracking device.
- the server 140 includes a processor 142 coupled to a memory 146, and communication circuitry 144.
- the communication circuitry 144 includes a transmitter and a receiver or a combination thereof (e.g., a transceiver).
- the communication circuitry 144 (or the processor 142 is configured to encrypt outgoing message(s) using a private key associated with the server 140 and to decrypt incoming message(s) using a public key of a device (e.g., the UAV 102 or the user device 120 that sent the incoming message(s).
- the outgoing and incoming messages may be transaction messages that include information associated with the UAV.
- communication between the UAV 102, the user device 120, and the server 140 are secure and trustworthy (e.g., authenticated).
- the processor 142 is configured to execute instructions from the memory 146 to perform various operations.
- the instructions include route instructions 148 comprising computer program instructions for aggregating data from disparate data servers, virtualizing the data in a map, generating a cost model for paths traversed in the map, and autonomously selecting the optimal route for the UAV based on the cost model.
- the route instructions 148 are configured to partition a map of a region into geographic cells, calculate a cost for each geographic cell, wherein the cost is a sum of a plurality of weighted factors, determine a plurality of flight paths for the UAV from a first location on the map to a second location on the map, wherein each flight path traverses a set of geographic cells, determine a cost for each flight path based on the total cost of the set of geographic cells traversed, and select, in dependence upon the total cost of each flight path, an optimal flight path from the plurality of flight paths.
- the route instructions 148 are further configured to obtain data from one or more data servers regarding one or more geographic cells, calculate, in dependence upon the received data, an updated cost for each geographic cell traversed by a current flight path, calculate a cost for each geographic cell traversed by at least one alternative flight path from the first location to the second location, determine that at least one alternative flight path has a total cost that is less than the total cost of the current flight path, and select a new optimal flight path from the at least one alternative flight paths.
- the route instructions 148 may also include instructions for storing the parameters of the selected optimal flight path as route information 110.
- the route information may include waypoints marked by GPS coordinates, arrival times for waypoints, pilot assignments.
- the instructions may also include control instructions 150 that include instructions or code that cause the server 140 to generate control data to transmit to the UAV 102 to enable the server 140 to control one or more operations of the UAV 102 during a particular time period, as further described herein.
- the memory 146 of the server 140 may also include a geofence manager 145.
- the geofence manager 145 includes computer program instructions that when executed by the processor 142 cause the processor 142 to carry out the operations of utilizing a first set of sensor data collected by a first set of the in-flight UAVs of the UAV system to detect a first object; utilizing the first set of sensor data to determine a first location of the detected first object; and determining whether the first location of the detected first object is within a geofence of an area.
- the geofence manager 145 includes computer program instructions that when executed by the processor 122 cause the processor 142 to carry out the operations of utilizing a first set of sensor data collected by a first set of the in-flight UAVs of the UAV system, to detect a first object; utilizing the first set of sensor data to determine a first location of the detected first object; and creating a geofence around the first location of the detected first object.
- the geofence manager 145 includes computer program instructions that when executed by the processor 122 cause the processor 142 to carry out the operations of receiving location data indicating a first location of a tracking device; utilizing a first set of sensor data collected by a first set of the in-flight UAVs of the UAV system, to detect a first object at the first location of the tracking device; utilizing the first set of sensor data to determine a first identification of the detected first object; and determining whether the first identification of the detected first object matches a stored identification of a particular object registered as being associated with the tracking device.
- the memory 146 of the server 140 also includes communication instructions 147 that when executed by the processor 142 cause the processor 142 to transmit to the distributed computing network 151, transaction messages that include control instructions 150 that are directed to the UAV 102.
- the distributed computing network 151 of FIG. 1 includes a plurality of computers.
- An example computer 158 of the plurality of computers is shown and includes a processor 152 coupled to a memory 154, and communication circuitry 153.
- the communication circuitry 153 includes a transmitter and a receiver or a combination thereof (e.g., a transceiver).
- the communication circuitry 153 (or the processor 152 is configured to encrypt outgoing message(s) using a private key associated with the computer 158 and to decrypt incoming message(s) using a public key of a device (e.g., the UAV 102, the user device 120, or the server 140 that sent the incoming message(s).
- a device e.g., the UAV 102, the user device 120, or the server 140 that sent the incoming message(s).
- the outgoing and incoming messages may be transaction messages that include information associated with the UAV 102.
- communication between the UAV 102, the user device 120, the server 140, and the distributed computing network 151 are secure and trustworthy (e g., authenticated).
- the processor 152 is configured to execute instructions from the memory 154 to perform various operations.
- the memory 154 includes a blockchain manager 155 that includes computer program instructions for utilizing an unmanned aerial vehicle for emergency response.
- the blockchain manager 155 includes computer program instructions that when executed by the processor 152 cause the processor 152 to receive a transaction message associated with a UAV.
- the blockchain manager may receive transaction messages from the UAV 102, the user device 120, or the server 140.
- the blockchain manager 155 also includes computer program instructions that when executed by the processor 152 cause the processor 152 to use the information within the transaction message to create a block of data; and store the created block of data in a blockchain data structure 156 associated with the UAV 102.
- the blockchain manager may also include instructions for accessing information regarding an unmanned aerial vehicle (UAV).
- UAV unmanned aerial vehicle
- the blockchain manager 155 also includes computer program instructions that when executed by the processor 152 cause the processor to receive from a device, a request for information regarding the UAV: in response to receiving the request, retrieve from a blockchain data structure associated with the UAV, data associated with the information requested; and based on the retrieved data, respond to the device.
- the UAV 102, the user device 120, and the server 140 are communicatively coupled via a network 118.
- the network 118 may include a satellite network or another type of network that enables wireless communication between the UAV 102, the user device 120, the server 140, and the distributed computing network 151.
- the user device 120 and the server 140 communicate with the UAV 102 via separate networks (e.g., separate short-range networks.
- minimal (or no) manual control of the UAV 102 may be performed, and the UAV 102 may travel from the origin to the destination without incident.
- a UAV software module may enable the minimal (or no) manual control operation of the UAV 102.
- one or more pilots may control the UAV 102 during a time period, such as to perform object avoidance or to compensate for an improper UAV operation.
- the UAV 102 may be temporarily stopped, such as during an emergency condition, for recharging, for refueling, to avoid adverse weather conditions, responsive to one or more status indicators from the UAV 102, etc.
- the route information 110 may be updated (e g., via a subsequent blockchain entry, as further described herein) by route instructions 148 executing on the UAV 102, the user device 120, or the server 140).
- the updated route information may include updated waypoints, updated time periods, and updated pilot assignments.
- the route information is exchanged using a blockchain data structure.
- the blockchain data structure may be shared in a distributed manner across a plurality of devices of the system 100, such as the UAV 102, the user device 120, the server 140, and any other user devices or UAVs in the system 100.
- each of the devices of the system 100 stores an instance of the blockchain data structure in a local memory of the respective device.
- each of the devices of the system 100 stores a portion of the shared blockchain data structure and each portion is replicated across multiple devices of the system 100 in a manner that maintains security of the shared blockchain data structure as a public (i.e., available to other devices) and incorruptible (or tamper evident) ledger.
- the blockchain data structure 156 is stored in a distributed manner in the distributed computing network 151.
- the blockchain data structure 156 may include, among other things, route information associated with the UAV 102, the telemetry data 107, the control instructions 130, and the route instructions 148.
- the route information 110 may be used to generate blocks of the blockchain data structure 156.
- a sample blockchain data structure 300 is illustrated in Figs 3A, 3B, and 4. Each block of the blockchain data structure 300 includes block data and other data, such as availability data, route data, telemetry data, service information, incident reports, etc.
- the block data of each block includes information that identifies the block (e g., a block ID) and enables the devices of the system 100 to confirm the integrity of the blockchain data structure 300.
- the block data also includes a timestamp and a previous block hash.
- the timestamp indicates a time that the block was created.
- the block ID may include or correspond to a result of a hash function (e.g., a SHA(256) hash function, a RIPEMD hash function, etc.) based on the other information (e.g., the availability data or the route data) in the block and the previous block hash (e.g., the block ID of the previous block).
- a hash function e.g., a SHA(256) hash function, a RIPEMD hash function, etc.
- the blockchain data structure 300 includes an initial block (Bk_0) 302 and several subsequent blocks, including a block Bk_l 304, a block Bk_2 306, a block BK_3 307, a block BK_4 308, a block BK_5 309, and a block Bk_n 310.
- the initial block Bk_0 302 includes an initial set of availability data or route data, a timestamp, and a hash value (e.g., a block ID) based on the initial set of availability data or route data. As shown in FIG.
- the block Bk_l 304 also may include a hash value based on the other data of the block Bk_l 304 and the previous hash value from the initial block Bk_0 302.
- the block Bk_2 306 other data and a hash value based on the other data of the block Bk_2 306 and the previous hash value from the block Bk 1 304.
- the block Bk n 310 includes other data and a hash value based on the other data of the block Bk_n 310 and the hash value from the immediately prior block (e.g., a block Bk_n-1).
- This chained arrangement of hash values enables each block to be validated with respect to the entire blockchain; thus, tampering with or modifying values in any block of the blockchain is evident by calculating and verifying the hash value of the final block in the block chain. Accordingly, the blockchain acts as a tamper-evident public ledger of availability data and route data for the system 100.
- each block of the blockchain data structure 300 includes some information associated with a UAV (e.g., availability data, route information, telemetry data, incident reports, updated route information, maintenance records, UAV software modules in use, etc.)
- the block Bk_l 304 includes availability data that includes a user ID (e.g., an identifier of the mobile device, or the pilot, that generated the availability data), a zone (e.g., a zone at which the pilot will be available), and an availability time (e.g., a time period the pilot is available at the zone to pilot a UAV).
- the block Bk_2 306 includes route information that includes a UAV ID, a start point, an end point, waypoints, GPS coordinates, zone markings, time periods, primary pilot assignments, and backup pilot assignments for each zone associated with the route.
- the block BK_3 307 includes telemetry data, such as a user ID (e.g., an identifier of the UAV that generated the telemetry data), a battery level of the UAV; a GPS position of the UAV; and an altimeter reading.
- a UAV may include many types of information within the telemetry data that is transmitted to the blockchain managers of the computers within the distributed computing network 151.
- the UAV is configured to periodically broadcast to the network 118, a transaction message that includes the UAV’s current telemetry data.
- the blockchain managers of the distributed computing network receive the transaction message containing the telemetry data and store the telemetry data within the blockchain data structure 156.
- FIG. 3B also depicts the block BK_4 308 as including updated route information having a start point, an endpoint, and a plurality of zone times and backups, along with a UAV ID.
- the user device 120 or the server 140 may determine that the route of the UAV should be changed. For example, the user device or the server may detect that the route of the UAV conflicts with a route of another UAV or a developing weather pattern. As another example, the user device or the server many determine that the priority level or concerns of the user have changed and thus the route needs to be changed. In such instances, the user device or the server may transmit to the UAV, updated route information, control data, or navigation information.
- Transmitting the updated route information, control data, or navigation information to the UAV may include broadcasting a transaction message that includes the updated route information, control data, or navigation information to the network 118.
- the blockchain manager 155 in the distributed computing network 151 retrieves the transaction message from the network 118 and stores the information within the transaction message in the blockchain data structure 156.
- FIG. 4 depicts the block BK_5 309 as including data describing an incident report.
- the incident report includes a user ID; a warning message; a GPS position; and an altimeter reading.
- a UAV may transmit a transaction message that includes an incident report in response to the UAV experiencing an incident. For example, if during a flight mission, one of the UAV’s propellers failed, a warning message describing the problem may be generated and transmitted as a transaction message.
- FIG. 4 also depicts the block BK_n 310 that includes a maintenance record having a user ID of the service provider that serviced the UAV; flight hours that the UAV had flown when the service was performed; the service ID that indicates the type of service that was performed; and the location that the service was performed.
- UAV must be serviced periodically.
- the service provider may broadcast to the blockchain managers in the distributed computing network, a transaction message that includes service information, such as a maintenance record.
- Blockchain managers may receive the messages that include the maintenance record and store the information in the blockchain data structure.
- a digital and immutable record or logbook of the UAV may be created. This type of record or logbook may be particularly useful to a regulatory agency and an owner/operator of the UAV.
- the server 140 may include a UAV software module that is configured to receive telemetry information from an airborne UAV and track the UAV’s progress and status.
- the server 140 is also configured to transmit in-flight commands to the UAV 102.
- Operation of the user device 120 and the server 140 may be carried out by some combination of a human operator and autonomous software (e.g., artificial intelligence (Al) software that is able to perform some or all of the operational functions of a typical human operator pilot).
- a human operator e.g., artificial intelligence (Al) software that is able to perform some or all of the operational functions of a typical human operator pilot.
- the route instructions 148 cause the server 140 to plan a flight path, generate route information, dynamically reroute the flight path and update the route information based on data aggregated from a plurality of data servers.
- the server 140 may receive air traffic data 167 over the network 119 from the air traffic data server 160, weather data 177 from the weather data server 170, regulatory data 187 from the regulatory data server 180, and topographical data 197 from the topographic data server 190.
- other data servers useful m-flight path planning of a UAV may also provide data to the server 140 over the network 118 or through direct communication with the server 140. Additionally, communication with each data server may be enabled through the use of a UAV software module as described herein.
- the air traffic data server 160 may include a processor 162, memory 164, and communication circuitry 168.
- the memory 164 of the air traffic data server 1 0 may include operating instructions 166 that when executed by the processor 162 cause the processor to provide the air traffic data 167 about the flight paths of other aircraft in a region, including those of other UAVs.
- the air traffic data may also include real-time radar data indicating the positions of other aircraft, including other UAVs, in the immediate vicinity or in the flight path of a particular UAV.
- Air traffic data servers may be, for example, radar stations, airport air traffic control systems, the FAA, UAV control systems, and so on.
- the weather data server 170 may include a processor 172, memory 174, and communication circuitry 178.
- the memory 174 of the weather data server 170 may include operating instructions 176 that when executed by the processor 172 cause the processor to provide the weather data 177 that indicates information about atmospheric conditions along the UAV’s flight path, such as temperature, wind, precipitation, lightening, humidity, atmospheric pressure, and so on.
- Weather data servers may be, for example, the National Weather Service (NWS), the National Oceanic and Atmospheric Administration (NOAA), local meteorologists, radar stations, other aircraft, and so on.
- the regulatory data server 180 may include a processor 182, memory 184, and communication circuitry 188.
- the memory 184 of the weather data server 170 may include operating instructions 186 that when executed by the processor 182 cause the processor to provide the regulatory data 187 that indicates information about laws and regulations governing a particular region of airspace, such as airspace restrictions, municipal and state laws and regulations, permanent and temporary no-fly zones, and so on.
- Regulatory data servers may include, for example, the FAA, state and local governments, the Department of Defense, and so on.
- the topographic data server 190 may include a processor 192, memory 194, and communication circuitry 198.
- the memory 194 of the topographic data server 190 may include operating instructions 196 that when executed by the processor 192 cause the processor to provide the topographical data that indicates information about terrain, places, structures, transportation, boundaries, hydrography, ortho-imagery, land cover, elevation, and so on.
- Topographic data may be embodied in, for example, digital elevation model data, digital line graphs, and digital raster graphics.
- Topographic data servers may include, for example, the United States Geological Survey or other geographic information systems (GISs).
- GISs geographic information systems
- the server 140 may aggregate data from the data servers 160, 170, 180, 190 using application program interfaces (APIs), syndicated feeds and extensible Markup Language (XML), natural language processing, JavaScript Object Notation (JSON) servers, or combinations thereof. Updated data may be pushed to the server 140 or may be pulled on-demand by the server 140.
- the FAA may be an important data server for both airspace data concerning flight paths and congestion as well as an important data server for regulatory data such as permanent and temporary airspace restrictions.
- the FAA provides the Aeronautical Data Delivery Service (ADDS), the Aeronautical Product Release API (APRA), System Wide Information Management (SWIM), Special Use Airspace information, and Temporary Flight Restrictions (TFR) information, among other data.
- the National Weather Service (NWS) API allows access to forecasts, alerts, and observations, along with other weather data.
- NWS National Weather Service
- the USGS Seamless Server provides geospatial data layers regarding places, structures, transportation, boundaries, hydrography, ortho-imagery, land cover, and elevation. Readers of skill in the art will appreciate that various governmental and non-govemmental entities may act as data servers and provide access to that data using APIs, JSON, XML, and other data formats.
- the server 140 can communicate with a UAV 102 using a variety of methods.
- the UAV 102 may transmit and receive data using Cellular, 5G, Sub 1 GHz, SigFox, WiFi networks, or any other communication means that would occur to one of skill in the art.
- the network 119 may comprise one or more Local Area Networks (LANs), Wide Area Networks (WANs), cellular networks, satellite networks, internets, intranets, or other networks and combinations thereof.
- the network 119 may comprise one or more wired connections, wireless connections, or combinations thereof.
- FIG. 1 The arrangement of servers and other devices making up the exemplary system illustrated in FIG. 1 are for explanation, not for limitation.
- Data processing systems useful according to various embodiments of the present disclosure may include additional servers, routers, other devices, and peer-to-peer architectures, not shown in FIG. 1, as will occur to those of skill in the art.
- Networks in such data processing systems may support many data communications protocols, including for example TCP (Transmission Control Protocol), IP (Internet Protocol), HTTP (HyperText Transfer Protocol), and others as will occur to those of skill in the art.
- Various embodiments of the present invention may be implemented on a variety of hardware platforms in addition to those illustrated in FIG. 1.
- FIG. 2 sets forth a block diagram illustrating another implementation of a system 200 of geofence management with an unmanned aerial vehicle (UAV).
- the system 200 of FIG. 2 shows an alternative configuration in which one or both of the UAV 102 and the server 140 may include route instructions 148 for generating route information.
- the UAV 102 and the user device 120 may retrieve and aggregate the information from the various data sources (e.g., the air traffic data server 160, the weather data server 170, the regulatory data server 180, and the topographical data server 190).
- the route instructions may be configured to use the aggregated information from the various source to plan and select a flight path for the UAV 102.
- FIG. 5 sets forth a flow chart illustrating an exemplary method of geofence management with an unmanned aerial vehicle (UAV) in accordance with at least one embodiment of the present disclosure.
- a geofence manager 501 may include a set of computer program instructions that are executed by a processor.
- the geofence manager 501 of FIG. 5 may be the geofence manager 139 of FIGs. 1 and 2 or the geofence manager 145 of FIG. 1.
- the method of FIG. 5 includes utilizing 502. by a geofence manager 501, a first set 550 of sensor data collected by a first set 552 of the in-flight UAVs 553 of the UAV system to detect a first object 560.
- the sensor data may include data collected from one or more sensors of a UAV (e.g., the UAV 102 of FIG. 1) such as gyroscopes; accelerometers; thermometers; inertial measurement sensors (magnetometer); barometers; GPS sensors; distance sensors (e.g., sensors based on radio detection and ranging; magnetic-field change sensing; sonar-pulse distance sensing (ultrasonic); time of flight (ToF) sensors (range imaging); light-pulse distance sensing (laser); SONAR, RADAR, and LIDAR); optical still or video cameras; monocular or stereo vision cameras; anemometers to measure wind speed and direction; heat detection devices (e.g., infrared sensors, thermal imaging vision cameras, etc); and chemical sensors for the detection of chemicals present in the environment).
- sensors of a UAV e.g., the UAV 102 of FIG. 1
- sensors of a UAV e.g., the UAV 102 of FIG. 1
- the sensor data is collected by the UAV and utilized by the UAV for object detection and object identification, or the collected sensor data is streamed to a remote device such as a UAV user device (e.g., the user device 120 of FIG. 1) or a server (e g., the server 140 of FIG. 1) for object detection and object identification.
- a UAV user device e.g., the user device 120 of FIG. 1
- a server e.g., the server 140 of FIG.
- a first set 550 of sensor data collected by a first set 552 of the in-flight UAVs 553 of the UAV system to detect a first object 560 is carried out through pattern recognition techniques using machine vision.
- machine vision may include visual sensors such as monocular cameras and stereo cameras, thermal imaging sensors, LIDAR sensors, SONAR sensors, and other imaging sensors that may be useful in object detection, recognition, and identification.
- pattern recognition techniques are applied to a still image obtained from a camera of the UAV (e.g., the camera 112 of FIG. 1).
- a variety of sensors may be used to obtain imagery of the detected object 560.
- sensor data from these sensors may be combined to further enhance an image of the first object 560.
- an image from a camera may be combined with imagery generated from LIDAR sensor data and imagery generated from SONAR sensor data.
- the imagery generated from the sensor data of each sensor may be transformed into the same coordinate system (and with the same scale and perspective) such that the images may be overlaid.
- These image layers may then be flattened into a single image with enhanced features that would not have been detected based on any single sensor. This flattened image may include enhanced features that provide better image resolution for feature detection and extraction.
- Feature detection and extraction techniques may be applied to the image to obtain a set of features useful in identifying the first object 560.
- convolution neural networks, support vector machines, and/or deep learning methods are used to extract features of the object and/or identify the object.
- object recognition techniques such as region-based convolutional neural networks (R-CNN) or You Only Look Once (YOLO) may be useful in identifying, based on the sensor data collected by the in-flight UAVs, a classification of a detected object.
- template-based image matching may be used in which a set of sample points of the extracted features are compared to image templates for object identification.
- OCR optical character recognition
- SRT shape recognition technology
- a first set 550 of sensor data collected by a first set 552 of the in-flight UAVs 553 of the UAV system to detect a first object 560 includes identifying object types that are particularly relevant to UAV operation and UAV missions. For example, exterior artifacts such as structures and vehicles are more likely to be relevant to UAV operation and UAV missions than interior artifacts such as furniture or appliances.
- the geofence manager 501 may employ a particular set of object classifications for the object.
- object classifications may include person, animal, vehicle, structure, liquid, vegetation, smoke, fire, and so on, that may be encountered during UAV flight.
- subtypes or particular instances of an object classification may be identified.
- the object could be a particular person or a particular vehicle.
- the object may be identified using techniques such as facial recognition or other identification techniques.
- the object to be detected can be a set of persons, such as persons having a particular characteristic.
- a body of liquid may be further differentiated as a lake, a river, etc.; a structure may be differentiated as a building, a communications tower; etc. ; an animal by be differentiated by species, etc.
- a first set 550 of sensor data collected by a first set 552 of the in-flight UAVs 553 of the UAV system to detect a first object 560 includes identifying the classification of the detected object in dependence upon the sensor data and one or more object models.
- identify ing the classification of the detected object in dependence upon the sensor data and one or more object models is carried out by the geofence manager 501 loading one or more object models and comparing the object pattern recognized from the sensor data.
- an artificial neural network may be trained on a set of training images for a particular object to generate an object model for that object.
- the object model may include a set of features represented by shape context vectors.
- the entire set of object models may be filtered to produce the set of candidate object models. Filtering may be applied based on characteristics of the detected object or scene, conditions present in the UAV, one or more UAV missions, or combinations thereof. As one simplified example, based on the altitude of the UAV and the camera angle, it may be easily determined that the scene of the image that includes the detected object is a skyscape. This precludes object models that are ground-based such a people, animals, vehicles. Based on a mission of collision avoidance, the set of candidate models may be narrowed based on the altitude of the UAV or the detected object, which may preclude object models for houses and retail stores and small office buildings.
- the set of candidate object models may be filtered to exclude an office building, apartment building, or a construction crane.
- the set of candidate models may be, for example: aircraft, cell tower, or radio tower. If the detected object is actually a radio tower, the comparison of the extracted features of the detected object to the radio tower object model will score high than the comparisons based on the aircraft object model and the cell tower object model.
- the UAV may be preloaded with a set of object models in the memory of the UAV (e.g., the memory 106 of FIG. 1) prior to executing a mission.
- the UAV may be preloaded with object models that are specific to the UAV’s mission.
- the UAV may also receive object models in-flight that are transmitted from a remote device (e.g., the user device 120 or the server 140 of FIG. 1).
- the method of FIG. 5 also includes utilizing 504, by the geofence manager 501, the first set 550 of sensor data to determine a first location 562 of the detected first object 560.
- the first set 550 of sensor data to determine a first location 562 of the detected first object 560 may be carried out by analyzing the first set of sensor data to determine a location 562 of the first object 560 based on the relationship of the first object 560 to one or more known locations.
- a number of techniques may be employed to determine the distance between the UAV and the first object 560 based on the sensor data.
- stereo cameras are used to capture two images of the object from different viewpoints.
- an image processing algorithm can identify the same point in both images and calculate the distance triangulation.
- high frequency SONAR pulses are transmitted toward the object and the time it takes for the signal to reflect off the first object 560 and return to the UAV is used to determine the distance to the first object 560.
- a geofence is a virtual perimeter around a real-world, physical, geographic area.
- the area around which the geofence is constructed or created may be any shape or size.
- the geofence may also be created in any number of ways including but not limited to a user drawing a perimeter line in a mapping application; a user providing coordinates for the perimeter; an application dynamically generating the perimeter around a fixed location or an object; a computer application storing the location(s) of the geofence in a computer readable storage medium.
- Determining 506, by the geofence manager 501, whether the first location 562 of the detected first object 560 is within a geofence of an area may be carried out by comparing the known location of the object to the locations or coordinates that define the geofence.
- a geofence manager 501 also includes utilizing 502, by a geofence manager 501, a first set 550 of sensor data collected by a first set 552 of the in-flight UAVs 553 of the UAV system to detect a first object 560; utilizing 504, by the geofence manager 501, the first set 550 of sensor data to determine a first location 562 of the detected first object 560; and determining 506, by the geofence manager 501, whether the first location 562 of the detected first object 560 is within a geofence of an area.
- Examples of actions that a UAV may perform include but are not limited to activating speakers and playing a sound; turning- on a microphone and recording sound near the UAV; switching and executing operation modes (e.g., switching from a surveillance mode to a follow mode in which the UAV tracks the detected object); activating crowd control measures (e g., light and sound devices); sending alerts, texts, and messages to a user device or some other device of the UAV system; activating cameras and capturing images or video; and others as will occur to those of skill in the art in view of the present disclosure.
- operation modes e.g., switching from a surveillance mode to a follow mode in which the UAV tracks the detected object
- activating crowd control measures e., light and sound devices
- sending alerts, texts, and messages to a user device or some other device of the UAV system
- activating cameras and capturing images or video and others as will occur to those of skill in the art in view of the present disclosure.
- Examples of actions that a user device, server, distributed computing device may perform include but are not limited to sending an alert, a text, a message indicating an update regarding the location of the detected object relative to the geofence; displaying a map that displays the geofence and any relevant objects; displaying objects that violate a parameter or rule related to the geofence (e.g., a detected object is within the geofence; a detected object is outside the geofence).
- a parameter or rule related to the geofence e.g., a detected object is within the geofence; a detected object is outside the geofence.
- Instructing 602, by the geofence manager 501, one or more devices 650 of the UAV system to perform a first set 690 of actions may be carried out by executing an operation or command at the device; transmitting a message, command, instruction to the device; transmitting a message, command, or instruction to another device that relays the message, command, or instruction to the device.
- FIG. 7 sets forth a flow chart illustrating an exemplary method of geofence management with an unmanned aerial vehicle (UAV) in accordance with at least one embodiment of the present disclosure.
- UAV unmanned aerial vehicle
- a geofence manager 501 also includes utilizing 502, by a geofence manager 501, a first set 550 of sensor data collected by a first set 552 of the in-flight UAVs 553 of the UAV system to detect a first object 560; utilizing 504, by the geofence manager 501, the first set 550 of sensor data to determine a first location 562 of the detected first object 560; and determining 506, by the geofence manager 501, whether the first location 562 of the detected first object 560 is within a geofence of an area.
- Examples of actions that a UAV may perform include but are not limited to activating speakers and playing a sound; tuming-on a microphone and recording sound near the UAV; switching and executing operation modes (e.g., switching from a surveillance mode to a follow mode in which the UAV tracks the detected object); activating crowd control measures (e.g., light and sound devices); sending alerts, texts, and messages to a user device or some other device of the UAV system; activating cameras and capturing images or video; and others as will occur to those of skill in the art in view of the present disclosure.
- operation modes e.g., switching from a surveillance mode to a follow mode in which the UAV tracks the detected object
- activating crowd control measures e.g., light and sound devices
- sending alerts, texts, and messages to a user device or some other device of the UAV system
- activating cameras and capturing images or video and others as will occur to those of skill in the art in view of the present disclosure.
- Examples of actions that a user device, server, distributed computing device may perform include but are not limited to sending an alert, text, message indicating an update regarding the location of the detected object relative to the geofence; displaying a map that displays the geofence and any relevant objects; displaying objects that violate a parameter or rule related to the geofence (e.g., a detected object is within the geofence; a detected object is outside the geofence).
- Instructing 702, by the geofence manager 501, one or more devices 750 of the UAV system to perform a second set 790 of actions may be carried out by executing an operation or command at the device; transmitting a message, command, instruction to the device; transmitting a message, command, or instruction to another device that relays the message, command, or instruction to the device.
- FIG. 8 sets forth a flow chart illustrating an exemplary method of geofence management with an unmanned aerial vehicle (UAV) in accordance with at least one embodiment of the present disclosure.
- UAV unmanned aerial vehicle
- the method of FIG. 8 includes utilizing 802, by the geofence manager 501, the first set 552 of sensor data to determine an identification 850 of the detected first object 560.
- detecting and identifying an object may be carried out by using pattern recognition techniques using machine vision.
- machine vision may include visual sensors such as monocular cameras and stereo cameras, thermal imaging sensors, LIDAR sensors, SONAR sensors, and other imaging sensors that may be useful in object detection, recognition, and classification.
- pattern recognition techniques are applied to a still image obtained from a camera of the UAV (e.g., the camera 112 of FIG. 1).
- image processing such as contrast enhancement, color enhancement, edge detection, noise removal, and geometrical transformation may be used to isolate and enhance the first object 560 within the image.
- an image of the first object 560 may be generated from LIDAR, RADAR, or SONAR sensor data.
- line scanning LIDAR may be employed to capture a representation of the first object 560 by illuminating the first object 560 with laser light and measuring the time the reflection of the light takes to return to the sensor. Differences in return times and light wavelengths can then be used to generate a three-dimensional representation of the target.
- FIG. 9 sets forth a flow chart illustrating an exemplary method of geofence management with an unmanned aerial vehicle (UAV) in accordance with at least one embodiment of the present disclosure.
- UAV unmanned aerial vehicle
- the method of FIG. 9 includes after determining that the first location 562 of the detected first object 560 is not within the geofence of the area, selecting 902 from a plurality 980 of actions, based on the identification 850 of the detected first object 560, by the geofence manager 501 , a first set 990 of actions. Selecting 902 from a plurality 980 of actions, based on the identification 850 of the detected first object 560, by the geofence manager 501, a first set 990 of actions may be carried out by referring to an index or list that associates identifications of objects with one or more actions. In a particular embodiment, actions may be object specific.
- FIG. 9 also includes instructing 904, by the geofence manager 501, one or more devices 970 of the UAV system to perform the first set 990 of actions.
- Instructing 904, by the geofence manager 501, one or more devices 970 of the UAV system to perform the first set 990 of actions may be carried out by executing an operation or command at the device; transmitting a message, command, instruction to the device; transmitting a message, command, or instruction to another device that relays the message, command, or instruction to the device.
- FIG. 10 sets forth a flow chart illustrating an exemplary method of geofence management with an unmanned aerial vehicle (UAV) in accordance with at least one embodiment of the present disclosure.
- UAV unmanned aerial vehicle
- 10 also includes utilizing 502, by a geofence manager 501, a first set 550 of sensor data collected by a first set 552 of the in-flight UAVs 553 of the UAV system to detect a first object 560; utilizing 504, by the geofence manager 501, the first set 550 of sensor data to determine a first location 562 of the detected first object 560; determining 506, by the geofence manager 501, whether the first location 562 of the detected first object 560 is within a geofence of an area; and utilizing 802, by the geofence manager 501, the first set 552 of sensor data to determine an identification of the detected first object 560.
- the method of FIG. 10 includes after determining that the first location 562 of the detected first object 560 is within the geofence of the area, selecting 1002 from a plurality 1080 of actions, based on the identification 850 of the detected first object 560, by the geofence manager 501, a second set 1050 of actions. Selecting 1002 from a plurality 1080 of actions, based on the identification 850 of the detected first object 560, by the geofence manager 501, a second set 1050 of actions may be carried out by referring to an index or list that associates identifications of objects with one or more actions. In a particular embodiment, actions may be object specific.
- 11 also includes utilizing 502, by a geofence manager 501, a first set 550 of sensor data collected by a first set 552 of the in-flight UAVs 553 of the UAV system to detect a first object 560; utilizing 504, by the geofence manager 501, the first set 550 of sensor data to determine a first location 562 of the detected first object 560; and determining 506, by the geofence manager 501, whether the first location 562 of the detected first object 560 is within a geofence of an area.
- the method of FIG. 11 includes utilizing 1102, by the geofence manager 501, a second set 1150 of sensor data collected by a second set 1152 of the in-flight UAVs 553 of the UAV system, to identify a second object 1154.
- the second set of the in-flight UAVs may include the same in-flight UAVs as the first set.
- the second set of the in-flight UAVs may include at least some different inflight UAVs as the first set.
- the second set of sensor data may be include the same or different data than the first set of sensor data.
- a second set 1150 of sensor data collected by a second set 1152 of the in-flight UAVs 553 of the UAV system, to identify a second object 1154 may be carried out by using various sensor data, such as cameras, LIDAR, SONAR, and RADAR; and applying pattern recognition techniques using machine vision to detect and identify the object.
- the method of FIG. 11 also includes utilizing 1104, by the geofence manager 501, the second set 1150 of sensor data to determine a second location 1160 of the identified second object 1154.
- the second set 1150 of sensor data to determine a second location 1160 of the identified second object 1154 may be carried out by analyzing the second set 1150 of sensor data to determine the second location 1160 of the second object 1154 based on the relationship of the second object 1154 to one or more known locations.
- the location of the second object 1154 may be determined based on the location of the UAV (e.g., x-y or latitude-longitude location) determined from a GPS receiver, the compass orientation of the UAV, and the distance between the UAV and the second object 1154 as determined from, for example, LIDAR or SONAR data.
- the location of the second object 1154 may be determined using a variety of techniques based on knowing the location of the UAV from a GPS receiver.
- the method of FIG. 11 also includes creating 1106, by the geofence manager 501, the geofence around the second location 1160 of the identified second obj ect 1154.
- Creating 1106, by the geofence manager 501, the geofence around the second location 1160 of the identified second object 1154 may be carried out by calculating the locations of a perimeter in a radius around the second location; calculating the locations of a perimeter of a predetermined shape (e.g., a square, a rectangle); and calculating the locations of a perimeter of a computer-generated shape.
- a predetermined shape e.g., a square, a rectangle
- FIG. 12 sets forth a flow chart illustrating an exemplary method of geofence management with an unmanned aerial vehicle (UAV) in accordance with at least one embodiment of the present disclosure.
- UAV unmanned aerial vehicle
- 12 also includes utilizing 502, by a geofence manager 501, a first set 550 of sensor data collected by a first set 552 of the in-flight UAVs 553 of the UAV system to detect a first object 560; utilizing 504, by the geofence manager 501, the first set 550 of sensor data to determine a first location 562 of the detected first object 560; and determining 506, by the geofence manager 501, whether the first location 562 of the detected first object 560 is within a geofence of an area.
- the method of FIG. 12 includes receiving 1202, by the geofence manager 501, location data 1250 indicating a third location of a tracking device 1254.
- a tracking device may be any device that is capable of transmitting or broadcasting location data or be used to transmit a location. For example, GPS devices and satellite transceivers.
- Receiving 1202, by the geofence manager 501, location data 1250 indicating a third location of a tracking device 1254 may be carried out by directly receiving the location data; and receiving the location data from another device, such as a handheld device, a satellite, a cell tower, a wireless hub, and any other device that is capable of relaying information.
- the method of FIG. 12 also includes utilizing 1204, by the geofence manager 501, a third set 1260 of sensor data collected by a third set 1262 of the in-flight UAVs 553 of the UAV system, to determine a set 1270 of identifications of any objects within a predetermined proximity to the third location of the tracking device 1254.
- detecting an object may be carried out by using pattern recognition techniques using machine vision.
- machine vision may include visual sensors such as monocular cameras and stereo cameras, thermal imaging sensors, LIDAR sensors, SONAR sensors, and other imaging sensors that may be useful in object detection, recognition, and classification.
- pattern recognition techniques are applied to a still image obtained from a camera of the UAV (e.g., the camera 112 of FIG. 1).
- image processing such as contrast enhancement, color enhancement, edge detection, noise removal, and geometrical transformation may be used to isolate and enhance the first object 560 within the image.
- an image of the first object 560 may be generated from LIDAR, RADAR, or SONAR sensor data.
- line scanning LIDAR may be employed to capture a representation of the first object 560 by illuminating the first object 560 with laser light and measuring the time the reflection of the light takes to return to the sensor. Differences in return times and light wavelengths can then be used to generate a three-dimensional representation of the target.
- Determining 1206, by the geofence manager 501 , whether at least one identification of the set 1270 of identifications matches a stored identification 1290 of a particular object registered as being associated with the tracking device 1254 may be carried out by comparing the information and data of each identification in the set of identification to the information and data of the stored identification.
- FIG. 13 sets forth a flow chart illustrating an exemplary method of geofence management with an unmanned aerial vehicle (UAV) in accordance with at least one embodiment of the present disclosure.
- UAV unmanned aerial vehicle
- 13 also includes utilizing 502, by a geofence manager 501, a first set 550 of sensor data collected by a first set 552 of the in-flight UAVs 553 of the UAV system to detect a first object 560; utilizing 504, by the geofence manager 501, the first set 550 of sensor data to detennine a first location 562 of the detected first object 560; determining 506, by the geofence manager 501, whether the first location 562 of the detected first object 560 is within a geofence of an area; receiving 1202, by the geofence manager 501, location data 1250 indicating a third location of a tracking device 1254; utilizing 1204, by the geofence manager 501, a third set 1260 of sensor data collected by a third set 1262 of the in-flight UAVs 553 of the UAV system, to determine a set 1270 of identifications of any objects within a predetermined proximity to the third location of the tracking device 1254; and determining 1206, by the geofence manager
- Examples of actions that a user device, server, distributed computing device may perform include but are not limited to sending an alert, text, message indicating an update regarding the location of the detected object relative to the geofence; displaying a map that displays the geofence and any relevant objects; displaying objects that violate a parameter or rule related to the geofence (e.g., a detected object is within the geofence; a detected object is outside the geofence).
- the method of FIG. 14 also includes after determining that at least one identification of the set 1270 of identifications does not match the stored identification 1290 of the particular object registered as being associated with the tracking device 1254, instructing 1402, by the geofence manager 501, one or more devices 1450 of the UAV system to perform a second set 1460 of actions.
- Devices of the UAV system may include UAVs; control devices; user devices; servers; data servers; and distributed computing systems.
- An action may be an operation, command, task, or behavior of a device of the UAV system.
- Examples of actions that a UAV may perform include but are not limited to activating speakers and playing a sound; tuming-on a microphone and recording sound near the UAV ; switching and executing operation modes (e.g., switching from a surveillance mode to a follow mode in which the UAV tracks the detected object); activating crowd control measures (e.g., light and sound devices); sending messages to a user device or some other device of the UAV system; activating cameras and capturing images or video; and others as will occur to those of skill in the art in view of the present disclosure.
- operation modes e.g., switching from a surveillance mode to a follow mode in which the UAV tracks the detected object
- activating crowd control measures e.g., light and sound devices
- sending messages to a user device or some other device of the UAV system activating cameras and capturing images or video; and others as will occur to those of skill in the art in view of the present disclosure.
- Examples of actions that a user device, server, distributed computing device may perform include but are not limited to sending an alert, text, message indicating an update regarding the location of the detected object relative to the geofence; displaying a map that displays the geofence and any relevant objects; displaying objects that violate a parameter or rule related to the geofence (e.g., a detected object is within the geofence; a detected object is outside the geofence).
- Instructing 1402, by the geofence manager 501, one or more devices 1450 of the UAV system to perform a second set 1460 of actions may be carried out by executing an operation or command at the device; transmitting a message, command, instruction to the device; transmitting a message, command, or instruction to another device that relays the message, command, or instruction to the device.
- FIG. 15 sets forth a flow chart illustrating an exemplary method of geofence management with an unmanned aerial vehicle (UAV) in accordance with at least one embodiment of the present disclosure.
- a geofence manager 501 may include a set of computer program instructions that are executed by a processor.
- the geofence manager 501 of FIG. 5 may be the geofence manager 139 of FIGs. 1 and 2 or the geofence manager 145 of FIG. 1.
- the method of FIG. 15 includes utilizing 1502, by a geofence manager 1501, a first set 1550 of sensor data collected by a first set 1552 of the inflight UAVs 1554 of the UAV system, to detect a first object 1560.
- the sensor data is collected by the UAV and utilized by the UAV for object detection and object classification, or the collected sensor data is streamed to a remote device such as a UAV user device (e.g., the user device 120 of FIG. 1) or a server (e.g., the server 140 of FIG. 1) for object detection and object identification.
- a UAV user device e.g., the user device 120 of FIG. 1
- a server e.g., the server 140 of FIG.
- a first set 1550 of sensor data collected by a first set 1552 of the in-flight UAVs 1554 of the UAV system, to detect a first object 1560 is carried out through pattern recognition techniques using machine vision.
- machine vision may include visual sensors such as monocular cameras and stereo cameras, thermal imaging sensors, LIDAR sensors, SONAR sensors, and other imaging sensors that may be useful in object detection, recognition, and identification.
- pattern recognition techniques are applied to a still image obtained from a camera of the UAV (e.g., the camera 112 of FIG. 1).
- image processing such as contrast enhancement, color enhancement, edge detection, noise removal, and geometrical transformation may be used to isolate and enhance the first object 1560 within the image.
- an image of the first object 1560 may be generated from LIDAR, RADAR, or SONAR sensor data.
- line scanning LIDAR may be employed to capture a representation of the first object 1560 by illuminating the first object 1560 with laser light and measuring the time the reflection of the light takes to return to the sensor. Differences in return times and light wavelengths can then be used to generate a three-dimensional representation of the target.
- Feature detection and extraction techniques may be applied to the image to obtain a set of features useful in identifying the first object 1560.
- convolution neural networks, support vector machines, and/or deep learning methods are used to extract features of the object and/or identify the object.
- object recognition techniques such as region-based convolutional neural networks (R-CNN) or You Only Look Once (YOLO) may be useful in identifying, based on the sensor data collected by the in-flight UAVs, a classification of a detected object.
- template-based image matching may be used in which a set of sample points of the extracted features are compared to image templates for object identification.
- OCR optical character recognition
- SRT shape recognition technology
- a first set 1550 of sensor data collected by a first set 1552 of the in-flight UAVs 1554 of the UAV system, to detect a first object 1560 includes identifying object types that are particularly relevant to UAV operation and UAV missions. For example, exterior artifacts such as structures and vehicles are more likely to be relevant to UAV operation and UAV missions than interior artifacts such as furniture or appliances.
- the geofence manager 1501 may employ a particular set of object classifications for object or object type identification.
- object classifications may include person, animal, vehicle, structure, liquid, vegetation, smoke, fire, and so on, that may be encountered during UAV flight.
- the object classification is identified based on an association with another object.
- the geofence manager 1501 may recognize a tall structure and identify the structure as a high-tension power tine structure based on identified power lines attached to it.
- a characteristic may include patterns for recognition such as a bar code or quick response (QR) code, an object temperature, a movement characteristic such as smooth or intermittent, a gait style, object emissions, sound patterns, or other characteristics. Identifying the object type of a particular object may rely upon a plurality of sensors.
- the sensor data may include information from a camera for a visual identification, a microphone for audio detection, a GPS system for identifying location, and/or a thermal sensor for identifying a temperature.
- utilizing 1502, by a geofence manager 1501, a first set 1550 of sensor data collected by a first set 1552 of the in-flight UAVs 1554 of the UAV system, to detect a first object 1560 includes identifying the classification of the detected object in dependence upon the sensor data and one or more object models.
- identifying the classification of the detected object in dependence upon the sensor data and one or more object models is carried out by the geofence manager 1501 loading one or more object models and comparing the object pattern recognized from the sensor data.
- an artificial neural network may be trained on a set of training images for a particular object to generate an object model for that object.
- the object model may include a set of features represented by shape context vectors.
- the extracted features may be compared to the set of features for a candidate object model. This comparison may be scored based on the matching of extracted features of the detected object and features of the object model. The process is then repeated for other candidate object models. Based on the scores, a candidate object model may be selected as the matching object model upon which the detected object is classified.
- the entire set of object models may be filtered to produce the set of candidate object models. Filtering may be applied based on characteristics of the detected object or scene, conditions present in the UAV, one or more UAV missions, or combinations thereof. As one simplified example, based on the altitude of the UAV and the camera angle, it may be easily determined that the scene of the image that includes the detected object is a skyscape. This precludes object models that are ground-based such a people, animals, vehicles. Based on a mission of collision avoidance, the set of candidate models may be narrowed based on the altitude of the UAV or the detected object, which may preclude object models for houses and retail stores and small office buildings.
- the set of candidate object models may be filtered to exclude an office building, apartment building, or a construction crane.
- the set of candidate models may be, for example: aircraft, cell tower, or radio tower. If the detected object is actually a radio tower, the comparison of the extracted features of the detected object to the radio tower object model will score high than the comparisons based on the aircraft object model and the cell tower object model.
- the UAV may be preloaded with a set of object models in the memory of the UAV (e.g., the memory 106 of FIG. 1) prior to executing a mission.
- the UAV may be preloaded with object models that are specific to the UAV’s mission.
- the UAV may also receive object models in-flight that are transmitted from a remote device (e.g., the user device 120 or the server 140 of FIG. 1).
- the server may provide one or more object models from the entire set of object models, where the one or more object models are used in carrying out the UAV mission.
- a standard set of object models may be provided for typical UAV flight operation (e.g., UAV navigation, collision avoidance, and route planning), while a specialized set of object models may be provided for a particular UAV mission.
- a set of object models are stored on the same server as a map server that includes an airspace awareness map database.
- the method of FIG. 15 also includes utilizing 1504, by the geofence manager 1501, the first set 1550 of sensor data to determine a first location 1562 of the detected first object 1560.
- the first set 1550 of sensor data to determine a first location 1562 of the detected first object 1560 may be carried out by analyzing sensor data to determine a location 1562 of an object 1560 based on the relationship of the first object 1560 to one or more known locations.
- the location of the first object 1560 may be determined based on the location of the UAV (e.g., x-y or latitude-longitude location) determined from a GPS receiver, the compass orientation of the UAV, and the distance between the UAV and the first object 1560 as determined from, for example, LIDAR or SONAR data.
- the location of the first object 1560 may be determined using a variety of techniques based on knowing the location of the UAV from a GPS receiver.
- a time-of-flight camera that includes an integrated light source and a camera is used to measure distance information for every pixel in the image by emitting a light pulse flash and calculating the time needed for the light to reach the first object 1560 and reflect back to the camera.
- LIDAR is used to determine how long it takes for a laser pulse to travel from the sensor to the first object 1560 and back and calculate the distance from the speed of light.
- image processing algorithms are used to match sequential images taken by the same camera to determine distance to objects in the image.
- the method of FIG. 15 also includes creating 1506, by the geofence manager 1501, a geofence around the first location 1562 of the detected first object 1560.
- a geofence is a virtual perimeter around a real -world, physical, geographic area.
- the area around which the geofence is constructed or created may be any shape or size.
- the geofence may also be created in any number of ways including but not limited to a user drawing a perimeter line in a mapping application; a user providing coordinates for the perimeter; an application dynamically generating the perimeter around a fixed location or an object.
- Creating 1506, by the geofence manager 1501, a geofence around the first location 1562 of the detected first object 1560 may be carried out by calculating the locations of a perimeter in a radius around the second location; calculating the locations of a perimeter of a predetermined shape (e.g., a square, a rectangle); and calculating the locations of a perimeter of a computer-generated shape.
- a predetermined shape e.g., a square, a rectangle
- FIG. 16 sets forth a flow chart illustrating an exemplary method of geofence management with an unmanned aerial vehicle (UAV) in accordance with at least one embodiment of the present disclosure.
- UAV unmanned aerial vehicle
- 16 also includes utilizing 1502, by a geofence manager 1501, a first set 1550 of sensor data collected by a first set 1552 of the in-flight UAVs 1554 of the UAV system, to detect a first object 1560; utilizing 1504, by the geofence manager 1501, the first set 1550 of sensor data to determine a first location 1562 of the detected first object 1560; and creating 1506, by the geofence manager 1501, a geofence around the first location 1562 of the detected first object 1560.
- the method of FIG. 16 also includes utilizing 1602, by the geofence manager 1501, a second set 1650 of sensor data collected by a second set 1652 of the in-flight UAVs 1554 of the UAV system to detect a second object 1660.
- a second set 1650 of sensor data collected by a second set 1652 of the in-flight UAVs 1554 of the UAV system to detect a second object 1660 may be carried out by pattern recognition techniques using machine vision.
- machine vision may include visual sensors such as monocular cameras and stereo cameras, thermal imaging sensors, LIDAR sensors, SONAR sensors, and other imaging sensors that may be useful in object detection, recognition, and classification.
- pattern recognition techniques are applied to a still image obtained from a camera of the UAV (e.g., the camera 112 of FIG. I).
- image processing such as contrast enhancement, color enhancement, edge detection, noise removal, and geometrical transformation may be used to isolate and enhance the first object 560 within the image.
- an image of the first object 1560 may be generated from LIDAR, RADAR, or SONAR sensor data.
- line scanning LIDAR may be employed to capture a representation of the first object 1560 by illuminating the first object 560 with laser light and measuring the time the reflection of the light takes to return to the sensor. Differences in return times and light wavelengths can then be used to generate a three-dimensional representation of the target.
- the method of FIG. 16 also includes utilizing 1604, by the geofence manager 1501, the second set 1650 of sensor data to determine a second location 1662 of the detected second object 1660.
- Utilizing 1604, by the geofence manager 1501, the second set 1650 of sensor data to determine a second location 1662 of the detected second object 1660 may be carried out by analyzing sensor data to determine a location of an object based on the relationship of the object to one or more known locations.
- FIG. 17 sets forth a flow chart illustrating an exemplary method of geofence management with an unmanned aerial vehicle (UAV) in accordance with at least one embodiment of the present disclosure.
- UAV unmanned aerial vehicle
- 17 also includes utilizing 1502, by a geofence manager 1501, a first set 1550 of sensor data collected by a first set 1552 of the in-flight UAVs 1554 of the UAV system, to detect a first object 1560; utilizing 1504, by the geofence manager 1501, the first set 1550 of sensor data to determine a first location 1562 of the detected first object 1560; creating 1506, by the geofence manager 1501, a geofence around the first location 1562 of the detected first object 1560; utilizing 1602, by the geofence manager 1501, a second set 1650 of sensor data collected by a second set 1652 of the in-flight UAVs 1554 of the UAV system to detect a second object 1660; utilizing 1604, by the geofence manager 1501, the second set 1650 of sensor data to detennine a second location 1662 of the detected second object 1660; and determining 1606, by the geofence manager 1501, whether the second location 1662 of the detected second object 1660 is within the geofence.
- the method of FIG. 17 includes after determining that the second location 1662 of the detected second object 1660 is not within the geofence, instructing 1702, by the geofence manager 1501, one or more devices 1750 of the UAV system to perform a first set 1752 of actions.
- Devices of the UAV system may include UAVs; control devices; user devices; servers; data servers; and distributed computing systems.
- An action may be an operation, command, task, or behavior of a device of the UAV system.
- Examples of actions that a UAV may perform include but are not limited to activating speakers and playing a sound; turning- on a microphone and recording sound near the UAV; switching and executing operation modes (e.g., switching from a surveillance mode to a follow mode in which the UAV tracks the detected object); activating crowd control measures (e.g., light and sound devices); sending alerts, texts, and messages to a user device or some other device of the UAV system; activating cameras and capturing images or video; and others as will occur to those of skill in the art in view of the present disclosure.
- operation modes e.g., switching from a surveillance mode to a follow mode in which the UAV tracks the detected object
- activating crowd control measures e.g., light and sound devices
- sending alerts, texts, and messages to a user device or some other device of the UAV system
- activating cameras and capturing images or video and others as will occur to those of skill in the art in view of the present disclosure.
- Examples of actions that a user device, server, distributed computing device may perform include but are not limited to sending an alert, a text, a message indicating an update regarding the location of the detected object relative to the geofence; displaying a map that displays the geofence and any relevant objects; displaying objects that violate a parameter or rule related to the geofence (e g., a detected object is within the geofence; a detected object is outside the geofence).
- a parameter or rule related to the geofence e g., a detected object is within the geofence; a detected object is outside the geofence.
- FIG. 18 sets forth a flow chart illustrating an exemplary method of geofence management with an unmanned aerial vehicle (UAV) in accordance with at least one embodiment of the present disclosure.
- UAV unmanned aerial vehicle
- 18 also includes utilizing 1502, by a geofence manager 1501, a first set 1550 of sensor data collected by a first set 1552 of the in-flight UAVs 1554 of the UAV system, to detect a first object 1560; utilizing 1504, by the geofence manager 1501, the first set 1550 of sensor data to determine a first location 1562 of the detected first object 1560; creating 1506, by the geofence manager 1501, a geofence around the first location 1562 of the detected first object 1560; utilizing 1602, by the geofence manager 1501, a second set 1650 of sensor data collected by a second set 1652 of the in-flight UAVs 1554 of the UAV system to detect a second object 1660; utilizing 1604, by the geofence manager 1501, the second set 1650 of sensor data to determine a second location 1662 of the detected second object 1660; and determining 1606, by the geofence manager 1501, whether the second location 1662 of the detected second object 1660 is within the geofence.
- the method of FIG. 18 includes after determining that the second location 1662 of the detected second object 1660 is within the geofence, instructing 1802, by the geofence manager 1501, one or more devices 1850 of the UAV system to perform a second set 1852 of actions
- Devices of the UAV system may include UAVs; control devices; user devices; servers; data servers; and distributed computing systems.
- An action may be an operation, command, task, or behavior of a device of the UAV system.
- Examples of actions that a UAV may perform include but are not limited to activating speakers and playing a sound; turning- on a microphone and recording sound near the UAV; switching and executing operation modes (e.g., switching from a surveillance mode to a follow mode in which the UAV tracks the detected object); activating crowd control measures (e.g., light and sound devices); sending alerts, texts, and messages to a user device or some other device of the UAV system; activating cameras and capturing images or video; and others as will occur to those of skill in the art in view of the present disclosure.
- operation modes e.g., switching from a surveillance mode to a follow mode in which the UAV tracks the detected object
- activating crowd control measures e.g., light and sound devices
- sending alerts, texts, and messages to a user device or some other device of the UAV system
- activating cameras and capturing images or video and others as will occur to those of skill in the art in view of the present disclosure.
- Examples of actions that a user device, server, distributed computing device may perform include but are not limited to sending an alert, a text, a message indicating an update regarding the location of the detected object relative to the geofence; displaying a map that displays the geofence and any relevant objects; displaying objects that violate a parameter or rule related to the geofence (e.g., a detected object is within the geofence; a detected object is outside the geofence).
- a parameter or rule related to the geofence e.g., a detected object is within the geofence; a detected object is outside the geofence.
- Instructing 1802, by the geofence manager 1501, one or more devices 1850 ofthe UAV system to perform a second set 1852 of actions may be carried out by executing an operation or command at the device; transmitting a message, command, instruction to the device; transmitting a message, command, or instruction to another device that relays the message, command, or instruction to the device.
- the method of FIG. 19 also includes utilizing 1902, by the geofence manager 1501, the second set 1650 of sensor data to determine an identification 1952 of the detected second object 1660.
- detecting and identifying an object may be carried out by using pattern recognition techniques using machine vision.
- machine vision may include visual sensors such as monocular cameras and stereo cameras, thermal imaging sensors, LIDAR sensors, SONAR sensors, and other imaging sensors that may be useful in object detection, recognition, and classification.
- pattern recognition techniques are applied to a still image obtained from a camera of the UAV (e g., the camera 112 of FIG. 1).
- image processing such as contrast enhancement, color enhancement, edge detection, noise removal, and geometrical transformation may be used to isolate and enhance the object within the image.
- an image of the object may be generated from LIDAR, RADAR, or SONAR sensor data.
- line scanning LIDAR may be employed to capture a representation of the object by illuminating the object with laser light and measuring the time the reflection of the light takes to return to the sensor. Differences in return times and light wavelengths can then be used to generate a three-dimensional representation of the target.
- FIG. 20 sets forth a flow chart illustrating an exemplary method of geofence management with an unmanned aerial vehicle (UAV) in accordance with at least one embodiment of the present disclosure.
- UAV unmanned aerial vehicle
- the method of FIG. 20 includes after determining that the second location 1662 of the detected second object 1660 is not within the geofence, selecting 2002 from a plurality 2050 of actions, based on the identification 1952 of the detected second object 1660, by the geofence manager 1501, a first set 2052 of actions. Selecting 2002 from a plurality 2050 of actions, based on the identification 1952 of the detected second object 1660, by the geofence manager 1501, a first set 2052 of actions may be carried out by referring to an index or list that associates identifications of objects with one or more actions. In a particular embodiment, actions may be object specific.
- the method of FIG. 20 includes instructing 2004, by the geofence manager 1501, one or more devices 2060 of the UAV system to perform the first set 2052 of actions.
- Instructing 2004, by the geofence manager 1501, one or more devices 2060 of the UAV system to perform the first set 2052 of actions may be carried out by executing an operation or command at the device: transmitting a message, command, instruction to the device; transmitting a message, command, or instruction to another device that relays the message, command, or instruction to the device.
- FIG. 21 sets forth a flow chart illustrating an exemplary method of geofence management with an unmanned aerial vehicle (UAV) in accordance with at least one embodiment of the present disclosure.
- UAV unmanned aerial vehicle
- the method of FIG. 21 also includes after determining that the second location 1662 of the detected second object 1660 is within the geofence, selecting 2102 from a plurality 2150 of actions, based on the identification 1952 of the detected second object 1660, by the geofence manager 1501, a second set 2152 of actions. Selecting 2102 from a plurality 2150 of actions, based on the identification 1952 of the detected second object 1660, by the geofence manager 1501, a second set 2152 of actions may be carried out by referring to an index or list that associates identifications of objects with one or more actions.
- the method of FIG. 21 also includes instructing 2104, by the geofence manager 1501, one or more devices 2160 of the UAV system to perform the second set 2152 of actions Instructing 2104, by the geofence manager 1501, one or more devices 2160 of the UAV system to perform the second set 2152 of actions may be carried out by executing an operation or command at the device: transmitting a message, command, instruction to the device; transmitting a message, command, or instruction to another device that relays the message, command, or instruction to the device.
- FIG. 22 sets forth a flow chart illustrating an exemplary method of geofence management with an unmanned aerial vehicle (UAV) in accordance with at least one embodiment of the present disclosure.
- a geofence manager 501 may include a set of computer program instructions that are executed by a processor.
- the geofence manager 501 of FIG. 22 may be the geofence manager 139 of FIGs. 1 and 2 or the geofence manager 145 of FIG. 1.
- the method of FIG. 22 includes receiving 2202, by a geofence manager 2201, location data 2250 indicating a first location 2252 of a tracking device 2254.
- a tracking device may be any device that is capable of transmitting or broadcasting location data or be used to transmit a location.
- Receiving 2202, by a geofence manager 2201, location data 2250 indicating a first location 2252 of a tracking device 2254 may be carried out by directly receiving the location data; receiving the location data from another device, such as a handheld device, a satellite, a cell tower, a wireless hub, and any other device that is capable of relaying information.
- the method of Fig. 22 also includes utilizing 2204, by the geofence manager 2201, a first set 2260 of sensor data collected by a first set 2262 of the in-flight UAVs 2264 of the UAV system, to detect a first object 2270 at the first location 2252 of the tracking device 2254.
- detecting an object may be carried out by using pattern recognition techniques using machine vision.
- machine vision may include visual sensors such as monocular cameras and stereo cameras, thermal imaging sensors, LIDAR sensors, SONAR sensors, and other imaging sensors that may be useful in object detection, recognition, and classification.
- pattern recognition techniques are applied to a still image obtained from a camera of the UAV (e.g., the camera 112 of FIG. 1).
- image processing such as contrast enhancement, color enhancement, edge detection, noise removal, and geometrical transformation may be used to isolate and enhance the first object 2270 within the image.
- an image of the first object 2270 may be generated from LIDAR, RADAR, or SONAR sensor data.
- line scanning LIDAR may be employed to capture a representation of the first object 2270 by illuminating the first object 2270 with laser light and measuring the time the reflection of the light takes to return to the sensor. Differences in return times and light wavelengths can then be used to generate a three-dimensional representation of the target.
- the first set 2260 of sensor data to determine a first identification 2272 of the detected first object 2270 may be carried out by identifying the classification of the detected object in dependence upon the sensor data and one or more object models; and identifying object types that are particularly relevant to UAV operation and UAV missions.
- the method of FIG. 22 also includes determining 2208, by the geofence manager 2201, whether the first identification 2272 of the detected first object 2270 matches a stored identification 2280 of a particular object registered as being associated with the tracking device 2254.
- a stored identification of a particular object registered as being associated with the tracking device may be a person, animal, vehicle, or other type of object.
- a tracking device may be registered to a particular person have an identification (e.g., a picture of the person; a classification of the person; a type of object; etc).
- Determining 2208, by the geofence manager 2201, whether the first identification 2272 of the detected first object 2270 matches a stored identification 2280 of a particular object registered as being associated with the tracking device 2254 may be carried out by comparing the information and data of each identification in the set of identification to the information and data of the stored identification.
- FIG. 23 sets forth a flow chart illustrating an exemplary method of geofence management with an unmanned aerial vehicle (UAV) in accordance with at least one embodiment of the present disclosure.
- UAV unmanned aerial vehicle
- 23 also includes receiving 2202, by a geofence manager 2201, location data 2250 indicating a first location 2252 of a tracking device 2254; utilizing 2204, by the geofence manager 2201, a first set 2260 of sensor data collected by a first set 2262 of the in-flight UAVs 2264 of the UAV system, to detect a first object 2270 at the first location 2252 of the tracking device 2254; utilizing 2206, by the geofence manager 2201, the first set 2260 of sensor data to determine a first identification 2272 of the detected first object 2270; and determining 2208, by the geofence manager 2201, whether the first identification 2272 of the detected first object 2270 matches a stored identification 2280 of a particular object registered as being associated with the tracking device 2254.
- the method of FIG. 23 includes creating 2302, by the geofence manager 2201, a geofence around the first location 2252 of the tracking device 2254.
- a geofence is a virtual perimeter around a real-world, physical, geographic area.
- the area around which the geofence is constructed or created may be any shape or size.
- the geofence may also be created in any number of ways including but not limited to a user drawing a perimeter line in a mapping application; a user providing coordinates for the perimeter; an application dynamically generating the perimeter around a fixed location or an object.
- 24 also includes receiving 2202, by a geofence manager 2201, location data 2250 indicating a first location 2252 of a tracking device 2254; utilizing 2204, by the geofence manager 2201, a first set 2260 of sensor data collected by a first set 2262 of the in-flight UAVs 2264 of the UAV system, to detect a first object 2270 at the first location 2252 of the tracking device 2254; utilizing 2206, by the geofence manager 2201, the first set 2260 of sensor data to determine a first identification 2272 of the detected first object 2270; determining 2208, by the geofence manager 2201, whether the first identification 2272 of the detected first object 2270 matches a stored identification 2280 of a particular object registered as being associated with the tracking device 2254; and creating 2302, by the geofence manager 2201, a geofence around the first location 2252 of the tracking device 2254.
- the method of FIG. 24 also includes utilizing 2404, by the geofence manager 2201, the second set 2450 of sensor data to determine a second location 2480 of the detected second object 2460.
- Utilizing 2404, by the geofence manager 2201, the second set 2450 of sensor data to determine a second location 2480 of the detected second object 2460 may be carried out by analyzing sensor data to determine a location of an object based on the relationship of the object to one or more known locations.
- LIDAR is used to determine how long it takes for a laser pulse to travel from the sensor to the object and back and calculate the distance from the speed of light.
- image processing algorithms are used to match sequential images taken by the same camera to determine distance to objects in the image.
- Exemplary embodiments of the present invention are described largely in the context of a fully functional computer system for managing UAV software modules. Readers of skill in the art will recognize, however, that the present invention also may be embodied in a computer program product disposed upon computer readable storage media for use with any suitable data processing system.
- Such computer readable storage media may be any storage medium for machine-readable information, including magnetic media, optical media, or other suitable media. Examples of such media include magnetic disks in hard drives or diskettes, compact disks for optical drives, magnetic tape, and others as wall occur to those of skill in the art.
- Persons skilled in the art will immediately recognize that any computer system having suitable programming means will be capable of executing the steps of the method of the invention as embodied in a computer program product. Persons skilled in the art will recognize also that, although some of the exemplary embodiments described in this specification are oriented to software installed and executing on computer hardware, nevertheless, alternative embodiments implemented as firmware or as hardware are well within the scope of the present invention.
- the present invention may be a system, a method, and/or a computer program product.
- the computer program product may include a computer readable storage medium (or media) having computer readable program instructions thereon for causing a processor to carry out aspects of the present invention.
- a non-exhaustive list of more specific examples of the computer readable storage medium includes the following: a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), a static random access memory (SRAM), a portable compact disc read-only memory (CD- ROM), a digital versatile disk (DVD), a memory stick, a floppy disk, a mechanically encoded device such as punch-cards or raised structures in a groove having instructions recorded thereon, and any suitable combination of the foregoing.
- RAM random access memory
- ROM read-only memory
- EPROM or Flash memory erasable programmable read-only memory
- SRAM static random access memory
- CD- ROM compact disc read-only memory
- DVD digital versatile disk
- memory stick a floppy disk
- a mechanically encoded device such as punch-cards or raised structures in a groove having instructions recorded thereon
- a computer readable storage medium is not to be construed as being transitory signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through a waveguide or other transmission media (e.g., light pulses passing through a fiberoptic cable), or electrical signals transmitted through a wire.
- Computer readable program instructions described herein can be downloaded to respective computing/processing devices from a computer readable storage medium or to an external computer or external storage device via a network, for example, the Internet, a local area netw ork, a wide area network and/or a wireless network.
- the network may comprise copper transmission cables, optical transmission fibers, wireless transmission, routers, firewalls, switches, gateway computers and/or edge servers.
- a network adapter card or network interface in each computing/processing device receives computer readable program instructions from the network and forwards the computer readable program instructions for storage in a computer readable storage medium within the respective computing/processing device.
- the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet Service Provider).
- electronic circuitry including, for example, programmable logic circuitry, field-programmable gate arrays (FPGA), or programmable logic arrays (PLA) may execute the computer readable program instructions by utilizing state information of the computer readable program instructions to personalize the electronic circuitry, in order to perform aspects of the present invention.
- Hardware logic including programmable logic for use with a programmable logic device (PLD) implementing all or part of the functionalitv previously described herein, may be designed using traditional manual methods or may be designed, captured, simulated, or documented electronically using various tools, such as Computer Aided Design (CAD) programs, a hardware description language (e.g., VHDL or Verilog), or a PLD programming language. Hardware logic may also be generated by a non-transitory computer readable medium storing instructions that, when executed by a processor, manage parameters of a semiconductor component, a cell, a 1 i b rary of components, or a library of cells in electronic design automation (EDA) software to generate a manufacturable design for an integrated circuit.
- EDA electronic design automation
- These computer readable program instructions may be provided to a processor of a general-purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/ acts specified in the flowchart and/or block diagram block or blocks.
- These computer readable program instructions may also be stored in a computer readable storage medium that can direct a computer, a programmable data processing apparatus, and/or other devices to function in a particular manner, such that the computer readable storage medium having instructions stored therein comprises an article of manufacture including instructions which implement aspects of the function/act specified in the flowchart and/or block diagram block or blocks.
- the computer readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process, such that the instructions which execute on the computer, other programmable apparatus, or other device implement the functions/acts specified in the flowchart and/or block diagram block or blocks.
- each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which comprises one or more executable instructions for implementing the specified logical function(s).
- the functions noted in the block may occur out of the order noted in the figures.
- two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved.
Landscapes
- Engineering & Computer Science (AREA)
- Aviation & Aerospace Engineering (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Automation & Control Theory (AREA)
- Traffic Control Systems (AREA)
Abstract
Des procédés, des systèmes, des appareils et des produits programmes d'ordinateur pour la gestion de périmètre virtuel par un véhicule aérien sans pilote (UAV) sont divulgués. Dans un mode de réalisation particulier, un procédé de gestion de périmètre virtuel avec un UAV comprend un gestionnaire de périmètre virtuel utilisant un premier ensemble de données de capteur recueillies par un premier ensemble d'UAV en vol du système d'UAV afin de détecter un premier objet. Dans ce mode de réalisation, le gestionnaire de périmètre virtuel utilise également le premier ensemble de données de capteur pour déterminer un premier emplacement du premier objet détecté et détermine si le premier emplacement du premier objet détecté se trouve à l'intérieur d'un périmètre virtuel d'une zone.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US202263316402P | 2022-03-03 | 2022-03-03 | |
US63/316,402 | 2022-03-03 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2023168186A1 true WO2023168186A1 (fr) | 2023-09-07 |
Family
ID=85771985
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/US2023/063192 WO2023168186A1 (fr) | 2022-03-03 | 2023-02-24 | Gestion de périmètre virtuel par véhicule aérien sans pilote |
Country Status (2)
Country | Link |
---|---|
US (1) | US20230282122A1 (fr) |
WO (1) | WO2023168186A1 (fr) |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2018017412A1 (fr) * | 2016-07-18 | 2018-01-25 | GeoFrenzy, Inc. | Systèmes et procédés pour définir et mettre en oeuvre des règles pour des barrières géographiques tridimensionnelles |
US20190141982A1 (en) * | 2017-11-16 | 2019-05-16 | Brian Wayne Carnell | Methods and systems for directing animals away from an area |
US20200154695A1 (en) * | 2018-11-16 | 2020-05-21 | BirdBrAin Inc. | Methods and systems for automatically relocating a pest deterrent system |
-
2023
- 2023-02-24 WO PCT/US2023/063192 patent/WO2023168186A1/fr unknown
- 2023-02-24 US US18/174,305 patent/US20230282122A1/en active Pending
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2018017412A1 (fr) * | 2016-07-18 | 2018-01-25 | GeoFrenzy, Inc. | Systèmes et procédés pour définir et mettre en oeuvre des règles pour des barrières géographiques tridimensionnelles |
US20190141982A1 (en) * | 2017-11-16 | 2019-05-16 | Brian Wayne Carnell | Methods and systems for directing animals away from an area |
US20200154695A1 (en) * | 2018-11-16 | 2020-05-21 | BirdBrAin Inc. | Methods and systems for automatically relocating a pest deterrent system |
Also Published As
Publication number | Publication date |
---|---|
US20230282122A1 (en) | 2023-09-07 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11335204B2 (en) | Flight path deconfliction among unmanned aerial vehicles | |
US20220343773A1 (en) | Updating airspace awareness for unmanned aerial vehicles | |
US20210304621A1 (en) | Utilizing unmanned aerial vehicles for emergency response | |
US11436930B2 (en) | Recording data associated with an unmanned aerial vehicle | |
US20210304625A1 (en) | Monotonic partitioning in unmanned aerial vehicle search and surveillance | |
US11945582B2 (en) | Coordinating an aerial search among unmanned aerial vehicles | |
US20220351631A1 (en) | Unmanned aerial vehicle response to object detection | |
US20220351626A1 (en) | Multi-objective mission planning and execution for an unmanned aerial vehicle | |
US20240078913A1 (en) | Automated preflight evaluation of an unmanned aerial vehicle configuration | |
US20220392352A1 (en) | Unmanned aerial vehicle module management | |
US20210217317A1 (en) | Decentralized oracles in an unmanned aerial vehicle (uav) transportation ecosystem | |
US20220383762A1 (en) | Increasing awareness of an environmental condition for an unmanned aerial vehicle | |
US20240233559A1 (en) | Accessing information regarding an unmanned aerial vehicle | |
US20230282122A1 (en) | Geofence management with an unmanned aerial vehicle | |
WO2021046005A1 (fr) | Agrégation de données pour navigation de véhicule aérien sans pilote (uav) | |
US20230282121A1 (en) | Displaying electromagnetic spectrum information for unmanned aerial vehicle (uav) navigation | |
US20220011784A1 (en) | Making a determination regarding consensus using proofs of altitude of unmanned aerial vehicles | |
EP4330945A1 (fr) | Incitation à l'utilisation d'un véhicule aérien sans pilote |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 23713240 Country of ref document: EP Kind code of ref document: A1 |