WO2020136640A1 - System and method for execution of an autonomous airborne scanning-mission - Google Patents
System and method for execution of an autonomous airborne scanning-mission Download PDFInfo
- Publication number
- WO2020136640A1 WO2020136640A1 PCT/IL2019/051396 IL2019051396W WO2020136640A1 WO 2020136640 A1 WO2020136640 A1 WO 2020136640A1 IL 2019051396 W IL2019051396 W IL 2019051396W WO 2020136640 A1 WO2020136640 A1 WO 2020136640A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- leg
- turn
- section
- computer
- maneuver
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G5/00—Traffic control systems for aircraft
- G08G5/70—Arrangements for monitoring traffic-related situations or conditions
- G08G5/74—Arrangements for monitoring traffic-related situations or conditions for monitoring terrain
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G5/00—Traffic control systems for aircraft
- G08G5/20—Arrangements for acquiring, generating, sharing or displaying traffic information
- G08G5/21—Arrangements for acquiring, generating, sharing or displaying traffic information located onboard the aircraft
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G5/00—Traffic control systems for aircraft
- G08G5/30—Flight plan management
- G08G5/32—Flight plan management for flight plan preparation
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G5/00—Traffic control systems for aircraft
- G08G5/50—Navigation or guidance aids
- G08G5/55—Navigation or guidance aids for a single aircraft
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B64—AIRCRAFT; AVIATION; COSMONAUTICS
- B64U—UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
- B64U2101/00—UAVs specially adapted for particular uses or applications
- B64U2101/30—UAVs specially adapted for particular uses or applications for imaging, photography or videography
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B64—AIRCRAFT; AVIATION; COSMONAUTICS
- B64U—UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
- B64U2201/00—UAVs characterised by their flight controls
- B64U2201/10—UAVs characterised by their flight controls autonomous, i.e. by navigating independently from ground or air stations, e.g. by using inertial navigation systems [INS]
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G5/00—Traffic control systems for aircraft
- G08G5/50—Navigation or guidance aids
- G08G5/57—Navigation or guidance aids for unmanned aircraft
Definitions
- the presently disclosed subject matter relates to the field of aerial missions executed by an aircraft.
- UAV unmanned aerial vehicle
- an imaging system mounted on a UAV can be used for the purpose of imagery collection and analysis in terrain dominance related applications such as reconnaissance, cartography, land use, environmental conditions studies and more.
- Other examples of missions include aerial application (crop dusting), fire extinguishing, irrigation, etc.
- Some aerial missions such as those related to terrain dominance mentioned above, involve flying over a certain area of interest (AOI) on the ground with the intent of systematically scanning ⁇ covering the entire area.
- AOI area of interest
- a camera system mounted onboard an aircraft is used for systematically scanning an AOI in order to collect imaging data of the entire area.
- a method of autonomously maneuvering an aircraft over an area of interest during a scanning-mission where the scanning-mission includes flying over the area of interest along a flight path that comprises multiple legs, wherein all legs traverse the area of interest in substantially the same direction (or azimuth) and each two consecutive legs are connected by a turn, the method comprising:
- mapping data indicative of boundaries of the area of interest to be scanned by the aircraft
- mapping data to select a selected cross-section of the area of interest from a plurality of cross-sections, each cross-section from among the plurality of cross-sections is characterized by a different angle relative to a certain frame of reference (e.g. global coordinate system) and comprises a respective section confined by two projection points, each of the two projection points are a projection of a respective extreme vertex of a polygon representing the area of interest;
- a certain frame of reference e.g. global coordinate system
- the flight path comprising a plurality of legs, where all legs are aligned with the selected flight direction, thereby reducing the number of turns during the scanning-mission relative to other possible flight directions ;
- the method according to this aspect of the presently disclosed subject matter can optionally comprise one or more of features
- the method further comprising: for each cross-section of the plurality of cross-sections, calculating the length of the respective section, comprising:
- the scanning-mission includes operating a hyperspectral imaging system over the AOI, and wherein the range of angles is determined according to the position of the sun relative to the AOI.
- the method further comprising: operating the at least one processing circuitry for selecting a turning maneuver during transition from a first leg to a second leg, wherein flying direction along the first leg is substantially parallel and at an opposite direction to flying direction along the second leg, the method comprising:
- a first turning maneuver that includes:
- first turn exiting the current leg in a first direction opposite to the direction of the second leg the first turn is aimed to increase the distance of the aircraft from the second leg; a second turn in a second direction toward the next leg, wherein the diameter of the second turn is such that the second turn ends at an ending point located beyond the next leg; and a third turn from the ending point of the second turn to the entry point of the next leg;
- performing a second turning maneuver that includes:
- each turn in the first turning maneuver and the second turning maneuver is part of a circle characterized by a diameter that is equal to the minimal effective turning diameter.
- the method further comprising operating the at least one processing circuitry for selecting a circling maneuver for repeating a traversed section within a current leg, the method comprising:
- the method further comprising: operating the at least one processing circuitry for selecting a turning maneuver during transition from a first leg to a second leg, wherein flying direction along the first leg is substantially parallel and at an opposite direction to flying direction along the second leg, the method comprising:
- the method further comprising: operating the at least one processing circuitry for selecting a circling maneuver for repeating a traversed section within a current leg; the method comprising:
- a system mountable on an aircraft for autonomously maneuvering the aircraft over an area of interest during a scanning-mission, where the scanning- mission includes flying over the area of interest along a flight path that comprises multiple legs, wherein all legs traverse the area of interest in substantially the same direction and each two consecutive legs are connected by a turn, the system comprises a computer and a payload, the computer comprising one or more processing circuitries configured to:
- mapping data indicative of boundaries of the area of interest to be scanned by the aircraft
- mapping data to select a selected cross-section of the area of interest from a plurality of cross-sections, each cross-section from among the plurality of cross-sections is characterized by a different angle relative to a certain frame of reference (e.g. global coordinate system) and comprises a respective section confined by two projection points, each of the two projection points are a projection of a respective extreme vertex of a polygon representing the area of interest;
- a certain frame of reference e.g. global coordinate system
- the flight path comprising a plurality of legs, where all legs are aligned with the selected flight direction, thereby reducing the number of turns during the scanning-mission relative to other possible flight directions ;
- a computer program product comprising a non-transitory computer useable medium having computer readable program code embodied therein for autonomously maneuvering an aircraft over an area of interest during a scanning- mission, where the scanning-mission includes flying over the area of interest along a flight path that comprises multiple legs, wherein all legs traverse the area of interest in substantially the same direction and each two consecutive legs are connected by a turn;
- the computer program product comprising:
- mapping data indicative of boundaries of the area of interest to be scanned by the aircraft
- each cross-section from among the plurality of cross- sections is characterized by a different angle relative to a certain frame of reference (e.g. global coordinate system) and comprises a respective section confined by two projection points, each of the two projection points are a projection of a respective extreme vertex of a polygon representing the area of interest; wherein the selected cross-section is characterized by the shortest respective section;
- a certain frame of reference e.g. global coordinate system
- an aircraft configured with autonomous flying capabilities (e.g. a UAV) that comprises a system for autonomously maneuvering the aircraft over an area of interest during a scanning-mission, as disclosed in the aspect above.
- the method, the computer program product, and the aircraft disclosed in accordance with the presently disclosed subject matter can optionally comprise one or more of features (i) to (xii) listed above, mutatis mutandis, in any technically possible combination or permutation.
- a computer program product comprising a non- transitory computer useable medium having computer readable program code embodied therein for autonomously maneuvering an aircraft over an area of interest; the computer program product comprising:
- the computer readable program code for causing the computer to perform a first turning maneuver, in case the minimal effective turning diameter is greater than a distance crossing between the first leg and the second leg, the first turning maneuver comprises:
- the presently disclosed subject matter further contemplates a method of autonomously controlling an aircraft (e.g. during a scanning-mission) and selecting a turning maneuver during transition from a first leg to a second leg as disclosed above, as well as a system mountable on an aircraft configured and operable for executing the method.
- a computer program product comprising a non- transitory computer useable medium having computer readable program code embodied therein, the computer program product comprising:
- the computer program product further includes a computer readable program code for causing the computer to generate instructions for controlling the aircraft according to the selected turning maneuver.
- the presently disclosed subject matter further contemplates a method of autonomously controlling an aircraft (e.g. during a scanning-mission) and selecting a circling maneuver during transition from a first leg to a second leg as disclosed above, as well as a system mountable on an aircraft configured and operable for executing the method.
- a computer program product comprising a non- transitory computer useable medium having computer readable program code embodied therein; the computer program product comprising:
- computer readable program code for causing the computer to select a circling maneuver for repeating a traversed section within a current leg; the computer program product further comprising: computer readable program code for causing the computer, responsive to detection of a need to repeat a traversed section within a leg to:
- the presently disclosed subject matter further contemplates a method of autonomously controlling an aircraft (e.g. during a scanning-mission) and selecting a circling maneuver during transition from a first leg to a second leg as disclosed above, as well as a system mountable on an aircraft configured and operable for executing the method.
- a computer program product comprising a non- transitory computer useable medium having computer readable program code embodied therein; the computer program product comprising: computer readable program code for causing the computer to select a circling maneuver for repeating a traversed section within a current leg; the computer program product further comprising:
- the computer program product further includes a computer readable program code for causing the computer to generate instructions for controlling the aircraft according to the selected turning maneuver.
- the presently disclosed subject matter further contemplates a method of autonomously maneuvering an aircraft over an area of interest (e.g. during a scanning-mission) and selecting a circling maneuver during transition from a first leg to a second leg as disclosed above, as well as a system mountable on an aircraft configured and operable for executing the method.
- FIG. 1 is block diagram schematically illustrating a UAV system, according to some examples of the presently disclosed subject matter
- FIG. 2 is block diagram schematically illustrating a scanning-mission control unit, according to some examples of the presently disclosed subject matter
- Fig. 3 is a schematic illustration of a flight pattern of an aircraft executing a scanning-mission, according to some examples of the presently disclosed subject matter
- Fig. 4 is a generalized flowchart of operations carried out during a scanning- mission, according to some examples of the presently disclosed subject matter
- Fig. 5 is a flowchart of operations carried out during a scanning-mission, according to some examples of the presently disclosed subject matter
- Fig. 6a is a schematic illustration demonstrating the processing of AOI characterized by curved sides, according to some examples of the presently disclosed subject matter
- Fig. 6b is a schematic illustration demonstrating the process of selecting a flight direction in a scanning-mission, according to some examples of the presently disclosed subject matter
- Fig. 7 is a schematic illustration demonstrating sun direction relative to the aircraft, according to some examples of the presently disclosed subject matter
- Fig. 8 is a flowchart of operations carried out during selection of a turning maneuver, according to some examples of the presently disclosed subject matter
- Figs. 9a - 9d are schematic illustrations demonstrating different turning maneuvers, according to some examples of the presently disclosed subject matter.
- Fig. 10 is a flowchart of operations carried out during selection of a circling maneuver, according to some examples of the presently disclosed subject matter; and Figs. 11a - 11c are schematic illustrations demonstrating different circling maneuvers, according to some examples of the presently disclosed subject matter;.
- ⁇ e.g., a Central Processing Unit (CPU), a microprocessor, an electronic circuit, an Integrated Circuit (1C), firmware written for or ported to a specific processor such as digital signal processor (DSP), a microcontroller, a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), etc.
- a computer processor e.g., a Central Processing Unit (CPU), a microprocessor, an electronic circuit, an Integrated Circuit (1C), firmware written for or ported to a specific processor such as digital signal processor (DSP), a microcontroller, a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), etc.
- DSP digital signal processor
- FPGA field programmable gate array
- ASIC application specific integrated circuit
- Figs. 1 and 2 illustrate a high level schematic of the system architecture in accordance with an embodiment of the presently disclosed subject matter.
- Elements in Figs. 1 and 2 can be made up of any combination of software and hardware and/or firmware that perform the functions as defined and explained herein.
- Elements in Figs. 1 and 2 may be centralized in one location or dispersed over more than one location.
- the system may comprise fewer, more, and/or different elements than those shown in Figs. 1 and 2.
- the term “substantially” is used herein to imply the possibility of variations in values within an acceptable range. According to one example, the term “substantially” used herein should be interpreted to imply possible variation of up to 10% over or under any specified value. According to another example, the term “substantially” used herein should be interpreted to imply possible variation of up to 5% over or under any specified value. According to a further example, the term “substantially” used herein should be interpreted to imply possible variation of up to 2.5% over or under any specified value. According to yet a further example, the term “substantially” used herein should be interpreted to imply possible variation of up to 1.0% over or under any specified value. The specified value can be absolute value (e.g.
- FIG. 1 is a block diagram of a UAV system 100 that includes a UAV 120 operatively connected to a control unit 110, according to an example of the presently disclosed subject matter.
- UAV 120 comprises an airborne system 125 comprising, for example: mission payload 131, mission computer 133, flight computer 135 and sensors 137.
- Mission payload 131 can include for example an imaging system which can be used in aerial photography missions.
- the imaging system can include one or more types of imaging devices such as color camera, black & white camera, infra-red camera, hyperspectral camera, etc.
- Mission payload can further include other types of data acquisition devices such as a RADAR or LIDAR as well as other types of payloads such as crop dusting or water irrigation systems.
- a payload such as a camera can be mounted on a gimbal assembly configured to move the camera around one or more gimbal axes to provide a scanning motion around an axis (e.g. in a sweeping motion across the flight direction) in order to increase the range which is covered by the camera.
- Multiple images of the ground terrain which are captured can be synthetically combined into a single continuous image.
- Mission computer 133 is configured, inter alia, to generate instructions dedicated for controlling the UAV (e.g. flight instructions) and/or the payload.
- mission computer can generate instructions directing the UAV to a desired location along a dedicated flight path or to fly over an AOI along a certain path, and generate instructions for operating an imaging system for capturing images as further discussed herein below.
- Airborne system 125 also comprises various sensing devices 137 such as altimeters, pitot tubes, navigation devices such as GPS sub-systems and inertial navigation systems, cameras, etc.
- sensing devices 137 such as altimeters, pitot tubes, navigation devices such as GPS sub-systems and inertial navigation systems, cameras, etc.
- Flight computer 135 is configured and operable to generate specific instructions for controlling various flight control devices in order to control the operation of the aircraft, e.g. according to instructions received from the mission computer.
- Flight control devices include for example, ailerons, flaps, throttle, rudder, wheels, etc.
- flight computer 135 can include, or be otherwise operatively connected to, various control units, each dedicated for controlling a specific flight control device.
- mission computer 133 comprises or is otherwise operatively connected to a communication unit configured and operable to establish a down-link (DNK) communication link (line of sight (LOS) and/or beyond line of sight/line of sight (B/LOS)) between the UAV and other remote entities such as control system 110 and provide data such as telemetry and imaging data over the communication link.
- DNK down-link
- LOS line of sight
- B/LOS line of sight/line of sight
- Control system (CS) 110 is located remotely from UAV (e.g. on the ground) and comprises communication unit 113 and control mission computer 115.
- Communication unit 113 is configured to establish a communication up-link (UPL; line of sight (LOS) and/or beyond line of sight/line of sight (B/LOS)) with airborne system 125.
- UPL communication up-link
- LOS line of sight
- B/LOS line of sight/line of sight
- Communication between UAV 120 and CS 110 can be realized by any suitable communication infrastructure and protocol known in the art.
- Communication unit 113 can comprise or be otherwise operatively connected to a ground data terminal (B/LOS GDT) as known in the art.
- communication unit in airborne system 125 can comprise or be otherwise operatively connected to an aerial data terminal (B/LOS ADT) as known in the art.
- Control mission computer 115 is configured and operable in general to monitor and control the operation of the UAV. More specifically, in some examples control mission computer 115 is configured to generate control data and transmit the control data to the UAV. Control data incudes for example flight instructions dedicated for directing the UAV to fly to a certain location or in a certain manner as well as payload operational instructions, specifying how and when to operate the payloads onboard the UAV.
- Control system (CS) 110 can further include a user interface for enabling interaction of an operator with the system.
- the user interface can comprise one or more display devices for displaying control data (e.g. telemetry received from the UAV and imaging data captured by an imaging system onboard the UAV).
- the user interface can further include one or more input devices (e.g. keyboard, mouse, touchpad, etc.) and appropriate computer software executed by a computer, as is well known in the art.
- system 100 further includes a scanning-mission control unit that includes one or more processing circuitries configured and operable to generate flight instructions dedicated for controlling the UAV during a scanning-mission for the purpose of improving the efficiency and autonomous operation of the scanning-mission execution.
- scanning-mission control unit 140 is designed as part of mission computer 133 or as a dedicated processing device operatively connectible to mission computer 133.
- scanning-mission control unit is designed as a distributed unit that comprises various sub-units each dedicated for performing a different task, where in some examples, part or all of the sub-units of scanning-mission control unit are implemented remotely from the UAV, e.g. at control system 110.
- scanning-mission is used herein to include an aerial mission where a UAV is required to fly over a certain area of interest (AOI) with the purpose of scanning or covering the entire area.
- AOI area of interest
- One example of a scanning-mission is an aerial imaging mission where a UAV is required to capture images of an entire area of interest. The UAV flies over the area of interest and uses its onboard imaging payload to continuously capture images of the area below. As mentioned above, in some examples, the captured images can be later processed and stitched together to provide a composite image of the entire area of interest.
- Fig. 3 is a schematic illustration in top view of flight progress of an aircraft during an imaging (scanning) mission.
- the area of interest is divided into legs, in the current example four legs, a, b, c and d.
- the arrows illustrated along the legs indicate the flight path of the aircraft during the mission.
- the camera system onboard the aircraft is operated to capture images of the area beneath the aircraft.
- the camera system moves the camera along a scanning line from side to side.
- Horizontal lines in section 'a' and the beginning of section 'b' represent scanning lines.
- aircraft e.g. UAV
- UAV 200 has finished the pass over leg 'a' and is now in the initial part of the pass over leg 'b'.
- some overlap may exist between two adjacent legs and between consecutive scanning lines.
- a turning maneuver connects between consecutive legs along the flight path, where both legs are aligned with the same azimuth and are generally traversed by the aircraft in opposite directions.
- scanning-mission control unit 140 is configured and operable (e.g. using a scanning direction determination module as illustrated in Fig. 2) to generate a flight plan that comprises flight instructions directing the aircraft during execution of a scanning-mission that reduces (e.g. minimizes) the number of turns that the UAV is required to make during the scanning-mission. Turns are executed outside the polygon and enable the aircraft to enter the next leg following the turn in a roll angle that allows to continue operation of the payload.
- the specific roll angle is dependent on the type of payload, and in general is substantially equal to zero i.e. the aircraft being leveled (possibly with tolerance of a few degrees).
- a turning maneuver is a wasteful operation, since, while turning, the aircraft is not positioned over the AOI and thus is unable to operate the payload for completing the mission (e.g. activate an imaging system for capturing images of the AOI). Accordingly, it would be advantageous to reduce the number of turns which are made during the execution of a scanning-mission. Reducing the number of turns would help to shorten the execution time needed for completing the mission, and also to reduce consumption of various resources such as fuel.
- the shape of the AOI is in many cases characterized by uneven sides.
- an operator can interact with aerial images of an area, which are displayed on a display device at the control system 110, and mark on the displayed images points indicating the boundaries of an AOI.
- the points marked by the operator, when connected, may construct a polygon with sides of unequal length.
- the shape of the field which may be characterized by sides of unequal length, prescribes the shape of the AOI.
- An example of an AOI with uneven sides is illustrated in Fig. 3.
- FIG. 4 is a flowchart of operations carried out according to some examples of the presently disclosed subject matter. Operations described with reference to Fig. 4 (as well as Figs. 5, 8 and 10 below) can be executed, for example, with the help of a system 100 (and more specifically by scanning-mission control unit 140) configured according to the principles described above with reference to Figs. 1 and 2. It is noted however that any description of operations, which is made with reference to elements in Figs. 1 and 2 , is done by way of example only and should not be construed as limiting in any way.
- the data includes for example, the location of the AOI (e.g. relative to a global coordinates system).
- the location of the area can be indicated by two or more points representing vertices located on the perimeter of the AOI.
- a shape e.g. polygon
- Connection of the vertices to obtain the AOI can be done automatically (e.g. by scanning-mission control unit) or by an operator.
- the data can include two vertices and a corresponding length for each of the vertices thus essentially providing information pertaining to a rectangle delineating the AOI.
- an entire shape of the AOI can be provided.
- the mapping data is processed in order to determine a selected flight direction (e.g. a certain azimuth) that enables to reduce (e.g. minimize) the number of turns required to be made by the UAV during the scanning-mission.
- a selected flight direction e.g. a certain azimuth
- reduce e.g. minimize
- instructions for directing the UAV to fly over the AOI and execute the mission are generated. For example, a continuous flight path directing the aircraft for scanning the entire AOI and instructions for following the flight path are generated.
- the flight path comprises a plurality of legs, each leg extending across the AOI in the selected flight direction and each pair of consecutive legs are connected by a turn.
- the UAV is controlled so it follows the generated flight path.
- the number of legs, and consequentially the number of turns connecting between each two legs depends, inter alia, on the width of the cross-section of the AOI that is perpendicular to the flight direction of the UAV and on the width of each leg.
- the width of each leg depends on the operational requirement of the specific payload which is being used and the type of mission. For example, in an image acquisition mission, the width of each leg depends on the sensor size, exposure time, scan orientation (Forward/Side), resolution, etc., as these parameters determine the FOV of the camera.
- the camera field of view defines the width of the leg.
- the camera is mounted on a gimbal device configured during operation to move the camera around one or more gimbal axes to provide a scanning motion from side to side (e.g. in a sweeping motion across the flight direction, parallel to the cross-section) in order to increase the range which is covered by the camera.
- an offset range from frame to frame is determined.
- the offset range is the range of new ground covered in each new frame. According to one example, it can be equal to the FOV.
- an overlap is maintained between consecutive frames.
- FIG. 5 shows a flowchart of a sequence of operations carried out for determining a selected flight direction, according to some examples of the presently disclosed subject matter.
- Fig. 5 is a more detailed example of the operations mentioned above with reference to block 403. Operations described with reference to Fig. 5 can be executed for example by scanning-mission control unit.
- a plurality of different candidate flight directions are analyzed, where the analysis includes, for each candidate flight direction:
- determining projection points of the vertices of the AOI on the particular cross-section including at least the two vertices that are projected on projection points located on the cross-section at the farthest distance, one from the other (block 505).
- vertices of the polygon are projected on the cross-section.
- a circumgon a polygon tangential to the AOI that represents the AOI
- scanning-mission control unit 140 can determine a circumgon around the AOI.
- the distance between the two farthest apart projection points on the particular cross section is calculated.
- a cross-section that accommodates the two farthest apart projection points with the shortest distance one from the other, is selected.
- the selected direction of flight (azimuth) is determined as the direction perpendicular (or substantially perpendicular) to the selected cross-section.
- the selected direction is the direction of flight that requires the least number of turns during the execution of a scanning operation.
- a flight path is generated that comprises a plurality of legs, where all legs are aligned with (are substantially parallel to) the selected flight direction.
- Fig. 6b is a schematic illustration demonstrating the operations described with reference to Fig. 5 above.
- Fig. 6b includes three states, state a, state b and state c.
- state a a cross-section (65) at a different angle relative to the AOI is shown.
- state 'a' the cross section is in the west-east direction, which is perpendicular to a north oriented flight direction (azimuth 0; or south, azimuth 180).
- vertices of the polygon representing the AOI are projected (90° projection of the vertices onto the cross-section) on the cross-section (indicated by the broken lines).
- the two projected points of the two vertices located farthest away from each other in the west-east direction of the AOI are indicated by circles (5).
- the process of determining a selected flight direction can include the analysis of additional cross-sections in relative angles.
- the analysis can include a cross-section for every angle in a 360° resolution around the AOI for a total of 360 cross-sections, or a cross-section for every other angle for a total of 180 cross- sections or a cross-section for every half an angle for a total of 720 cross sections or a cross-section for every 4 angles for a total of 90 cross-section, or the like.
- the aircraft is controlled to fly over the AOI in the selected direction along a first leg, make a turn at the edge of the AOI, and fly over the next leg in a direction opposite to the selected direction.
- the direction of the sun may also be taken into consideration when selecting a flight direction.
- an electro optic imaging system e.g. a hyperspectral imaging system
- the direction of the sun may also be taken into consideration when selecting a flight direction.
- Direction of the sun can be determined based on the current date and time, as is well known in the art.
- the direction of flight during a scanning- mission that involves the operation of an imaging depends on the direction of the sun, and is selected such that the direction of flight is aligned with the direction of the sun.
- alignment of the flight direction with the direction of the sun is maintained within a certain tolerance, for example, a ⁇ 40° offset from the real-time estimated sun direction.
- the possible flight direction is within the tolerance window.
- the specific direction of the UAV within the tolerance window is determined as discussed above with reference to Figs. 4 and 5, so as to reduce the number of turns to the minimal possible, while not deviating from the allowed tolerance window determined according to the direction of the sunlight.
- Another example is related to the wind direction, where a flight direction is limited to a certain tolerance window relative to the estimated wind direction.
- the possible flight direction is within the tolerance window determined as discussed above with reference to Figs. 4 and 5, so as to reduce the number of turns to the minimal possible, while not deviating from the allowed tolerance window determined according to the direction of the wind (e.g. aligned with or perpendicular to the wind direction).
- the presently disclosed subject matter further contemplates a method and system for controlling a UAV aimed to improve efficiency of the UAV operation when executing turns.
- a UAV aimed to improve efficiency of the UAV operation when executing turns.
- the position of the UAV relative to the AOI does not permit to operate the payload for completing the mission, and accordingly it is desired to reduce the time spent for turning.
- specific UAV control logic is implemented, which helps to reduce the time spent for performing turns.
- Fig. 8 is a flowchart of a sequence of operations carried out according to some examples of the presently disclosed subject matter. Operations described with reference to Fig. 8 can be executed for example by scanning-mission control unit (e.g. by turning maneuver control module illustrated in fig. 2).
- the minimal-effective (actual) turning diameter of the aircraft is calculated or obtained e.g. from computer memory.
- the minimal-effective (or actual) turning diameter of the aircraft is calculated in real-time e.g. at the beginning of the flight, or right before a turn.
- the minimal-effective turning diameter is calculated based on the minimal-mechanical turning diameter (i.e. the minimal turning diameter possible in optimal conditions) and other environmental conditions, such as for example true airspeed and direction (obtained for example from pitot tubes).
- the spacing is related to the width of a current leg on which the aircraft is located and the next leg to which the aircraft is about to turn.
- the leg width depends on the operational requirement of the specific payload used during a mission. An example of calculation of the leg width is provided above. Notably, in some missions the width of different legs may not be equal, and in some cases the width is calculated in real-time.
- a turning maneuver (or transition between legs) is constructed as illustrated in Fig. 9a (block 805).
- the turning maneuver includes a sequence comprising: a first turn exiting the current leg 90 and turning to a first direction (arrow 5) toward the next leg, the first direction substantially perpendicular to the direction of the current leg (arrow 3); a second turn 92 towards the entry point to the next leg 93, in a direction substantially perpendicular to the first direction (arrow 7); and an extended section 9 connecting between the end of the first turn 91 and the beginning of the second turn 92 covering the distance between the legs, where the length of the line depends on the difference between the minimal-effective turning diameter (D) and the distance between the two legs (R).
- the turning maneuver according to the example illustrated in Fig. 9a is comprised of a first section of a first complete turn (section 90-91) and a second section of a second complete turn (section 92- 93) and another section connecting the two sections, and tangential to the two complete turns (section 91-92).
- a turning maneuver or transition between legs is constructed as illustrated in Fig. 9b (block 807).
- the turning maneuver includes three consecutive turns: a first turn exiting the current leg in a first direction away from the next leg 95 to thereby provide sufficient distance for executing a full turn towards the next leg; a second turn in a second direction towards the next leg 96, wherein the diameter of the second turn is such that the second turn ends at an ending point 97 located beyond the entry point to next leg 98 (the diameter of the second turn > D); and a third turn from the ending point of the second turn 97, directing the UAV towards the entry point to the next leg 98.
- the turning maneuver according to the example illustrated in Fig. 9b is comprised of a first section of a first complete turn (section 95-96) and a second section of a second complete turn (section 97- 98) and another section of a third complete turn connecting the two sections (section 96-97).
- a turning maneuver (or transition between legs) is constructed as illustrated in Fig. 9c.
- the turning maneuver includes a first turn exiting the current leg 901 in a first direction (arrow 9) away from the next leg to thereby provide sufficient distance for executing a full turn towards the next leg; a second turn 903 in a second direction towards the next leg, wherein the diameter of the second turn is such that the second turn ends at an ending point 905 with the aircraft pointing in the direction of the next leg; and an extended section (section 905 -907), substantially aligned with the next leg, leading the aircraft to the next leg.
- the turning maneuver according to the example illustrated in Fig. 9c is comprised of a first section of a complete turn (section 901-903) and a second section of a complete turn (section 903-907).
- the maneuver according to Fig. 9c can be alternatively made in the opposite direction i.e. a turning maneuver that starts with an extended section, substantially aligned with the next leg and followed by a first turn in the direction (arrow 15) of the next leg, the first turn ending at an ending point 913 located beyond the entry point to next leg 915 and followed by a second turn leading to the entry point to the next leg 915.
- the process according to Fig. 8 includes a decision stage for selecting between two or more possible maneuvers, e.g. selecting between a maneuver according to Fig. 9b, a maneuver according to Fig. 9c and a maneuver according to Fig. 9d.
- a maneuver that would take the shortest time for the aircraft to travel from the exit point of the current leg to entry point of the next leg is selected. Selection is performed for example based on a calculation of a predicted ground-speed in each of the maneuvers.
- the predicted ground-speed is calculated based on the airspeed and the wind velocity along each turn. Assuming the airspeed is constant along the turning maneuver, the ground-speed depends on the wind velocity along a certain turning maneuver.
- the ground-speed along the turning maneuver is calculated by taking the different directions assumed by the aircraft along the turning maneuver, determining the wind velocity and calculating the ground-speed in each of the different directions and integrating the calculated ground-speed to obtain an integrated ground-speed along the entire turning maneuver.
- Wind velocity can be determined based on airspeed (received for example from pitot tubes), heading (e.g. obtained from INS) which give together an first (inertial) vector.
- a second vector is received from the GPS sub-system. The subtraction between the first and second vectors provides the wind velocity.
- an estimated time for completing the turning maneuver is calculated based on the length of the turning maneuver and the integrated ground-speed.
- the turning maneuver that would take the shortest time to complete is selected. Notably, in some cases the selected maneuver may not be the one with the shortest distance.
- different turning maneuvers can be used during the transition between different legs. This can result for example in a change in wind direction and/or wind velocity that occurs during the mission execution or in variation in the spacing between consecutive legs.
- the presently disclosed subject matter further contemplates a method and system for controlling a UAV aimed to improve efficiency of the UAV operation when executing mission operation.
- the UAV is controlled to fly along a certain flight path that comprises a plurality of legs for the purpose of covering an AOI and operating a payload while traveling along the flight path.
- it may be desired to repeat a certain section e.g. in case of operational failure of the payload over a certain section.
- system 100 can comprise an automatic quality assessment sub-system which can be implemented for example as part of the imaging system or the mission computer 133 or the control mission computer 115.
- Automatic quality assessment executed onboard the UAV can be used to determine, immediately after an image is generated, whether the image complies with certain quality measures.
- quality measures can include for instance, smearing of the image due to a movement which is above the allowed exposure speed.
- movement of the aircraft may cause a deviation from the required overlap between legs.
- the UAV may be required (e.g. according to instructions generated by scanning-mission control unit 140) to repeat and fly over the same section a second time in order to obtain images in sufficient quality.
- a UAV may be required to fly a second time over a certain section for repeatedly applying the material.
- the UAV is controlled to reduce the time and/or distance travelled when executing a circling maneuver for the purpose of repeating and flying over the same section.
- Fig. 10 is a flowchart of a sequence of operations carried out according to some examples of the presently disclosed subject matter.
- Operations described with reference to Fig. 10 can be executed for example by scanning-mission control unit 140 (e.g. by mission correction control module illustrated in fig. 2).
- scanning-mission control unit 140 e.g. by mission correction control module illustrated in fig. 2.
- data indicative of a need to fly over a section of a leg currently being traversed is detected.
- a payload operation failure is detected along a certain section X (referred to herein as a "bad section" or "traversed section").
- a type of circling maneuver is selected from of at least two different types of candidate circling maneuvers.
- Fig. 11a is a schematic illustration of a first type of circling maneuver (referred to herein as “circling back maneuver”) where the UAV turns back, as close as possible, to the end of the bad section, to reach the beginning of the bad section, and then flies over the bad section a second time while operating the payload (e.g. repeats image acquisition to obtain images in a sufficient quality).
- Fig. lib is a schematic illustration of a second type of circling maneuver (referred to herein as “leg repeating maneuver”), where the UAV proceeds until the end of the leg, makes a U-turn at the end of the leg, and flies over the entire leg a second time while repeating the mission over the bad section.
- the leg repeating maneuver may result in a change in the direction of flight along the following legs, switching to the opposite direction.
- the flight distance and flight time added by two or more types of circling maneuvers is calculated. To this end the following operations may be carried out for each candidate circling maneuver:
- the integrated ground-speed of each maneuver is calculated, based on the wind velocity relative to various directions of the aircraft during the maneuver.
- the time needed for completing each maneuver is calculated based on the distance of the maneuver and the integrated ground-speed.
- calculation of the distance of the first circling maneuver can be based on:
- X is the length of the bad section.
- the length of the bad section can be determined by monitoring the performance of the scan (e.g. using an on-board quality assessment sub-system) regarding the examples above. For example, this may be the area over which poor quality image output was obtained.
- the circling maneuver Y is the estimated length of the maneuver required for circling back from the current position of the UAV along the leg to the beginning of the bad section.
- the circling maneuver Y according to the example illustrated in Fig. 11a is similar to the turning maneuver shown in Fig. 9a and comprises a first section of a first complete turn (section 1103 -1105) and a second section of a second complete turn (section 1107 -1101) and another section connecting and tangential to the two sections (section 1105 -1107).
- the length of Y can be determined based on the calculation of the minimal-effective turning radius calculated as described above.
- minimal-effective turning radius is based on airspeed and can be calculated in real-time. In some case the radius of the two circles may not be the same.
- Calculation of the distance of the second circling maneuver can be based on:
- LR is the length of the leg which is repeated
- U1 is the length of the U-turn.
- the turning maneuver U1 according to the example illustrated in Fig. lib is comprised of a first section extending in the general direction of the current leg (section 1111 -1113) and a second section of a first complete turn (section 1113 - 1117) and another section of a second complete turn turning back to the current leg (section 1115 -1111).
- the maneuver illustrated in Fig. lib can be alternatively executed in the opposite direction, i.e. with a first turn exiting the current leg, followed by a turn in the other direction that ends with an extended section substantially aligned with the current leg.
- Fig. 11c Another alternative for a circling maneuver is illustrated in Fig. 11c.
- This maneuver includes a first turn exiting the current leg 1121 in a first direction that provides sufficient distance for executing a full turn back towards the entry to the current leg; a second turn 1123 pointing the aircraft back towards the current leg; and a third turn 1125 starting from the end of the second turn and directing the aircraft back towards the current leg.
- the U-turn comprises a full turn, with its center substantially aligned with the current leg.
- a maneuver that would require the shortest time for the aircraft to travel from the exit point of the current leg, to entry point of the next leg is selected. Selection is performed for example, based on a calculation of a predicted ground-speed in each of the maneuvers.
- the predicted ground-speed is calculated based on the airspeed and the wind velocity along each turn.
- the ground-speed along the circling maneuver is calculated by taking the different directions assumed by the aircraft along the turning maneuver, determining the wind velocity, and calculating the ground-speed in each of the different directions and integrating the calculated ground-speed to obtain an integrated ground-speed along the entire circling maneuver.
- an estimated time for completing the circling maneuver is calculated based on the length (distance) of the circling maneuver and the integrated ground-speed.
- the circling maneuver that is determined to take the shortest time to complete is selected. Notably, in some cases the selected maneuver may not be the one with the shortest distance.
- different circling maneuvers can be used during the transition between different legs. This can result for example in a change in wind direction and/or wind velocity that occurs during the mission execution.
- the UAV is controlled to fly according to the selected maneuver and repeat the mission over the bad section (block 1010).
- system may be a suitably programmed computer.
- the presently disclosed subject matter contemplates a computer program being readable by a computer for executing the method of the presently disclosed subject matter.
- the presently disclosed subject matter further contemplates a machine- readable non-transitory memory tangibly embodying a program of instructions executable by the machine for executing the method of the presently disclosed subject matter.
Landscapes
- Engineering & Computer Science (AREA)
- Aviation & Aerospace Engineering (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Control Of Position, Course, Altitude, Or Attitude Of Moving Bodies (AREA)
Abstract
The presently disclosed subject matter includes a method and system for autonomously maneuvering an aircraft over an area of interest during a scanning- mission, where the scanning-mission includes flying over the area of interest along a flight path that comprises multiple legs, wherein all legs traverse the area of interest in substantially the same direction (or azimuth) and each two consecutive legs are connected by a turn. The method and system allow generation of flight instructions dedicated for controlling the UAV during a scanning-mission for the purpose of improving the efficiency and autonomous operation of the scanning-mission execution.
Description
SYSTEM AND METHOD FOR EXECUTION OF AN AUTONOMOUS AIRBORNE SCANNING-MISSION
FIELD OF THE PRESENTLY DISCLOSED SUBJECT MATTER
The presently disclosed subject matter relates to the field of aerial missions executed by an aircraft.
BACKGROUND
Various types of aerial missions involve operating a payload mounted onboard an aircraft (e.g. unmanned aerial vehicle (UAV) aka unmanned aerial system or drone). For example, an imaging system mounted on a UAV can be used for the purpose of imagery collection and analysis in terrain dominance related applications such as reconnaissance, cartography, land use, environmental conditions studies and more. Other examples of missions include aerial application (crop dusting), fire extinguishing, irrigation, etc.
GENERAL DESCRIPTION
Some aerial missions, such as those related to terrain dominance mentioned above, involve flying over a certain area of interest (AOI) on the ground with the intent of systematically scanning\covering the entire area. For example, in some aerial photography missions a camera system mounted onboard an aircraft is used for systematically scanning an AOI in order to collect imaging data of the entire area.
According to an aspect of the presently disclosed subject matter there is provided a method of autonomously maneuvering an aircraft over an area of interest during a scanning-mission, where the scanning-mission includes flying over the area of interest along a flight path that comprises multiple legs, wherein all legs traverse the area of interest in substantially the same direction (or azimuth) and each two consecutive legs are connected by a turn, the method comprising:
operating at least one processing circuitry for:
obtaining mapping data indicative of boundaries of the area of interest to be scanned by the aircraft;
processing the mapping data to select a selected cross-section of the area of interest from a plurality of cross-sections, each cross-section from among the plurality of cross-sections is characterized by a different angle relative to a certain frame of reference (e.g. global coordinate system) and comprises a respective section confined by two projection points, each of the two projection points are a projection of a respective extreme vertex of a polygon representing the area of interest;
wherein the selected cross-section is characterized by the shortest respective section;
determining a selected flight direction to be substantially perpendicular to the selected cross-section;
generating the flight path comprising a plurality of legs, where all legs are aligned with the selected flight direction, thereby reducing the number of turns during the scanning-mission relative to other possible flight directions ; and
generating instructions dedicated for controlling the aircraft to fly along the flight path.
In addition to the above features, the method according to this aspect of the presently disclosed subject matter can optionally comprise one or more of features
(i) to (xii) below, in any desired combination or permutation:
(i). The method further comprising operating the payload while proceeding along the flight path.
(ii). wherein the polygon representing the AOI is the area of interest.
(iii). wherein the polygon representing the AOI is a polygon tangential to the AOI.
(iv).The method further comprising:
for each cross-section of the plurality of cross-sections, calculating the length of the respective section, comprising:
projecting a plurality of vertices of the polygon on the cross-section; and determining the greatest distance between two points projected on the cross- section.
(v). The method further comprising:
obtaining information indicative of a range of angles limiting the allowed flying direction; and
selecting the selected cross-section from a plurality of cross-sections characterized by an angle substantially perpendicular to an angle that resides within the range of angles.
(vi). wherein the scanning-mission includes operating a hyperspectral imaging system over the AOI, and wherein the range of angles is determined according to the position of the sun relative to the AOI.
(vii). The method further comprising: operating the at least one processing circuitry for selecting a turning maneuver during transition from a first leg to a second leg, wherein flying direction along the first leg is substantially parallel and at an opposite direction to flying direction along the second leg, the method comprising:
determining a minimal effective turning diameter of the aircraft;
in case the minimal effective turning diameter is greater than a distance crossing between the first leg and the second leg, preforming a first turning maneuver that includes:
a first turn exiting the current leg in a first direction opposite to the direction of the second leg, the first turn is aimed to increase the distance of the aircraft from the second leg; a second turn in a second direction toward the next leg, wherein the diameter of the second turn is such that the second turn ends at an ending point
located beyond the next leg; and a third turn from the ending point of the second turn to the entry point of the next leg; and
in case diameter of the minimal effective turning is shorter than the distance crossing between the first leg and the second leg, performing a second turning maneuver that includes:
a first turn exiting the current leg in a direction of the next leg; a second turn toward the next leg, the second turn having a direction substantially opposite to the first turn and an extended section connecting between the first turn and the second turn.
(viii). wherein each turn in the first turning maneuver and the second turning maneuver is part of a circle characterized by a diameter that is equal to the minimal effective turning diameter.
(ix). The method further comprising operating the at least one processing circuitry for selecting a circling maneuver for repeating a traversed section within a current leg, the method comprising:
responsive to detection of a need to repeat a traversed section within a leg: calculating the distance of a first circling maneuver that comprises a turn starting from about the end of the traversed section and circles back around to the beginning of traversed section along the current leg; and
calculating the distance of a second circling maneuver that comprises proceeding to an ending point of the current leg, performing a U-turn leading back to the ending point and into the current leg, and repeating the entire current leg a second time;
selecting a selected circling maneuver with the shorter length;
controlling the aircraft according to the selected circling maneuver for flying over the traversed section a second time, and activating a payload.
(x). wherein the aircraft is an unmanned aerial vehicle.
(xi). The method further comprising: operating the at least one processing circuitry for selecting a turning maneuver during transition from a first leg to a second leg, wherein flying direction along the first leg is substantially parallel and at an opposite direction to flying direction along the second leg, the method comprising:
for each one of a plurality of candidate turning maneuvers:
calculating predicted ground-speed along the candidate turning maneuvers, based on the wind velocity and flight directions along the course of the candidate turning maneuver;
calculating a time of travel for completing each of the candidate turning maneuvers; and
selecting a turning maneuver from a plurality of turning maneuvers characterized by the shortest time of travel.
(xii). The method further comprising: operating the at least one processing circuitry for selecting a circling maneuver for repeating a traversed section within a current leg; the method comprising:
calculating a predicted ground-speed along each one of a plurality of candidate circling maneuvers, based on the wind velocity and flight directions along the candidate circling maneuver;
calculating a time of travel for completing each of the candidate circling maneuvers; and
selecting a circling maneuver from a plurality of turning maneuvers characterized by the shortest time of travel.
According to another aspect of the presently disclosed subject matter there is provided a system mountable on an aircraft for autonomously maneuvering the aircraft over an area of interest during a scanning-mission, where the scanning- mission includes flying over the area of interest along a flight path that comprises
multiple legs, wherein all legs traverse the area of interest in substantially the same direction and each two consecutive legs are connected by a turn, the system comprises a computer and a payload, the computer comprising one or more processing circuitries configured to:
obtain mapping data indicative of boundaries of the area of interest to be scanned by the aircraft;
process the mapping data to select a selected cross-section of the area of interest from a plurality of cross-sections, each cross-section from among the plurality of cross-sections is characterized by a different angle relative to a certain frame of reference (e.g. global coordinate system) and comprises a respective section confined by two projection points, each of the two projection points are a projection of a respective extreme vertex of a polygon representing the area of interest;
wherein the selected cross-section is characterized by the shortest respective section;
determine a selected flight direction to be substantially perpendicular to the selected cross-section;
generate the flight path comprising a plurality of legs, where all legs are aligned with the selected flight direction, thereby reducing the number of turns during the scanning-mission relative to other possible flight directions ; and
generate instructions dedicated for controlling the aircraft to fly along the flight path and instructions for operating the payload along the flight path.
According to another aspect of the presently disclosed subject matter there is provided a computer program product comprising a non-transitory computer useable medium having computer readable program code embodied therein for autonomously maneuvering an aircraft over an area of interest during a scanning- mission, where the scanning-mission includes flying over the area of interest along a
flight path that comprises multiple legs, wherein all legs traverse the area of interest in substantially the same direction and each two consecutive legs are connected by a turn; the computer program product comprising:
computer readable program code for causing the computer to obtain mapping data indicative of boundaries of the area of interest to be scanned by the aircraft;
computer readable program code for causing the computer to process the mapping data and select a selected cross-section of the area of interest from a plurality of cross-sections, each cross-section from among the plurality of cross- sections is characterized by a different angle relative to a certain frame of reference (e.g. global coordinate system) and comprises a respective section confined by two projection points, each of the two projection points are a projection of a respective extreme vertex of a polygon representing the area of interest; wherein the selected cross-section is characterized by the shortest respective section;
computer readable program code for causing the computer to determine a selected flight direction to be substantially perpendicular to the selected cross- section;
computer readable program code for causing the computer to generate the flight path comprising a plurality of legs, where all legs are aligned with the selected flight direction, thereby reducing the number of turns during the scanning-mission relative to other possible flight directions; and
computer readable program code for causing the computer to generate instructions dedicated for controlling the aircraft to fly along the flight path.
According to another aspect of the presently disclosed subject matter there is provided an aircraft configured with autonomous flying capabilities (e.g. a UAV) that comprises a system for autonomously maneuvering the aircraft over an area of interest during a scanning-mission, as disclosed in the aspect above.
The method, the computer program product, and the aircraft disclosed in accordance with the presently disclosed subject matter can optionally comprise one or more of features (i) to (xii) listed above, mutatis mutandis, in any technically possible combination or permutation.
• According to another aspect of the presently disclosed subject matter there is provided a computer program product comprising a non- transitory computer useable medium having computer readable program code embodied therein for autonomously maneuvering an aircraft over an area of interest; the computer program product comprising:
computer readable program code for causing the computer to select a turning maneuver during transition from a first leg to a second leg, wherein flying direction along the first leg is substantially parallel and at a substantially opposite direction to flying direction along the second leg; the computer program product further comprising:
computer readable program code for causing the computer to determine a minimal effective turning diameter of the aircraft;
computer readable program code for causing the computer to perform a first turning maneuver, in case the minimal effective turning diameter is greater than a distance crossing between the first leg and the second leg, the first turning maneuver comprises:
a first turn exiting the current leg in a first direction opposite to the direction of the second leg, the first turn is aimed to increase the distance of the aircraft from the second leg; a second turn in a second direction toward the next leg, wherein the diameter of the second turn is such that the second turn ends at an ending point located beyond the next leg; and a third turn from the ending point of the second turn to the entry point of the next leg; and
computer readable program code for causing the computer to perform a second turning maneuver, in case diameter of the minimal effective turning is shorter than the distance crossing between the first leg and the second leg, performing the second turning maneuver comprises:
a first turn exiting the current leg in a direction of the next leg; a second turn toward the next leg, the second turn having a direction substantially opposite to the first turn and an extended section connecting between the first turn and the second turn.
The presently disclosed subject matter further contemplates a method of autonomously controlling an aircraft (e.g. during a scanning-mission) and selecting a turning maneuver during transition from a first leg to a second leg as disclosed above, as well as a system mountable on an aircraft configured and operable for executing the method.
• According to another aspect of the presently disclosed subject matter there is provided a computer program product comprising a non- transitory computer useable medium having computer readable program code embodied therein, the computer program product comprising:
computer readable program code for causing the computer to select a turning maneuver during transition from a first leg to a second leg, wherein flying direction along the first leg is substantially parallel and at a substantially opposite direction to flying direction along the second leg; the computer program product further comprising:
computer readable program code for causing the computer to calculate a predicted ground-speed along each one of a plurality of
candidate turning maneuvers, based on the wind velocity and flight directions along the candidate turning maneuver;
computer readable program code for causing the computer to calculate a time of travel for completing each of the candidate turning maneuvers; and
computer readable program code for causing the computer to select a selected turning maneuver from the plurality of turning maneuvers, the selected turning maneuver is characterized by the shortest time of travel.
According to some examples, the computer program product further includes a computer readable program code for causing the computer to generate instructions for controlling the aircraft according to the selected turning maneuver.
The presently disclosed subject matter further contemplates a method of autonomously controlling an aircraft (e.g. during a scanning-mission) and selecting a circling maneuver during transition from a first leg to a second leg as disclosed above, as well as a system mountable on an aircraft configured and operable for executing the method.
• According to another aspect of the presently disclosed subject matter there is provided a computer program product comprising a non- transitory computer useable medium having computer readable program code embodied therein; the computer program product comprising:
computer readable program code for causing the computer to select a circling maneuver for repeating a traversed section within a current leg; the computer program product further comprising:
computer readable program code for causing the computer, responsive to detection of a need to repeat a traversed section within a leg to:
calculate the distance of a first circling maneuver that comprises a turn starting from about the end of the traversed section and circling back around to the beginning of traversed sections along the current leg; and
calculate the distance of a second circling maneuver that comprises proceeding to the end of the current leg, performing a U- turn leading back into the current leg, and repeating the entire current leg a second time;
computer readable program code for causing the computer to select the circling maneuver with the shorter length;
computer readable program code for causing the computer to control the aircraft according to the selected circling maneuver for flying over the traversed section a second time, and activating a payload.
The presently disclosed subject matter further contemplates a method of autonomously controlling an aircraft (e.g. during a scanning-mission) and selecting a circling maneuver during transition from a first leg to a second leg as disclosed above, as well as a system mountable on an aircraft configured and operable for executing the method.
• According to another aspect of the presently disclosed subject matter there is provided a computer program product comprising a non- transitory computer useable medium having computer readable program code embodied therein; the computer program product comprising:
computer readable program code for causing the computer to select a circling maneuver for repeating a traversed section within a current leg; the computer program product further comprising:
computer readable program code for causing the computer to calculate a predicted ground-speed along each one of a plurality of candidate circling maneuvers, based on the wind velocity and flight directions along the candidate circling maneuver;
computer readable program code for causing the computer to calculate a time of travel for completing each of the candidate circling maneuvers; and
computer readable program code for causing the computer to select a circling maneuver from a plurality of turning maneuvers characterized by the shortest time of travel.
According to some examples, the computer program product further includes a computer readable program code for causing the computer to generate instructions for controlling the aircraft according to the selected turning maneuver.
The presently disclosed subject matter further contemplates a method of autonomously maneuvering an aircraft over an area of interest (e.g. during a scanning-mission) and selecting a circling maneuver during transition from a first leg to a second leg as disclosed above, as well as a system mountable on an aircraft configured and operable for executing the method.
BRIEF DESCRIPTION OF THE DRAWINGS
In order to understand the presently disclosed subject matter and to see how it may be carried out in practice, the subject matter will now be described, by way of non-limiting examples only, with reference to the accompanying drawings, in which:
Fig. 1 is block diagram schematically illustrating a UAV system, according to some examples of the presently disclosed subject matter;
Fig. 2 is block diagram schematically illustrating a scanning-mission control unit, according to some examples of the presently disclosed subject matter;
Fig. 3 is a schematic illustration of a flight pattern of an aircraft executing a scanning-mission, according to some examples of the presently disclosed subject matter;
Fig. 4 is a generalized flowchart of operations carried out during a scanning- mission, according to some examples of the presently disclosed subject matter;
Fig. 5 is a flowchart of operations carried out during a scanning-mission, according to some examples of the presently disclosed subject matter;
Fig. 6a is a schematic illustration demonstrating the processing of AOI characterized by curved sides, according to some examples of the presently disclosed subject matter;
Fig. 6b is a schematic illustration demonstrating the process of selecting a flight direction in a scanning-mission, according to some examples of the presently disclosed subject matter;
Fig. 7 is a schematic illustration demonstrating sun direction relative to the aircraft, according to some examples of the presently disclosed subject matter;
Fig. 8 is a flowchart of operations carried out during selection of a turning maneuver, according to some examples of the presently disclosed subject matter;
Figs. 9a - 9d are schematic illustrations demonstrating different turning maneuvers, according to some examples of the presently disclosed subject matter;
Fig. 10 is a flowchart of operations carried out during selection of a circling maneuver, according to some examples of the presently disclosed subject matter; and
Figs. 11a - 11c are schematic illustrations demonstrating different circling maneuvers, according to some examples of the presently disclosed subject matter;.
DETAILED DESCRIPTION
In the drawings and descriptions set forth, identical reference numerals indicate those components that are common to different embodiments or configurations. Elements in the drawings are not necessarily drawn to scale.
Unless specifically stated otherwise, as apparent from the following discussions, it is appreciated that throughout the specification discussions utilizing terms such as "obtaining", "processing", "determining", "generating" or the like, include action and/or processes of a computer that manipulate and/or transform data into other data, said data represented as physical quantities, e.g. such as electronic quantities, and/or said data representing the physical objects.
The terms "computer", "computerized device" or the like as used herein is meant to include any kind of electronic device that comprises one or more processing circuitries with data processing capability, that include a computer processor (e.g., a Central Processing Unit (CPU), a microprocessor, an electronic circuit, an Integrated Circuit (1C), firmware written for or ported to a specific processor such as digital signal processor (DSP), a microcontroller, a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), etc.) configured for executing computer instructions readable for example from a computer memory, configured as part of the processing circuitry or operatively connected thereto.
It is appreciated that certain features of the presently disclosed subject matter, which are, for clarity, described in the context of separate embodiments, may also be provided in combination in a single embodiment. Conversely, various features of the presently disclosed subject matter, which are, for brevity, described in the context of a single embodiment, may also be provided separately or in any suitable sub-combination.
In embodiments of the presently disclosed subject matter, fewer, more and/or different stages than those shown in Figs. 4, 5, 8 and 10 may be executed. In embodiments of the presently disclosed subject matter one or more stages illustrated in Figs. 4, 5, 8 and 10 may be executed in a different order and/or one or more groups of stages may be executed simultaneously. For example, operations described with reference to block 1005 and 1007 can be executed substantially simultaneously, also illustrated in a sequential order.
Figs. 1 and 2 illustrate a high level schematic of the system architecture in accordance with an embodiment of the presently disclosed subject matter. Elements in Figs. 1 and 2 can be made up of any combination of software and hardware and/or firmware that perform the functions as defined and explained herein. Elements in Figs. 1 and 2 may be centralized in one location or dispersed over more than one location. In other embodiments of the presently disclosed subject matter, the system may comprise fewer, more, and/or different elements than those shown in Figs. 1 and 2.
For the sake of clarity the term "substantially" is used herein to imply the possibility of variations in values within an acceptable range. According to one example, the term "substantially" used herein should be interpreted to imply possible variation of up to 10% over or under any specified value. According to another example, the term "substantially" used herein should be interpreted to imply possible variation of up to 5% over or under any specified value. According to a further example, the term "substantially" used herein should be interpreted to imply possible variation of up to 2.5% over or under any specified value. According to yet a further example, the term "substantially" used herein should be interpreted to imply possible variation of up to 1.0% over or under any specified value. The specified value can be absolute value (e.g. substantially not exceeding 45°, substantially perpendicular, etc.) or relative (e.g. substantially not exceeding the height of x, etc.).
Fig. 1 is a block diagram of a UAV system 100 that includes a UAV 120 operatively connected to a control unit 110, according to an example of the presently disclosed subject matter. UAV 120 comprises an airborne system 125 comprising, for example: mission payload 131, mission computer 133, flight computer 135 and sensors 137.
Mission payload 131 can include for example an imaging system which can be used in aerial photography missions. The imaging system can include one or more types of imaging devices such as color camera, black & white camera, infra-red camera, hyperspectral camera, etc. Mission payload can further include other types of data acquisition devices such as a RADAR or LIDAR as well as other types of payloads such as crop dusting or water irrigation systems.
In some examples, a payload such as a camera can be mounted on a gimbal assembly configured to move the camera around one or more gimbal axes to provide a scanning motion around an axis (e.g. in a sweeping motion across the flight direction) in order to increase the range which is covered by the camera. Multiple images of the ground terrain which are captured can be synthetically combined into a single continuous image.
Mission computer 133 is configured, inter alia, to generate instructions dedicated for controlling the UAV (e.g. flight instructions) and/or the payload. For example, mission computer can generate instructions directing the UAV to a desired location along a dedicated flight path or to fly over an AOI along a certain path, and generate instructions for operating an imaging system for capturing images as further discussed herein below.
Airborne system 125 also comprises various sensing devices 137 such as altimeters, pitot tubes, navigation devices such as GPS sub-systems and inertial navigation systems, cameras, etc.
Flight computer 135 is configured and operable to generate specific instructions for controlling various flight control devices in order to control the
operation of the aircraft, e.g. according to instructions received from the mission computer. Flight control devices include for example, ailerons, flaps, throttle, rudder, wheels, etc. In some examples, flight computer 135 can include, or be otherwise operatively connected to, various control units, each dedicated for controlling a specific flight control device.
According to some examples, mission computer 133 comprises or is otherwise operatively connected to a communication unit configured and operable to establish a down-link (DNK) communication link (line of sight (LOS) and/or beyond line of sight/line of sight (B/LOS)) between the UAV and other remote entities such as control system 110 and provide data such as telemetry and imaging data over the communication link.
Control system (CS) 110 is located remotely from UAV (e.g. on the ground) and comprises communication unit 113 and control mission computer 115. Communication unit 113 is configured to establish a communication up-link (UPL; line of sight (LOS) and/or beyond line of sight/line of sight (B/LOS)) with airborne system 125. Communication between UAV 120 and CS 110 can be realized by any suitable communication infrastructure and protocol known in the art. Communication unit 113 can comprise or be otherwise operatively connected to a ground data terminal (B/LOS GDT) as known in the art. Likewise, communication unit in airborne system 125 can comprise or be otherwise operatively connected to an aerial data terminal (B/LOS ADT) as known in the art.
Control mission computer 115 is configured and operable in general to monitor and control the operation of the UAV. More specifically, in some examples control mission computer 115 is configured to generate control data and transmit the control data to the UAV. Control data incudes for example flight instructions dedicated for directing the UAV to fly to a certain location or in a certain manner as well as payload operational instructions, specifying how and when to operate the payloads onboard the UAV.
Control system (CS) 110 can further include a user interface for enabling interaction of an operator with the system. The user interface can comprise one or more display devices for displaying control data (e.g. telemetry received from the UAV and imaging data captured by an imaging system onboard the UAV). The user interface can further include one or more input devices (e.g. keyboard, mouse, touchpad, etc.) and appropriate computer software executed by a computer, as is well known in the art.
According to the presently disclosed subject matter system 100 further includes a scanning-mission control unit that includes one or more processing circuitries configured and operable to generate flight instructions dedicated for controlling the UAV during a scanning-mission for the purpose of improving the efficiency and autonomous operation of the scanning-mission execution. According to some examples, as illustrated in Fig. 1, scanning-mission control unit 140 is designed as part of mission computer 133 or as a dedicated processing device operatively connectible to mission computer 133. According to other examples, scanning-mission control unit is designed as a distributed unit that comprises various sub-units each dedicated for performing a different task, where in some examples, part or all of the sub-units of scanning-mission control unit are implemented remotely from the UAV, e.g. at control system 110. Placing the scanning-mission control-unit (140) onboard the aircraft has the advantage that calculations can be done faster as they are not hindered by communication link delays and breakdown, which may be significant. This helps to safeguard the autonomous operation of the aircraft and augment its efficiency during execution of the scanning-mission.
The term "scanning-mission" is used herein to include an aerial mission where a UAV is required to fly over a certain area of interest (AOI) with the purpose of scanning or covering the entire area. One example of a scanning-mission is an aerial imaging mission where a UAV is required to capture images of an entire area of interest. The UAV flies over the area of interest and uses its onboard imaging payload to continuously capture images of the area below. As mentioned above, in
some examples, the captured images can be later processed and stitched together to provide a composite image of the entire area of interest.
Fig. 3 is a schematic illustration in top view of flight progress of an aircraft during an imaging (scanning) mission. According to the illustrated example, the area of interest is divided into legs, in the current example four legs, a, b, c and d. The arrows illustrated along the legs indicate the flight path of the aircraft during the mission. As the aircraft flies along each leg, the camera system onboard the aircraft is operated to capture images of the area beneath the aircraft. Assuming a gimbaled camera is used, during each pass, the camera system moves the camera along a scanning line from side to side. Horizontal lines in section 'a' and the beginning of section 'b' represent scanning lines. In the illustrated example aircraft (e.g. UAV) 200 has finished the pass over leg 'a' and is now in the initial part of the pass over leg 'b'. Although not shown in Fig. 3, in some cases some overlap may exist between two adjacent legs and between consecutive scanning lines.
As illustrated in Fig. 3, a turning maneuver (T Fig. 3) connects between consecutive legs along the flight path, where both legs are aligned with the same azimuth and are generally traversed by the aircraft in opposite directions. According to one example, scanning-mission control unit 140 is configured and operable (e.g. using a scanning direction determination module as illustrated in Fig. 2) to generate a flight plan that comprises flight instructions directing the aircraft during execution of a scanning-mission that reduces (e.g. minimizes) the number of turns that the UAV is required to make during the scanning-mission. Turns are executed outside the polygon and enable the aircraft to enter the next leg following the turn in a roll angle that allows to continue operation of the payload. The specific roll angle is dependent on the type of payload, and in general is substantially equal to zero i.e. the aircraft being leveled (possibly with tolerance of a few degrees). A turning maneuver is a wasteful operation, since, while turning, the aircraft is not positioned over the AOI and thus is unable to operate the payload for completing the mission (e.g. activate an imaging system for capturing images of the AOI). Accordingly, it would be
advantageous to reduce the number of turns which are made during the execution of a scanning-mission. Reducing the number of turns would help to shorten the execution time needed for completing the mission, and also to reduce consumption of various resources such as fuel.
The shape of the AOI is in many cases characterized by uneven sides. For example, an operator can interact with aerial images of an area, which are displayed on a display device at the control system 110, and mark on the displayed images points indicating the boundaries of an AOI. The points marked by the operator, when connected, may construct a polygon with sides of unequal length. For instance assuming the area of interest is a field, the shape of the field, which may be characterized by sides of unequal length, prescribes the shape of the AOI. An example of an AOI with uneven sides is illustrated in Fig. 3.
According to examples disclosed herein a flight direction that reduces (e.g. minimizes) the number of turns made during a scanning-mission is calculated. Fig. 4 is a flowchart of operations carried out according to some examples of the presently disclosed subject matter. Operations described with reference to Fig. 4 (as well as Figs. 5, 8 and 10 below) can be executed, for example, with the help of a system 100 (and more specifically by scanning-mission control unit 140) configured according to the principles described above with reference to Figs. 1 and 2. It is noted however that any description of operations, which is made with reference to elements in Figs. 1 and 2 , is done by way of example only and should not be construed as limiting in any way.
At block 401 data on an area of interest (AOI) is obtained. The data includes for example, the location of the AOI (e.g. relative to a global coordinates system). The location of the area can be indicated by two or more points representing vertices located on the perimeter of the AOI. By connecting the points, a shape (e.g. polygon) bounding the area of interest is obtained. Connection of the vertices to obtain the AOI can be done automatically (e.g. by scanning-mission control unit) or
by an operator. In some examples the data can include two vertices and a corresponding length for each of the vertices thus essentially providing information pertaining to a rectangle delineating the AOI. In other examples, an entire shape of the AOI can be provided.
At block 403 the mapping data is processed in order to determine a selected flight direction (e.g. a certain azimuth) that enables to reduce (e.g. minimize) the number of turns required to be made by the UAV during the scanning-mission. A more detailed description of an example of determining the flight direction is described below with reference to Fig. 5.
At block 405, once the selected flight direction is known, instructions for directing the UAV to fly over the AOI and execute the mission (e.g. capture images of the ground) are generated. For example, a continuous flight path directing the aircraft for scanning the entire AOI and instructions for following the flight path are generated.
As illustrated in Fig. 3, the flight path comprises a plurality of legs, each leg extending across the AOI in the selected flight direction and each pair of consecutive legs are connected by a turn. The UAV is controlled so it follows the generated flight path. The number of legs, and consequentially the number of turns connecting between each two legs, depends, inter alia, on the width of the cross-section of the AOI that is perpendicular to the flight direction of the UAV and on the width of each leg. The width of each leg depends on the operational requirement of the specific payload which is being used and the type of mission. For example, in an image acquisition mission, the width of each leg depends on the sensor size, exposure time, scan orientation (Forward/Side), resolution, etc., as these parameters determine the FOV of the camera.
If the camera is mounted in a static position, the camera field of view (FOV) defines the width of the leg. The FOV can be determined based on required image resolution and resolution of the sensor of the camera device. Assuming for example
that required pixel resolution range is 0.5 meters (requiring 0.5 meters width for each pixel), and sensor resolution is 500 pixels, the FOV is calculated by 0.5 * 500 = 250 meters, which represent the distance on the ground covered by each frame.
In some cases the camera is mounted on a gimbal device configured during operation to move the camera around one or more gimbal axes to provide a scanning motion from side to side (e.g. in a sweeping motion across the flight direction, parallel to the cross-section) in order to increase the range which is covered by the camera. In such cases, an offset range from frame to frame is determined. The offset range is the range of new ground covered in each new frame. According to one example, it can be equal to the FOV. According to other examples, in order to enable the successful stitching of the captured images into one combined image, an overlap is maintained between consecutive frames. The offset range depends on the overlapping range and equals the FOV minus the overlapping range. For example, if the overlapping range is 20% of the FOV and FOV is 250 meters, the overlap range equals 20% of 250 which equals 50 meters. In this case, the offset range equals 250 - 50 = 200.
Turning to Fig. 5, this shows a flowchart of a sequence of operations carried out for determining a selected flight direction, according to some examples of the presently disclosed subject matter. Fig. 5 is a more detailed example of the operations mentioned above with reference to block 403. Operations described with reference to Fig. 5 can be executed for example by scanning-mission control unit.
At block 510 a plurality of different candidate flight directions are analyzed, where the analysis includes, for each candidate flight direction:
determining a respective cross-section of the AOI substantially perpendicular to the particular candidate flight direction of the plurality of flight direction (block 503);
determining projection points of the vertices of the AOI on the particular cross-section, including at least the two vertices that are projected on projection
points located on the cross-section at the farthest distance, one from the other (block 505). In case of an AOI having a polygon shape, vertices of the polygon are projected on the cross-section. As illustrated in Fig. 6a, In case the AOI is characterized by curved sides, a circumgon (a polygon tangential to the AOI that represents the AOI) can be drawn around the AOI. For example scanning-mission control unit 140 can determine a circumgon around the AOI.
At block 507, the distance between the two farthest apart projection points on the particular cross section is calculated.
At block 515 a cross-section that accommodates the two farthest apart projection points with the shortest distance one from the other, is selected. At block 520, the selected direction of flight (azimuth) is determined as the direction perpendicular (or substantially perpendicular) to the selected cross-section. The selected direction is the direction of flight that requires the least number of turns during the execution of a scanning operation. A flight path is generated that comprises a plurality of legs, where all legs are aligned with (are substantially parallel to) the selected flight direction.
Fig. 6b is a schematic illustration demonstrating the operations described with reference to Fig. 5 above. Fig. 6b includes three states, state a, state b and state c. In each state a cross-section (65) at a different angle relative to the AOI is shown. In state 'a' the cross section is in the west-east direction, which is perpendicular to a north oriented flight direction (azimuth 0; or south, azimuth 180). As shown, vertices of the polygon representing the AOI are projected (90° projection of the vertices onto the cross-section) on the cross-section (indicated by the broken lines). The two projected points of the two vertices located farthest away from each other in the west-east direction of the AOI are indicated by circles (5).
Likewise, in states 'b' and 'c' a similar calculation is performed, where in state 'b' the cross-section is in the north-south direction perpendicular to the west-east
flight direction, and in state 'c' the cross-section is in the northeast-southwest direction perpendicular to the northwest-southeast flight direction.
As is apparent from the illustration, in state 'b' the section confined between the two farthest away projection points is the shortest from among the three illustrated states, and accordingly state 'b' would be selected out of the 3 states. Of course the process of determining a selected flight direction can include the analysis of additional cross-sections in relative angles. For example, the analysis can include a cross-section for every angle in a 360° resolution around the AOI for a total of 360 cross-sections, or a cross-section for every other angle for a total of 180 cross- sections or a cross-section for every half an angle for a total of 720 cross sections or a cross-section for every 4 angles for a total of 90 cross-section, or the like.
As illustrated in Fig. 3, during execution of the mission, the aircraft is controlled to fly over the AOI in the selected direction along a first leg, make a turn at the edge of the AOI, and fly over the next leg in a direction opposite to the selected direction.
According to some examples, other conditions and constraints are taken into consideration in order to increase the quality of the scanning output. For example, in case the scanning-mission involves operation of an electro optic imaging system (e.g. a hyperspectral imaging system) over the AOI, the direction of the sun may also be taken into consideration when selecting a flight direction. As schematically illustrated in Fig. 7, in order to improve the output of a hyperspectral imaging system, it is desirable to operate the imaging system substantially in parallel to the direction of the sun. Direction of the sun can be determined based on the current date and time, as is well known in the art.
Thus, according to some examples, the direction of flight during a scanning- mission that involves the operation of an imaging (payload e.g. hyperspectral imaging system) depends on the direction of the sun, and is selected such that the direction of flight is aligned with the direction of the sun.
In some cases, in order to reduce the number of turns as discussed above and increase the efficiency of the scanning-mission, alignment of the flight direction with the direction of the sun is maintained within a certain tolerance, for example, a ±40° offset from the real-time estimated sun direction. In such cases, the possible flight direction is within the tolerance window. The specific direction of the UAV within the tolerance window is determined as discussed above with reference to Figs. 4 and 5, so as to reduce the number of turns to the minimal possible, while not deviating from the allowed tolerance window determined according to the direction of the sunlight.
Another example is related to the wind direction, where a flight direction is limited to a certain tolerance window relative to the estimated wind direction. In this case the possible flight direction is within the tolerance window determined as discussed above with reference to Figs. 4 and 5, so as to reduce the number of turns to the minimal possible, while not deviating from the allowed tolerance window determined according to the direction of the wind (e.g. aligned with or perpendicular to the wind direction).
The presently disclosed subject matter further contemplates a method and system for controlling a UAV aimed to improve efficiency of the UAV operation when executing turns. As explained above, during turns the position of the UAV relative to the AOI does not permit to operate the payload for completing the mission, and accordingly it is desired to reduce the time spent for turning. According to the presently disclosed subject matter, specific UAV control logic is implemented, which helps to reduce the time spent for performing turns.
Fig. 8 is a flowchart of a sequence of operations carried out according to some examples of the presently disclosed subject matter. Operations described with reference to Fig. 8 can be executed for example by scanning-mission control unit (e.g. by turning maneuver control module illustrated in fig. 2). At block 801, the minimal-effective (actual) turning diameter of the aircraft is calculated or obtained
e.g. from computer memory. In some examples, the minimal-effective (or actual) turning diameter of the aircraft is calculated in real-time e.g. at the beginning of the flight, or right before a turn. The minimal-effective turning diameter is calculated based on the minimal-mechanical turning diameter (i.e. the minimal turning diameter possible in optimal conditions) and other environmental conditions, such as for example true airspeed and direction (obtained for example from pitot tubes).
At block 803 it is determined whether the minimal-effective turning diameter is smaller than the spacing between two consecutive legs. In general, the spacing is related to the width of a current leg on which the aircraft is located and the next leg to which the aircraft is about to turn. As explained above, the leg width depends on the operational requirement of the specific payload used during a mission. An example of calculation of the leg width is provided above. Notably, in some missions the width of different legs may not be equal, and in some cases the width is calculated in real-time.
In case the minimal-effective turning diameter (D) is smaller than the spacing between legs (R), a turning maneuver (or transition between legs) is constructed as illustrated in Fig. 9a (block 805). According to this example, the turning maneuver includes a sequence comprising: a first turn exiting the current leg 90 and turning to a first direction (arrow 5) toward the next leg, the first direction substantially perpendicular to the direction of the current leg (arrow 3); a second turn 92 towards the entry point to the next leg 93, in a direction substantially perpendicular to the first direction (arrow 7); and an extended section 9 connecting between the end of the first turn 91 and the beginning of the second turn 92 covering the distance between the legs, where the length of the line depends on the difference between the minimal-effective turning diameter (D) and the distance between the two legs (R). Notably, the turning maneuver according to the example illustrated in Fig. 9a is comprised of a first section of a first complete turn (section 90-91) and a second section of a second complete turn (section 92- 93) and another section connecting the two sections, and tangential to the two complete turns (section 91-92).
In case the minimal-effective turning diameter (D) is larger than the spacing between two consecutive legs (R), a turning maneuver (or transition between legs) is constructed as illustrated in Fig. 9b (block 807). According to this example the turning maneuver includes three consecutive turns: a first turn exiting the current leg in a first direction away from the next leg 95 to thereby provide sufficient distance for executing a full turn towards the next leg; a second turn in a second direction towards the next leg 96, wherein the diameter of the second turn is such that the second turn ends at an ending point 97 located beyond the entry point to next leg 98 (the diameter of the second turn > D); and a third turn from the ending point of the second turn 97, directing the UAV towards the entry point to the next leg 98. Notably, the turning maneuver according to the example illustrated in Fig. 9b is comprised of a first section of a first complete turn (section 95-96) and a second section of a second complete turn (section 97- 98) and another section of a third complete turn connecting the two sections (section 96-97).
As an alternative to block 807, in some examples, in case the minimal- effective turning diameter (D) is larger than the spacing between two consecutive legs (R) a turning maneuver (or transition between legs) is constructed as illustrated in Fig. 9c. According to this example the turning maneuver includes a first turn exiting the current leg 901 in a first direction (arrow 9) away from the next leg to thereby provide sufficient distance for executing a full turn towards the next leg; a second turn 903 in a second direction towards the next leg, wherein the diameter of the second turn is such that the second turn ends at an ending point 905 with the aircraft pointing in the direction of the next leg; and an extended section (section 905 -907), substantially aligned with the next leg, leading the aircraft to the next leg. The turning maneuver according to the example illustrated in Fig. 9c is comprised of a first section of a complete turn (section 901-903) and a second section of a complete turn (section 903-907).
Notably, as illustrated in Fig. 9d, the maneuver according to Fig. 9c can be alternatively made in the opposite direction i.e. a turning maneuver that starts with
an extended section, substantially aligned with the next leg and followed by a first turn in the direction (arrow 15) of the next leg, the first turn ending at an ending point 913 located beyond the entry point to next leg 915 and followed by a second turn leading to the entry point to the next leg 915.
According to some examples, upon determining that the minimal-effective turning diameter (D) is larger than the spacing between two consecutive legs (R) the process according to Fig. 8 includes a decision stage for selecting between two or more possible maneuvers, e.g. selecting between a maneuver according to Fig. 9b, a maneuver according to Fig. 9c and a maneuver according to Fig. 9d. According to this example a maneuver that would take the shortest time for the aircraft to travel from the exit point of the current leg to entry point of the next leg is selected. Selection is performed for example based on a calculation of a predicted ground-speed in each of the maneuvers.
The predicted ground-speed is calculated based on the airspeed and the wind velocity along each turn. Assuming the airspeed is constant along the turning maneuver, the ground-speed depends on the wind velocity along a certain turning maneuver. The ground-speed along the turning maneuver is calculated by taking the different directions assumed by the aircraft along the turning maneuver, determining the wind velocity and calculating the ground-speed in each of the different directions and integrating the calculated ground-speed to obtain an integrated ground-speed along the entire turning maneuver. Wind velocity can be determined based on airspeed (received for example from pitot tubes), heading (e.g. obtained from INS) which give together an first (inertial) vector. A second vector is received from the GPS sub-system. The subtraction between the first and second vectors provides the wind velocity.
For each of the candidate turning maneuvers, an estimated time for completing the turning maneuver is calculated based on the length of the turning maneuver and the integrated ground-speed. The turning maneuver that would take
the shortest time to complete is selected. Notably, in some cases the selected maneuver may not be the one with the shortest distance. According to some examples, while executing a certain scanning-mission, different turning maneuvers can be used during the transition between different legs. This can result for example in a change in wind direction and/or wind velocity that occurs during the mission execution or in variation in the spacing between consecutive legs.
The presently disclosed subject matter further contemplates a method and system for controlling a UAV aimed to improve efficiency of the UAV operation when executing mission operation. As explained above, during a scanning-mission the UAV is controlled to fly along a certain flight path that comprises a plurality of legs for the purpose of covering an AOI and operating a payload while traveling along the flight path. In some cases, it may be desired to repeat a certain section, e.g. in case of operational failure of the payload over a certain section. For example, in an imaging mission, images which are captured by an imaging payload onboard the UAV undergo quality assessment. To this end, system 100 can comprise an automatic quality assessment sub-system which can be implemented for example as part of the imaging system or the mission computer 133 or the control mission computer 115. Automatic quality assessment executed onboard the UAV can be used to determine, immediately after an image is generated, whether the image complies with certain quality measures. Such quality measures can include for instance, smearing of the image due to a movement which is above the allowed exposure speed. In another example, in a camera operated in a fixed position (not gimbaled), movement of the aircraft may cause a deviation from the required overlap between legs.
In case images captured along a certain section along a leg are found to be incompliant with some prescribed quality measure, the UAV may be required (e.g. according to instructions generated by scanning-mission control unit 140) to repeat and fly over the same section a second time in order to obtain images in sufficient quality. Likewise, in the example of crop dusting or irrigation, a UAV may be required to fly a second time over a certain section for repeatedly applying the material.
According to examples of the presently disclosed subject matter, the UAV is controlled to reduce the time and/or distance travelled when executing a circling maneuver for the purpose of repeating and flying over the same section. Fig. 10 is a flowchart of a sequence of operations carried out according to some examples of the presently disclosed subject matter. Operations described with reference to Fig. 10 can be executed for example by scanning-mission control unit 140 (e.g. by mission correction control module illustrated in fig. 2). At block 1001, data indicative of a need to fly over a section of a leg currently being traversed, is detected. According to the example illustrated in Figs. 11a and lib while a UAV is executing a mission (e.g. operating an imaging system) along leg L, a payload operation failure is detected along a certain section X (referred to herein as a "bad section" or "traversed section").
In case it is decided that repeating of a payload operation over the bad section is required, a type of circling maneuver is selected from of at least two different types of candidate circling maneuvers.
Fig. 11a is a schematic illustration of a first type of circling maneuver (referred to herein as "circling back maneuver") where the UAV turns back, as close as possible, to the end of the bad section, to reach the beginning of the bad section, and then flies over the bad section a second time while operating the payload (e.g. repeats image acquisition to obtain images in a sufficient quality). Fig. lib is a schematic illustration of a second type of circling maneuver (referred to herein as "leg repeating maneuver"), where the UAV proceeds until the end of the leg, makes a U-turn at the end of the leg, and flies over the entire leg a second time while repeating the mission over the bad section. Notably, the leg repeating maneuver may result in a change in the direction of flight along the following legs, switching to the opposite direction.
At block 1005 the flight distance and flight time added by two or more types of circling maneuvers is calculated. To this end the following operations may be carried out for each candidate circling maneuver:
the flight distance of each circling maneuver is calculated.
the integrated ground-speed of each maneuver is calculated, based on the wind velocity relative to various directions of the aircraft during the maneuver.
The time needed for completing each maneuver is calculated based on the distance of the maneuver and the integrated ground-speed.
In some examples, calculation of the distance of the first circling maneuver (CM) can be based on:
First CM = X + Y
where:
X is the length of the bad section.
The length of the bad section can be determined by monitoring the performance of the scan (e.g. using an on-board quality assessment sub-system) regarding the examples above. For example, this may be the area over which poor quality image output was obtained.
Y is the estimated length of the maneuver required for circling back from the current position of the UAV along the leg to the beginning of the bad section. The circling maneuver Y according to the example illustrated in Fig. 11a is similar to the turning maneuver shown in Fig. 9a and comprises a first section of a first complete turn (section 1103 -1105) and a second section of a second complete turn (section 1107 -1101) and another section connecting and tangential to the two sections (section 1105 -1107). According to some examples, the length of Y can be determined based on the calculation of the minimal-effective turning radius calculated as described above. Notably, minimal-effective turning radius is based on
airspeed and can be calculated in real-time. In some case the radius of the two circles may not be the same.
Calculation of the distance of the second circling maneuver (CM) can be based on:
Second CM = LR+ U1
where:
LR is the length of the leg which is repeated; and
U1 is the length of the U-turn.
The turning maneuver U1 according to the example illustrated in Fig. lib is comprised of a first section extending in the general direction of the current leg (section 1111 -1113) and a second section of a first complete turn (section 1113 - 1117) and another section of a second complete turn turning back to the current leg (section 1115 -1111). Notably, the maneuver illustrated in Fig. lib can be alternatively executed in the opposite direction, i.e. with a first turn exiting the current leg, followed by a turn in the other direction that ends with an extended section substantially aligned with the current leg.
Another alternative for a circling maneuver is illustrated in Fig. 11c. This maneuver includes a first turn exiting the current leg 1121 in a first direction that provides sufficient distance for executing a full turn back towards the entry to the current leg; a second turn 1123 pointing the aircraft back towards the current leg; and a third turn 1125 starting from the end of the second turn and directing the aircraft back towards the current leg. According to this example, the U-turn comprises a full turn, with its center substantially aligned with the current leg.
According to some examples a maneuver that would require the shortest time for the aircraft to travel from the exit point of the current leg, to entry point of the next leg, is selected. Selection is performed for example, based on a calculation of a predicted ground-speed in each of the maneuvers. The predicted ground-speed
is calculated based on the airspeed and the wind velocity along each turn. As explained above with respect to the turning maneuver, the ground-speed along the circling maneuver is calculated by taking the different directions assumed by the aircraft along the turning maneuver, determining the wind velocity, and calculating the ground-speed in each of the different directions and integrating the calculated ground-speed to obtain an integrated ground-speed along the entire circling maneuver. For each of the candidate turning maneuvers, an estimated time for completing the circling maneuver is calculated based on the length (distance) of the circling maneuver and the integrated ground-speed. The circling maneuver that is determined to take the shortest time to complete is selected. Notably, in some cases the selected maneuver may not be the one with the shortest distance. According to some examples, while executing a certain scanning-mission, different circling maneuvers can be used during the transition between different legs. This can result for example in a change in wind direction and/or wind velocity that occurs during the mission execution.
The UAV is controlled to fly according to the selected maneuver and repeat the mission over the bad section (block 1010).
It will also be understood that the system according to the presently disclosed subject matter may be a suitably programmed computer. Likewise, the presently disclosed subject matter contemplates a computer program being readable by a computer for executing the method of the presently disclosed subject matter. The presently disclosed subject matter further contemplates a machine- readable non-transitory memory tangibly embodying a program of instructions executable by the machine for executing the method of the presently disclosed subject matter.
It is to be understood that the presently disclosed subject matter is not limited in its application to the details set forth in the description contained herein or illustrated in the drawings. The presently disclosed subject matter is capable of
other embodiments and of being practiced and carried out in various ways. Hence, it is to be understood that the phraseology and terminology employed herein are for the purpose of description and should not be regarded as limiting. As such, those skilled in the art will appreciate that the conception upon which this disclosure is based may readily be utilized as a basis for designing other structures, methods, and systems for carrying out the several purposes of the present presently disclosed subject matter.
Claims
1. A method of autonomously maneuvering an aircraft over an area of interest during a scanning-mission, where the scanning-mission includes flying over the area of interest along a flight path that comprises multiple legs, wherein all legs traverse the area of interest in substantially the same direction and each two consecutive legs are connected by a turn, the method comprising:
operating at least one processing circuitry for:
obtaining mapping data indicative of boundaries of the area of interest to be scanned by the aircraft;
processing the mapping data to select a selected cross-section of the area of interest from a plurality of cross-sections, each cross-section from among the plurality of cross-sections is characterized by a different angle relative to a certain frame of reference and comprises a respective section confined by two projection points, each of the two projection points are a projection of a respective extreme vertex of a polygon representing the area of interest;
wherein the selected cross-section is characterized by the shortest respective section;
determining a selected flight direction to be substantially perpendicular to the selected cross-section;
generating the flight path comprising a plurality of legs, where all legs are aligned with the selected flight direction, thereby reducing the number of turns during the scanning-mission relative to other possible flight directions ; and
generating instructions dedicated for controlling the aircraft to fly along the flight path.
2. The method of claim 1 further comprising operating the payload while proceeding along the flight path.
3. The method of claim 1, wherein the polygon representing the AOI is the area of interest.
4. The method of claim 1, wherein the polygon representing the AOI is a polygon tangential to the AOI.
5. The method of any one of the preceding claims further comprising: for each cross-section of the plurality of cross-sections, calculating the length of the respective section, comprising: projecting a plurality of vertices of the polygon on the cross-section; and determining the greatest distance between two points projected on the cross- section.
6. The method of any one of the preceding claims further comprising: obtaining information indicative of a range of angles limiting the allowed flying direction; and selecting the selected cross-section from a plurality of cross-sections characterized by an angle substantially perpendicular to an angle that resides within the range of angles.
7. The method according to claim 6, wherein the scanning-mission includes operating a hyperspectral imaging system over the AOI, and wherein the range of angles is determined according to the position of the sun relative to the AOI.
8. The method of any one of preceding claims further comprising: operating the at least one processing circuitry for selecting a turning maneuver during transition from a first leg to a second leg, wherein flying direction along the first leg is substantially parallel and at an opposite direction to flying direction along the second leg, the selecting comprising: determining a minimal effective turning diameter of the aircraft;
in case the minimal effective turning diameter is greater than a distance crossing between the first leg and the second leg, performing a first turning maneuver that includes:
a first turn exiting the current leg in a first direction opposite to the direction of the second leg, the first turn is aimed to increase the distance of the aircraft from the second leg; a second turn in a second direction toward the next leg, wherein the diameter of the second turn is such that the second turn ends at an ending point located beyond the next leg; and a third turn from the ending point of the second turn to the entry point of the next leg; and
in case diameter of the minimal effective turning is shorter than the distance crossing between the first leg and the second leg, performing a second turning maneuver that includes:
a first turn exiting the current leg in a direction of the next leg; a second turn toward the next leg, the second turn having a direction substantially opposite to the first turn, and an extended section connecting between the first turn and the second turn.
9. The method according to claim 8, wherein each turn in the first turning maneuver and the second turning maneuver is part of a circle characterized by a diameter that is equal to the minimal effective turning diameter.
10. The method of any one of the proceeding claims, further comprising operating the at least one processing circuitry for selecting a circling maneuver for repeating a traversed section within a current leg, the selecting comprising:
responsive to detection of a need to repeat a traversed section within a leg:
calculating the distance of a first circling maneuver that comprises a turn starting from about the end of the traversed section and circling back around to the beginning of traversed sections along the current leg; and
calculating the distance of a second circling maneuver that comprises proceeding to the end of the current leg, performing a U-turn leading back into the current leg, and repeating the entire current leg a second time;
selecting the circling maneuver with the shorter length;
controlling the aircraft according to the selected circling maneuver for flying over the traversed section a second time, and activating a payload.
11. The method of any one of the preceding claims wherein the aircraft is an unmanned aerial vehicle.
12. A system mountable on an aircraft for autonomously maneuvering the aircraft over an area of interest during a scanning-mission, where the scanning- mission includes flying over the area of interest along a flight path that comprises multiple legs, wherein all legs traverse the area of interest in substantially the same direction and each two consecutive legs are connected by a turn, the system comprises a computer and a payload, the computer comprising one or more processing circuitries configured to:
obtain mapping data indicative of boundaries of the area of interest to be scanned by the aircraft;
process the mapping data to select a selected cross-section of the area of interest from a plurality of cross-sections, each cross-section from among the plurality of cross-sections is characterized by a different angle relative to a certain frame of reference and comprises a respective section confined by two projection points, each of the two projection points are a projection of a respective extreme vertex of a polygon representing the area of interest;
wherein the selected cross-section is characterized by the shortest respective section;
determine a selected flight direction to be substantially perpendicular to the selected cross-section;
generate the flight path comprising a plurality of legs, where all legs are aligned with the selected flight direction, thereby reducing the number of turns during the scanningmission relative to other possible flight directions; and
generate instructions dedicated for controlling the aircraft to fly along the flight path and instructions for operating the payload along the flight path.
13. The system of claim 12 wherein the payload is an imaging system configured for capturing images of the area of interest.
14. The system of claim 12, wherein the at least one processing circuitry is further configured to operate the payload while proceeding along the flight path.
15. The system of claim 12 wherein the at least one processing circuitry is further configured to:
obtain information indicative of a range of angles limiting the allowed flying direction; and select the selected cross-section from a plurality of cross-sections characterized by an angle substantially perpendicular to an angle that resides within the range of angles.
16. The system of claim 15, wherein the scanning-mission includes operating a hyperspectral imaging system over the AOI, and wherein the range of angles is determined according to the position of the sun relative to the AOI.
17. The system of claim 12, wherein the at least one processing circuitry is further configured to:
select a turning maneuver during transition from a first leg to a second leg, wherein flying direction along the first leg is substantially parallel and at an opposite direction to flying direction along the second leg, the selecting comprising:
determining a minimal effective turning diameter of the aircraft;
in case the minimal effective turning diameter is greater than a distance crossing between the first leg and the second leg, performing a first turning maneuver that includes: a first turn exiting the current leg in a first direction opposite to the direction of the second leg, the first turn is aimed to increase the distance of the aircraft from the second leg; a second turn in a second direction toward the next leg, wherein the diameter of the second turn is such that the second turn ends at an ending point located beyond the next leg; and a third turn from the ending point of the second turn to the entry point of the next leg; and in case diameter of the minimal effective turning is shorter than the distance crossing between the first leg and the second leg, performing a second turning maneuver that includes: a first turn exiting the current leg in a direction of the next leg; a second turn toward the next leg, the second turn having a direction substantially opposite to the first turn and an extended section connecting between the first turn and the second turn.
18. The system of claim 17, wherein each turn in the first turning maneuver and the second turning maneuver is part of a circle characterized by a diameter that is equal to the minimal effective turning diameter.
19. The system of claim 12, wherein the at least one processing circuitry is further configured to: select a circling maneuver for repeating a traversed section within a current leg, the selecting comprising: responsive to detection of a need to repeat a traversed section within a leg:
calculating the distance of a first circling maneuver that comprises a turn starting from about the end of the traversed section and circling back around to the beginning of traversed sections along the current leg; and
calculating the distance of a second circling maneuver that comprises proceeding to the end of the current leg, performing a U-turn leading back into the current leg, and repeating the entire current leg a second time;
selecting the circling maneuver with the shorter length; controlling the aircraft according to the selected circling maneuver for flying over the traversed section a second time, and activating a payload.
20. An unmanned aerial vehicle comprising the system according to any one of claims 12 to 19.
21. A computer program product comprising a non-transitory computer useable medium having computer readable program code embodied therein for autonomously maneuvering an aircraft over an area of interest during a scanning- mission, where the scanning-mission includes flying over the area of interest along a flight path that comprises multiple legs, wherein all legs traverse the area of interest in substantially the same direction and each two consecutive legs are connected by a turn; the computer program product comprising: computer readable program code for causing the computer to obtain mapping data indicative of boundaries of the area of interest to be scanned by the aircraft; computer readable program code for causing the computer to process the mapping data and select a selected cross-section of the area of interest from a plurality of cross-sections, each cross-section from among the plurality of cross- sections is characterized by a different angle relative to a certain frame of reference and comprises a respective section confined by two projection points, each of the two projection points are a projection of a respective extreme vertex of a polygon
representing the area of interest; wherein the selected cross-section is characterized by the shortest respective section;
computer readable program code for causing the computer to determine a selected flight direction to be substantially perpendicular to the selected cross- section;
computer readable program code for causing the computer to generate the flight path comprising a plurality of legs, where all legs are aligned with the selected flight direction, thereby reducing the number of turns during the scanning-mission relative to other possible flight directions; and
computer readable program code for causing the computer to generate instructions dedicated for controlling the aircraft to fly along the flight path.
22. A computer program product comprising a non-transitory computer useable medium having computer readable program code embodied therein; the computer program product comprising:
computer readable program code for causing the computer to select a turning maneuver during transition from a first leg to a second leg, wherein flying direction along the first leg is substantially parallel and at a substantially opposite direction to flying direction along the second leg; the computer program product further comprising:
computer readable program code for causing the computer to calculate a predicted ground-speed along each one of a plurality of candidate turning maneuvers, based on the wind velocity and flight directions along the candidate turning maneuver;
computer readable program code for causing the computer to calculate a time of travel for completing each of the candidate turning maneuvers; and
computer readable program code for causing the computer to select a turning maneuver from a plurality of turning maneuvers characterized by the shortest time of travel.
23. A computer program product comprising a non-transitory computer useable medium having computer readable program code embodied therein; the computer program product comprising:
computer readable program code for causing the computer to select a circling maneuver for repeating a traversed section within a current leg; the computer program product further comprising:
computer readable program code for causing the computer to calculate a predicted ground-speed along each one of a plurality of candidate circling maneuvers, based on the wind velocity and flight directions along the candidate circling maneuver;
computer readable program code for causing the computer to calculate a time of travel for completing each of the candidate circling maneuvers; and
computer readable program code for causing the computer to select a circling maneuver from a plurality of turning maneuvers characterized by the shortest time of travel.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| IL264016A IL264016A (en) | 2018-12-27 | 2018-12-27 | System and method for autonomous execution of an aerial scanning mission |
| IL264016 | 2018-12-27 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2020136640A1 true WO2020136640A1 (en) | 2020-07-02 |
Family
ID=65910788
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/IL2019/051396 Ceased WO2020136640A1 (en) | 2018-12-27 | 2019-12-22 | System and method for execution of an autonomous airborne scanning-mission |
Country Status (2)
| Country | Link |
|---|---|
| IL (1) | IL264016A (en) |
| WO (1) | WO2020136640A1 (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN119847212A (en) * | 2025-01-08 | 2025-04-18 | 西安爱生技术集团有限公司 | Unmanned aerial vehicle safe turning space prediction and display method in wind field environment |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20170334559A1 (en) * | 2016-05-20 | 2017-11-23 | Unmanned Innovation, Inc. | Unmanned aerial vehicle area surveying |
| US9852639B2 (en) * | 2015-10-20 | 2017-12-26 | Skycatch, Inc. | Generating a mission plan for capturing aerial images with an unmanned aerial vehicle |
-
2018
- 2018-12-27 IL IL264016A patent/IL264016A/en unknown
-
2019
- 2019-12-22 WO PCT/IL2019/051396 patent/WO2020136640A1/en not_active Ceased
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9852639B2 (en) * | 2015-10-20 | 2017-12-26 | Skycatch, Inc. | Generating a mission plan for capturing aerial images with an unmanned aerial vehicle |
| US20170334559A1 (en) * | 2016-05-20 | 2017-11-23 | Unmanned Innovation, Inc. | Unmanned aerial vehicle area surveying |
Non-Patent Citations (1)
| Title |
|---|
| COOMBES, M. ET AL.: "Optimal polygon decomposition for UAV survey coverage path planning in wind", SENSORS, vol. 18, no. 7, 18 July 2018 (2018-07-18), pages 2132, XP055722845 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN119847212A (en) * | 2025-01-08 | 2025-04-18 | 西安爱生技术集团有限公司 | Unmanned aerial vehicle safe turning space prediction and display method in wind field environment |
Also Published As
| Publication number | Publication date |
|---|---|
| IL264016A (en) | 2020-06-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US12210346B2 (en) | Methods and systems for determining flight plans for vertical take-off and landing (VTOL) aerial vehicles | |
| EP3740785B1 (en) | Automatic camera driven aircraft control for radar activation | |
| Valente et al. | Near-optimal coverage trajectories for image mosaicing using a mini quad-rotor over irregular-shaped fields | |
| EP3850456B1 (en) | Control and navigation systems, pose optimisation, mapping, and localisation techniques | |
| US11029352B2 (en) | Unmanned aerial vehicle electromagnetic avoidance and utilization system | |
| CN103017753B (en) | Unmanned aerial vehicle route planning method and device | |
| Hernandez-Lopez et al. | An automatic approach to UAV flight planning and control for photogrammetric applications | |
| US12148205B2 (en) | Contour scanning with an unmanned aerial vehicle | |
| US20220390940A1 (en) | Interfaces And Control Of Aerial Vehicle For Automated Multidimensional Volume Scanning | |
| US20180267561A1 (en) | Autonomous control of unmanned aircraft | |
| CN111650962A (en) | Multi-rotor unmanned aerial vehicle route planning and aerial photography method suitable for banded survey area | |
| US10424105B2 (en) | Efficient airborne oblique image collection | |
| Kamat et al. | A survey on autonomous navigation techniques | |
| WO2020136640A1 (en) | System and method for execution of an autonomous airborne scanning-mission | |
| US20200307788A1 (en) | Systems and methods for automatic water surface and sky detection | |
| EP4429950B1 (en) | Contour scanning with an unmanned aerial vehicle | |
| Siavalas et al. | Unmanned aerial vehicles for agricultural automation | |
| Liu et al. | Adaptive Weight Multi-Band Blending Based Fast Aerial Image Stitching and Mapping | |
| CN117699082A (en) | Unmanned aerial vehicle system for autonomous light and small photoelectric panoramic observation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 19905425 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 19905425 Country of ref document: EP Kind code of ref document: A1 |