US10338592B2 - High accuracy remote coordinate machine - Google Patents

High accuracy remote coordinate machine Download PDF

Info

Publication number
US10338592B2
US10338592B2 US15/685,789 US201715685789A US10338592B2 US 10338592 B2 US10338592 B2 US 10338592B2 US 201715685789 A US201715685789 A US 201715685789A US 10338592 B2 US10338592 B2 US 10338592B2
Authority
US
United States
Prior art keywords
aerial vehicle
unmanned aerial
fixed device
tether
external surface
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
US15/685,789
Other versions
US20190064818A1 (en
Inventor
Pablo Carrasco Zanini
Fadl Abdellatif
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Saudi Arabian Oil Co
Original Assignee
Saudi Arabian Oil Co
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Saudi Arabian Oil Co filed Critical Saudi Arabian Oil Co
Priority to US15/685,789 priority Critical patent/US10338592B2/en
Assigned to SAUDI ARABIAN OIL COMPANY reassignment SAUDI ARABIAN OIL COMPANY ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: ABDELLATIF, FADL, CARRASCO ZANINI, PABLO
Priority to PCT/US2018/047962 priority patent/WO2019040875A1/en
Priority to EP18773019.7A priority patent/EP3673295B1/en
Priority to JP2020511269A priority patent/JP2020531835A/en
Priority to CN201880054866.7A priority patent/CN111095025A/en
Priority to KR1020207006060A priority patent/KR20200041894A/en
Priority to SG11202001201VA priority patent/SG11202001201VA/en
Publication of US20190064818A1 publication Critical patent/US20190064818A1/en
Priority to US16/387,734 priority patent/US10481604B2/en
Publication of US10338592B2 publication Critical patent/US10338592B2/en
Application granted granted Critical
Priority to SA520411292A priority patent/SA520411292B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/0094Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots involving pointing a payload, e.g. camera, weapon, sensor, towards a fixed or moving target
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01FMEASURING VOLUME, VOLUME FLOW, MASS FLOW OR LIQUID LEVEL; METERING BY VOLUME
    • G01F17/00Methods or apparatus for determining the capacity of containers or cavities, or the volume of solid bodies
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/02Systems using the reflection of electromagnetic waves other than radio waves
    • G01S17/06Systems determining position data of a target
    • G01S17/42Simultaneous measurement of distance and other co-ordinates
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/66Tracking systems using electromagnetic waves other than radio waves
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/88Lidar systems specially adapted for specific applications
    • G01S17/89Lidar systems specially adapted for specific applications for mapping or imaging
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/48Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
    • G01S7/4808Evaluating distance, position or velocity data
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/48Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
    • G01S7/497Means for monitoring or calibrating
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/0088Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots characterized by the autonomous decision making process, e.g. artificial intelligence, predefined behaviours
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/60Intended control result
    • G05D1/656Interaction with payloads or external entities
    • G05D1/678Interaction with payloads or external entities for tethered vehicles
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/60Intended control result
    • G05D1/656Interaction with payloads or external entities
    • G05D1/689Pointing payloads towards fixed or moving targets
    • B64C2201/141
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B64AIRCRAFT; AVIATION; COSMONAUTICS
    • B64UUNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
    • B64U2201/00UAVs characterised by their flight controls
    • B64U2201/10UAVs characterised by their flight controls autonomous, i.e. by navigating independently from ground or air stations, e.g. by using inertial navigation systems [INS]
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D2105/00Specific applications of the controlled vehicles
    • G05D2105/80Specific applications of the controlled vehicles for information gathering, e.g. for academic research
    • G05D2105/89Specific applications of the controlled vehicles for information gathering, e.g. for academic research for inspecting structures, e.g. wind mills, bridges, buildings or vehicles
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D2107/00Specific environments of the controlled vehicles
    • G05D2107/70Industrial sites, e.g. warehouses or factories
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D2109/00Types of controlled vehicles
    • G05D2109/20Aircraft, e.g. drones
    • G05D2109/25Rotorcrafts
    • G05D2109/254Flying platforms, e.g. multicopters
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D2111/00Details of signals used for control of position, course, altitude or attitude of land, water, air or space vehicles
    • G05D2111/10Optical signals
    • G05D2111/17Coherent light, e.g. laser signals

Definitions

  • the present invention relates to structural calibration and mapping methods, and in particular relates to a technique that uses an unmanned aerial vehicle (UAV) to map large objects in three-dimensions.
  • UAV unmanned aerial vehicle
  • the volume of storage tanks is calibrated periodically in order to be able to accurately determine the amount of fuel stored in the tank.
  • a level gauge is used to determine the amount of fuel in a tank.
  • storage tanks located in environments subject to high average temperatures tend to expand non-uniformly. The expansions are often difficult to measure accurately and can have an appreciable effect on the total volume.
  • the accuracy of standard gauge readings which are based on a static volume of the tank, diminish. Inaccurate fuel level readings can lead to systematic undervaluation of fuel assets and consequent loss of revenue during custodial transfers.
  • Embodiments of the present invention provide a method of calibrating a structure.
  • the method includes securing a first end of a tether to a device at a fixed location on an external surface of the structure, attaching an unmanned aerial vehicle to the second end of the tether, moving the unmanned aerial vehicle in a trajectory around the structure while tethered to the fixed device, scanning the external surface of the structure over a course of the trajectory using the unmanned aerial vehicle to obtain a mapping of the external surface of the structure, determining a position of the unmanned aerial vehicle with respect to the fixed device; and calibrating the structure based on i) the determined position of the unmanned aerial vehicle with respect to the fixed device, and ii) the mapping of external surface of the structure.
  • the trajectory of the unmanned aerial vehicle around the structure is a circular path.
  • the fixed device can be situated on a top surface of the structure.
  • the fixed device includes a laser scanner and the unmanned aerial vehicle includes a mounted reflector.
  • the laser scanner and mounted reflector together establish a position of the unmanned aerial vehicle relative to the fixed device.
  • the fixed device includes a tether spool having an angular encoder, and a strain sensor.
  • the strain on the tether using the strain sensor is measured using the strain sensor and the distance between the unmanned aerial vehicle and the fixed device is determined based on the measured strain.
  • the angular position of the unmanned aerial vehicle and the fixed device is determined using the angular encoder.
  • the unmanned aerial vehicle can include a laser scanning device that creates a point cloud of the external surface of the structure during scanning.
  • the unmanned aerial vehicle can also include three thrusters.
  • Embodiments of the present invention also provide a system for calibrating a structure.
  • the system includes a device located at a fixed location on an external surface of the structure, a tether having first and second ends and secured at the first end to the fixed device, and an unmanned aerial vehicle attached to the second end of the tether, the unmanned aerial vehicle including a scanning device.
  • the unmanned aerial vehicle is operative to move in a trajectory around the structure while tethered to the fixed device and to scan the external surface of the structure over a course of the trajectory to obtain a mapping of the external surface of the structure.
  • the structure is calibrated based on i) the known position of the unmanned aerial vehicle with respect to the fixed device, and ii) the mapping of external surface of the structure.
  • the unmanned aerial vehicle can include a plurality of thrusters, and is operative to control the thrusters to maintain tension in the tether so as to move in a circular trajectory and in some implementations, the fixed device is situated on a top surface of the structure.
  • the fixed device includes a laser scanner and the unmanned aerial vehicle includes a mounted reflector, and the laser scanner and mounted reflector together establish a position of the unmanned aerial vehicle relative to the fixed device.
  • the fixed device includes a tether spool, an angular encoder, and a strain sensor.
  • the strain sensor is operative to measure a strain on the tether, and a distance between the unmanned aerial vehicle and the fixed device is determined based on the measured strain.
  • the angular encoder can be used to determine the angular position of the unmanned vehicle relative to the fixed device.
  • the scanning device of the unmanned aerial vehicle can be implemented as a LiDAR device, and the unmanned aerial vehicle can be implemented as a tricopter with three thrusters.
  • FIG. 1 is a perspective view of an exemplary embodiment of a system for calibrating a structure according to the present invention.
  • FIG. 2 is a schematic perspective view of an embodiment of a fixed device according to an embodiment of the present invention.
  • FIG. 3 is a perspective view of a tricopter that can be used as a UAV according to embodiments of the present invention.
  • FIG. 4 is a schematic block diagram of a control system for calibrating a structure according to an embodiment of the present invention.
  • FIG. 5 is a flow chart of an exemplary embodiment of a method for propelling the UAV in a circular trajectory around the structure according to the present invention.
  • FIG. 6 is a flow chart of an exemplary embodiment of a data calibration method according to the present invention.
  • an unmanned aerial vehicle (sometimes referred to as a drone, but hereinafter referred to as a “UAV”) is tethered to a fixed point on the structure and travels around the structure in a trajectory while tethered.
  • the UAV scans the external surface of the structure while traversing the trajectory.
  • the tethering of the structure to the fixed point creates a coordinate reference frame since the precise location of the UAV with respect to the fixed point at any time can be accurately measured. Accordingly, the scanned data of the surface of the structure can be automatically converted into spatial coordinates within the reference frame. Since the UAV is tethered during its trajectory, maintaining unassisted stability is unnecessary, and unconventional UAV designs can be employed, including three-thruster (tricopter) designs.
  • FIG. 1 is a perspective view of an exemplary embodiment of a system for calibrating a structure according to the present invention.
  • a calibration system 100 is shown being used to calibrate structure 105 , which in this example is a fuel storage tank.
  • the structure has a top surface 110 on which a fixed device 120 is secured using a tripod or other stable platform, or by a fixture.
  • the fixed device 120 can also be secured to other parts of structure 105 .
  • the fixed device 120 is coupled to a first end of a tether 125 .
  • a second end of tether 125 is coupled to a UAV 130 .
  • the tether 125 is preferably light-weight, flexible, non-extendable and strong enough to withstand force sufficient to maintain the tether in a state of tension at full stretch. As shown in FIG. 1 , the tether 125 is extended and under tension. Either the fixed device 120 or UAV 130 (or both) can include a strain sensor adapted to measure a tension on the tether as it is suspended between the fixed device and the UAV. The tether can be coupled to a retractable spool mounted to either the fixed device 120 or the UAV 130 or it can be unwound manually.
  • the tether in general, it is preferable for the tether to have a length greater than a radius of the structure to be calibrated so that the UAV clears the edge of the structure sufficiently to be able to scan the entire external surface of the structure.
  • the UAV 130 is capable of traveling airborne in a trajectory around the structure 105 while attached to the tether 125 .
  • UAV 130 also includes a scanning device (not shown in FIG. 1 ) for capturing precise information regarding the dimensions of the structure.
  • the scanning device is a laser (LiDAR) scanner and the data captured using the scanner comprises a high-resolution point cloud or mapping, of the structure 105 .
  • the cloud resolution (point-to-point) distance can be approximately one centimeter ( ⁇ 1 cm) and the precision of each point can be approximately one millimeter ( ⁇ 1 mm).
  • the laser scanner can be a 2-dimensional LiDAR system that is adapted to map sets of point along a cross-section between a scanning plane and the structure. The 2-dimensional cross-section can be combined into a 3-dimensional mapping.
  • the UAV 130 includes an externally mounted reflector 132 .
  • the fixed device 120 can be implemented as a laser tracker, such as, for example, a Leica Absolute Tracker AT402, AT930 or AT960, with six degrees of freedom.
  • the tracker 120 is configured to determine the precise position of the reflector relative to the tracker and the reflector 132 using interferometry.
  • the UAV 130 can be coupled to the tether 125 so as to force the reflector 132 to face toward the tracker 120 while the UAV is deployed for scanning.
  • motion of the tether itself in combination with strain sensor and angular encoders, can be used to track the location of the drone instead of a laser tracker.
  • a fixed device based on this principle is shown schematically in FIG. 2 .
  • a tether 200 is coupled to and extends from a fixed device 205 (referred to as a “station”) that can be coupled to a spool (not shown in FIG. 2 ).
  • the station 205 is mounted to a first bearing 210 that provides freedom of rotation for the station in the azimuthal direction (horizontal plane).
  • a second bearing 215 provides freedom of rotation in a perpendicular plane that changes the orientation of the station in terms of altitude.
  • station 205 includes a distance encoder and/or strain sensor (not shown) that dynamically measures the length of the tether as it is unwound from a spool.
  • a strain sensor can measure a tension on the tether indicating that the tether has been extended to or close to its full length.
  • a distance encoder can be used to directly measure the length unwound, and can activate a clamp mechanism to stop a further unwinding of the spool to maintain the tether at a fixed length.
  • the distance between the fixed device and UAV can be preset by fixing the length of the tether and extending the tether to its maximum length.
  • the station can include a first encoder 222 coupled to the first bearing 210 that measures the azimuthal angle of the tether as the station rotates with respect to the first bearing.
  • Station 205 can also include a second encoder 224 coupled to the second bearing 215 that measures the altitude angle of the tether as the station rotates with respect to the second bearing.
  • sensors on the UAV 130 can be used in conjunction with or as a substitute for the encoders.
  • the station can include an altitude sensor that indicates the altitude of the station itself on the structure, and the UAV can include a similar altitude sensor.
  • the difference between the altitudes measured at the station and the UAV indicates the angle of the tether between the station and the UAV.
  • the orientation of the UAV with respect to the station can be measured using inertial measurement units (IMUS) on board of the UAV.
  • IMUS inertial measurement units
  • FIG. 3 shows a perspective view of a tricopter 300 that can be used for the UAV in embodiments of the present invention.
  • Tricopter 300 includes a first end thruster 302 which provides thrust in a vertical direction, a central thruster 304 which provides thrust in a horizontal direction, and a second end thruster 306 which also provides thrust in a vertical direction.
  • the central thruster 304 is used to impel in a horizontal direction the tricopter away from the structure to maintain tension on the tether.
  • the first and second end thrusters 302 , 306 can be used to adjust the altitude of the tricopter and also to adjust the angular orientation of the tricopter 300 with respect to the horizontal plane. (referred to as the “attitude”).
  • the attitude can be adjusted by providing downward thrust using first end thruster 302 simultaneously with an upward thrust using second end thruster 306 .
  • the system 100 is initialized so that the fixed device is enabled to track the UAV.
  • the UAV is first coupled to the tether 125 at an initial location.
  • the fixed device 120 is implemented using a laser tracker, the reflector 132 of the UAV is located, and the orientation of the UAV 130 with respect to the fixed device 120 is determined.
  • the initial location can be a pre-assigned “perch” location which is stored in the memory of the tracker. In this case, the location of the UAV is spotted by the tracker automatically.
  • the orientation of the UAV can be determined.
  • the encoders determine the orientation.
  • the UAV can then be tracked start from the point that it departs from the perch location.
  • an operator can position the UAV relative to the laser tracker, manually or by remote control, so that a beam from the tracker intercepts the reflector of the UAV. After interception, the operator can issue a command for the UAV to lift off.
  • the UAV can be configured (i.e., programmed) to move away from the fixed device up to a point that either a threshold tension is detected via a strain sensor positioned on either the fixed device or the UAV, or the limit of the tether is reached and the UAV cannot move further away from the fixed device.
  • the amount of sag is a function of the tension on the tether.
  • the tension can be measured with the strain sensor, which, as noted, can be included on either the fixed device or UAV (or both). Once measured, the amount of the sag, and the amount that the sag reduces the distance between the fixed device and the UAV, is determined. If the sag is determined to be beyond a threshold magnitude, the UAV thrusters are activated to increase the tension on the tether.
  • the UAV travels in a trajectory around the structure and scans the structure, preferably using LiDAR scanning (although other scanning and imaging modes can be used).
  • the UAV travels in a circular trajectory with the fixed device as the center, keeping the tension on the tether constant or nearly constant, and thus maintaining a consistent distance from the fixed center.
  • the trajectory can vary from circularity, and the tension on the tether can be reduced as necessary for periods of time.
  • the thrusters of the UAV are activated to continuously thrust away from the fixed device to sustain the tension on the tether and also to thrust upwardly to keep the UAV airborne.
  • FIG. 4 is a schematic block diagram of a control system for calibrating a structure according to an embodiment of the present invention.
  • UAV 130 includes a control unit 405 , a group of sensors 410 , a scanner 412 , a transceiver 414 , thrusters 416 and on-board memory 418 .
  • the control unit 405 which can be implemented using a microprocessor, programmable logic units and/or application specific circuitry, is configured with program modules.
  • the program modules include a trajectory control module 420 , a scanner control module 422 , a communications module 424 and a calibration module.
  • the sensors 410 can include inertial measurement units, pressure/strain sensors, optical sensors, altitude sensors, remote control sensors, etc. Data receives by sensor 410 is transmitted to the control unit 405 for further processing.
  • control unit 405 employs the trajectory control module 422 to control thrusters 416 either automatically or in response to commands received from an operator (e.g., by remote control).
  • the trajectory control module 420 includes logic for controlling the thrusters to maintain the UAV in a particular trajectory while tethered.
  • the scanner control module 422 is used to control the operation of scanner 412 , which obtains a series of cross-sectional mappings of the external surface of the structure as the UAV traverses a trajectory around the structure. In this manner, the trajectory control module 420 and the scanner control module 422 operate in tandem to ensure that entire surface of the structure is scanned.
  • the communications module 424 operates transceiver 414 which is adapted to communicate wirelessly via Wi-fi, Bluetooth or other suitable communication mode.
  • the calibration module 426 generates a complete 3-D mapping of the external surface of the structure based using the scanned data and data received form the fixed device.
  • the trajectory control module 420 executes an algorithm for propelling the UAV in a circular trajectory around the structure.
  • a flow chart of an exemplary embodiment of the algorithm is shown in FIG. 5 .
  • the thruster module receives data regarding the current position (starting position) of the UAV with respect to the fixed device.
  • the UAV determines whether there is sufficient tension on the tether based on input received from strain sensors. If there is not sufficient tension, in step 506 , the thruster module drives a thruster (the central thruster for implementations using a tricopter) to move the UAV away from the fixed device to increase the tension on the tether to a sufficient level.
  • a thruster the central thruster for implementations using a tricopter
  • the thruster module determines based on operator commands or preset instructions, the direction in which to traverse a circular trajectory, clockwise versus counterclockwise. Simultaneously, scanning module is activated to begin scanning the structure (independently of the thruster module). After determining a direction, in step 510 the thruster module activates the thrusters so as to travel at an approximately steady circumferential speed that is preset or selected by the operator. For tricopter implementations, the side thrusters are activated to accelerate the UAV to start the circumferential motion and then the amount of force can be reduced to achieve a steady speed.
  • the thruster module determines, in step 512 , whether the UAV has reached the initial position and traversed the entire circumference of the structure. The thruster module then determines, based on operator commands or preset instructions, whether to deactivate the thrusters (step 514 ) and park the UAV on a surface or to restart the trajectory (cycling back to step 510 ) and perform another scan run. Multiple scan runs can be performed to increase the amount of scan data for reducing possible errors and increasing overall scan accuracy.
  • the UAV 130 is coupled to the fixed device 120 by tether 125 .
  • Fixed device 120 in turn includes a control unit 430 , a group of sensors 432 , a transceiver 434 , and memory 436 .
  • the control unit 430 can be implemented using a processor, programming logic units or specialized circuits is configured with program modules, including a tracking module 442 , an orientation/distance determining module 444 and a communications module 446 .
  • Sensors 432 can include, but are not limited to a LiDAR tracker, angular encoders and a strain sensor (depending on the implementation of the fixed device employed).
  • the control unit 430 uses the tracking module 442 to locate and thereafter track a reflector on the UAV.
  • the orientation/distance determining module utilizes data received by the laser tracker or from the sensors 432 to determine the instantaneous orientation and distance of the UAV with respect to the fixed device. This information is continuously (ever small time increments) stored in memory 436 and is transmitted to the UAV via communication module 446 and transceiver 434 .
  • the method of the present invention provides a highly accurate calibration of the structure by cross-referencing the scanned data obtained by the UAV and the orientation and distance data obtained by the fixed device (or a combination of the UAV and the fixed device).
  • a low-latency communication link 450 can be established between the UAV 130 and fixed device 120 .
  • the communication link 450 enables the fixed device 120 to continuously transmit information to the UAV 130 while the UAV scans the structure.
  • the calibration module 426 of the UAV uses the information received from the fixed device to cross-reference the scanned data into a reference frame in real time.
  • the communication modules 424 , 444 of the UAV and fixed device perform a time-synchronization over the communication link 450 .
  • the fixed device then accumulates data over the trajectory of the UAV and the data is time stamped.
  • the accumulated data is then sent to the UAV.
  • the UAV cross-references the accumulated information with scanned data according to the time stamp, and thereby correlates a particular scan with an associated orientation of the UAV in the fixed reference frame.
  • the ability to cross-reference this information dispenses with the need to stitch scanned point sets together in a registration process. Once the orientation information and scanned data are fully cross-referenced, an accurate 3-D mapping of the structure can be rendered, and the volume of the structure can be calibrated using the 3-D mapping by the calibration module.
  • a flow chart of an embodiment of an algorithm performed by the calibration module 426 is shown in FIG. 6 .
  • the calibration module receives the image data obtained from the scanning module, including time data for associated with each scan.
  • the calibration module receives UAV position information received from the fixed device.
  • the UAV position information indicates the position of the UAV relative to the fixed device, also including time data.
  • the calibration module cross-references the image data and the position data by matching time data, and thereby, in step 608 determines both an accurate scale and orientation of the images of the structure in the reference frame of the fixed device.
  • the calibration module determines an estimate of the volume of the structure.
  • the method and system of the present invention provide a number of advantages.
  • the methods of the present invention enable large structures such as storage tanks to be calibrated in approximately 30 minutes, which is considerably shorter than conventional calibration times.
  • the calibration methods of the present invention do not require point set registration which allows for greater ease in mapping the entire surface of a large structure in a short period of time.
  • the present invention provides an efficient and highly accurate technique for creating a three-dimensional reconstruction of a large structure from a single absolute frame of reference that surpasses the performance of existing structural mapping techniques.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Electromagnetism (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • Automation & Control Theory (AREA)
  • Health & Medical Sciences (AREA)
  • Evolutionary Computation (AREA)
  • Game Theory and Decision Science (AREA)
  • Medical Informatics (AREA)
  • Artificial Intelligence (AREA)
  • Business, Economics & Management (AREA)
  • Fluid Mechanics (AREA)
  • Control Of Position, Course, Altitude, Or Attitude Of Moving Bodies (AREA)
  • Length Measuring Devices By Optical Means (AREA)
  • Optical Radar Systems And Details Thereof (AREA)

Abstract

A method of calibrating a structure is provided. The method includes securing a first end of a tether to a device at a fixed location on an external surface of the structure, attaching an unmanned aerial vehicle to the second end of the tether, moving the unmanned aerial vehicle in a trajectory around the structure while tethered to the fixed device, scanning the external surface of the structure over a course of the trajectory using the unmanned aerial vehicle to obtain a mapping of the external surface of the structure, determining a position of the unmanned aerial vehicle with respect to the fixed device; and calibrating the structure based on i) the determined position of the unmanned aerial vehicle with respect to the fixed device, and ii) the mapping of external surface of the structure.

Description

FIELD OF THE INVENTION
The present invention relates to structural calibration and mapping methods, and in particular relates to a technique that uses an unmanned aerial vehicle (UAV) to map large objects in three-dimensions.
BACKGROUND OF THE INVENTION
In the oil and gas industry the volume of storage tanks is calibrated periodically in order to be able to accurately determine the amount of fuel stored in the tank. Typically, a level gauge is used to determine the amount of fuel in a tank. However, storage tanks located in environments subject to high average temperatures tend to expand non-uniformly. The expansions are often difficult to measure accurately and can have an appreciable effect on the total volume. When the volume of a tank changes, the accuracy of standard gauge readings, which are based on a static volume of the tank, diminish. Inaccurate fuel level readings can lead to systematic undervaluation of fuel assets and consequent loss of revenue during custodial transfers.
Increasing the frequency of tank calibration could improve accuracy and yield financial benefits. However, commonly-used calibration techniques typically take an unduly long time to perform, e.g., 3 to 8 hours per tank. These lengthy techniques cause considerable disruption to the operation of the tanks, which can be scheduled for product transfers almost continuously.
What is therefore needed is a calibration technique applicable to large structures such as storage tanks that is both highly accurate and has minimal impact to their operation.
SUMMARY OF THE INVENTION
Embodiments of the present invention provide a method of calibrating a structure. The method includes securing a first end of a tether to a device at a fixed location on an external surface of the structure, attaching an unmanned aerial vehicle to the second end of the tether, moving the unmanned aerial vehicle in a trajectory around the structure while tethered to the fixed device, scanning the external surface of the structure over a course of the trajectory using the unmanned aerial vehicle to obtain a mapping of the external surface of the structure, determining a position of the unmanned aerial vehicle with respect to the fixed device; and calibrating the structure based on i) the determined position of the unmanned aerial vehicle with respect to the fixed device, and ii) the mapping of external surface of the structure.
In some implementations of the method, the trajectory of the unmanned aerial vehicle around the structure is a circular path. The fixed device can be situated on a top surface of the structure.
In some embodiments, the fixed device includes a laser scanner and the unmanned aerial vehicle includes a mounted reflector. The laser scanner and mounted reflector together establish a position of the unmanned aerial vehicle relative to the fixed device.
In other embodiments, the fixed device includes a tether spool having an angular encoder, and a strain sensor. In such embodiments, the strain on the tether using the strain sensor is measured using the strain sensor and the distance between the unmanned aerial vehicle and the fixed device is determined based on the measured strain. In addition, the angular position of the unmanned aerial vehicle and the fixed device is determined using the angular encoder.
In some implementations, the unmanned aerial vehicle can include a laser scanning device that creates a point cloud of the external surface of the structure during scanning. The unmanned aerial vehicle can also include three thrusters.
Embodiments of the present invention also provide a system for calibrating a structure. The system includes a device located at a fixed location on an external surface of the structure, a tether having first and second ends and secured at the first end to the fixed device, and an unmanned aerial vehicle attached to the second end of the tether, the unmanned aerial vehicle including a scanning device. The unmanned aerial vehicle is operative to move in a trajectory around the structure while tethered to the fixed device and to scan the external surface of the structure over a course of the trajectory to obtain a mapping of the external surface of the structure. The structure is calibrated based on i) the known position of the unmanned aerial vehicle with respect to the fixed device, and ii) the mapping of external surface of the structure.
The unmanned aerial vehicle can include a plurality of thrusters, and is operative to control the thrusters to maintain tension in the tether so as to move in a circular trajectory and in some implementations, the fixed device is situated on a top surface of the structure.
In some embodiments, the fixed device includes a laser scanner and the unmanned aerial vehicle includes a mounted reflector, and the laser scanner and mounted reflector together establish a position of the unmanned aerial vehicle relative to the fixed device.
In other embodiments, the fixed device includes a tether spool, an angular encoder, and a strain sensor. In some implementations, the strain sensor is operative to measure a strain on the tether, and a distance between the unmanned aerial vehicle and the fixed device is determined based on the measured strain. The angular encoder can be used to determine the angular position of the unmanned vehicle relative to the fixed device.
The scanning device of the unmanned aerial vehicle can be implemented as a LiDAR device, and the unmanned aerial vehicle can be implemented as a tricopter with three thrusters.
Any combinations of the various embodiments and implementations disclosed herein can be used.
These and other aspects, features, and advantages can be appreciated from the following description of certain embodiments of the invention and the accompanying drawing figures and claims.
BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1 is a perspective view of an exemplary embodiment of a system for calibrating a structure according to the present invention.
FIG. 2 is a schematic perspective view of an embodiment of a fixed device according to an embodiment of the present invention.
FIG. 3 is a perspective view of a tricopter that can be used as a UAV according to embodiments of the present invention.
FIG. 4 is a schematic block diagram of a control system for calibrating a structure according to an embodiment of the present invention.
FIG. 5 is a flow chart of an exemplary embodiment of a method for propelling the UAV in a circular trajectory around the structure according to the present invention.
FIG. 6 is a flow chart of an exemplary embodiment of a data calibration method according to the present invention.
It is noted that the drawings are illustrative and not necessarily to scale.
DETAILED DESCRIPTION CERTAIN OF EMBODIMENTS OF THE INVENTION
By way of overview, the present disclosure describes a method and system for calibrating a structure, such as a fuel storage tank. An unmanned aerial vehicle (sometimes referred to as a drone, but hereinafter referred to as a “UAV”) is tethered to a fixed point on the structure and travels around the structure in a trajectory while tethered. The UAV scans the external surface of the structure while traversing the trajectory. The tethering of the structure to the fixed point creates a coordinate reference frame since the precise location of the UAV with respect to the fixed point at any time can be accurately measured. Accordingly, the scanned data of the surface of the structure can be automatically converted into spatial coordinates within the reference frame. Since the UAV is tethered during its trajectory, maintaining unassisted stability is unnecessary, and unconventional UAV designs can be employed, including three-thruster (tricopter) designs.
FIG. 1 is a perspective view of an exemplary embodiment of a system for calibrating a structure according to the present invention. In FIG. 1, a calibration system 100 is shown being used to calibrate structure 105, which in this example is a fuel storage tank. The structure has a top surface 110 on which a fixed device 120 is secured using a tripod or other stable platform, or by a fixture. The fixed device 120 can also be secured to other parts of structure 105. The fixed device 120 is coupled to a first end of a tether 125. A second end of tether 125 is coupled to a UAV 130. The tether 125 is preferably light-weight, flexible, non-extendable and strong enough to withstand force sufficient to maintain the tether in a state of tension at full stretch. As shown in FIG. 1, the tether 125 is extended and under tension. Either the fixed device 120 or UAV 130 (or both) can include a strain sensor adapted to measure a tension on the tether as it is suspended between the fixed device and the UAV. The tether can be coupled to a retractable spool mounted to either the fixed device 120 or the UAV 130 or it can be unwound manually.
In general, it is preferable for the tether to have a length greater than a radius of the structure to be calibrated so that the UAV clears the edge of the structure sufficiently to be able to scan the entire external surface of the structure. The UAV 130 is capable of traveling airborne in a trajectory around the structure 105 while attached to the tether 125. UAV 130 also includes a scanning device (not shown in FIG. 1) for capturing precise information regarding the dimensions of the structure. In some implementations, the scanning device is a laser (LiDAR) scanner and the data captured using the scanner comprises a high-resolution point cloud or mapping, of the structure 105. The cloud resolution (point-to-point) distance can be approximately one centimeter (˜1 cm) and the precision of each point can be approximately one millimeter (˜1 mm). The laser scanner can be a 2-dimensional LiDAR system that is adapted to map sets of point along a cross-section between a scanning plane and the structure. The 2-dimensional cross-section can be combined into a 3-dimensional mapping.
In some embodiments, the UAV 130 includes an externally mounted reflector 132. In such embodiments, the fixed device 120 can be implemented as a laser tracker, such as, for example, a Leica Absolute Tracker AT402, AT930 or AT960, with six degrees of freedom. The tracker 120 is configured to determine the precise position of the reflector relative to the tracker and the reflector 132 using interferometry. The UAV 130 can be coupled to the tether 125 so as to force the reflector 132 to face toward the tracker 120 while the UAV is deployed for scanning.
In another embodiment, motion of the tether itself, in combination with strain sensor and angular encoders, can be used to track the location of the drone instead of a laser tracker. One example embodiment of a fixed device based on this principle is shown schematically in FIG. 2. As depicted, a tether 200 is coupled to and extends from a fixed device 205 (referred to as a “station”) that can be coupled to a spool (not shown in FIG. 2). The station 205 is mounted to a first bearing 210 that provides freedom of rotation for the station in the azimuthal direction (horizontal plane). A second bearing 215 provides freedom of rotation in a perpendicular plane that changes the orientation of the station in terms of altitude. The rotatable bearings allow the tether to rotate along with the UAV as it travels in its trajectory in both the horizontal plane and vertically. In some implementations, station 205 includes a distance encoder and/or strain sensor (not shown) that dynamically measures the length of the tether as it is unwound from a spool. For a tether with a relatively short length, a strain sensor can measure a tension on the tether indicating that the tether has been extended to or close to its full length. For a tether with a large spool, a distance encoder can be used to directly measure the length unwound, and can activate a clamp mechanism to stop a further unwinding of the spool to maintain the tether at a fixed length. Alternatively, the distance between the fixed device and UAV can be preset by fixing the length of the tether and extending the tether to its maximum length.
In addition, the station can include a first encoder 222 coupled to the first bearing 210 that measures the azimuthal angle of the tether as the station rotates with respect to the first bearing. Station 205 can also include a second encoder 224 coupled to the second bearing 215 that measures the altitude angle of the tether as the station rotates with respect to the second bearing. In alternative implementations, sensors on the UAV 130 can be used in conjunction with or as a substitute for the encoders. For example, the rather than an altitude angle encoder, the station can include an altitude sensor that indicates the altitude of the station itself on the structure, and the UAV can include a similar altitude sensor. The difference between the altitudes measured at the station and the UAV indicates the angle of the tether between the station and the UAV. In still other implementations, the orientation of the UAV with respect to the station can be measured using inertial measurement units (IMUS) on board of the UAV.
The UAV 130 can be implemented using unconventional, simplified rotor configurations since it is tethered. In order to maintain stability over a trajectory, the UAV only needs to have the ability to thrust away from the fixed device to maintain the tension on the tether, and to control the angular direction (clockwise versus counterclockwise) of the trajectory. These conditions can be accomplished using three thrusters (rotors). FIG. 3 shows a perspective view of a tricopter 300 that can be used for the UAV in embodiments of the present invention. Tricopter 300 includes a first end thruster 302 which provides thrust in a vertical direction, a central thruster 304 which provides thrust in a horizontal direction, and a second end thruster 306 which also provides thrust in a vertical direction. The central thruster 304 is used to impel in a horizontal direction the tricopter away from the structure to maintain tension on the tether. The first and second end thrusters 302, 306 can be used to adjust the altitude of the tricopter and also to adjust the angular orientation of the tricopter 300 with respect to the horizontal plane. (referred to as the “attitude”). For example, the attitude can be adjusted by providing downward thrust using first end thruster 302 simultaneously with an upward thrust using second end thruster 306.
In operation, prior to a scanning run, the system 100 is initialized so that the fixed device is enabled to track the UAV. During an initialization stage, the UAV is first coupled to the tether 125 at an initial location. When the fixed device 120 is implemented using a laser tracker, the reflector 132 of the UAV is located, and the orientation of the UAV 130 with respect to the fixed device 120 is determined. The initial location can be a pre-assigned “perch” location which is stored in the memory of the tracker. In this case, the location of the UAV is spotted by the tracker automatically. However, using a pre-assigned location is not necessary; rather as long as the reflector of the UAV is in a line of sight of the tracker, the orientation of the UAV can be determined. When the fixed device is implemented using angular encoders, the encoders determine the orientation. The UAV can then be tracked start from the point that it departs from the perch location. In other implementations, an operator can position the UAV relative to the laser tracker, manually or by remote control, so that a beam from the tracker intercepts the reflector of the UAV. After interception, the operator can issue a command for the UAV to lift off. Once airborne, the UAV can be configured (i.e., programmed) to move away from the fixed device up to a point that either a threshold tension is detected via a strain sensor positioned on either the fixed device or the UAV, or the limit of the tether is reached and the UAV cannot move further away from the fixed device.
Additionally, since there is a tendency for the tether to sag as it is suspended between the fixed device and the UAV, and the degree of sag affects the distance between the fixed device and UAV, it is advantageous to compensate for this factor. According to the physics of suspended lines, which is well known, the amount of sag is a function of the tension on the tether. The tension can be measured with the strain sensor, which, as noted, can be included on either the fixed device or UAV (or both). Once measured, the amount of the sag, and the amount that the sag reduces the distance between the fixed device and the UAV, is determined. If the sag is determined to be beyond a threshold magnitude, the UAV thrusters are activated to increase the tension on the tether.
Once the initialization has taken place, the UAV travels in a trajectory around the structure and scans the structure, preferably using LiDAR scanning (although other scanning and imaging modes can be used). In many instances, the UAV travels in a circular trajectory with the fixed device as the center, keeping the tension on the tether constant or nearly constant, and thus maintaining a consistent distance from the fixed center. However, depending on the exact location of the fixed device with respect to the structure, the trajectory can vary from circularity, and the tension on the tether can be reduced as necessary for periods of time. To maintain the trajectory, the thrusters of the UAV are activated to continuously thrust away from the fixed device to sustain the tension on the tether and also to thrust upwardly to keep the UAV airborne.
FIG. 4 is a schematic block diagram of a control system for calibrating a structure according to an embodiment of the present invention. As shown, UAV 130 includes a control unit 405, a group of sensors 410, a scanner 412, a transceiver 414, thrusters 416 and on-board memory 418. The control unit 405, which can be implemented using a microprocessor, programmable logic units and/or application specific circuitry, is configured with program modules. The program modules include a trajectory control module 420, a scanner control module 422, a communications module 424 and a calibration module. The sensors 410 can include inertial measurement units, pressure/strain sensors, optical sensors, altitude sensors, remote control sensors, etc. Data receives by sensor 410 is transmitted to the control unit 405 for further processing.
In operation the control unit 405 employs the trajectory control module 422 to control thrusters 416 either automatically or in response to commands received from an operator (e.g., by remote control). The trajectory control module 420 includes logic for controlling the thrusters to maintain the UAV in a particular trajectory while tethered. The scanner control module 422 is used to control the operation of scanner 412, which obtains a series of cross-sectional mappings of the external surface of the structure as the UAV traverses a trajectory around the structure. In this manner, the trajectory control module 420 and the scanner control module 422 operate in tandem to ensure that entire surface of the structure is scanned. The communications module 424 operates transceiver 414 which is adapted to communicate wirelessly via Wi-fi, Bluetooth or other suitable communication mode. The calibration module 426 generates a complete 3-D mapping of the external surface of the structure based using the scanned data and data received form the fixed device.
According to one embodiment, the trajectory control module 420 executes an algorithm for propelling the UAV in a circular trajectory around the structure. A flow chart of an exemplary embodiment of the algorithm is shown in FIG. 5. In an initial step 502, the thruster module receives data regarding the current position (starting position) of the UAV with respect to the fixed device. In the next step 504, the UAV determines whether there is sufficient tension on the tether based on input received from strain sensors. If there is not sufficient tension, in step 506, the thruster module drives a thruster (the central thruster for implementations using a tricopter) to move the UAV away from the fixed device to increase the tension on the tether to a sufficient level. If it is determined that there is sufficient tension or after step 506, in step 508, the thruster module determines based on operator commands or preset instructions, the direction in which to traverse a circular trajectory, clockwise versus counterclockwise. Simultaneously, scanning module is activated to begin scanning the structure (independently of the thruster module). After determining a direction, in step 510 the thruster module activates the thrusters so as to travel at an approximately steady circumferential speed that is preset or selected by the operator. For tricopter implementations, the side thrusters are activated to accelerate the UAV to start the circumferential motion and then the amount of force can be reduced to achieve a steady speed. While the UAV is traveling along the trajectory it continuously receives data regarding its position from its own sensors and from the fixed device. Based on this data, the thruster module determines, in step 512, whether the UAV has reached the initial position and traversed the entire circumference of the structure. The thruster module then determines, based on operator commands or preset instructions, whether to deactivate the thrusters (step 514) and park the UAV on a surface or to restart the trajectory (cycling back to step 510) and perform another scan run. Multiple scan runs can be performed to increase the amount of scan data for reducing possible errors and increasing overall scan accuracy.
The UAV 130 is coupled to the fixed device 120 by tether 125. Fixed device 120 in turn includes a control unit 430, a group of sensors 432, a transceiver 434, and memory 436. The control unit 430 can be implemented using a processor, programming logic units or specialized circuits is configured with program modules, including a tracking module 442, an orientation/distance determining module 444 and a communications module 446. Sensors 432 can include, but are not limited to a LiDAR tracker, angular encoders and a strain sensor (depending on the implementation of the fixed device employed).
In operation, for embodiments of the fixed device that employ a laser tracker, the control unit 430 uses the tracking module 442 to locate and thereafter track a reflector on the UAV. The orientation/distance determining module utilizes data received by the laser tracker or from the sensors 432 to determine the instantaneous orientation and distance of the UAV with respect to the fixed device. This information is continuously (ever small time increments) stored in memory 436 and is transmitted to the UAV via communication module 446 and transceiver 434.
The method of the present invention provides a highly accurate calibration of the structure by cross-referencing the scanned data obtained by the UAV and the orientation and distance data obtained by the fixed device (or a combination of the UAV and the fixed device). During the trajectory of the UAV around a structure, a low-latency communication link 450 can be established between the UAV 130 and fixed device 120. The communication link 450 enables the fixed device 120 to continuously transmit information to the UAV 130 while the UAV scans the structure. The calibration module 426 of the UAV uses the information received from the fixed device to cross-reference the scanned data into a reference frame in real time.
In alternative embodiments, the communication modules 424, 444 of the UAV and fixed device perform a time-synchronization over the communication link 450. The fixed device then accumulates data over the trajectory of the UAV and the data is time stamped. The accumulated data is then sent to the UAV. The UAV cross-references the accumulated information with scanned data according to the time stamp, and thereby correlates a particular scan with an associated orientation of the UAV in the fixed reference frame. The ability to cross-reference this information dispenses with the need to stitch scanned point sets together in a registration process. Once the orientation information and scanned data are fully cross-referenced, an accurate 3-D mapping of the structure can be rendered, and the volume of the structure can be calibrated using the 3-D mapping by the calibration module.
A flow chart of an embodiment of an algorithm performed by the calibration module 426 is shown in FIG. 6. In a first step 602, the calibration module receives the image data obtained from the scanning module, including time data for associated with each scan. In a second step 604, the calibration module receives UAV position information received from the fixed device. The UAV position information indicates the position of the UAV relative to the fixed device, also including time data. In step 606, the calibration module cross-references the image data and the position data by matching time data, and thereby, in step 608 determines both an accurate scale and orientation of the images of the structure in the reference frame of the fixed device. In step 610, using the scaled and referenced image data, the calibration module determines an estimate of the volume of the structure.
It is noted that while the systems and methods disclosed herein are particularly suitable for calibrating storage tanks used in the oil and gas industry, it is to be understood that the systems and methods can be usefully applied to calibrating other structures such as, for example, large machinery, landmarks, and large format artwork.
The method and system of the present invention provide a number of advantages. The methods of the present invention enable large structures such as storage tanks to be calibrated in approximately 30 minutes, which is considerably shorter than conventional calibration times. In addition, the calibration methods of the present invention do not require point set registration which allows for greater ease in mapping the entire surface of a large structure in a short period of time. More generally, the present invention provides an efficient and highly accurate technique for creating a three-dimensional reconstruction of a large structure from a single absolute frame of reference that surpasses the performance of existing structural mapping techniques.
It is to be understood that any structural and functional details disclosed herein are not to be interpreted as limiting the systems and methods, but rather are provided as a representative embodiment and/or arrangement for teaching one skilled in the art one or more ways to implement the methods.
It is to be further understood that like numerals in the drawings represent like elements through the several figures, and that not all components and/or steps described and illustrated with reference to the figures are required for all embodiments or arrangements
The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used herein, the singular forms “a”, “an” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms “comprises” and/or “comprising”, when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
Terms of orientation are used herein merely for purposes of convention and referencing, and are not to be construed as limiting. However, it is recognized these terms could be used with reference to a viewer. Accordingly, no limitations are implied or to be inferred.
Also, the phraseology and terminology used herein is for the purpose of description and should not be regarded as limiting. The use of “including,” “comprising,” or “having,” “containing,” “involving,” and variations thereof herein, is meant to encompass the items listed thereafter and equivalents thereof as well as additional items.
While the invention has been described with reference to exemplary embodiments, it will be understood by those skilled in the art that various changes may be made and equivalents may be substituted for elements thereof without departing from the scope of the invention. In addition, many modifications will be appreciated by those skilled in the art to adapt a particular instrument, situation or material to the teachings of the invention without departing from the essential scope thereof. Therefore, it is intended that the invention not be limited to the particular embodiment disclosed as the best mode contemplated for carrying out this invention, but that the invention will include all embodiments falling within the scope of the appended claims.

Claims (15)

What is claimed is:
1. A method of calibrating a structure comprising:
securing a first end of a tether to a device fixed to a location on an external surface of the structure;
attaching an unmanned aerial vehicle to the second end of the tether;
moving the unmanned aerial vehicle in a trajectory around the structure while the tether is extended and in tension;
scanning the external surface of the structure over a course of the trajectory using the unmanned aerial vehicle to obtain a mapping of the external surface of the structure;
determining a position of the unmanned aerial vehicle with respect to the fixed device;
calibrating, using a calibration module of a control unit, the structure based on i) the determined position of the unmanned aerial vehicle with respect to the fixed device, and ii) the mapping of external surface of the structure, and
wherein the fixed device includes a laser scanner and the unmanned aerial vehicle includes a mounted reflector, and the laser scanner and mounted reflector together establish a position of the unmanned aerial vehicle relative to the fixed device.
2. The method of claim 1, wherein the fixed device is situated on a top surface of the structure.
3. The method of claim 1, wherein the unmanned aerial vehicle includes a laser scanning device that creates a point cloud of the external surface of the structure during scanning.
4. The method of claim 1, wherein unmanned aerial vehicle includes three thrusters.
5. A method of calibrating a structure comprising:
securing a first end of a tether to a device fixed to a location on an external surface of the structure, the fixed device including a tether spool having an angular encoder, and a strain sensor;
attaching an unmanned aerial vehicle to the second end of the tether;
moving the unmanned aerial vehicle in a trajectory around the structure while the tether is extended and in tension;
scanning the external surface of the structure over a course of the trajectory using the unmanned aerial vehicle to obtain a mapping of the external surface of the structure;
determining a position of the unmanned aerial vehicle with respect to the fixed device;
calibrating using a calibration module of a control unit, the structure based on i) the determined position of the unmanned aerial vehicle with respect to the fixed device, and ii) the mapping of external surface of the structure, and
measuring a strain on the tether using the strain sensor; and
determining whether the unmanned aerial vehicle has moved away sufficiently from the fixed device based on the measured strain; and
determining an angular position of the unmanned aerial vehicle and the fixed device using the angular encoder.
6. A system for calibrating a structure comprising:
a device fixed to a location on an external surface of the structure;
a tether having first and second ends and secured at the first end to the fixed device; and
an unmanned aerial vehicle attached to the second end of the tether, the unmanned aerial vehicle including a scanning device,
wherein the unmanned aerial vehicle includes a plurality of thrusters and is operative to move in a trajectory around the structure while tethered to the fixed device, to scan the external surface of the structure over a course of the trajectory to obtain a mapping of the external surface of the structure, and to control the thrusters to reduce the tension in the tether to move in a non-circular trajectory,
and wherein the structure is calibrated based on i) a known position of the unmanned aerial vehicle with respect to the fixed device, and ii) the mapping of external surface of the structure.
7. The system of claim 6, wherein the fixed device includes a laser scanner and the unmanned aerial vehicle includes a mounted reflector, and the laser scanner and mounted reflector together establish a position of the unmanned aerial vehicle relative to the fixed device.
8. The system of claim 6, wherein the fixed device is situated on a top surface of the structure.
9. The system of claim 6, wherein the scanning device of the unmanned aerial vehicle is a LiDAR device.
10. The system of claim 6, wherein unmanned aerial vehicle includes three thrusters.
11. A system for calibrating a structure, comprising:
a device fixed to a location on an external surface of the structure;
a tether having first and second ends and secured at the first end to the fixed device; and
an unmanned aerial vehicle attached to the second end of the tether, the unmanned aerial vehicle including a scanning device,
wherein the unmanned aerial vehicle is operative to move in a trajectory around the structure while tethered to the fixed device, and to scan the external surface of the structure over a course of the trajectory to obtain a mapping of the external surface of the structure,
and wherein the structure is calibrated based on i) a known position of the unmanned aerial vehicle with respect to the fixed device, and ii) the mapping of external surface of the structure, and
wherein the fixed device includes a tether spool, an angular encoder, and a strain sensor.
12. The system of claim 11, wherein the strain sensor is operative to measure a strain on the tether to determine whether the tether is in full tension based on the measured strain.
13. The system of claim 11, wherein the spool is motorized and is operative to automatically wind and unwind the tether to control the distance between the unmanned aerial vehicle and the fixed device.
14. The system of claim 13, wherein the spool is operative to control the distance between the unmanned aerial vehicle and the fixed device so as to cause the unmanned aerial vehicle to move in a non-circular trajectory.
15. The system of claim 11, wherein the angular encoder provides an angular position of the unmanned vehicle relative to the fixed device.
US15/685,789 2017-08-24 2017-08-24 High accuracy remote coordinate machine Active US10338592B2 (en)

Priority Applications (9)

Application Number Priority Date Filing Date Title
US15/685,789 US10338592B2 (en) 2017-08-24 2017-08-24 High accuracy remote coordinate machine
SG11202001201VA SG11202001201VA (en) 2017-08-24 2018-08-24 High accuracy remote coordinate machine
EP18773019.7A EP3673295B1 (en) 2017-08-24 2018-08-24 High accuracy remote coordinate machine
JP2020511269A JP2020531835A (en) 2017-08-24 2018-08-24 High-precision remote coordinate device
CN201880054866.7A CN111095025A (en) 2017-08-24 2018-08-24 High-precision remote coordinate machine
KR1020207006060A KR20200041894A (en) 2017-08-24 2018-08-24 High accuracy remote coordinate machine
PCT/US2018/047962 WO2019040875A1 (en) 2017-08-24 2018-08-24 High accuracy remote coordinate machine
US16/387,734 US10481604B2 (en) 2017-08-24 2019-04-18 High accuracy remote coordinate machine
SA520411292A SA520411292B1 (en) 2017-08-24 2020-02-10 High Accuracy Remote Coordinate Machine

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US15/685,789 US10338592B2 (en) 2017-08-24 2017-08-24 High accuracy remote coordinate machine

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US16/387,734 Continuation US10481604B2 (en) 2017-08-24 2019-04-18 High accuracy remote coordinate machine

Publications (2)

Publication Number Publication Date
US20190064818A1 US20190064818A1 (en) 2019-02-28
US10338592B2 true US10338592B2 (en) 2019-07-02

Family

ID=63638372

Family Applications (2)

Application Number Title Priority Date Filing Date
US15/685,789 Active US10338592B2 (en) 2017-08-24 2017-08-24 High accuracy remote coordinate machine
US16/387,734 Active US10481604B2 (en) 2017-08-24 2019-04-18 High accuracy remote coordinate machine

Family Applications After (1)

Application Number Title Priority Date Filing Date
US16/387,734 Active US10481604B2 (en) 2017-08-24 2019-04-18 High accuracy remote coordinate machine

Country Status (8)

Country Link
US (2) US10338592B2 (en)
EP (1) EP3673295B1 (en)
JP (1) JP2020531835A (en)
KR (1) KR20200041894A (en)
CN (1) CN111095025A (en)
SA (1) SA520411292B1 (en)
SG (1) SG11202001201VA (en)
WO (1) WO2019040875A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10908263B1 (en) * 2019-12-16 2021-02-02 Saudi Arabian Oil Company System and method for aligning a laser scanning device for measurement of a volume of a container

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11097796B2 (en) * 2018-11-29 2021-08-24 Saudi Arabian Oil Company Articulated magnet-bearing legs for UAV landing on curved surfaces
CN112304315B (en) * 2020-10-20 2024-07-02 青岛中科防务科技有限公司 Positioning method for aerial striking unmanned aerial vehicle
CN113071675B (en) * 2021-04-28 2023-04-07 黄河水利职业技术学院 Unmanned aerial vehicle mapping device's control platform

Citations (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7184072B1 (en) * 2000-06-15 2007-02-27 Power View Company, L.L.C. Airborne inventory and inspection system and apparatus
US20070247615A1 (en) 2006-04-21 2007-10-25 Faro Technologies, Inc. Camera based six degree-of-freedom target measuring and target tracking device with rotatable mirror
US7805851B2 (en) 2008-04-07 2010-10-05 Leica Geosystems Ag Articulated arm coordinate measuring machine
US20110043515A1 (en) 2007-04-09 2011-02-24 Sam Stathis System and method capable of navigating and/or mapping any multi-dimensional space
US20110202224A1 (en) 2010-02-16 2011-08-18 Thompson Jeffrey S Tethered robot positioning
US20120212627A1 (en) * 2009-10-28 2012-08-23 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Method and device for generating a calibrated projection
US20130233964A1 (en) 2012-03-07 2013-09-12 Aurora Flight Sciences Corporation Tethered aerial system for data gathering
US20140032021A1 (en) 2011-04-14 2014-01-30 Hexagon Technology Center Gmbh System and method for controlling an unmanned air vehicle
US20140046589A1 (en) 2011-04-14 2014-02-13 Hexagon Technology Center Gmbh Measuring system for determining 3d coordinates of an object surface
US20140163775A1 (en) 2011-04-14 2014-06-12 Hexagon Technology Center Gmbh Geodetic marking system for marking target points
US20140267627A1 (en) * 2013-03-15 2014-09-18 State Farm Mutual Automobile Insurance Company Methods and systems for capturing the condition of a physical structure
US20160292872A1 (en) * 2015-03-03 2016-10-06 PreNav, Inc. Scanning environments and tracking unmanned aerial vehicles
US20160320775A1 (en) 2015-04-14 2016-11-03 ETAK Systems, LLC Cell tower installation and maintenance systems and methods using robotic devices
US20160340006A1 (en) 2015-05-19 2016-11-24 Rujing Tang Unmanned aerial vehicle system and methods for use
US9619265B2 (en) 2013-06-25 2017-04-11 Empire Technology Development Llc Reconfiguration with virtual machine switching
EP3165945A1 (en) 2015-11-03 2017-05-10 Leica Geosystems AG Surface measuring device for determining the 3d coordinates of a surface
US20170142596A1 (en) * 2015-04-14 2017-05-18 ETAK Systems, LLC 3d modeling of cell sites and cell towers with unmanned aerial vehicles
WO2017093453A1 (en) 2015-12-03 2017-06-08 Trinamix Gmbh Detector for optically detecting at least one object
US20180081037A1 (en) * 2016-09-20 2018-03-22 Innoviz Technologies Ltd. Methods Circuits Assemblies Devices Systems and Functionally Associated Machine Executable Code for Controllably Steering an Optical Beam

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS4835920Y1 (en) * 1969-03-06 1973-10-27
JP2694245B2 (en) * 1988-06-20 1997-12-24 ヤマハ発動機株式会社 Remote control method and remote control device for helicopter
JP2694246B2 (en) * 1988-06-20 1997-12-24 ヤマハ発動機株式会社 Remote-controlled helicopter
JP2887597B2 (en) * 1988-10-25 1999-04-26 ヤマハ発動機株式会社 Flying object control method and control device
JP2009100893A (en) * 2007-10-23 2009-05-14 Ift:Kk Cotton swab, its manufacturing method, and cotton swab article
JP6326237B2 (en) * 2014-01-31 2018-05-16 株式会社トプコン Measuring system
US9771925B2 (en) * 2014-10-13 2017-09-26 X Development Llc Tether termination systems and methods
US20160349746A1 (en) * 2015-05-29 2016-12-01 Faro Technologies, Inc. Unmanned aerial vehicle having a projector and being tracked by a laser tracker
KR101602609B1 (en) * 2015-10-30 2016-03-15 김은종 Structural testing equipment of small components for aircraft
CN105352438A (en) * 2015-11-18 2016-02-24 长沙开元仪器股份有限公司 Coal inventory system and data collection apparatus
CA3012049A1 (en) * 2016-01-20 2017-07-27 Ez3D, Llc System and method for structural inspection and construction estimation using an unmanned aerial vehicle

Patent Citations (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7184072B1 (en) * 2000-06-15 2007-02-27 Power View Company, L.L.C. Airborne inventory and inspection system and apparatus
US20070247615A1 (en) 2006-04-21 2007-10-25 Faro Technologies, Inc. Camera based six degree-of-freedom target measuring and target tracking device with rotatable mirror
US20110043515A1 (en) 2007-04-09 2011-02-24 Sam Stathis System and method capable of navigating and/or mapping any multi-dimensional space
US7805851B2 (en) 2008-04-07 2010-10-05 Leica Geosystems Ag Articulated arm coordinate measuring machine
US20120212627A1 (en) * 2009-10-28 2012-08-23 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Method and device for generating a calibrated projection
US20110202224A1 (en) 2010-02-16 2011-08-18 Thompson Jeffrey S Tethered robot positioning
US20140046589A1 (en) 2011-04-14 2014-02-13 Hexagon Technology Center Gmbh Measuring system for determining 3d coordinates of an object surface
US20140032021A1 (en) 2011-04-14 2014-01-30 Hexagon Technology Center Gmbh System and method for controlling an unmanned air vehicle
US20140163775A1 (en) 2011-04-14 2014-06-12 Hexagon Technology Center Gmbh Geodetic marking system for marking target points
US20130233964A1 (en) 2012-03-07 2013-09-12 Aurora Flight Sciences Corporation Tethered aerial system for data gathering
US20140267627A1 (en) * 2013-03-15 2014-09-18 State Farm Mutual Automobile Insurance Company Methods and systems for capturing the condition of a physical structure
US9619265B2 (en) 2013-06-25 2017-04-11 Empire Technology Development Llc Reconfiguration with virtual machine switching
US20160292872A1 (en) * 2015-03-03 2016-10-06 PreNav, Inc. Scanning environments and tracking unmanned aerial vehicles
US20160320775A1 (en) 2015-04-14 2016-11-03 ETAK Systems, LLC Cell tower installation and maintenance systems and methods using robotic devices
US20170142596A1 (en) * 2015-04-14 2017-05-18 ETAK Systems, LLC 3d modeling of cell sites and cell towers with unmanned aerial vehicles
US20160340006A1 (en) 2015-05-19 2016-11-24 Rujing Tang Unmanned aerial vehicle system and methods for use
EP3165945A1 (en) 2015-11-03 2017-05-10 Leica Geosystems AG Surface measuring device for determining the 3d coordinates of a surface
WO2017093453A1 (en) 2015-12-03 2017-06-08 Trinamix Gmbh Detector for optically detecting at least one object
US20180081037A1 (en) * 2016-09-20 2018-03-22 Innoviz Technologies Ltd. Methods Circuits Assemblies Devices Systems and Functionally Associated Machine Executable Code for Controllably Steering an Optical Beam

Non-Patent Citations (9)

* Cited by examiner, † Cited by third party
Title
3DR, "How to Get Started with Drones for Surveying and Mapping" Url: https://3dr.com/enterprise/industries/survey-mapping/, accessed on Sep. 19, 2017.
Hexagon Manufacturing Intelligence, "Leica T-Scan 5" Url:www.hexagonmi.com/en-GB/products/3d-laser-scanners/leica-tscan5 accessed on Sep. 19, 2017.
Karpowicz, J., "Figuring Out Aerial Surveying with a Drone Instead of Arguing About Photogrammetry vs LiDAR," retrieved from www.expouav.com/news/latest/events/commercial-uav-expo-2016/ . Aug. 23, 2016.
Martinez, J.L. et al., "Progress in Mini-Helicopter Tracking with a 3D Laser Range-Finder," University of Malaga, Dept of System Engineering and Automation Industrial Engineering School, p. 1-6. 2005.
Merrett Survey Ltd Website, Home Page Url: http://www.merrettsurvey.com/lidar.htm accessed on Sep. 19, 2017.
Mondragon, I. et al., "3D pose estimation based on planar object tracking for UAVs control," Computer Vision Group, Universidad Politecnica de Madrid. 2007.
Rosnell, T. et al., "Point Cloud Generation from Aerial Image Data Acquired by a Quadrocopter Type Micro Unmanned Aerial Vehicle and a Digital Still Camera," Sensors, vol. 12, p. 453-480. 2012.
Sadikin, H. et al., "UAV System W ith Terrestrial Geo-referencing for Small Area Mapping ," FIG Congress 2014, Engaging the Challenges-Enhancing the Relevance, Kulal Lumpur, Malaysia 16-21, p. 1-13, Jun. 2014.
Sadikin, H. et al., "UAV System W ith Terrestrial Geo-referencing for Small Area Mapping ," FIG Congress 2014, Engaging the Challenges—Enhancing the Relevance, Kulal Lumpur, Malaysia 16-21, p. 1-13, Jun. 2014.

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10908263B1 (en) * 2019-12-16 2021-02-02 Saudi Arabian Oil Company System and method for aligning a laser scanning device for measurement of a volume of a container
US11385333B2 (en) 2019-12-16 2022-07-12 Saudi Arabian Oil Company System and method for aligning a laser scanning device for measurement of a volume of a container

Also Published As

Publication number Publication date
US10481604B2 (en) 2019-11-19
CN111095025A (en) 2020-05-01
WO2019040875A1 (en) 2019-02-28
US20190243366A1 (en) 2019-08-08
KR20200041894A (en) 2020-04-22
SG11202001201VA (en) 2020-03-30
EP3673295B1 (en) 2021-10-20
EP3673295A1 (en) 2020-07-01
JP2020531835A (en) 2020-11-05
SA520411292B1 (en) 2022-10-26
US20190064818A1 (en) 2019-02-28

Similar Documents

Publication Publication Date Title
US10481604B2 (en) High accuracy remote coordinate machine
US9609282B2 (en) Camera for photogrammetry and aerial photographic device
KR102385820B1 (en) Navigation chart composition method, obstacle avoidance method and device, terminal, unmanned aerial vehicle
US9482524B2 (en) Measuring system for determining 3D coordinates of an object surface
US9409656B2 (en) Aerial photographing system
US20180305012A1 (en) Method for controlling small-size unmanned aerial vehicle
JP7123774B2 (en) flight control system
US20190086206A1 (en) Survey system
CN103492967A (en) System and method for controlling an unmanned air vehicle
US20180147998A1 (en) Aerial Photogrammetric Device And Aerial Photogrammetric Method
WO2019000345A1 (en) Control method, unmanned aerial vehicle, and computer readable storage medium
CN208536841U (en) The measuring device of UAV Attitude and flying height based on cross laser
CN111837086A (en) Method and apparatus for detecting radar wave offset
WO2016151575A1 (en) Device system and method for determining the relative orientation between two different locations
JP2020531835A5 (en)
WO2021166845A1 (en) Information processing device, information processing method, and program
JP6631900B1 (en) Flying object
CN110892353A (en) Control method, control device and control terminal of unmanned aerial vehicle
JP2023070120A (en) Autonomous flight control method, autonomous flight control apparatus and autonomous flight control system
JP2023105698A (en) Chimney interior inspection method and chimney interior inspection system used therefor
JP2023048409A (en) Survey system

Legal Events

Date Code Title Description
AS Assignment

Owner name: SAUDI ARABIAN OIL COMPANY, SAUDI ARABIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:CARRASCO ZANINI, PABLO;ABDELLATIF, FADL;SIGNING DATES FROM 20170906 TO 20180130;REEL/FRAME:044802/0597

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS

STPP Information on status: patent application and granting procedure in general

Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT VERIFIED

STCF Information on status: patent grant

Free format text: PATENTED CASE

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 4