US20100268409A1 - System and method for inspection of structures and objects by swarm of remote unmanned vehicles - Google Patents

System and method for inspection of structures and objects by swarm of remote unmanned vehicles Download PDF

Info

Publication number
US20100268409A1
US20100268409A1 US12/124,565 US12456508A US2010268409A1 US 20100268409 A1 US20100268409 A1 US 20100268409A1 US 12456508 A US12456508 A US 12456508A US 2010268409 A1 US2010268409 A1 US 2010268409A1
Authority
US
United States
Prior art keywords
unmanned mobile
unmanned
vehicles
vehicle
mobile vehicles
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
US12/124,565
Other versions
US8060270B2 (en
Inventor
John Lyle Vian
Ali Reza Mansouri
Emad William Saad
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Boeing Co
Original Assignee
Boeing Co
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Boeing Co filed Critical Boeing Co
Priority to US12/124,565 priority Critical patent/US8060270B2/en
Assigned to THE BOEING COMPANY reassignment THE BOEING COMPANY ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: MANSOURI, ALI REZA, SAAD, EMAD WILLIAM, VIAN, JOHN LYLE
Priority to PCT/US2009/043364 priority patent/WO2009142933A2/en
Priority to CN200980118675.3A priority patent/CN102160005B/en
Priority to JP2011510568A priority patent/JP5697592B2/en
Priority to EP09751162.0A priority patent/EP2288970B1/en
Publication of US20100268409A1 publication Critical patent/US20100268409A1/en
Application granted granted Critical
Publication of US8060270B2 publication Critical patent/US8060270B2/en
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/10Simultaneous control of position or course in three dimensions
    • G05D1/101Simultaneous control of position or course in three dimensions specially adapted for aircraft
    • G05D1/104Simultaneous control of position or course in three dimensions specially adapted for aircraft involving a plurality of aircrafts, e.g. formation flying

Definitions

  • the present disclosure relates to systems and methods for performing inspection activities, and more particularly to a system and method for enabling remote inspection of structures or objects by a plurality of unmanned mobile vehicles.
  • In-person human based inspections of structures and various types of objects can be time consuming, expensive, difficult and often dangerous for an individual to perform.
  • Examples of structures that pose significant challenges in inspecting are bridges, dams, levees, power plants, power lines or electrical power grids, water treatment facilities; oil refineries, chemical processing plants, high rise buildings, infrastructure associated with electric trains and monorail support structures, just to name a few.
  • static cameras i.e., fixedly mounted cameras
  • Static cameras have a limited field-of-view. Therefore, inspecting a large area, such a power line stretching hundreds of meters or more, is difficult or impossible without using a large number of such cameras.
  • a camera once a camera is mounted in place, it may not be easily accessible for repair or maintenance. The mounting of the camera may require it to be exposed to the elements, which can decrease the reliability and/or cost of operation of the camera.
  • a static camera mounted near a top of a bridge, to obtain periodic pictures of a structural portion of the bridge, may also be difficult and/or costly to access by an individual if a repair or maintenance becomes necessary.
  • the act of requiring an individual to access a camera mounted high atop a bridge, dam, etc., could also entail significant risk to human safety for the worker or workers charged with such a task.
  • an infrastructure may require inspection where because of environmental, chemical or biological elements the inspection would place a human worker at significant risk to his or her health.
  • a situation might be found inside a manufacturing facility, where a periodic regular inspection of a portion of the facility or machines operating within it, in areas where harmful chemicals may be present, needs to be made.
  • Inspection of structural portions of an offshore oil drilling platform would be another example where environmental factors could make the inspection of various parts of the platform by humans fraught with hazard.
  • Still other structures for example large antennas or telescopes located on mountains, can present situations where inspection by a human presents significant risk to the individual's safety.
  • human piloted helicopters have been used to inspect various infrastructures.
  • human piloted helicopters can be expensive to operate in terms of asset cost (helicopter, fuel and maintenance) and operational cost (pilot salary).
  • inspection is limited by the available number of pilots and helicopters and can be hazardous in some instances, such as during rain or dust storms.
  • the use of human piloted helicopters is sometimes simply not possible during inclement weather.
  • Remote controlled (RC) helicopters are lower in cost but require a trained RC pilot, and thus inspecting a large area with multiple helicopters requires a large number of expensive trained RC pilots.
  • precision inspection and the time duration during which an inspection operation may be performed can be limited because of the available number of RC pilots and RC helicopters.
  • the present disclosure relates to a method for inspecting structures.
  • the method may comprise:
  • each of the unmanned mobile vehicles equipping each of the unmanned mobile vehicles with a control and guidance system for enabling each unmanned mobile vehicle to operate autonomously;
  • each unmanned mobile vehicle with an operating program that defines a path of travel for each unmanned mobile vehicle, relative to a structure to be inspected;
  • a method for inspecting structures may comprise:
  • each of the unmanned mobile vehicles equipping each of the unmanned mobile vehicles with a control and guidance system for enabling each unmanned mobile vehicle to operate autonomously;
  • each unmanned vehicle with an operating program that defines a unique path of travel for each unmanned mobile vehicle, relative to a structure to be inspected;
  • each unmanned mobile vehicle to wirelessly transmit the images to a remote centralized inspection station.
  • a system for inspecting structures.
  • the system may comprise:
  • each of the unmanned mobile vehicles having a control and guidance system for enabling each unmanned mobile vehicle to operate autonomously;
  • each of the unmanned mobile vehicles including an operating program that defines a path of travel for each unmanned mobile vehicle, relative to a structure to be inspected, so that in operation the unmanned mobile vehicles cooperatively form a swarm that moves about the structure;
  • At least one of the unmanned mobile vehicles including an imaging device to obtain an image of a portion of the structure as it executes its respective operating program.
  • FIG. 1 is a block diagram of one implementation of a system in accordance with the present disclosure
  • FIG. 2 is a block diagram of the onboard system that may be carried on each of the UAVs shown in FIG. 1 ;
  • FIG. 3 is a flowchart of major operations that may be performed by the system of FIG. 1 .
  • the system 10 includes a plurality of unmanned mobile vehicles 12 that may be used move around a structure 14 requiring periodic inspection.
  • the unmanned mobile vehicles are illustrated as unmanned aerial vehicles, and more specifically as unmanned rotorcraft (hereinafter after simply referred to as “UAVs” 12 ), although it will be appreciated that other forms of unmanned vehicles such as unmanned land vehicles 12 ′ and unmanned marine vessels 12 ′′ (both surface and underwater) could readily be adapted for use with the present system 10 .
  • UAVs unmanned rotorcraft
  • the system 10 is equally well adapted for use in inspecting a wide range of other structures including, but not limited to, power lines, power generating facilities, power grids, dams, levees, stadiums, large buildings, large antennas and telescopes, water treatment facilities, oil refineries, chemical processing plants, high rise buildings, and infrastructure associated with electric trains and monorail support structures.
  • the system 10 is also particularly well suited for use inside large buildings such as manufacturing facilities and warehouses. Virtually any structure that would be difficult, costly, or too hazardous to inspect by a human piloted vehicle or a human remote controlled (RC) vehicle may potentially be inspected using the system 10 .
  • RC remote controlled
  • each UAV 12 a - 12 e includes an onboard system 16 that is able to navigate the UAV 12 in accordance with a preprogrammed flight plan and to enable inspection data for the structure being inspected to be obtained.
  • the inspection data may comprise pictures, video or audio data, as will be explained in more detail in the following paragraphs.
  • each UAV 12 a - 12 e enables each UAV to follow a unique flight path around a portion of the structure.
  • UAV 12 a may include a flight plan that enables it to fly out to the bridge 14 and circle repeatedly around column 14 a , while the flight program of UAV 12 b causes UAV 12 b to fly down and up along path 14 b .
  • UAV 12 c may be assigned to fly back and forth under the bridge 14 closely along its horizontal steel structures.
  • each UAV 12 can traverse a specific designated portion of the bridge 14 .
  • the UAVs 12 a - 12 e form what can be viewed as a “swarm’ of vehicles that enable an extremely thorough inspection of various areas of a structure may otherwise be difficult, costly and/or hazardous for a human piloted vehicle to inspect.
  • the larger the plurality of UAVs 12 employed in any given inspection task the shorter the time it will take to complete the inspection task.
  • unmanned rotorcraft such as unmanned helicopters
  • unmanned helicopters may be especially advantageous for use as the UAVs 12 . This is because of the ability of an unmanned helicopter to hover and move at very slow speeds.
  • the vertical take-off and landing capability of remote controlled unmanned helicopters also may be highly advantageous in many applications, especially when operating inside of structures or facilities such as manufacturing plants, warehouses, etc., or when inspecting complex facilities such as oil refineries or chemical processing that may have many tall structures clustered (e.g., smoke stacks) clustered closely together.
  • the UAVs 12 could also be deployed from another airborne vehicle, such as a large transport helicopter or fixed wing aircraft. Such a deployment would obviously save fuel for the UAVs 12 , which would enable them to stay airborne for a longer period of time than would otherwise be possible if the UAVs 12 had to take off from a ground based location under their own power.
  • another airborne vehicle such as a large transport helicopter or fixed wing aircraft.
  • the system 10 further may include a remote centralized inspection station 18 for receiving wireless communications from each of the UAVs 12 a - 12 e .
  • the centralized inspection station 18 may include an antenna 20 , a computer control system 22 , a display 24 for viewing by an inspection technician or operator, such as an CRT, LCD or plasma screen, and a wireless transceiver.
  • the wireless transceiver 26 is in communication with the antenna 20 for enabling wireless communication between the computer control system 22 and the onboard system 16 of each UAV 12 a - 12 e .
  • the computer control system 22 may be used to send commands or to monitor various operating performance parameters of each UAV 12 a - 12 e such as fuel remaining, battery power remaining, etc.
  • the computer control system 22 may also be used generate commands to alter the flight plan of any one of the UAVs 12 , as will be described in the following paragraphs.
  • the centralized inspection station 18 is illustrated as being a terrestrial based station, it could just as readily be formed as a mobile inspection station 18 ′ on an aircraft or human piloted rotorcraft. A land based, mobile inspection station 18 ′′ could also be formed. Accordingly, the centralized inspection station 18 does not necessarily need to be a fixed structure or facility. It is also possible for each of the UAVs 12 a - 12 e to communicate with the centralized inspection station 18 via a transponded satellite 29 and/or using a wide area network or a local area network.
  • the onboard system 16 that may be carried by each UAV 12 a - 12 e is shown. It will be appreciated, however, that the onboard system 16 carried by each UAV 12 a - 12 e could include different components, depending on the specific portion of the structure that a given UAV 12 is programmed to inspect. Thus, it is not necessary that the onboard system 16 of each UAV be identical.
  • the onboard system 16 may include a guidance and control hardware and software system 30 that is able to implement one or more different, stored flight plans from a memory 30 A.
  • the onboard system 30 may include a global positioning system (GPS)/inertial navigation system 32 for controlling the orientation of its associated UAV 12 and assisting in carrying out the preprogrammed flight plan stored in the memory 30 a .
  • GPS global positioning system
  • a wireless transceiver 34 and an on board antenna 36 enable bidirectional, wireless electromagnetic wave communications with the centralized inspection station 18 .
  • the onboard system 16 may also include a plurality of different sensors for providing useful inspection information to the centralized inspection station 18 .
  • a still camera (color and/or black and white) 38 may be used to obtain still images of portions of the structure 14 being inspected.
  • a video camera 40 may be used to obtain color and/or black and white video of the bridge 14 .
  • An infrared camera 42 could also be used to obtain infrared still images or infrared video.
  • An audio microphone 44 could be used to pick up audio signals emanating from the structure being inspected. This feature could be particularly valuable for inspecting large machines inside a manufacturing facility, where the presence of specific types of sounds might be indicative of an imminent machine or component failure. For example, the detection of grinding sounds coming from an elevated portion of a large machine might indicate that a bearing failure is imminent, but such sounds might otherwise not be perceptible by individuals working on a floor of the manufacturing facility where other noise sources are present to mask the grinding noise.
  • the onboard system 16 may also include a vehicle health monitoring subsystem 44 , a battery 48 for powering the electronic devices carried on the UAV 12 , as well as a fuel level sensor 50 .
  • the vehicle health monitoring subsystem 44 may be used to monitor the battery level of the battery 48 and the fuel reservoir level sensor 50 and generate suitable signals that may be periodically transmitted to the centralized inspection station 18 . If an issue develops with any one of the UAVs 12 , for example a sudden drop in battery power to an unacceptable level, this enables the centralized inspection station 18 to be wirelessly informed of this condition.
  • the centralized inspection station 18 may then wirelessly upload modified flight programs to the other UAVs 12 that would enable the remaining UAVs 12 to finish the needed inspection task.
  • the onboard system 16 may optionally also include an image/audio memory 52 for maintaining electronic copies of the images, video or audio captured during an inspection process.
  • an interface 54 may be included on each UAV 12 that enables an external device, for example a lap top computer, to be coupled to the interface 54 and used to download the stored images and/or audio obtained during the previously executed inspection process.
  • the interface 54 could be formed by a conventional RS-232, RS-422, or any other suitable interface.
  • the interface 54 could also be implemented using Blue-tooth technology so that a wireless connection can be made with the image/audio memory 52 .
  • the interface 54 could also be used for enabling a wired connection to the UAV 12 to upload programs or other information without the need for a wireless transceiver to be used on the UAV 12 .
  • the use of the image/audio memory 52 may be advantageous in environments where periodic high levels of electromagnetic interference are to be expected, which could affect the ability of the acquired images and audio data to be reliably transmitted via electromagnetic wave signals to the centralized inspection station 18 .
  • the onboard system 16 may also include additional sensors such as an ultrasound sensor, an X-Ray sensor 58 , a magnetic sensor 60 or a Hall Effect sensor 62 . It will be appreciated that the specific type of inspection operation(s) that the system 10 is expected to be used to perform will likely determine the specific form of sensors that will need to be included in the onboard system.
  • the onboard system 16 may also optionally include a dynamic flight reallocation plan system 64 .
  • the dynamic flight plan reallocation system 64 may be used to dynamically change the flight plan used for each UAV 12 a - 12 e in the event one of the UAVs becomes inoperable for any reason, is required to land because of a fuel, battery or detected sensor problem, or for any other reason.
  • dynamically change it is meant that the system 64 is able to automatically and virtually instantaneously determine which one of a plurality of alternative flight plans should be implemented by the remaining UAVs 12 still in operation so that the overall inspection task can be completed by the remaining UAVs.
  • the dynamic flight plan reallocation system 64 of each UAV 12 b - 12 e determines which one of a plurality of alternative pre-stored flight plans it should implement for the remaining UAVs 12 b - 12 d to be able carry out the remainder of the entire inspection task, and the guidance and control hardware 30 will then implement the alternative flight plan in real time.
  • real time it is meant essentially instantaneously.
  • the alternative flight plans may be stored in a memory that is included within the dynamic flight plan reallocation system 64 , or the alternative flight plans may be stored in the memory 30 A.
  • a flowchart 100 is illustrated that sets forth the operations of one exemplary implementation of the system 10 .
  • a flight plan program is loaded into the flight plan memory 30 a of each UAV 12 a - 12 e .
  • the flight plan is specific to a designated portion (or portions) of the bridge 14 that the UAV 12 is assigned to inspect.
  • the flight plan is such that it causes its associated UAV 12 to travel on a flight path that takes it sufficiently close to a predetermined portion of the bridge 14 to obtain the needed inspection data, which in this example would be either still images or video.
  • the UAVs 12 a - 12 e are deployed to form an inspection “swarm”. When the UAVs 12 reach the bridge 14 they each begin acquiring inspection data for the portion of the bridge that they have been designated to inspect. The inspection data may consist of still images, video, audio, or even a combination thereof.
  • the UAVs 12 a - 12 e transmit their acquired inspection data to the centralized inspection station 18 via their transceivers 34 and antennas 36 .
  • the UAVs 12 a - 12 e could each store their acquired inspection data in their image/audio memory 52 for future downloading once they land, as indicated at operation 108 a.
  • the acquired inspection data has been transmitted wirelessly from the UAVs 12 a - 12 e , then it may be displayed and/or analyzed using the display 24 and/or computer control system 22 of the centralized inspection station 22 .
  • a check is then made to make sure that all of the UAVs 12 a - 12 e are operating properly. If the vehicle health monitoring subsystem 46 on any of the UAVs 12 a - 12 e has reported a problem with a component or a problem that requires the UAV to land immediately, this condition will be reported to the centralized inspection station 18 via a wireless signal from the affected UAV 12 .
  • the computer control system 22 of the centralized inspection station 18 may be used to transmit a new, alternative flight plan to each of the UAVs 12 that remain in service. This enables the remaining UAVs 12 to carry out the remainder of the inspection task.
  • the new, alternative flight plan could instead be provided to merely one or more of the remaining UAVs, rather than to all of the remaining UAVs. Operations 106 - 112 may then be repeated.
  • the dynamic flight plan reallocation system 64 on each UAV 12 may be used to dynamically determine and implement a new flight that enables the remaining UAVs to complete the inspection task.
  • the predetermined probability of detection value is checked at operation 118 to determine if the inspection task is essentially now complete. If so, the UAVs 12 a - 12 e will land, as indicated at operation 120 . If not, then operations 106 - 112 are repeated until the predetermined probability of detection value has been reached.
  • the system 10 and methodology described herein may be used to inspect a wide range of structures and objects, both stationary and moving.
  • An example of a moving object that may require inspection is a fixed wing aircraft in flight.
  • the UAVs 12 could be used to fly above, behind, below, or possibly even ahead of the aircraft while it is in flight.
  • the UAVs 12 may be used to obtain images or audio data of the fixed wing aircraft, such as the position of flaps or ailerons, that may be used for real time analysis (i.e., essentially instantaneous analysis).
  • the collected inspection data may be saved by each of the UAVs 12 and downloaded at a later time for analysis.
  • a particular advantage of the system 10 is that the data acquired by each UAV 12 may be either downlinked in real time to the centralized inspection station 18 , thus permitting real time analysis of the data, or saved for analysis at a later time.
  • this feature may be advantageous in certain applications where bandwidth of the downlink is limited, and any potential flaws in the structure being inspected would not be of such nature as to produce conditions that threaten human safety or property.
  • Yet other applications will exist where it would be important to be immediately apprised of a major structural flaw, such as on a bridge heavily traveled by cars and trucks. In such an instance, if a major structural flaw was discovered on a bridge, the real time downlinking capability of the system 10 would enable the acquired inspection images to be processed in real time.
  • system 10 and methodology will also have particular utility with regard to the inspection of structures that are submerged, or partially submerged, underwater.
  • inspection data such as pictures or video of submerged portions of bridges, oil drilling platforms, and even submerged portions of ships can be obtained for analysis.
  • the various embodiments of the system 10 all provide the advantage that a human operator is not required to pilot each inspection vehicle, nor is a human operator required to remotely control each inspection vehicle. In many applications this is expected to provide a significant cost savings.
  • the system 10 is also beneficial from the standpoint that human pilots do not need to be used in inspection applications that would pose a significant risk to human safety or health.

Landscapes

  • Engineering & Computer Science (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Automation & Control Theory (AREA)
  • Control Of Position, Course, Altitude, Or Attitude Of Moving Bodies (AREA)
  • Bridges Or Land Bridges (AREA)
  • Investigating Materials By The Use Of Optical Means Adapted For Particular Applications (AREA)

Abstract

A method for inspecting structures that includes using a plurality of independent unmanned mobile vehicles. The unmanned mobile vehicles are equipped with a control and guidance system for enabling each unmanned mobile vehicle to operate autonomously. Each unmanned mobile vehicle may be programmed with an operating program that defines a path of travel for it, relative to a structure to be inspected. The unmanned mobile vehicles are deployed so that they cooperatively form a swarm that travels about the structure. At least one of said unmanned mobile vehicles is used to obtain inspection data of a portion of the structure as it executes its respective operating program.

Description

    CROSS-REFERENCE TO RELATED APPLICATIONS
  • This application takes priority from U.S. Patent Application Nos. 61/032,624 filed Feb. 29, 2008, and 61/032,609 filed Feb. 29, 2008. The disclosures of the above applications are incorporated herein by reference.
  • This application is related in general subject matter to U.S. patent application Ser. No. ______, entitled “TRAFFIC AND SECURITY MONITORING SYSTEM AND METHOD” (Boeing Reference 08-0125A) filed concurrently herewith and assigned to the Boeing Company. This disclosure of this application is incorporated herein by reference.
  • FIELD
  • The present disclosure relates to systems and methods for performing inspection activities, and more particularly to a system and method for enabling remote inspection of structures or objects by a plurality of unmanned mobile vehicles.
  • BACKGROUND
  • The statements in this section merely provide background information related to the present disclosure and may not constitute prior art.
  • In-person human based inspections of structures and various types of objects can be time consuming, expensive, difficult and often dangerous for an individual to perform. Examples of structures that pose significant challenges in inspecting are bridges, dams, levees, power plants, power lines or electrical power grids, water treatment facilities; oil refineries, chemical processing plants, high rise buildings, infrastructure associated with electric trains and monorail support structures, just to name a few.
  • The use of static cameras (i.e., fixedly mounted cameras) to provide periodic pictures of a structure or object requiring periodic visual inspection has met with limited effectiveness. Static cameras have a limited field-of-view. Therefore, inspecting a large area, such a power line stretching hundreds of meters or more, is difficult or impossible without using a large number of such cameras. Furthermore, once a camera is mounted in place, it may not be easily accessible for repair or maintenance. The mounting of the camera may require it to be exposed to the elements, which can decrease the reliability and/or cost of operation of the camera.
  • A static camera mounted near a top of a bridge, to obtain periodic pictures of a structural portion of the bridge, may also be difficult and/or costly to access by an individual if a repair or maintenance becomes necessary. The act of requiring an individual to access a camera mounted high atop a bridge, dam, etc., could also entail significant risk to human safety for the worker or workers charged with such a task.
  • Occasionally an infrastructure may require inspection where because of environmental, chemical or biological elements the inspection would place a human worker at significant risk to his or her health. Such a situation might be found inside a manufacturing facility, where a periodic regular inspection of a portion of the facility or machines operating within it, in areas where harmful chemicals may be present, needs to be made. Inspection of structural portions of an offshore oil drilling platform would be another example where environmental factors could make the inspection of various parts of the platform by humans fraught with hazard. Still other structures, for example large antennas or telescopes located on mountains, can present situations where inspection by a human presents significant risk to the individual's safety.
  • In some inspection applications human piloted helicopters have been used to inspect various infrastructures. However, human piloted helicopters can be expensive to operate in terms of asset cost (helicopter, fuel and maintenance) and operational cost (pilot salary). In addition, inspection is limited by the available number of pilots and helicopters and can be hazardous in some instances, such as during rain or dust storms. Also, the use of human piloted helicopters is sometimes simply not possible during inclement weather.
  • Remote controlled (RC) helicopters are lower in cost but require a trained RC pilot, and thus inspecting a large area with multiple helicopters requires a large number of expensive trained RC pilots. In addition, precision inspection and the time duration during which an inspection operation may be performed can be limited because of the available number of RC pilots and RC helicopters.
  • SUMMARY
  • In one aspect the present disclosure relates to a method for inspecting structures. The method may comprise:
  • using a plurality of independent unmanned mobile vehicles;
  • equipping each of the unmanned mobile vehicles with a control and guidance system for enabling each unmanned mobile vehicle to operate autonomously;
  • programming each unmanned mobile vehicle with an operating program that defines a path of travel for each unmanned mobile vehicle, relative to a structure to be inspected;
  • deploying each unmanned mobile vehicle so that the unmanned mobile vehicles cooperatively form a swarm that travels about the structure; and
  • using at least one of the unmanned mobile vehicles to obtain inspection data of a portion of the structure as it executes its respective operating program.
  • In another aspect a method for inspecting structures is disclosed. The method may comprise:
  • using a plurality of independent unmanned mobile vehicles;
  • equipping each of the unmanned mobile vehicles with a control and guidance system for enabling each unmanned mobile vehicle to operate autonomously;
  • programming each unmanned vehicle with an operating program that defines a unique path of travel for each unmanned mobile vehicle, relative to a structure to be inspected;
  • deploying each unmanned mobile vehicle so that the unmanned mobile vehicles cooperatively form a swarm that travels about the structure;
  • using the unmanned mobile vehicles to obtain images of portions of the structure as each unmanned mobile vehicle executes its respective operating program; and
  • causing each unmanned mobile vehicle to wirelessly transmit the images to a remote centralized inspection station.
  • In another aspect of the present disclosure a system is disclosed for inspecting structures. The system may comprise:
  • a plurality of independent unmanned mobile vehicles;
  • each of the unmanned mobile vehicles having a control and guidance system for enabling each unmanned mobile vehicle to operate autonomously;
  • each of the unmanned mobile vehicles including an operating program that defines a path of travel for each unmanned mobile vehicle, relative to a structure to be inspected, so that in operation the unmanned mobile vehicles cooperatively form a swarm that moves about the structure; and
  • at least one of the unmanned mobile vehicles including an imaging device to obtain an image of a portion of the structure as it executes its respective operating program.
  • Further areas of applicability will become apparent from the description provided herein. It should be understood that the description and specific examples are intended for purposes of illustration only and are not intended to limit the scope of the present disclosure.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • The drawings described herein are for illustration purposes only and are not intended to limit the scope of the present disclosure in any way.
  • FIG. 1 is a block diagram of one implementation of a system in accordance with the present disclosure;
  • FIG. 2 is a block diagram of the onboard system that may be carried on each of the UAVs shown in FIG. 1; and
  • FIG. 3 is a flowchart of major operations that may be performed by the system of FIG. 1.
  • DETAILED DESCRIPTION
  • The following description is merely exemplary in nature and is not intended to limit the present disclosure, application, or uses.
  • Referring to FIG. 1, there is shown a system 10 for inspecting structures. The system 10 includes a plurality of unmanned mobile vehicles 12 that may be used move around a structure 14 requiring periodic inspection. In this example the unmanned mobile vehicles are illustrated as unmanned aerial vehicles, and more specifically as unmanned rotorcraft (hereinafter after simply referred to as “UAVs” 12), although it will be appreciated that other forms of unmanned vehicles such as unmanned land vehicles 12′ and unmanned marine vessels 12″ (both surface and underwater) could readily be adapted for use with the present system 10. Also, while the structure 14 is illustrated as a bridge, the system 10 is equally well adapted for use in inspecting a wide range of other structures including, but not limited to, power lines, power generating facilities, power grids, dams, levees, stadiums, large buildings, large antennas and telescopes, water treatment facilities, oil refineries, chemical processing plants, high rise buildings, and infrastructure associated with electric trains and monorail support structures. The system 10 is also particularly well suited for use inside large buildings such as manufacturing facilities and warehouses. Virtually any structure that would be difficult, costly, or too hazardous to inspect by a human piloted vehicle or a human remote controlled (RC) vehicle may potentially be inspected using the system 10.
  • In FIG. 1, only five UAVs 12 a-12 e are shown to avoid cluttering the drawing. However, it will be appreciated that a greater or lesser plurality of UAVs 12 could be implemented to meet the needs of a specific inspection task. For large structures such as the bridge 14 shown in FIG. 1, potentially 10-20 UAVs 12 may be desired. Smaller structures may only require 2-5 UAVs to perform the needed inspection task. Each UAV 12 a-12 e includes an onboard system 16 that is able to navigate the UAV 12 in accordance with a preprogrammed flight plan and to enable inspection data for the structure being inspected to be obtained. The inspection data may comprise pictures, video or audio data, as will be explained in more detail in the following paragraphs.
  • The preprogrammed flight plan carried by each UAV 12 a-12 e enables each UAV to follow a unique flight path around a portion of the structure. For Example, UAV 12 a may include a flight plan that enables it to fly out to the bridge 14 and circle repeatedly around column 14 a, while the flight program of UAV 12 b causes UAV 12 b to fly down and up along path 14 b. UAV 12 c may be assigned to fly back and forth under the bridge 14 closely along its horizontal steel structures. Thus, it will be appreciated that for each UAV 12 a-12 b, its preprogrammed flight plan (and therefore flight path), is unique and is formed with respect to a designated portion of the structure that it is intended to inspect. In this manner each UAV 12 can traverse a specific designated portion of the bridge 14. Once airborne, the UAVs 12 a-12 e form what can be viewed as a “swarm’ of vehicles that enable an extremely thorough inspection of various areas of a structure may otherwise be difficult, costly and/or hazardous for a human piloted vehicle to inspect. Generally, the larger the plurality of UAVs 12 employed in any given inspection task, the shorter the time it will take to complete the inspection task.
  • For inspection applications, it is anticipated that unmanned rotorcraft, such as unmanned helicopters, may be especially advantageous for use as the UAVs 12. This is because of the ability of an unmanned helicopter to hover and move at very slow speeds. The vertical take-off and landing capability of remote controlled unmanned helicopters also may be highly advantageous in many applications, especially when operating inside of structures or facilities such as manufacturing plants, warehouses, etc., or when inspecting complex facilities such as oil refineries or chemical processing that may have many tall structures clustered (e.g., smoke stacks) clustered closely together. In these applications, the use of a fixed wing unmanned vehicle would necessitate a clear, lengthy area for take-off and landing, and would be difficult, if not impossible, to maneuver around the various vertical structures or within a building. The ability to hover and/or move only vertically, if needed, enables unmanned remote controlled helicopters fly close to and inspect large vertical structures such as vertical support posts of bridges, antennas, or closely against other vertical surfaces such as dams, where the use of a fixed wing unmanned vehicle may have difficulty inspecting.
  • The UAVs 12 could also be deployed from another airborne vehicle, such as a large transport helicopter or fixed wing aircraft. Such a deployment would obviously save fuel for the UAVs 12, which would enable them to stay airborne for a longer period of time than would otherwise be possible if the UAVs 12 had to take off from a ground based location under their own power.
  • The system 10 further may include a remote centralized inspection station 18 for receiving wireless communications from each of the UAVs 12 a-12 e. The centralized inspection station 18 may include an antenna 20, a computer control system 22, a display 24 for viewing by an inspection technician or operator, such as an CRT, LCD or plasma screen, and a wireless transceiver. The wireless transceiver 26 is in communication with the antenna 20 for enabling wireless communication between the computer control system 22 and the onboard system 16 of each UAV 12 a-12 e. The computer control system 22 may be used to send commands or to monitor various operating performance parameters of each UAV 12 a-12 e such as fuel remaining, battery power remaining, etc. The computer control system 22 may also be used generate commands to alter the flight plan of any one of the UAVs 12, as will be described in the following paragraphs.
  • While the centralized inspection station 18 is illustrated as being a terrestrial based station, it could just as readily be formed as a mobile inspection station 18′ on an aircraft or human piloted rotorcraft. A land based, mobile inspection station 18″ could also be formed. Accordingly, the centralized inspection station 18 does not necessarily need to be a fixed structure or facility. It is also possible for each of the UAVs 12 a-12 e to communicate with the centralized inspection station 18 via a transponded satellite 29 and/or using a wide area network or a local area network.
  • Referring to FIG. 2, the onboard system 16 that may be carried by each UAV 12 a-12 e is shown. It will be appreciated, however, that the onboard system 16 carried by each UAV 12 a-12 e could include different components, depending on the specific portion of the structure that a given UAV 12 is programmed to inspect. Thus, it is not necessary that the onboard system 16 of each UAV be identical.
  • The onboard system 16 may include a guidance and control hardware and software system 30 that is able to implement one or more different, stored flight plans from a memory 30A. The onboard system 30 may include a global positioning system (GPS)/inertial navigation system 32 for controlling the orientation of its associated UAV 12 and assisting in carrying out the preprogrammed flight plan stored in the memory 30 a. A wireless transceiver 34 and an on board antenna 36 enable bidirectional, wireless electromagnetic wave communications with the centralized inspection station 18.
  • The onboard system 16 may also include a plurality of different sensors for providing useful inspection information to the centralized inspection station 18. For example, a still camera (color and/or black and white) 38 may be used to obtain still images of portions of the structure 14 being inspected. A video camera 40 may be used to obtain color and/or black and white video of the bridge 14. An infrared camera 42 could also be used to obtain infrared still images or infrared video. An audio microphone 44 could be used to pick up audio signals emanating from the structure being inspected. This feature could be particularly valuable for inspecting large machines inside a manufacturing facility, where the presence of specific types of sounds might be indicative of an imminent machine or component failure. For example, the detection of grinding sounds coming from an elevated portion of a large machine might indicate that a bearing failure is imminent, but such sounds might otherwise not be perceptible by individuals working on a floor of the manufacturing facility where other noise sources are present to mask the grinding noise.
  • The onboard system 16 may also include a vehicle health monitoring subsystem 44, a battery 48 for powering the electronic devices carried on the UAV 12, as well as a fuel level sensor 50. The vehicle health monitoring subsystem 44 may be used to monitor the battery level of the battery 48 and the fuel reservoir level sensor 50 and generate suitable signals that may be periodically transmitted to the centralized inspection station 18. If an issue develops with any one of the UAVs 12, for example a sudden drop in battery power to an unacceptable level, this enables the centralized inspection station 18 to be wirelessly informed of this condition. The centralized inspection station 18 may then wirelessly upload modified flight programs to the other UAVs 12 that would enable the remaining UAVs 12 to finish the needed inspection task.
  • The onboard system 16 may optionally also include an image/audio memory 52 for maintaining electronic copies of the images, video or audio captured during an inspection process. If this option is implemented, then an interface 54 may be included on each UAV 12 that enables an external device, for example a lap top computer, to be coupled to the interface 54 and used to download the stored images and/or audio obtained during the previously executed inspection process. The interface 54 could be formed by a conventional RS-232, RS-422, or any other suitable interface. The interface 54 could also be implemented using Blue-tooth technology so that a wireless connection can be made with the image/audio memory 52. The interface 54 could also be used for enabling a wired connection to the UAV 12 to upload programs or other information without the need for a wireless transceiver to be used on the UAV 12. The use of the image/audio memory 52 may be advantageous in environments where periodic high levels of electromagnetic interference are to be expected, which could affect the ability of the acquired images and audio data to be reliably transmitted via electromagnetic wave signals to the centralized inspection station 18.
  • The onboard system 16 may also include additional sensors such as an ultrasound sensor, an X-Ray sensor 58, a magnetic sensor 60 or a Hall Effect sensor 62. It will be appreciated that the specific type of inspection operation(s) that the system 10 is expected to be used to perform will likely determine the specific form of sensors that will need to be included in the onboard system.
  • The onboard system 16 may also optionally include a dynamic flight reallocation plan system 64. The dynamic flight plan reallocation system 64 may be used to dynamically change the flight plan used for each UAV 12 a-12 e in the event one of the UAVs becomes inoperable for any reason, is required to land because of a fuel, battery or detected sensor problem, or for any other reason. By “dynamically” change, it is meant that the system 64 is able to automatically and virtually instantaneously determine which one of a plurality of alternative flight plans should be implemented by the remaining UAVs 12 still in operation so that the overall inspection task can be completed by the remaining UAVs. Thus, if UAV 12 a becomes inoperable for any reason, or one of its sensors becomes inoperable, the dynamic flight plan reallocation system 64 of each UAV 12 b-12 e determines which one of a plurality of alternative pre-stored flight plans it should implement for the remaining UAVs 12 b-12 d to be able carry out the remainder of the entire inspection task, and the guidance and control hardware 30 will then implement the alternative flight plan in real time. By “real time” it is meant essentially instantaneously. The alternative flight plans may be stored in a memory that is included within the dynamic flight plan reallocation system 64, or the alternative flight plans may be stored in the memory 30A.
  • Referring to FIG. 3, a flowchart 100 is illustrated that sets forth the operations of one exemplary implementation of the system 10. At operation 102 a flight plan program is loaded into the flight plan memory 30 a of each UAV 12 a-12 e. The flight plan is specific to a designated portion (or portions) of the bridge 14 that the UAV 12 is assigned to inspect. The flight plan is such that it causes its associated UAV 12 to travel on a flight path that takes it sufficiently close to a predetermined portion of the bridge 14 to obtain the needed inspection data, which in this example would be either still images or video.
  • At operation 104 the UAVs 12 a-12 e are deployed to form an inspection “swarm”. When the UAVs 12 reach the bridge 14 they each begin acquiring inspection data for the portion of the bridge that they have been designated to inspect. The inspection data may consist of still images, video, audio, or even a combination thereof. At operation 108 the UAVs 12 a-12 e transmit their acquired inspection data to the centralized inspection station 18 via their transceivers 34 and antennas 36. Alternatively the UAVs 12 a-12 e could each store their acquired inspection data in their image/audio memory 52 for future downloading once they land, as indicated at operation 108 a.
  • At operation 110, if the acquired inspection data has been transmitted wirelessly from the UAVs 12 a-12 e, then it may be displayed and/or analyzed using the display 24 and/or computer control system 22 of the centralized inspection station 22. At operation 112 a check is then made to make sure that all of the UAVs 12 a-12 e are operating properly. If the vehicle health monitoring subsystem 46 on any of the UAVs 12 a-12 e has reported a problem with a component or a problem that requires the UAV to land immediately, this condition will be reported to the centralized inspection station 18 via a wireless signal from the affected UAV 12. At this point, the computer control system 22 of the centralized inspection station 18 may be used to transmit a new, alternative flight plan to each of the UAVs 12 that remain in service. This enables the remaining UAVs 12 to carry out the remainder of the inspection task. The new, alternative flight plan could instead be provided to merely one or more of the remaining UAVs, rather than to all of the remaining UAVs. Operations 106-112 may then be repeated. Alternatively, if implemented, the dynamic flight plan reallocation system 64 on each UAV 12 may be used to dynamically determine and implement a new flight that enables the remaining UAVs to complete the inspection task.
  • At operation 116 a determination is made of the percentage of coverage area of the bridge 14 that has been inspected. For example, it may be accepted that once about 99% of the bridge 14 has been inspected, that a guaranteed probability of detection of a defect or flaw has reached a certain value, and the task may be considered to be completed. The predetermined probability of detection value is checked at operation 118 to determine if the inspection task is essentially now complete. If so, the UAVs 12 a-12 e will land, as indicated at operation 120. If not, then operations 106-112 are repeated until the predetermined probability of detection value has been reached.
  • The system 10 and methodology described herein may be used to inspect a wide range of structures and objects, both stationary and moving. An example of a moving object that may require inspection is a fixed wing aircraft in flight. Using the system 10, the UAVs 12 could be used to fly above, behind, below, or possibly even ahead of the aircraft while it is in flight. The UAVs 12 may be used to obtain images or audio data of the fixed wing aircraft, such as the position of flaps or ailerons, that may be used for real time analysis (i.e., essentially instantaneous analysis). Alternatively, the collected inspection data may be saved by each of the UAVs 12 and downloaded at a later time for analysis.
  • A particular advantage of the system 10 is that the data acquired by each UAV 12 may be either downlinked in real time to the centralized inspection station 18, thus permitting real time analysis of the data, or saved for analysis at a later time. For data such as video, that requires greater bandwidth to downlink, this feature may be advantageous in certain applications where bandwidth of the downlink is limited, and any potential flaws in the structure being inspected would not be of such nature as to produce conditions that threaten human safety or property. Yet other applications will exist where it would be important to be immediately apprised of a major structural flaw, such as on a bridge heavily traveled by cars and trucks. In such an instance, if a major structural flaw was discovered on a bridge, the real time downlinking capability of the system 10 would enable the acquired inspection images to be processed in real time.
  • It will be appreciated that the system 10 and methodology will also have particular utility with regard to the inspection of structures that are submerged, or partially submerged, underwater. By using suitable submersible unmanned vehicles, inspection data such as pictures or video of submerged portions of bridges, oil drilling platforms, and even submerged portions of ships can be obtained for analysis.
  • The various embodiments of the system 10 all provide the advantage that a human operator is not required to pilot each inspection vehicle, nor is a human operator required to remotely control each inspection vehicle. In many applications this is expected to provide a significant cost savings. The system 10 is also beneficial from the standpoint that human pilots do not need to be used in inspection applications that would pose a significant risk to human safety or health.
  • While various embodiments have been described, those skilled in the art will recognize modifications or variations which might be made without departing from the present disclosure. The examples illustrate the various embodiments and are not intended to limit the present disclosure. Therefore, the description and claims should be interpreted liberally with only such limitation as is necessary in view of the pertinent prior art.

Claims (21)

1. A method for inspecting structures, comprising:
using a plurality of independent unmanned mobile vehicles;
equipping each of said unmanned mobile vehicles with a control and guidance system for enabling each said unmanned mobile vehicle to operate autonomously;
programming each said unmanned mobile vehicle with an operating program that defines a path of travel for each said unmanned mobile vehicle, relative to a structure to be inspected;
deploying each said unmanned mobile vehicle so that said unmanned mobile vehicles cooperatively form a swarm that travels about said structure; and
using at least one of said unmanned mobile vehicles to obtain inspection data for a portion of said structure as it executes its respective said operating program.
2. The method of claim 1, wherein using at least one of said unmanned mobile vehicles to obtain inspection data for a portion of said structure comprises using a camera on said at least one unmanned mobile vehicle to image an image of a portion of said structure.
3. The method of claim 1, wherein each of said unmanned mobile vehicles obtains images of portions of said structure while executing its respective said operating program.
4. The method of claim 1, wherein programming each said unmanned mobile vehicle with an operating program that defines a path of travel, relative to a structure to be inspected, comprises programming each said unmanned mobile vehicle with a unique operating program that causes each said unmanned mobile vehicle to follow a unique path, relative to said structure.
5. The method of claim 4, wherein each said unmanned mobile vehicle obtains a plurality of images of said structure while following said unique path.
6. The method of claim 5, wherein each said unmanned mobile vehicle stores said plurality of images of said structure in an onboard memory.
7. The method of claim 6, wherein said stored images comprise a video stream.
8. The method of claim 1, further comprising using said at least one unmanned mobile vehicle to wirelessly communicate said inspection data to a remote centralized inspection station for analysis.
9. The method of claim 1, wherein using a plurality of unmanned mobile vehicles comprises using a plurality of unmanned rotorcraft.
10. The method of claim 1, further comprising using a remote centralized inspection station to communicate with said unmanned mobile vehicles and to wirelessly modify said operating programs associated with remaining ones of said mobile unmanned vehicles in real time when one of said unmanned mobile vehicles becomes inoperable.
11. The method of claim 1, wherein using a plurality of unmanned mobile vehicles comprises using one of:
a plurality of unmanned land vehicles;
a plurality of unmanned aerial vehicles; and
a plurality of unmanned marine vehicles.
12. A method for inspecting structures, comprising:
using a plurality of independent unmanned mobile vehicles;
equipping each of said unmanned mobile vehicles with a control and guidance system for enabling each said unmanned mobile vehicle to operate autonomously;
programming each said unmanned mobile vehicle with an operating program that defines a unique path of travel for each said unmanned mobile vehicle, relative to a structure to be inspected;
deploying each said unmanned mobile vehicle so that said unmanned mobile vehicles cooperatively form a swarm that travels about said structure;
using said unmanned mobile vehicles to obtain images of portions of said structure as each said unmanned mobile vehicle executes its respective said operating program; and
causing each said unmanned mobile vehicle to wirelessly transmit said images to a remote centralized inspection station.
13. The method of claim 12, wherein using a plurality of unmanned mobile vehicles comprises using at least one of:
a plurality of airborne mobile vehicles;
a plurality of mobile land vehicles; and
a plurality of mobile marine vehicles.
14. The method of claim 12, wherein using a plurality of unmanned mobile vehicles comprises using a plurality of unmanned rotorcraft.
15. The method of claim 13, wherein using said unmanned mobile vehicles to obtain images of portions of said structure comprises obtaining at least one of:
color images of portions of said structure;
color video of portions of said structure;
black and white images of portions of said structure;
infrared images of portions of said structure; and
infrared video of portions of said structure.
16. The method of claim 12, further comprising equipping each of said unmanned mobile vehicles with a health monitoring system to monitor at least one operational parameter thereof.
17. The method of claim 12, wherein said images are provided to said remote centralized inspection station in real time.
18. The method of claim 12, further comprising equipping each of said unmanned mobile vehicles with an audio pickup device to pick up audio signals emanating from said structure.
19. A system for inspecting structures, comprising:
a plurality of independent unmanned mobile vehicles;
each of said unmanned mobile vehicles having a control and guidance system for enabling each said unmanned mobile vehicle to operate autonomously;
each of said unmanned mobile vehicles including an operating program that defines a path of travel for each said unmanned vehicle, relative to a structure to be inspected, so that in operation said unmanned mobile vehicles cooperatively form a swarm that moves about said structure; and
at least one of said unmanned mobile vehicles including an imaging device to obtain an image of a portion of said structure as it executes its respective said operating program.
20. The system of claim 19, further comprising a remote centralized inspection station in wireless communication with each of said unmanned mobile vehicles, and
said at least one of said unmanned mobile vehicles including a wireless transceiver for wirelessly transmitting said image to said remote centralized inspection station.
21. The system of claim 19, wherein said remote centralized inspection station includes a wireless transceiver for wirelessly communicating a different operating program to said at least one unmanned vehicle to assign a new path of travel to said at least one unmanned mobile vehicle.
US12/124,565 2008-02-29 2008-05-21 System and method for inspection of structures and objects by swarm of remote unmanned vehicles Active 2029-10-02 US8060270B2 (en)

Priority Applications (5)

Application Number Priority Date Filing Date Title
US12/124,565 US8060270B2 (en) 2008-02-29 2008-05-21 System and method for inspection of structures and objects by swarm of remote unmanned vehicles
PCT/US2009/043364 WO2009142933A2 (en) 2008-05-21 2009-05-08 System and method for inspection of structures and objects by swarm of remote unmanned vehicles
CN200980118675.3A CN102160005B (en) 2008-05-21 2009-05-08 System and method for inspection of structures and objects by swarm of remote unmanned vehicles
JP2011510568A JP5697592B2 (en) 2008-05-21 2009-05-08 System and method for inspection of structures and objects by remote unmanned transport means
EP09751162.0A EP2288970B1 (en) 2008-05-21 2009-05-08 System and method for inspection of structures and objects by swarm of remote unmanned vehicles

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US3262408P 2008-02-29 2008-02-29
US3260908P 2008-02-29 2008-02-29
US12/124,565 US8060270B2 (en) 2008-02-29 2008-05-21 System and method for inspection of structures and objects by swarm of remote unmanned vehicles

Publications (2)

Publication Number Publication Date
US20100268409A1 true US20100268409A1 (en) 2010-10-21
US8060270B2 US8060270B2 (en) 2011-11-15

Family

ID=41217812

Family Applications (1)

Application Number Title Priority Date Filing Date
US12/124,565 Active 2029-10-02 US8060270B2 (en) 2008-02-29 2008-05-21 System and method for inspection of structures and objects by swarm of remote unmanned vehicles

Country Status (5)

Country Link
US (1) US8060270B2 (en)
EP (1) EP2288970B1 (en)
JP (1) JP5697592B2 (en)
CN (1) CN102160005B (en)
WO (1) WO2009142933A2 (en)

Cited By (53)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090079839A1 (en) * 2006-06-19 2009-03-26 Oshkosh Corporation Vehicle diagnostics based on information communicated between vehicles
US20100131133A1 (en) * 2008-11-27 2010-05-27 Coden Co., Ltd. Unmanned boat automatic survey system and unmanned boat automatic survey method
US20120136630A1 (en) * 2011-02-04 2012-05-31 General Electric Company Method and system for wind turbine inspection
US8459619B2 (en) 2010-10-24 2013-06-11 Oshkosh Corporation Gas spring control system and method
CN103576691A (en) * 2012-07-27 2014-02-12 常州天鹅科技有限公司 3G police-service unmanned aerial vehicle management and control system
US8775013B1 (en) * 2013-04-19 2014-07-08 The Boeing Company System and method for acoustic signature health monitoring of unmanned autonomous vehicles (UAVS)
US8788119B2 (en) 2010-12-09 2014-07-22 The Boeing Company Unmanned vehicle and system
US20140249693A1 (en) * 2013-02-15 2014-09-04 Disney Enterprises, Inc. Controlling unmanned aerial vehicles as a flock to synchronize flight in aerial displays
US20140336928A1 (en) * 2013-05-10 2014-11-13 Michael L. Scott System and Method of Automated Civil Infrastructure Metrology for Inspection, Analysis, and Information Modeling
US20150066253A1 (en) * 2013-08-30 2015-03-05 Insitu, Inc. Systems and methods for fuel monitoring
US20150120045A1 (en) * 2013-10-24 2015-04-30 Board Of Trustees Of Michigan State University Gliding robotic fish navigation and propulsion
US20150145954A1 (en) * 2013-11-27 2015-05-28 Honeywell International Inc. Generating a three-dimensional model of an industrial plant using an unmanned aerial vehicle
EP2937756A1 (en) 2014-04-22 2015-10-28 Airbus Operations GmbH Method for inspecting an airborne vehicle
EP2897864A4 (en) * 2012-09-19 2016-03-09 Boeing Co Forestry management system
US20160176542A1 (en) * 2014-12-18 2016-06-23 The Boeing Company Image capture systems and methods and associated mobile apparatuses
US9420203B2 (en) 2006-06-19 2016-08-16 Oshkosh Defense, Llc Vision system for a vehicle
DE102015217773A1 (en) 2015-09-17 2016-09-08 Voith Patent Gmbh Method of inspecting the waterways of a hydroelectric power station
WO2016209504A1 (en) 2015-06-25 2016-12-29 Intel Corporation Personal sensory drones
US9609288B1 (en) * 2015-12-31 2017-03-28 Unmanned Innovation, Inc. Unmanned aerial vehicle rooftop inspection system
US20170162059A1 (en) * 2014-07-14 2017-06-08 John A. Jarrell Unmanned aerial vehicle communication, monitoring, and traffic management
WO2017127711A1 (en) * 2016-01-20 2017-07-27 Ez3D, Llc System and method for structural inspection and construction estimation using an unmanned aerial vehicle
US9740200B2 (en) 2015-12-30 2017-08-22 Unmanned Innovation, Inc. Unmanned aerial vehicle inspection system
US20170313439A1 (en) * 2016-04-29 2017-11-02 Jordan Holt Methods and syststems for obstruction detection during autonomous unmanned aerial vehicle landings
US20180095478A1 (en) * 2015-03-18 2018-04-05 Izak van Cruyningen Flight Planning for Unmanned Aerial Tower Inspection with Long Baseline Positioning
CN108021143A (en) * 2016-10-31 2018-05-11 波音公司 For carrying out the method and system of non-destructive testing using unmanned vehicle
WO2018132224A1 (en) * 2017-01-13 2018-07-19 Microsoft Technology Licensing, Llc Optimal scanning trajectories for 3d scenes
CN109270951A (en) * 2018-08-02 2019-01-25 佛山世寰智能科技有限公司 A kind of unmanned plane environmental monitoring cruise method and system
EP3455803A2 (en) * 2016-05-13 2019-03-20 General Electric Company Robot system for asset health management
US10269138B2 (en) * 2016-08-11 2019-04-23 Changzhou Campus of Hohai University UAV inspection method for power line based on human visual system
US20190144112A1 (en) * 2017-11-16 2019-05-16 The Boeing Company Charging a rechargeable battery of an unmanned aerial vehicle in flight using a high voltage power line
WO2019166185A1 (en) * 2018-03-02 2019-09-06 Robert Bosch Gmbh Device, particularly a hand-held power tool management device and method for monitoring and/or managing a plurality of objects
US10534068B2 (en) * 2018-12-27 2020-01-14 Intel Corporation Localization system, vehicle control system, and methods thereof
US10586365B2 (en) * 2009-11-13 2020-03-10 Samsung Electronics Co., Ltd. Server, user terminal, and service providing method, and control method thereof
US10694529B2 (en) 2016-10-18 2020-06-23 Apium Inc Swarm communication method and device
US20200207472A1 (en) * 2016-09-29 2020-07-02 Mcafee, Llc Apparatus and methods for unmanned aerial vehicle servicing of modular device assembly
US11029352B2 (en) 2016-05-18 2021-06-08 Skydio, Inc. Unmanned aerial vehicle electromagnetic avoidance and utilization system
US11030812B2 (en) * 2019-01-02 2021-06-08 The Boeing Company Augmented reality system using enhanced models
US11048250B2 (en) 2017-06-13 2021-06-29 Prüftechnik Dieter Busch AG Mobile transportation means for transporting data collectors, data collection system and data collection method
US11059378B2 (en) 2017-11-16 2021-07-13 The Boeing Company Charging a rechargeable battery of an unmanned aerial vehicle in flight using a high voltage power line
US11079760B2 (en) * 2018-11-28 2021-08-03 The Boeing Company Methods for maintaining difficult-to-access structures using unmanned aerial vehicles
CN113396361A (en) * 2019-02-07 2021-09-14 富士胶片株式会社 Imaging system, imaging part setting device, imaging device, and imaging method
US20220016772A1 (en) * 2020-07-17 2022-01-20 X Development Llc Robot planning using unmanned aerial vehicles
US20220055749A1 (en) * 2020-08-21 2022-02-24 Eyal Stein Unmanned aerial vehicle with neural network for enhanced mission performance
US11275391B2 (en) 2019-05-13 2022-03-15 The Boeing Company In-service maintenance process using unmanned aerial vehicles
DE102020130236A1 (en) 2020-11-16 2022-05-19 Gestra Ag Unmanned aircraft and related aircraft system
US20220166957A1 (en) * 2020-11-25 2022-05-26 Zhejiang University Method for modal analysis of bridge structures based on surveillance videos
US11430180B2 (en) 2017-06-27 2022-08-30 State Farm Mutual Automobile Insurance Company Systems and methods for controlling a fleet of drones for data collection
US11529777B2 (en) 2020-02-05 2022-12-20 The Boeing Company Hot bond repair of structures using unmanned aerial vehicles
US11555693B2 (en) 2020-05-12 2023-01-17 The Boeing Company Measurement of surface profiles using unmanned aerial vehicles
US11630459B2 (en) 2020-01-29 2023-04-18 The Boeing Company Repair of structures using unmanned aerial vehicles
US11741703B2 (en) * 2018-09-11 2023-08-29 Pointivo, Inc. In data acquisition, processing, and output generation for use in analysis of one or a collection of physical assets of interest
US11745872B2 (en) 2020-06-19 2023-09-05 The Boeing Company Methods for marking surfaces using unmanned aerial vehicles
US11891174B2 (en) 2020-02-05 2024-02-06 The Boeing Company Repair of structures using unmanned aerial vehicles

Families Citing this family (91)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9418496B2 (en) 2009-02-17 2016-08-16 The Boeing Company Automated postflight troubleshooting
US9541505B2 (en) 2009-02-17 2017-01-10 The Boeing Company Automated postflight troubleshooting sensor array
US20100215212A1 (en) * 2009-02-26 2010-08-26 Honeywell International Inc. System and Method for the Inspection of Structures
US8812154B2 (en) * 2009-03-16 2014-08-19 The Boeing Company Autonomous inspection and maintenance
US9046892B2 (en) 2009-06-05 2015-06-02 The Boeing Company Supervision and control of heterogeneous autonomous operations
US8773289B2 (en) 2010-03-24 2014-07-08 The Boeing Company Runway condition monitoring
FR2963431B1 (en) * 2010-07-27 2013-04-12 Cofice DEVICE FOR NON-DESTRUCTIVE CONTROL OF STRUCTURES AND COMPRISING A DRONE AND AN EMBEDDED MEASUREMENT SENSOR
US8599044B2 (en) 2010-08-11 2013-12-03 The Boeing Company System and method to assess and report a health of a tire
US8712634B2 (en) 2010-08-11 2014-04-29 The Boeing Company System and method to assess and report the health of landing gear related components
US8982207B2 (en) 2010-10-04 2015-03-17 The Boeing Company Automated visual inspection system
US9651950B2 (en) * 2012-07-18 2017-05-16 The Boeing Company Mission re-planning for coordinated multivehicle task allocation
EP2888085B1 (en) * 2012-08-22 2020-11-11 ABB Schweiz AG Unmanned vehicle for system supervision
US9251698B2 (en) 2012-09-19 2016-02-02 The Boeing Company Forest sensor deployment and monitoring system
US10518877B2 (en) 2012-12-19 2019-12-31 Elwha Llc Inter-vehicle communication for hazard handling for an unoccupied flying vehicle (UFV)
US9747809B2 (en) 2012-12-19 2017-08-29 Elwha Llc Automated hazard handling routine activation
US9405296B2 (en) * 2012-12-19 2016-08-02 Elwah LLC Collision targeting for hazard handling
US9776716B2 (en) 2012-12-19 2017-10-03 Elwah LLC Unoccupied flying vehicle (UFV) inter-vehicle communication for hazard handling
US9810789B2 (en) 2012-12-19 2017-11-07 Elwha Llc Unoccupied flying vehicle (UFV) location assurance
US9540102B2 (en) 2012-12-19 2017-01-10 Elwha Llc Base station multi-vehicle coordination
US9527587B2 (en) 2012-12-19 2016-12-27 Elwha Llc Unoccupied flying vehicle (UFV) coordination
US9567074B2 (en) 2012-12-19 2017-02-14 Elwha Llc Base station control for an unoccupied flying vehicle (UFV)
US9669926B2 (en) 2012-12-19 2017-06-06 Elwha Llc Unoccupied flying vehicle (UFV) location confirmance
US9235218B2 (en) 2012-12-19 2016-01-12 Elwha Llc Collision targeting for an unoccupied flying vehicle (UFV)
US10279906B2 (en) 2012-12-19 2019-05-07 Elwha Llc Automated hazard handling routine engagement
US9527586B2 (en) 2012-12-19 2016-12-27 Elwha Llc Inter-vehicle flight attribute communication for an unoccupied flying vehicle (UFV)
EP3039613A4 (en) * 2013-07-02 2016-07-27 Jasper Mason Pons Airborne scanning system and method
JP6648971B2 (en) * 2014-03-27 2020-02-19 株式会社フジタ Structure inspection device
CN111717407B (en) * 2014-04-25 2023-09-29 索尼公司 Control method and control device
JP6555255B2 (en) * 2014-04-25 2019-08-07 ソニー株式会社 Information processing apparatus, information processing method, and computer program
JP6486024B2 (en) 2014-07-02 2019-03-20 三菱重工業株式会社 Indoor monitoring system and method for structure
WO2016015311A1 (en) * 2014-07-31 2016-02-04 SZ DJI Technology Co., Ltd. System and method for enabling virtual sightseeing using unmanned aerial vehicles
US9655034B2 (en) 2014-10-31 2017-05-16 At&T Intellectual Property I, L.P. Transaction sensitive access network discovery and selection
US9371133B2 (en) 2014-11-07 2016-06-21 Paccar Inc Drone systems for pre-trip inspection and assisted backing
US9629076B2 (en) 2014-11-20 2017-04-18 At&T Intellectual Property I, L.P. Network edge based access network discovery and selection
CN104535649A (en) * 2014-12-25 2015-04-22 刘凯 Unmanned intelligent detection machine for cracks
US9809305B2 (en) 2015-03-02 2017-11-07 Amazon Technologies, Inc. Landing of unmanned aerial vehicles on transportation vehicles for transport
EP3265885A4 (en) * 2015-03-03 2018-08-29 Prenav Inc. Scanning environments and tracking unmanned aerial vehicles
JP5887641B1 (en) * 2015-05-12 2016-03-16 オービタルワークス株式会社 Unmanned aerial vehicle
JP2016218010A (en) * 2015-05-26 2016-12-22 株式会社リコー Flight type inspection device
US10162351B2 (en) * 2015-06-05 2018-12-25 At&T Intellectual Property I, L.P. Remote provisioning of a drone resource
US10129706B2 (en) 2015-06-05 2018-11-13 At&T Intellectual Property I, L.P. Context sensitive communication augmentation
FR3037429B1 (en) * 2015-06-15 2018-09-07 Donecle SYSTEM AND METHOD FOR AUTOMATIC SURFACE INSPECTION
US10197392B2 (en) * 2015-06-23 2019-02-05 The Boeing Company Automated resin ridge reduction system
EP3317614A4 (en) 2015-06-30 2019-05-15 Unmanned Innovations, Inc. Systems and methods for multi-mode unmanned vehicle mission planning and control
KR102328305B1 (en) * 2015-08-18 2021-11-17 대우조선해양 주식회사 Apparatus for inspecting LNGC cargo tank using unmaned aerial vehicle
US10310518B2 (en) 2015-09-09 2019-06-04 Apium Inc. Swarm autopilot
US9776717B2 (en) 2015-10-02 2017-10-03 The Boeing Company Aerial agricultural management system
JP6039050B1 (en) * 2015-12-25 2016-12-07 俊雄 小泉 Inspection method for structures using drone
US9513635B1 (en) 2015-12-30 2016-12-06 Unmanned Innovation, Inc. Unmanned aerial vehicle inspection system
US9464907B1 (en) 2016-01-08 2016-10-11 International Business Machines Corporation Dynamically establishing a temporary safe route via a network of unmanned vehicles
JP6202407B2 (en) * 2016-01-22 2017-09-27 オービタルワークス株式会社 Unmanned aerial vehicle
JP5999537B1 (en) * 2016-01-22 2016-09-28 オービタルワークス株式会社 Unmanned aerial vehicle
JP6478329B2 (en) * 2016-02-02 2019-03-06 Jfe鋼板株式会社 Structure inspection system and inspection method
US9711851B1 (en) * 2016-02-04 2017-07-18 Proxy Technologies, Inc. Unmanned vehicle, system and method for transmitting signals
US9823664B2 (en) 2016-02-25 2017-11-21 A.M.T.S., Llc Unmanned aircraft for positioning an instrument for inspection purposes and methods of inspecting a target surface
WO2017161326A1 (en) * 2016-03-18 2017-09-21 Oceaneering International Inc Use of unmanned aerial vehicles for ndt inspections
JP2017181766A (en) * 2016-03-30 2017-10-05 Kddi株式会社 Underwater monitoring device, on-water communication terminal, and underwater monitoring system
US10470241B2 (en) 2016-11-15 2019-11-05 At&T Intellectual Property I, L.P. Multiple mesh drone communication
US11368002B2 (en) 2016-11-22 2022-06-21 Hydro-Quebec Unmanned aerial vehicle for monitoring an electrical line
DE102017205647A1 (en) 2017-03-14 2018-09-20 Bitmanagement Software GmbH METHOD FOR DETERMINING A PATH ALONG AN OBJECT, SYSTEM AND METHOD FOR AUTOMATIC INSPECTION OF AN OBJECT
CN107193286B (en) * 2017-06-02 2020-12-08 同济大学 Bridge live-action digital acquisition method
US10507916B2 (en) * 2017-06-30 2019-12-17 Intel Corporation Unmanned aerial vehicles and related methods and systems
CN107328344B (en) * 2017-07-01 2023-11-17 浙江大学宁波理工学院 Unmanned aerial vehicle for monitoring surface crack width of concrete structure
DE102017120491A1 (en) * 2017-09-06 2019-03-07 Artifidea UG (haftungsbeschränkt) Unit for performing tasks and operating procedures therefor
US10423831B2 (en) 2017-09-15 2019-09-24 Honeywell International Inc. Unmanned aerial vehicle based expansion joint failure detection system
US20190107845A1 (en) * 2017-10-09 2019-04-11 Intel Corporation Drone clouds for video capture and creation
US10309779B2 (en) 2017-11-07 2019-06-04 Ross McArthur System and method for monitoring underwater organic solid buildup and related emissions background
WO2019092790A1 (en) * 2017-11-07 2019-05-16 ヤマハ株式会社 Imaging system, control device, imaging device, method for controlling imaging device, and program
US10690525B2 (en) 2018-01-03 2020-06-23 General Electric Company Systems and methods associated with unmanned aerial vehicle targeting accuracy
US10689110B2 (en) * 2018-02-12 2020-06-23 Wipro Limited Method and system for performing inspection and maintenance tasks of three-dimensional structures using drones
US10953938B2 (en) 2018-03-15 2021-03-23 The Boeing Company Apparatus and methods for maintenance of wind turbine blades
JP6713156B2 (en) * 2018-05-30 2020-06-24 株式会社センシンロボティクス Flight management server and flight management system for unmanned air vehicles
US10823709B2 (en) 2018-07-06 2020-11-03 The Boeing Company Methods and apparatus for realigning and re-adhering a hanging crawler vehicle on a non-level surface
US11053925B2 (en) 2018-07-19 2021-07-06 The Boeing Company Cable-suspended non-destructive inspection units for rapid large-area scanning
US11007635B2 (en) 2018-07-25 2021-05-18 The Boeing Company Gravity compensation for self-propelled robotic vehicles crawling on non-level surfaces
EP3830533A4 (en) 2018-07-30 2022-04-20 SeekOps Inc. Ultra-lightweight, handheld gas leak detection device
US11149718B2 (en) 2018-08-21 2021-10-19 The Boeing Company Methods and apparatus for maintaining airfoil-shaped body using cart that follows trailing edge
CN109213196A (en) * 2018-09-05 2019-01-15 福州日兆信息科技有限公司 A kind of communication iron tower intelligent patrol detection unmanned plane device
US10955310B2 (en) 2018-09-12 2021-03-23 The Boeing Company Vacuum-adhering apparatus for automated inspection of airfoil-shaped bodies with improved surface mounting
US11062614B2 (en) 2018-09-12 2021-07-13 Alliance Solutions Group, Inc. Systems and methods for collecting and analyzing hazardous materials information using an unmanned aerial vehicle
US11203445B2 (en) * 2018-12-11 2021-12-21 The Boeing Company Data- and model-driven inspection of autonomous aircraft using an unmanned aerial vehicle
US11385204B2 (en) 2018-12-11 2022-07-12 The Boeing Company Fan-propelled surface-adhering apparatus for automated maintenance operations
US11275376B2 (en) * 2019-06-20 2022-03-15 Florida Power & Light Company Large scale unmanned monitoring device assessment of utility system components
JP7355316B2 (en) * 2019-09-30 2023-10-03 株式会社トップライズ Mobile object management system, mobile object management device, and mobile object management method
JP7355315B2 (en) * 2019-09-30 2023-10-03 株式会社トップライズ Mobile object management system, mobile object management device, and mobile object management method
EP4038357A4 (en) * 2019-10-04 2023-11-08 SeekOps Inc. Closed surface flight pattern generation for unmanned aerial vehicle (uav) flux plane assessment
JP2021081957A (en) * 2019-11-19 2021-05-27 旭化成株式会社 Examination assist system
US12055485B2 (en) 2020-02-05 2024-08-06 Seekops Inc. Multispecies measurement platform using absorption spectroscopy for measurement of co-emitted trace gases
CA3180630A1 (en) 2020-05-29 2021-12-02 Alexander Harvey Methods and systems for construct identification and analysis
US11868931B2 (en) 2021-03-31 2024-01-09 Kabushiki Kaisha Toshiba Reliability-aware multi-agent coverage path planning
CA3116940A1 (en) 2021-04-30 2022-10-30 Hydro-Quebec Drone with positioning system tool

Citations (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5036935A (en) * 1989-03-08 1991-08-06 Kabushiki Kaisha Toyoda Jidoshokki Seisakusho Travel control device for unmanned vehicle
US5324948A (en) * 1992-10-27 1994-06-28 The United States Of America As Represented By The United States Department Of Energy Autonomous mobile robot for radiologic surveys
US5351621A (en) * 1992-02-17 1994-10-04 Hitachi, Ltd. Traveling inspection robot system
US5845725A (en) * 1995-01-09 1998-12-08 Bishamon Industries Corporation System for controlling unmanned vehicles at intersections
US20040158358A1 (en) * 2003-02-06 2004-08-12 Matsushita Electric Industrial Co., Ltd. Method of teaching traveling path to robot and robot having function of learning traveling path
US20050217589A1 (en) * 2004-04-02 2005-10-06 Daniel Brace B Agitation of poultry by applied robotics
US6984952B2 (en) * 1995-05-30 2006-01-10 F Robotics Acquisitions Ltd. Navigation method and system for autonomous machines with markers defining the working area
US20060079997A1 (en) * 2002-04-16 2006-04-13 Mclurkin James Systems and methods for dispersing and clustering a plurality of robotic devices
US20060085106A1 (en) * 2004-02-06 2006-04-20 Icosystem Corporation Methods and systems for area search using a plurality of unmanned vehicles
US20060271251A1 (en) * 2005-02-17 2006-11-30 Hopkins Jeffrey A Unmanned vehicle control
US7218993B2 (en) * 2002-10-04 2007-05-15 Fujitsu Limited Robot system and autonomous mobile robot
US20070129847A1 (en) * 2005-12-07 2007-06-07 Cedric Ulmer Method and system for automatically organizing and achieving a pre-given task by means of robot functionalities
US20070208442A1 (en) * 2006-02-27 2007-09-06 Perrone Paul J General purpose robotics operating system
US20080033684A1 (en) * 2006-07-24 2008-02-07 The Boeing Company Autonomous Vehicle Rapid Development Testbed Systems and Methods
US20090118875A1 (en) * 2007-11-01 2009-05-07 Stroud Ken A Systems and methods for coordination of entities and/or communicating location information
US20100250022A1 (en) * 2006-12-29 2010-09-30 Air Recon, Inc. Useful unmanned aerial vehicle

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS60210108A (en) * 1984-04-02 1985-10-22 株式会社フジクラ Method of inspecting aerial transmission line
US6907799B2 (en) * 2001-11-13 2005-06-21 Bae Systems Advanced Technologies, Inc. Apparatus and method for non-destructive inspection of large structures
US7047861B2 (en) * 2002-04-22 2006-05-23 Neal Solomon System, methods and apparatus for managing a weapon system
FR2861457B1 (en) * 2003-10-28 2007-10-19 Marc Serge Brussieux NON-DESTRUCTIVE CONTROL SYSTEM
JP2006027448A (en) * 2004-07-16 2006-02-02 Chugoku Electric Power Co Inc:The Aerial photographing method and device using unmanned flying body
US20070288132A1 (en) * 2006-06-07 2007-12-13 Raytheon Company Cooperative swarm of unmanned vehicles
US7581702B2 (en) * 2006-06-09 2009-09-01 Insitu, Inc. Wirelessly controlling unmanned aircraft and accessing associated surveillance data
JP2008105591A (en) * 2006-10-26 2008-05-08 Hiroboo Kk Flight management method of autonomous control unmanned flying object

Patent Citations (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5036935A (en) * 1989-03-08 1991-08-06 Kabushiki Kaisha Toyoda Jidoshokki Seisakusho Travel control device for unmanned vehicle
US5351621A (en) * 1992-02-17 1994-10-04 Hitachi, Ltd. Traveling inspection robot system
US5324948A (en) * 1992-10-27 1994-06-28 The United States Of America As Represented By The United States Department Of Energy Autonomous mobile robot for radiologic surveys
US5845725A (en) * 1995-01-09 1998-12-08 Bishamon Industries Corporation System for controlling unmanned vehicles at intersections
US6984952B2 (en) * 1995-05-30 2006-01-10 F Robotics Acquisitions Ltd. Navigation method and system for autonomous machines with markers defining the working area
US20060079997A1 (en) * 2002-04-16 2006-04-13 Mclurkin James Systems and methods for dispersing and clustering a plurality of robotic devices
US7218993B2 (en) * 2002-10-04 2007-05-15 Fujitsu Limited Robot system and autonomous mobile robot
US20040158358A1 (en) * 2003-02-06 2004-08-12 Matsushita Electric Industrial Co., Ltd. Method of teaching traveling path to robot and robot having function of learning traveling path
US20060085106A1 (en) * 2004-02-06 2006-04-20 Icosystem Corporation Methods and systems for area search using a plurality of unmanned vehicles
US20050217589A1 (en) * 2004-04-02 2005-10-06 Daniel Brace B Agitation of poultry by applied robotics
US20060271251A1 (en) * 2005-02-17 2006-11-30 Hopkins Jeffrey A Unmanned vehicle control
US20070129847A1 (en) * 2005-12-07 2007-06-07 Cedric Ulmer Method and system for automatically organizing and achieving a pre-given task by means of robot functionalities
US20070208442A1 (en) * 2006-02-27 2007-09-06 Perrone Paul J General purpose robotics operating system
US20080033684A1 (en) * 2006-07-24 2008-02-07 The Boeing Company Autonomous Vehicle Rapid Development Testbed Systems and Methods
US20100250022A1 (en) * 2006-12-29 2010-09-30 Air Recon, Inc. Useful unmanned aerial vehicle
US20090118875A1 (en) * 2007-11-01 2009-05-07 Stroud Ken A Systems and methods for coordination of entities and/or communicating location information

Cited By (96)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9420203B2 (en) 2006-06-19 2016-08-16 Oshkosh Defense, Llc Vision system for a vehicle
US8947531B2 (en) * 2006-06-19 2015-02-03 Oshkosh Corporation Vehicle diagnostics based on information communicated between vehicles
US20090079839A1 (en) * 2006-06-19 2009-03-26 Oshkosh Corporation Vehicle diagnostics based on information communicated between vehicles
US20100131133A1 (en) * 2008-11-27 2010-05-27 Coden Co., Ltd. Unmanned boat automatic survey system and unmanned boat automatic survey method
US12106409B2 (en) 2009-11-13 2024-10-01 Samsung Electronics Co., Ltd. Server, user terminal, and service providing method, and control method thereof
US11776185B2 (en) 2009-11-13 2023-10-03 Samsung Electronics Co., Ltd. Server, user terminal, and service providing method, and control method thereof for displaying photo images within a map
US10977850B2 (en) * 2009-11-13 2021-04-13 Samsung Electronics Co., Ltd. Server, user terminal, and service providing method, and control method thereof
US10586365B2 (en) * 2009-11-13 2020-03-10 Samsung Electronics Co., Ltd. Server, user terminal, and service providing method, and control method thereof
US8459619B2 (en) 2010-10-24 2013-06-11 Oshkosh Corporation Gas spring control system and method
US8788119B2 (en) 2010-12-09 2014-07-22 The Boeing Company Unmanned vehicle and system
US20120136630A1 (en) * 2011-02-04 2012-05-31 General Electric Company Method and system for wind turbine inspection
CN103576691A (en) * 2012-07-27 2014-02-12 常州天鹅科技有限公司 3G police-service unmanned aerial vehicle management and control system
EP2897864A4 (en) * 2012-09-19 2016-03-09 Boeing Co Forestry management system
US9809306B2 (en) * 2013-02-15 2017-11-07 Disney Enterprises, Inc. Controlling unmanned aerial vehicles as a flock to synchronize flight in aerial displays
US9102406B2 (en) * 2013-02-15 2015-08-11 Disney Enterprises, Inc. Controlling unmanned aerial vehicles as a flock to synchronize flight in aerial displays
US20150338855A1 (en) * 2013-02-15 2015-11-26 Disney Enterprises, Inc. Controlling unmanned aerial vehicles as a flock to synchronize flight in aerial displays
US20140249693A1 (en) * 2013-02-15 2014-09-04 Disney Enterprises, Inc. Controlling unmanned aerial vehicles as a flock to synchronize flight in aerial displays
US8775013B1 (en) * 2013-04-19 2014-07-08 The Boeing Company System and method for acoustic signature health monitoring of unmanned autonomous vehicles (UAVS)
US20140336928A1 (en) * 2013-05-10 2014-11-13 Michael L. Scott System and Method of Automated Civil Infrastructure Metrology for Inspection, Analysis, and Information Modeling
US9248915B2 (en) * 2013-08-30 2016-02-02 Insitu, Inc. Systems and methods for fuel monitoring
US9738394B2 (en) * 2013-08-30 2017-08-22 Insitu, Inc. Systems and methods for fuel monitoring
US20160101872A1 (en) * 2013-08-30 2016-04-14 Insitu, Inc. Systems and methods for fuel monitoring
US20150066253A1 (en) * 2013-08-30 2015-03-05 Insitu, Inc. Systems and methods for fuel monitoring
US10589829B2 (en) * 2013-10-24 2020-03-17 Board Of Trustees Of Michigan State University Gliding robotic fish navigation and propulsion
US20150120045A1 (en) * 2013-10-24 2015-04-30 Board Of Trustees Of Michigan State University Gliding robotic fish navigation and propulsion
US9718523B2 (en) * 2013-10-24 2017-08-01 Board Of Trustees Of Michigan State University Gliding robotic fish navigation and propulsion
US10250821B2 (en) * 2013-11-27 2019-04-02 Honeywell International Inc. Generating a three-dimensional model of an industrial plant using an unmanned aerial vehicle
AU2014256424B2 (en) * 2013-11-27 2019-05-30 Honeywell International Inc. Generating a three-dimensional model of an industrial plant using an unmanned aerial vehicle
US20150145954A1 (en) * 2013-11-27 2015-05-28 Honeywell International Inc. Generating a three-dimensional model of an industrial plant using an unmanned aerial vehicle
EP2937756A1 (en) 2014-04-22 2015-10-28 Airbus Operations GmbH Method for inspecting an airborne vehicle
US9691285B2 (en) 2014-07-14 2017-06-27 John A. Jarrell Unmanned aerial vehicle communication, monitoring, and traffic management
US20170162059A1 (en) * 2014-07-14 2017-06-08 John A. Jarrell Unmanned aerial vehicle communication, monitoring, and traffic management
EP3170055A4 (en) * 2014-07-14 2018-03-07 John A. Jarrell Unmanned aerial vehicle communication, monitoring, and traffic management
US20160176542A1 (en) * 2014-12-18 2016-06-23 The Boeing Company Image capture systems and methods and associated mobile apparatuses
US10752378B2 (en) * 2014-12-18 2020-08-25 The Boeing Company Mobile apparatus for pest detection and engagement
US10509417B2 (en) * 2015-03-18 2019-12-17 Van Cruyningen Izak Flight planning for unmanned aerial tower inspection with long baseline positioning
US20180095478A1 (en) * 2015-03-18 2018-04-05 Izak van Cruyningen Flight Planning for Unmanned Aerial Tower Inspection with Long Baseline Positioning
WO2016209504A1 (en) 2015-06-25 2016-12-29 Intel Corporation Personal sensory drones
US11076134B2 (en) 2015-06-25 2021-07-27 Intel Corporation Personal sensory drones
US10694155B2 (en) 2015-06-25 2020-06-23 Intel Corporation Personal sensory drones
EP3786753A1 (en) * 2015-06-25 2021-03-03 INTEL Corporation Personal sensory drones
EP3314343A4 (en) * 2015-06-25 2019-01-30 Intel Corporation Personal sensory drones
DE102015217773A1 (en) 2015-09-17 2016-09-08 Voith Patent Gmbh Method of inspecting the waterways of a hydroelectric power station
US10761525B2 (en) 2015-12-30 2020-09-01 Skydio, Inc. Unmanned aerial vehicle inspection system
US12007761B2 (en) 2015-12-30 2024-06-11 Skydio, Inc. Unmanned aerial vehicle inspection system
US9740200B2 (en) 2015-12-30 2017-08-22 Unmanned Innovation, Inc. Unmanned aerial vehicle inspection system
US11550315B2 (en) 2015-12-30 2023-01-10 Skydio, Inc. Unmanned aerial vehicle inspection system
US10083616B2 (en) 2015-12-31 2018-09-25 Unmanned Innovation, Inc. Unmanned aerial vehicle rooftop inspection system
US9915946B2 (en) 2015-12-31 2018-03-13 Unmanned Innovation, Inc. Unmanned aerial vehicle rooftop inspection system
US9881213B2 (en) 2015-12-31 2018-01-30 Unmanned Innovation, Inc. Unmanned aerial vehicle rooftop inspection system
US9613538B1 (en) * 2015-12-31 2017-04-04 Unmanned Innovation, Inc. Unmanned aerial vehicle rooftop inspection system
US9609288B1 (en) * 2015-12-31 2017-03-28 Unmanned Innovation, Inc. Unmanned aerial vehicle rooftop inspection system
US10061470B2 (en) 2015-12-31 2018-08-28 Unmanned Innovation, Inc. Unmanned aerial vehicle rooftop inspection system
WO2017127711A1 (en) * 2016-01-20 2017-07-27 Ez3D, Llc System and method for structural inspection and construction estimation using an unmanned aerial vehicle
US10217207B2 (en) 2016-01-20 2019-02-26 Ez3D, Llc System and method for structural inspection and construction estimation using an unmanned aerial vehicle
US20170313439A1 (en) * 2016-04-29 2017-11-02 Jordan Holt Methods and syststems for obstruction detection during autonomous unmanned aerial vehicle landings
EP3455803A2 (en) * 2016-05-13 2019-03-20 General Electric Company Robot system for asset health management
US11835561B2 (en) 2016-05-18 2023-12-05 Skydio, Inc. Unmanned aerial vehicle electromagnetic avoidance and utilization system
US11029352B2 (en) 2016-05-18 2021-06-08 Skydio, Inc. Unmanned aerial vehicle electromagnetic avoidance and utilization system
US10269138B2 (en) * 2016-08-11 2019-04-23 Changzhou Campus of Hohai University UAV inspection method for power line based on human visual system
US12054250B2 (en) * 2016-09-29 2024-08-06 Mcafee, Llc Apparatus and methods for unmanned aerial vehicle servicing of modular device assembly
US20200207472A1 (en) * 2016-09-29 2020-07-02 Mcafee, Llc Apparatus and methods for unmanned aerial vehicle servicing of modular device assembly
US11212814B2 (en) 2016-10-18 2021-12-28 Apium Inc. Swarm communication method and device
US10694529B2 (en) 2016-10-18 2020-06-23 Apium Inc Swarm communication method and device
CN108021143A (en) * 2016-10-31 2018-05-11 波音公司 For carrying out the method and system of non-destructive testing using unmanned vehicle
US10602056B2 (en) 2017-01-13 2020-03-24 Microsoft Technology Licensing, Llc Optimal scanning trajectories for 3D scenes
WO2018132224A1 (en) * 2017-01-13 2018-07-19 Microsoft Technology Licensing, Llc Optimal scanning trajectories for 3d scenes
US11048250B2 (en) 2017-06-13 2021-06-29 Prüftechnik Dieter Busch AG Mobile transportation means for transporting data collectors, data collection system and data collection method
US12118665B2 (en) 2017-06-27 2024-10-15 State Farm Mutual Automobile Insurance Company Systems and methods for controlling a fleet of drones for data collection
US11430180B2 (en) 2017-06-27 2022-08-30 State Farm Mutual Automobile Insurance Company Systems and methods for controlling a fleet of drones for data collection
US20190144112A1 (en) * 2017-11-16 2019-05-16 The Boeing Company Charging a rechargeable battery of an unmanned aerial vehicle in flight using a high voltage power line
US10919626B2 (en) * 2017-11-16 2021-02-16 The Boeing Company Charging a rechargeable battery of an unmanned aerial vehicle in flight using a high voltage power line
US11059378B2 (en) 2017-11-16 2021-07-13 The Boeing Company Charging a rechargeable battery of an unmanned aerial vehicle in flight using a high voltage power line
WO2019166185A1 (en) * 2018-03-02 2019-09-06 Robert Bosch Gmbh Device, particularly a hand-held power tool management device and method for monitoring and/or managing a plurality of objects
US11979800B2 (en) 2018-03-02 2024-05-07 Robert Bosch Gmbh Device, particularly a hand-held power tool management device and method for monitoring and/or managing a plurality of objects
CN109270951A (en) * 2018-08-02 2019-01-25 佛山世寰智能科技有限公司 A kind of unmanned plane environmental monitoring cruise method and system
US11741703B2 (en) * 2018-09-11 2023-08-29 Pointivo, Inc. In data acquisition, processing, and output generation for use in analysis of one or a collection of physical assets of interest
US11079760B2 (en) * 2018-11-28 2021-08-03 The Boeing Company Methods for maintaining difficult-to-access structures using unmanned aerial vehicles
US10534068B2 (en) * 2018-12-27 2020-01-14 Intel Corporation Localization system, vehicle control system, and methods thereof
US11030812B2 (en) * 2019-01-02 2021-06-08 The Boeing Company Augmented reality system using enhanced models
EP3923065A4 (en) * 2019-02-07 2022-04-06 FUJIFILM Corporation Photographing system, photographing spot setting device, photographing device, and photographing method
CN113396361A (en) * 2019-02-07 2021-09-14 富士胶片株式会社 Imaging system, imaging part setting device, imaging device, and imaging method
US11275391B2 (en) 2019-05-13 2022-03-15 The Boeing Company In-service maintenance process using unmanned aerial vehicles
US11630459B2 (en) 2020-01-29 2023-04-18 The Boeing Company Repair of structures using unmanned aerial vehicles
US11529777B2 (en) 2020-02-05 2022-12-20 The Boeing Company Hot bond repair of structures using unmanned aerial vehicles
US11891174B2 (en) 2020-02-05 2024-02-06 The Boeing Company Repair of structures using unmanned aerial vehicles
US11555693B2 (en) 2020-05-12 2023-01-17 The Boeing Company Measurement of surface profiles using unmanned aerial vehicles
US11745872B2 (en) 2020-06-19 2023-09-05 The Boeing Company Methods for marking surfaces using unmanned aerial vehicles
US20220016772A1 (en) * 2020-07-17 2022-01-20 X Development Llc Robot planning using unmanned aerial vehicles
US11794342B2 (en) * 2020-07-17 2023-10-24 Intrinsic Innovation Llc Robot planning using unmanned aerial vehicles
US11783715B2 (en) * 2020-08-21 2023-10-10 Drobotics, Llc Unmanned aerial vehicle with neural network for enhanced mission performance
US20220055749A1 (en) * 2020-08-21 2022-02-24 Eyal Stein Unmanned aerial vehicle with neural network for enhanced mission performance
DE102020130236B4 (en) 2020-11-16 2022-06-09 Gestra Ag Unmanned aircraft and related aircraft system
DE102020130236A1 (en) 2020-11-16 2022-05-19 Gestra Ag Unmanned aircraft and related aircraft system
US11516440B2 (en) * 2020-11-25 2022-11-29 Zhejiang University Method for modal analysis of bridge structures based on surveillance videos
US20220166957A1 (en) * 2020-11-25 2022-05-26 Zhejiang University Method for modal analysis of bridge structures based on surveillance videos

Also Published As

Publication number Publication date
EP2288970B1 (en) 2016-04-27
CN102160005B (en) 2014-11-26
JP2011530692A (en) 2011-12-22
CN102160005A (en) 2011-08-17
US8060270B2 (en) 2011-11-15
WO2009142933A2 (en) 2009-11-26
JP5697592B2 (en) 2015-04-08
EP2288970A2 (en) 2011-03-02
WO2009142933A3 (en) 2012-07-05

Similar Documents

Publication Publication Date Title
US8060270B2 (en) System and method for inspection of structures and objects by swarm of remote unmanned vehicles
US10633093B2 (en) Three-dimensional robotic inspection system
US10452078B2 (en) Self-localized mobile sensor network for autonomous robotic inspection
US9823664B2 (en) Unmanned aircraft for positioning an instrument for inspection purposes and methods of inspecting a target surface
CN113238581B (en) Method and system for flight control of unmanned aerial vehicle
KR102675315B1 (en) Systems and methods for automatically inspecting surfaces
US11029352B2 (en) Unmanned aerial vehicle electromagnetic avoidance and utilization system
US11874676B2 (en) Cooperative unmanned autonomous aerial vehicles for power grid inspection and management
JP4475632B2 (en) Transmission line inspection system using unmanned air vehicle
Martinez et al. iSafeUAS: An unmanned aerial system for construction safety inspection
US10480953B2 (en) Semi-autonomous monitoring system
KR20170111921A (en) Method and system for controlling unmanned air vehicle
CN109990778B (en) Bridge base inspection route planning method
Henrickson et al. Infrastructure assessment with small unmanned aircraft systems
CA3192091A1 (en) Method and aircraft for monitoring operational states and for determining outage probabilities of current-carrying line systems
Alsadik et al. The rise in UAV inspections for civil infrastructure
KR102575000B1 (en) System for ai drone platform using a crack diagnosis of plant
Garcia-Fidalgo et al. Evaluation of a skill-based control architecture for a visual inspection-oriented aerial platform
Lau Banh et al. Evaluation of Feasibility of UAV Technologies for Remote Surveying BART Rail Systems
Nicholson Certain Smart Center Project
US20230061934A1 (en) Neural network-guided passive sensor drone inspection system
Fernandez-Cortizas et al. D7. 1 Inspection Testbed Concept and Requirement Analysis
YONATHAN A STUDY OF APPLICATION OF UNMANNED AERIAL SYSTEMS IN CONSTRUCTION PROJECTS
Gogel et al. Use of Modern Technologies and Methodologies to Improve Helicopter Accident Investigation
CN117237790A (en) Movable beyond-sight unmanned aerial vehicle operation control scheduling platform

Legal Events

Date Code Title Description
AS Assignment

Owner name: THE BOEING COMPANY, ILLINOIS

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:VIAN, JOHN LYLE;MANSOURI, ALI REZA;SAAD, EMAD WILLIAM;SIGNING DATES FROM 20080509 TO 20080519;REEL/FRAME:020989/0746

STCF Information on status: patent grant

Free format text: PATENTED CASE

FPAY Fee payment

Year of fee payment: 4

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1552); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 8

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 12TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1553); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 12