WO2017138049A1 - Corps volant et système de commande associé - Google Patents

Corps volant et système de commande associé Download PDF

Info

Publication number
WO2017138049A1
WO2017138049A1 PCT/JP2016/004754 JP2016004754W WO2017138049A1 WO 2017138049 A1 WO2017138049 A1 WO 2017138049A1 JP 2016004754 W JP2016004754 W JP 2016004754W WO 2017138049 A1 WO2017138049 A1 WO 2017138049A1
Authority
WO
WIPO (PCT)
Prior art keywords
base station
light
image
flying object
distance measuring
Prior art date
Application number
PCT/JP2016/004754
Other languages
English (en)
Japanese (ja)
Inventor
堀ノ内　貴志
俊典 廣瀬
Original Assignee
パナソニックＩｐマネジメント株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by パナソニックＩｐマネジメント株式会社 filed Critical パナソニックＩｐマネジメント株式会社
Publication of WO2017138049A1 publication Critical patent/WO2017138049A1/fr

Links

Images

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B64—AIRCRAFT; AVIATION; COSMONAUTICS
    • B64C—AEROPLANES; HELICOPTERS
    • B64C13/00—Control systems or transmitting systems for actuating flying-control surfaces, lift-increasing flaps, air brakes, or spoilers
    • B64C13/02—Initiating means
    • B64C13/16—Initiating means actuated automatically, e.g. responsive to gust detectors
    • B64C13/18—Initiating means actuated automatically, e.g. responsive to gust detectors using automatic pilot
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B64—AIRCRAFT; AVIATION; COSMONAUTICS
    • B64D—EQUIPMENT FOR FITTING IN OR TO AIRCRAFT; FLIGHT SUITS; PARACHUTES; ARRANGEMENT OR MOUNTING OF POWER PLANTS OR PROPULSION TRANSMISSIONS IN AIRCRAFT
    • B64D43/00—Arrangements or adaptations of instruments
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B64—AIRCRAFT; AVIATION; COSMONAUTICS
    • B64D—EQUIPMENT FOR FITTING IN OR TO AIRCRAFT; FLIGHT SUITS; PARACHUTES; ARRANGEMENT OR MOUNTING OF POWER PLANTS OR PROPULSION TRANSMISSIONS IN AIRCRAFT
    • B64D47/00—Equipment not otherwise provided for
    • B64D47/08—Arrangements of cameras
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B64—AIRCRAFT; AVIATION; COSMONAUTICS
    • B64F—GROUND OR AIRCRAFT-CARRIER-DECK INSTALLATIONS SPECIALLY ADAPTED FOR USE IN CONNECTION WITH AIRCRAFT; DESIGNING, MANUFACTURING, ASSEMBLING, CLEANING, MAINTAINING OR REPAIRING AIRCRAFT, NOT OTHERWISE PROVIDED FOR; HANDLING, TRANSPORTING, TESTING OR INSPECTING AIRCRAFT COMPONENTS, NOT OTHERWISE PROVIDED FOR
    • B64F1/00—Ground or aircraft-carrier-deck installations
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C15/00—Surveying instruments or accessories not provided for in groups G01C1/00 - G01C13/00

Definitions

  • the present disclosure relates to an aircraft flying in the air and a control system thereof.
  • Patent Document 2 discloses a technique related to position and orientation control.
  • Patent Document 2 discloses an apparatus that obtains distance distribution information (distance image) on the lower surface by performing stereo processing on a captured image captured by a stereo camera, and calculates the attitude angle of the own device from distance information of a large number of measurement points. is doing.
  • Patent Document 3 discloses a method of tracking a flying object including a light reflector with a surveying device.
  • the present disclosure provides a flying object control system that can stably control the attitude of a flying object even in a situation where a satellite positioning signal such as a GPS signal cannot be captured due to an obstacle.
  • a flying object control system including a flying object and a base station.
  • the base station includes a light source unit that emits guide light having a predetermined wavelength.
  • the flying object includes a propulsion unit that generates a driving force for flying in the air, a distance measuring unit that measures a distance from the flying object to an object existing in a predetermined space around the flying object, and a predetermined measurement unit.
  • An imaging unit that captures an image of a subject existing in space and generates image data, and a first controller that controls the operation of the flying object. The first controller obtains the relative positional relationship of the flying object with respect to the base station based on the guide light image included in the image data generated by the imaging unit and information from the distance measuring unit.
  • the flying object can recognize the relative position with respect to the base station based on the guide light from the base station. For this reason, if the base station is arranged at a position where the flying object can receive the guide light from the base station, even if the satellite positioning signal such as a GPS signal cannot be captured by an obstacle, the flying object can be stably obtained. Attitude control can be performed.
  • FIG. 4 is a block diagram showing a functional configuration of a base station in the second embodiment.
  • Flowchart showing processing of the control system for an aircraft in the second embodiment The figure which shows the example of the image B image
  • FIG. 1 is a diagram illustrating a configuration of an aircraft control system according to the present disclosure.
  • the flying vehicle control system 100 includes an unmanned flying vehicle (a so-called “drone”) 10 that is automatically piloted, and a base station 50 that gives instructions to the flying vehicle.
  • the flying object 10 captures the state of the bridge floor slab 73 and the bridge girder 74 with a camera while moving under the bridge.
  • the base station 50 is attached and fixed to a part of the bridge. Below the bridge, the GPS signal from the GPS satellite is shielded by the floor slab 73 and the bridge girder 74 and does not reach the flying object 10. For this reason, the flying object 10 cannot receive GPS signals, and position control becomes difficult.
  • the flying object 10 of the present embodiment grasps the relative position with respect to the base station 50 based on the guide light (light indicating the position of the base station 50) emitted from the base station 50, and performs position and orientation control based on the relative position. (Details will be described later).
  • FIG. 2 is a view showing the appearance of the flying object 10.
  • FIG. 3A is a block diagram showing a functional configuration of the flying object 10.
  • the flying object 10 includes a main body 11 and a propulsion device 15 that generates a propulsive force of the flying object 10.
  • the propulsion device 15 is attached to the tip of the support portion 13 extending from each of the squares of the main body 11.
  • a first camera 21 is attached to the side surface of the main body 11.
  • An inertial measuring device 17, a GPS positioning device 18, an omnidirectional distance measuring device 19, and a second camera 21b are attached to the upper side of the main body 11.
  • a communication unit 23 and a battery 25 are attached to the lower side of the main body 11.
  • a controller 16 is accommodated in the main body 11.
  • the propulsion device 15 includes a propeller and a motor that rotates the propeller.
  • the flying object 10 includes four propulsion devices 15, but the number of propulsion devices is not limited to four, and may be five or more, for example. By appropriately controlling the rotation speed of each propeller 15, the moving direction and flight state of the flying object 10 can be controlled.
  • the first camera 21 captures a subject (inspection target) and generates high-definition (for example, 4K) image data for inspection.
  • the first camera 21 includes an optical system and an image sensor such as a CCD or CMOS image sensor, and shoots a subject to generate image data.
  • the first camera 21 captures visible light and generates image data.
  • An image generated by imaging such visible light is hereinafter referred to as an “RGB image”.
  • the first camera 21 is attached to the side surface of the flying object 10 toward the upper side of the flying object 10.
  • the flying object 10 can take an image of a predetermined angle of view vertically above the flying object 10 during the flight. That is, the state of the lower side of the building can be photographed by causing the flying object 10 to fly under the building to be inspected.
  • the inertial measurement device 17 includes an acceleration sensor and a gyro sensor, and measures the acceleration and angular velocity of the flying object 10. Based on the output from the inertial measurement device 17, the behavior and attitude of the flying vehicle 10 are controlled.
  • the GPS positioning device 18 receives a signal from a GPS (Global Positioning System) satellite and measures the current position of the flying object 10.
  • the battery 25 is a power source that supplies a power supply voltage to each element of the flying vehicle 10.
  • the omnidirectional distance measuring device 19 captures a space around the distance measuring device 19 at a wide angle, and generates a distance image indicating a distance to an object existing in the space. Specifically, as shown in FIG. 4A, a substantially hemispherical space (hereinafter referred to as “measurement target space”) surrounding a portion where the light of the distance measuring device 19 enters and exits is photographed.
  • the range in which the distance measuring device 19 can shoot covers all directions (360 °) in the horizontal direction and covers a range of 180 ° or more in the vertical direction.
  • the distance measuring device 19 can be constituted by, for example, a TOF (Time) of Flight) sensor capable of photographing at a wide angle.
  • FIG. 4B is a diagram showing a functional configuration of the distance measuring device 19.
  • the distance measuring device 19 includes a light receiving lens 192, a filter 193, a light receiving unit 194, a control unit 195 (an example of a second controller), a light source unit 197, and an irradiation lens 199.
  • the light source unit 197 emits light for measuring the distance to the object in the measurement target space (hereinafter referred to as “ranging light”) at a predetermined timing in accordance with the control of the control unit 195.
  • the distance measuring light is infrared light and has a predetermined wavelength (wavelength A).
  • the light source unit 197 includes a plurality of (for example, eight or more) laser diodes that output laser light having a predetermined wavelength (wavelength A) and a diffusion plate. Laser light from a plurality of laser diodes is diffused by a diffusion plate to become uniform light, and is irradiated in all directions through the irradiation lens 199 as distance measurement light.
  • the light receiving lens 192 is a wide-angle lens that can capture an image in a wide range (hemispherical range) as shown in FIG. 4A.
  • the irradiation lens 199 is a lens for diffusing and irradiating the distance measuring light at a wide angle so that the distance measuring light is irradiated to an object in a wide range as shown in FIG. 4A.
  • the filter 193 is an optical filter configured to transmit light of a wavelength component having a predetermined width centered on the wavelength of the distance measuring light (wavelength A) in the light received through the light receiving lens 192. By filtering in this way, the light receiving unit 194 receives only the reflected light of the distance measuring light (wavelength A).
  • the light receiving unit 194 includes an image sensor such as a CMOS image sensor, and generates image data based on the received light.
  • the light receiving unit 194 receives light through the filter 193 to generate image data of an image (hereinafter referred to as “IR image”) by reflected light of the distance measuring light (wavelength A).
  • the light source unit 197 emits distance measuring light.
  • the distance measuring light is reflected by an object existing in the measurement object space.
  • the reflected light is received by the light receiving unit 194 through the filter 193, and an IR image is generated.
  • the control unit 195 generates a distance image using information on the IR image generated by the light receiving unit 194.
  • the second camera 21b includes an optical system and an image sensor such as a CCD or a CMOS image sensor.
  • the second camera 21b captures visible light and generates RGB image data.
  • the RGB image data is image data used for ranging (hereinafter referred to as “ranging image data”).
  • the distance measurement image data generated by the second camera 21b has a lower resolution than the image data generated by the first camera 21.
  • the second camera 21b has the same angle of view as the distance measuring device 19, images the same measurement target space as the distance measuring device 19, and generates distance measurement image data. That is, in the present embodiment, distance measurement image data (RGB image data) by the second camera 21b and distance image data by the distance measuring device 19 are generated for the same measurement target space.
  • FIG. 5 is a diagram illustrating an appearance of the base station 50.
  • FIG. 6 is a block diagram showing a functional configuration of the base station 50.
  • the base station 50 includes a light source unit 51 that emits guide light, a communication unit 53 that communicates with the flying object 10, a battery 55 that supplies power, and operations of the light source unit 51. And a GPS positioning device 58 that measures the current position of the base station 50.
  • the base station 50 includes a reflecting plate 52 around the light emitting part of the light source part 51.
  • the base station 50 includes a support member 59 for fixing to an inspection object such as a bridge.
  • the reflector 52 reflects the distance measuring light from the flying object 10.
  • the communication unit 53 includes a communication module for performing wireless communication with the flying object 10.
  • the controller 56 is configured by a programmable microcomputer or the like.
  • the GPS positioning device 58 receives a signal from a GPS satellite and measures the current position (absolute position) of the base station 50.
  • the GPS positioning device 58 includes an antenna 58a for receiving a signal from a GPS satellite.
  • the antenna 58a is installed at a position protruding from the bridge 71 so that a signal from the GPS satellite is not shielded by the floor slab 73 or the bridge girder 74.
  • the light source unit 51 includes an LED (light emitting diode) that emits guide light, a lens for irradiating light emitted from the LED at a wide angle, and a drive circuit that drives the LED.
  • the color (wavelength) of the guide light emitted from the light source unit 51 is set to a specific color (wavelength) that can be photographed by the first camera 21.
  • the flying object 10 flies in a posture in which the side to which the distance measuring device 19 is attached faces upward.
  • the flying object 10 moves in a state in which it always faces a certain direction with respect to the inspection object. That is, as shown in FIG. 3B, when the flying object 10 moves in the direction of the arrow, the flying object 10 always moves while facing a certain direction.
  • the flying object 10 flies below the inspection object (for example, bridge floor slab 73 or bridge girder 74) in accordance with the instruction from the base station 50 or the pre-programmed instruction content, and is inspected by the first camera 21. An image of the surface of an object (for example, a bridge floor slab 73 or a bridge girder 74) is taken.
  • the flying object 10 grasps the relative positional relationship (position and orientation) with respect to the base station 50 based on the guide light from the base station 50.
  • the base station 50 measures its own absolute position by the GPS positioning device 58 and notifies the flying object 10 of the absolute position of the base station 50. Based on the absolute position of the base station 50 and the relative positional relationship with respect to the base station 50, the flying object 10 recognizes the absolute position of its own device and determines the flight path.
  • FIG. 7 is a flowchart showing processing in the flying object control system 100 according to the first embodiment. The operation of recognizing the relative positional relationship between the flying object 10 and the base station 50 in the flying object control system 100 will be described with reference to the flowchart of FIG.
  • the base station 50 emits guide light of a desired color from the light source unit 51 (S11).
  • the second camera 21b of the flying object 10 takes a wide-angle image of the measurement target space and generates distance measurement image data (S12).
  • the distance measurement image data generated by the second camera 21b is image data represented by RGB signals.
  • the controller 16 of the flying object 10 converts the ranging image represented by RGB into an HSV image represented by hue, saturation, and value (S13).
  • the controller 16 extracts a light source having a color close to the guide light from the HSV image, and detects the position of the guide light (that is, the light source 51 or the reflection plate 52) in the HSV image (S14).
  • FIG. 8A is a diagram showing an example of an HSV image generated by performing color conversion from an RGB image for distance measurement generated by the second camera 21b.
  • the center P00 indicates the position of the flying object 10
  • the star mark P01 indicates the position on the image that emits a color close to the guide light.
  • the controller 16 detects the position of the guide light (that is, the light source 51 or the reflection plate 52) by extracting a pixel including a color close to the guide light from the HSV image 60.
  • the controller 16 detects the orientation of the base station 50 from the position of the guide light detected on the HSV image (S15).
  • the azimuth D of the base station 50 is obtained from the position P01 of the guide light specified on the HSV image 60 shown in FIG. 8A.
  • the flying object 10 moves in a fixed direction with respect to the inspection object (for example, attitude control in which one of the longitudinal directions of the bridge is always forward of the flying object).
  • the azimuth indicated in the image does not change greatly depending on the flight status of the aircraft 10.
  • the laser light (ranging light) of wavelength A is emitted from the light source unit 197 of the distance measuring device 19 of the flying object 10 through the irradiation lens 199 at a wide angle (S16). Then, the distance measuring device 19 shoots the measurement target space and generates a distance image (S17). Specifically, the light receiving unit 194 of the distance measuring device 19 receives the reflected light of the distance measuring light through the filter 193, thereby photographing the measurement target space and generating image data. The control unit 195 generates image data indicating a distance image based on the image data generated by the light receiving unit 194.
  • the controller 16 of the flying object 10 determines the distance from the flying object 10 to the guide light (that is, the light source 51 or the reflecting plate 52) of the base station 50 based on the previously determined direction of the base station 50 and the position of the guide light. Measure (S18). Specifically, in the distance image, the controller 16 obtains a position corresponding to the position of the guide light (such as the light source unit 51) previously obtained from the HSV image, and obtains the distance to this position.
  • FIG. 8B is a diagram showing an example of a distance image corresponding to the HSV image 60 shown in FIG. 8A. 8A and 8B, in the distance image 62, the pixel position P11 corresponding to the position P01 obtained from the HSV image 60 is obtained, and the distance to the pixel at this position P11 is obtained.
  • the controller 16 of the flying object 10 obtains a relative positional relationship (position and orientation) with respect to the base station 50 based on the azimuth of the base station 50 and the distance to the base station 50 obtained as described above (S19).
  • the flying object 10 acquires the absolute position of the base station 50 from the base station 50. Since the absolute position of the base station 50 is known, the flying object 10 can recognize the absolute position of the flying object 10 by recognizing the relative positional relationship of the flying object 10 with respect to the base station 50. Therefore, even in a situation where GPS signals or the like cannot be received due to an obstacle, the controller 16 of the flying object 10 can grasp the absolute position of the own device from the relative positional relationship with the base station 50 and control the flight path. it can.
  • the image data of the RGB image for distance measurement is generated by the first camera 21b, and the image data of the distance image is generated by the distance measuring device 19, respectively.
  • one ranging device 19 may generate image data of RGB images for distance measurement in addition to distance image data.
  • the filter 193 is configured to have characteristics as shown in FIG. FIG. 9 shows the transmission characteristics for four pixels for convenience of explanation, and the pattern shown in FIG. 9 is repeatedly applied to the entire pixel region of the light receiving unit 194.
  • the filter 193 separates R, G, and B colors and infrared light (IR) for each pixel.
  • the light receiving unit 194 receives light through a filter 193 having a pattern as shown in FIG.
  • control unit 195 generates the image data of the distance image based on the image data of the IR image.
  • the controller 16 of the flying object 10 acquires the image data of the RGB image for distance measurement and the data of the distance image from the distance measuring device 19, and uses these image data to perform the same method as the above-described method.
  • the relative positional relationship with respect to the base station 50 is recognized.
  • the configuration of the distance measuring device 19 is not limited to the above-described one, and any other configuration may be used as long as it can capture a distance image in the infrared wavelength region and an image in the visible wavelength region. Good.
  • a distance measuring device used in the flying object control system 100 a distance measuring device having a configuration disclosed in Japanese Patent Application Laid-Open No. 2008-70374 can be applied.
  • the controller 56 of the base station 50 may transmit the guide light emitted from the light source unit 51 after modulating it with a modulation signal.
  • the modulation signal may include, for example, identification information for identifying the base station.
  • the flying object 10 is obtained by demodulating the signal extracted through the RGB image obtained by photographing the guide light to extract the identification information included in the modulation signal, and the guide light is emitted from the base station 50 based on the extracted identification information. I can confirm that there is. Thereby, disturbance light and guide light can be distinguished, and it can prevent misidentifying the position of the base station 50 by disturbance light.
  • the control system 100 is a control system including the flying object 10 and the base station 50.
  • the base station 50 includes a light source unit 51 that emits guide light having a predetermined wavelength (specific color).
  • the flying object 10 is a omnidirectional distance measuring device that measures a distance from a propulsion device 15 that generates a propulsive force for flying in the air and an object existing in a predetermined space around the flying object 10.
  • a device 19 an example of a distance measuring unit
  • a second camera 21b an example of an imaging unit
  • a controller 16 (which controls the operation of the flying object) An example of a first controller).
  • the controller 16 obtains the relative positional relationship of the flying object with respect to the base station 50 based on the guide light image included in the image data generated by the second camera 21 b and the information from the omnidirectional distance measuring device 19.
  • the flying object 10 can grasp the relative positional relationship of its own device with the guide light from the base station 50, it can grasp the position of its own device even when the GPS signal or the like cannot be received due to an obstacle or the like. it can.
  • the influence of multipath can be eliminated by using light instead of sound waves and radio waves as a communication medium.
  • the base station 50 includes an LED, and radiates light emitted from the LED as guide light.
  • the base station emits laser light as guide light.
  • FIG. 10A is a diagram showing a functional configuration of the flying object 10b in the second embodiment.
  • the flying object 10b according to the second embodiment is different from the structure of the flying object 10 according to the first embodiment in that the second camera 21b is not provided.
  • the omnidirectional distance measuring device 19b is different from the configuration of the first embodiment in that it receives infrared light of two types of wavelengths (wavelength A and wavelength B) and generates a captured image for each wavelength.
  • the filter 193 of the omnidirectional distance measuring device 19b of Embodiment 2 has a transmission characteristic as shown in FIG. 10B.
  • FIG. 10B shows the transmission characteristics for four pixels for convenience of explanation, and the pattern shown in FIG.
  • FIG. 10B is repeatedly applied to the entire pixel region of the light receiving unit 194.
  • FIG. 10B shows filter characteristics that transmit the wavelength A and the wavelength B for each pixel.
  • the light receiving unit 194 of the omnidirectional distance measuring device 19b can receive light of wavelength A or light of wavelength B for each pixel.
  • the light receiving unit 194 of the omnidirectional distance measuring device 19b can generate image data of an image based on light received at a wavelength A and image data of an image based on light received at a wavelength B.
  • the control unit 195 generates distance image data based on a signal from a pixel that receives the wavelength A.
  • FIG. 11 is a diagram showing a configuration of the base station 50b in the second embodiment.
  • the light source unit 51 includes an LED.
  • the light source unit 51b includes a laser diode that emits a laser beam having a wavelength B different from the wavelength A of the ranging light. This is different from the first embodiment. That is, in the second embodiment, the distance measuring light and the guide light are the same laser light, but their wavelengths (wavelength A and wavelength B) are different.
  • FIG. 12 is a flowchart showing processing of the flying object control system 100 according to the second embodiment. The operation of the flying object control system 100 according to the second embodiment will be described with reference to the flowchart of FIG.
  • the base station 50b radiates guide light having a wavelength B from the light source unit 51b (S21).
  • the distance measuring device 19b of the flying object 10 irradiates laser light (ranging light) having a wavelength A from the light source unit 197 at a wide angle (S22).
  • the distance measuring device 19b takes a wide-angle image of the measurement target space, and image data of an image based on light received at wavelength A (hereinafter referred to as “image A”) and an image based on light received at wavelength B (hereinafter referred to as “image B”). Is generated) (S23).
  • the controller 16 detects the position of the guide light (that is, the light source unit 51 or the reflection plate 52) from the image B (S24).
  • FIG. 13A is a diagram illustrating an example of an image B.
  • the center P00 indicates the position of the flying object 10
  • the star P02 indicates the position of the guide light.
  • the controller 16 can detect the position of the guide light (that is, the light source unit 51 or the reflection plate 52) based on the luminance of each pixel of the image B (60b).
  • the controller 16 detects the azimuth of the base station 50b from the position of the guide light detected on the image B (S25).
  • the direction D1 of the base station 50 is obtained from the position P02 of the guide light detected on the image B (60b) shown in FIG. 13A.
  • the control unit 195 of the distance measuring device 19 generates image data indicating a distance image based on the image data of the image A (S26).
  • FIG. 13B is a diagram illustrating an example of a distance image obtained from the image A.
  • the distance image 62b in the distance image 62b, the pixel position P22 corresponding to the position P02 obtained from the image B (60b) is obtained, and the distance to the pixel at this position P22 is obtained.
  • the controller 16 obtains a relative positional relationship (position and orientation) with respect to the base station 50 based on the orientation of the base station 50b and the distance to the base station 50b obtained as described above (S28).
  • the desired wavelength based on each light can be obtained by making the wavelengths different from each other. Can be controlled. Thereby, the flying body 10 can obtain a relative positional relationship with respect to the base station 50b based on the guide light.
  • FIG. 14A is a diagram showing a functional configuration of the flying object 10c in the third embodiment.
  • the flying object 10c of the third embodiment is different from the structure of the flying object 10b of the second embodiment in the filter of the omnidirectional distance measuring device. That is, in the third embodiment, as in the first embodiment, the filter 193 has a characteristic of transmitting light of wavelength A.
  • FIG. 14B is a diagram illustrating the configuration of the base station 50c according to the third embodiment.
  • the light source unit 51b outputs guide light (laser light) having a wavelength different from the wavelength of the distance measuring light.
  • the light source unit 51c according to the present embodiment outputs guide light (laser light) having the same wavelength as the distance measuring light (that is, wavelength A).
  • FIG. 15 is a flowchart showing processing of the flying object control system 100 according to the third embodiment. The operation of the flying object control system 100 according to the third embodiment will be described with reference to the flowchart of FIG.
  • the base station 50c irradiates guide light having a wavelength A from the light source unit 51c (S31). While the guide light is emitted from the light source unit 51c, as shown in FIG. 16, the flying object 10 stops the irradiation of the distance measuring light.
  • the distance measuring device 19c takes a wide-angle image of the measurement target space, and generates image data of an image (image A) based on the received light of wavelength A (S32).
  • the controller 16 detects the position of the guide light (that is, the light source unit 51) from the image A (S33). Further, the controller 16 detects the azimuth of the base station 50c from the position of the guide light detected on the image A (S34).
  • the ranging device 19c of the flying object 10 irradiates laser light (ranging light) having a wavelength A at a wide angle (S35). While the laser beam (ranging beam) is emitted from the distance measuring device 19c, the base station 50c stops the irradiation of the guide beam as shown in FIG. Then, the distance measuring device 19 performs wide-angle imaging of the measurement target space, generates image data of the image A based on the received light of wavelength A, and generates image data indicating the distance image based on the image data of the image A ( S36). In this manner, the irradiation timing of the ranging light from the flying object 10 is different from the irradiation timing of the guide light from the base station 50c (see FIG. 16). Thereby, even when the same wavelength is used for the distance measuring light and the guide light, it is possible to perform desired control based on each light without interfering with each other.
  • the controller 16 of the flying object 10 reaches the base station 50c (that is, the guide light, the light source 51, or the reflector 52) based on the direction of the base station 50c obtained in step S34 and the position of the guide light obtained in step S33. Is measured (S37).
  • the controller 16 obtains a relative positional relationship (position and orientation) with respect to the base station 50c based on the orientation of the base station 50c and the distance to the base station 50c obtained as described above (S38).
  • the flying object 10 and the base station 50 are: It is necessary to accurately synchronize the time managed by them in advance.
  • each of the flying object 10 and the base station 50 exclusively uses wavelength A light (ranging light or guide light) at a predetermined timing (see FIG. 16) so that the light irradiation timings do not overlap each other. Irradiate.
  • the base station 50 and the flying object 10 may communicate to control each other's irradiation timing exclusively.
  • the other device when one device of the flying object 10 and the base station 50 stops emitting the light of the wavelength A (ranging light or guide light), the other device may be notified to that effect.
  • the other device receives the notification of the stop of irradiation from the one device, the other device may irradiate light of wavelength A for a certain period of time.
  • the guide light and the distance measurement light are emitted exclusively by controlling the timing of the guide light irradiation and the distance measurement light irradiation, so that the guide light and the distance measurement light have the same wavelength.
  • Light can be distinguished and detected. Therefore, the flying object 10 can obtain the relative positional relationship with respect to the base station 50c based on the guide light even if the wavelengths of the guide light and the distance measuring light are the same.
  • Embodiments 1 to 3 have been described as examples of the technology disclosed in the present application.
  • the technology in the present disclosure is not limited to this, and can also be applied to an embodiment in which changes, replacements, additions, omissions, and the like are appropriately performed.
  • the configuration of the omnidirectional distance measuring device in the above embodiment is not limited to that described above. Other configurations can be applied to the omnidirectional distance measuring device as long as the distance to the object can be measured. For example, a configuration in which a distance to an object is measured using a stereo camera can be applied.
  • the flying object 10 and the base station 50 perform wireless communication has been described.
  • the flying object 10 and the base station 50 may be connected by wire to perform communication by wired communication. .
  • the first camera 21 is mounted upward with respect to the flying object 10 so as to shoot a subject in the space above the flying object 10, but the orientation of the first camera 21 is this. It is not limited to.
  • the direction of the first camera 21 may be set as appropriate according to the part to be inspected and the structure of the inspection object.
  • the omnidirectional distance measuring device 19 is also attached to the flying object 10 so as to photograph the hemispheric space above the flying object 10 and generate a distance image.
  • the direction of the omnidirectional distance measuring device 19 is not limited to this.
  • the orientation of the omnidirectional distance measuring device 19 may be set as appropriate according to the part or structure to be inspected of the inspection object. For example, when inspecting the upper surface of the inspection object, the omnidirectional distance measuring device 19 may be attached to the flying object 10 so as to photograph a hemispheric space below the flying object 10 and generate a distance image.
  • the controller 16 and the control unit 195 of the flying object 10 and the controller 56 in the base station can be constituted by an electronic circuit such as a CPU, MPU, DSP, microcomputer, FPGA, ASIC or the like.
  • the control system of the present disclosure is useful for a flying object control system because it enables stable attitude control of the flying object even in a situation where a satellite positioning signal such as a GPS signal cannot be captured by an obstacle.

Landscapes

  • Engineering & Computer Science (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • Mechanical Engineering (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Automation & Control Theory (AREA)
  • Optical Radar Systems And Details Thereof (AREA)
  • Control Of Position, Course, Altitude, Or Attitude Of Moving Bodies (AREA)

Abstract

La présente invention concerne un système de commande (100) qui comprend un corps volant (10) et une station de base (50). La station de base est équipée d'une unité de source de lumière qui éclaire une lumière de guidage d'une longueur d'onde prédéterminée. Le corps volant comporte : une unité de propulsion qui génère une force de propulsion pour voler dans les airs ; une unité de mesure de distance qui mesure la distance entre le corps volant et un objet dans un espace prédéterminé autour du corps volant ; une unité d'imagerie qui capture une image de l'objet dans l'espace prédéterminé et génère des données d'image ; et un premier contrôleur qui commande le mouvement du corps volant. Le premier contrôleur détermine la relation de position relative du corps volant par rapport à la station de base sur la base de l'image de la lumière de guidage incluse dans les données d'image générées par l'unité d'imagerie et des informations provenant de l'unité de mesure de distance.
PCT/JP2016/004754 2016-02-10 2016-10-28 Corps volant et système de commande associé WO2017138049A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2016-023443 2016-02-10
JP2016023443 2016-02-10

Publications (1)

Publication Number Publication Date
WO2017138049A1 true WO2017138049A1 (fr) 2017-08-17

Family

ID=59562947

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2016/004754 WO2017138049A1 (fr) 2016-02-10 2016-10-28 Corps volant et système de commande associé

Country Status (1)

Country Link
WO (1) WO2017138049A1 (fr)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019193642A1 (fr) * 2018-04-03 2019-10-10 株式会社自律制御システム研究所 Dispositif de localisation et procédé de localisation pour véhicule aérien sans pilote
WO2019229887A1 (fr) * 2018-05-30 2019-12-05 マクセル株式会社 Appareil de caméra
JP2020019371A (ja) * 2018-08-01 2020-02-06 三菱ロジスネクスト株式会社 無人飛行体を用いた無人搬送システム
JP2020056627A (ja) * 2018-09-28 2020-04-09 株式会社リコー 撮像装置

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008070374A (ja) * 2007-09-25 2008-03-27 Fujifilm Corp 画像撮像装置及び距離測定方法
JP2011022062A (ja) * 2009-07-17 2011-02-03 Topcon Corp 位置測定方法及び位置測定装置
JP2016015628A (ja) * 2014-07-02 2016-01-28 三菱重工業株式会社 構造物の屋内監視システム及び方法

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008070374A (ja) * 2007-09-25 2008-03-27 Fujifilm Corp 画像撮像装置及び距離測定方法
JP2011022062A (ja) * 2009-07-17 2011-02-03 Topcon Corp 位置測定方法及び位置測定装置
JP2016015628A (ja) * 2014-07-02 2016-01-28 三菱重工業株式会社 構造物の屋内監視システム及び方法

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019193642A1 (fr) * 2018-04-03 2019-10-10 株式会社自律制御システム研究所 Dispositif de localisation et procédé de localisation pour véhicule aérien sans pilote
JPWO2019193642A1 (ja) * 2018-04-03 2021-04-30 株式会社自律制御システム研究所 無人航空機用の自己位置推定装置及び自己位置推定方法
WO2019229887A1 (fr) * 2018-05-30 2019-12-05 マクセル株式会社 Appareil de caméra
JPWO2019229887A1 (ja) * 2018-05-30 2021-07-26 マクセル株式会社 カメラ装置
JP7025539B2 (ja) 2018-05-30 2022-02-24 マクセル株式会社 カメラ装置
JP2020019371A (ja) * 2018-08-01 2020-02-06 三菱ロジスネクスト株式会社 無人飛行体を用いた無人搬送システム
JP2020056627A (ja) * 2018-09-28 2020-04-09 株式会社リコー 撮像装置

Similar Documents

Publication Publication Date Title
EP3187895B1 (fr) Système de radar de vol à résolution variable
JP6371988B2 (ja) 飛行体
JP6729561B2 (ja) 光照射装置および光照射システム
US11019322B2 (en) Estimation system and automobile
WO2017138049A1 (fr) Corps volant et système de commande associé
JP2023022237A (ja) 色によるパノラマｌｉｄａｒ結果の増強
KR20190004276A (ko) 다수의 무인 항공기들을 사용하는 이미징
US11237252B2 (en) Detection apparatus, detection system, detection method, and movable device
US10429508B2 (en) Distance measuring device, moving system, and distance measurement method
JP4928203B2 (ja) レーザエネルギおよび情報供給システム
US11999480B2 (en) Flight control system for unmanned aerial vehicle and topography measuring system
WO2021241534A1 (fr) Système de photographie aérienne et procédé associé
WO2019230604A1 (fr) Système d'inspection
US20190116309A1 (en) Overhead line image capturing system and overhead line image capturing method
EP3788451B1 (fr) Commande d'un véhicule à l'aide d'un laser situé à distance et d'une caméra embarquée
JP2017201757A (ja) 画像取得システム、画像取得方法、画像処理方法
JP2020185941A (ja) 無人航空機、点検方法および点検プログラム
KR20180027847A (ko) 무인비행체의 충전위치 탐지 장치
JP2023113608A (ja) 飛行体
JP2020191523A (ja) 無人移動体
JP2010133802A (ja) 海上監視・捜索方法
KR20200023927A (ko) 영상 처리 장치 및 영상 처리 방법
WO2018014252A1 (fr) Source lumineuse circulaire pour la détection d'obstacles
JP2017227516A (ja) 装置、移動体装置及び測距方法
KR102553469B1 (ko) 드론 위치 판단 장치 및 방법

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16889753

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16889753

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: JP