WO2018100744A1 - Control device, imaging device, moving body, determination method, and program - Google Patents
Control device, imaging device, moving body, determination method, and program Download PDFInfo
- Publication number
- WO2018100744A1 WO2018100744A1 PCT/JP2016/085978 JP2016085978W WO2018100744A1 WO 2018100744 A1 WO2018100744 A1 WO 2018100744A1 JP 2016085978 W JP2016085978 W JP 2016085978W WO 2018100744 A1 WO2018100744 A1 WO 2018100744A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- altitude
- scanning range
- width
- information
- imaging device
- Prior art date
Links
- 238000003384 imaging method Methods 0.000 title claims abstract description 117
- 238000000034 method Methods 0.000 title description 18
- 238000001514 detection method Methods 0.000 claims description 17
- 230000008859 change Effects 0.000 abstract description 6
- 238000012545 processing Methods 0.000 description 17
- 238000004891 communication Methods 0.000 description 13
- 230000007246 mechanism Effects 0.000 description 9
- 230000008569 process Effects 0.000 description 6
- 238000010586 diagram Methods 0.000 description 5
- 230000003287 optical effect Effects 0.000 description 5
- 230000005540 biological transmission Effects 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 230000010365 information processing Effects 0.000 description 3
- 238000003491 array Methods 0.000 description 2
- 238000011156 evaluation Methods 0.000 description 2
- 239000004519 grease Substances 0.000 description 2
- 238000005259 measurement Methods 0.000 description 2
- 230000001133 acceleration Effects 0.000 description 1
- 230000004913 activation Effects 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 1
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B64—AIRCRAFT; AVIATION; COSMONAUTICS
- B64U—UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
- B64U20/00—Constructional aspects of UAVs
- B64U20/80—Arrangement of on-board electronics, e.g. avionics systems or wiring
- B64U20/87—Mounting of imaging devices, e.g. mounting of gimbals
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B7/00—Mountings, adjusting means, or light-tight connections, for optical elements
- G02B7/02—Mountings, adjusting means, or light-tight connections, for optical elements for lenses
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B7/00—Mountings, adjusting means, or light-tight connections, for optical elements
- G02B7/28—Systems for automatic generation of focusing signals
- G02B7/36—Systems for automatic generation of focusing signals using image sharpness techniques, e.g. image processing techniques for generating autofocus signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B64—AIRCRAFT; AVIATION; COSMONAUTICS
- B64U—UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
- B64U10/00—Type of UAV
- B64U10/10—Rotorcrafts
- B64U10/13—Flying platforms
- B64U10/14—Flying platforms with four distinct rotor axes, e.g. quadcopters
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B64—AIRCRAFT; AVIATION; COSMONAUTICS
- B64U—UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
- B64U2101/00—UAVs specially adapted for particular uses or applications
- B64U2101/30—UAVs specially adapted for particular uses or applications for imaging, photography or videography
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B64—AIRCRAFT; AVIATION; COSMONAUTICS
- B64U—UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
- B64U30/00—Means for producing lift; Empennages; Arrangements thereof
- B64U30/20—Rotors; Rotor supports
Definitions
- the present invention relates to a control device, an imaging device, a moving body, a determination method, and a program.
- Patent Document 1 when the elapsed time from the power-on to the image input device is included in the time range corresponding to the fluctuation period of the ambient temperature of the distance measuring sensor, the elapsed time corresponds to the stable period of the ambient temperature. It is described that the scanning range of the focus lens in autofocus is set wider than that included in the time range. Patent Document 1 Japanese Patent No. 4226936
- the environment such as the ambient temperature of the imaging device may change. Such environmental changes may affect the movement of the focus lens of the imaging apparatus.
- the control device may include an acquisition unit that acquires altitude information of the imaging device.
- the control device may include a determination unit that determines a scanning range of the focus lens when determining the focus position of the imaging device based on the altitude information.
- the determining unit may determine the width of the scanning range based on the altitude information.
- the determination unit may determine the width of the scanning range as the first width when the height indicated by the height information is the first height.
- the determining unit may determine the width of the scanning range to a second width that is narrower than the first width.
- the determination unit may narrow the width of the scanning range when the altitude indicated by the altitude information is higher.
- the determining unit may determine the width of the scanning range as the first width.
- the determination unit may determine the width of the scanning range as the second width.
- the determining unit may determine the end on the closest end side of the scanning range to a position closer to the infinity end side.
- the determining unit may determine the end on the closest end side of the scanning range as the first position.
- the determining unit may determine the end on the closest end side of the scanning range as the second position on the infinity end side from the first position.
- the acquisition unit may acquire temperature information of the imaging device.
- the determination unit may determine the scanning range based on altitude information and temperature information.
- the determining unit may determine the width of the scanning range as the first width.
- the determining unit determines the width of the scanning range to be a third width that is narrower than the first width. It's okay.
- the control device may include a detection unit that detects an object existing within a predetermined range from the imaging device.
- the determination unit may determine the scanning range without using the altitude information.
- An imaging device may include the control device.
- the imaging device may include a focus lens.
- the imaging apparatus may include a control unit that controls the movement of the focus lens based on the scanning range determined by the determination unit.
- the moving body according to one embodiment of the present invention may move with the imaging device.
- the determination method may include a step of acquiring altitude information of the imaging device.
- the determination method may include a step of determining a scan range of the focus lens when determining the focus position of the imaging device based on the altitude information.
- the program may cause a computer to execute the step of acquiring altitude information of the imaging device.
- the program may cause the computer to execute a step of determining the scanning range of the focus lens when determining the focus position of the imaging device based on the altitude information.
- FIG. 1 Various embodiments of the present invention may be described with reference to flowcharts and block diagrams.
- the blocks in the flowcharts and block diagrams may represent (1) the stage of the process in which the operation is performed or (2) the “part” of the device responsible for performing the operation.
- Certain stages and “parts” are provided with dedicated circuitry, programmable circuitry supplied with computer readable instructions stored on a computer readable storage medium, and / or computer readable instructions stored on a computer readable storage medium. It may be implemented by a processor.
- Dedicated circuitry may include digital and / or analog hardware circuitry. Integrated circuits (ICs) and / or discrete circuits may be included.
- Programmable circuits may be logical products, logical sums, exclusive logical sums, negative logical products, negative logical sums, and other logical operations, such as field programmable gate arrays (FPGAs) and programmable logic arrays (PLA), for example. , Flip-flops, registers, and memory elements, including reconfigurable hardware circuitry.
- FPGAs field programmable gate arrays
- PLA programmable logic arrays
- a computer-readable storage medium may include any tangible device capable of storing instructions to be executed by a suitable device.
- a computer readable storage medium having instructions stored thereon comprises a product that includes instructions that can be executed to create a means for performing the operations specified in the flowcharts or block diagrams.
- Examples of computer readable storage media may include electronic storage media, magnetic storage media, optical storage media, electromagnetic storage media, semiconductor storage media, and the like. More specific examples of computer-readable storage media include floppy disks, diskettes, hard disks, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM or flash memory).
- EEPROM Electrically erasable programmable read only memory
- SRAM static random access memory
- CD-ROM compact disc read only memory
- DVD digital versatile disc
- Blu-ray registered trademark
- the computer readable instructions may include either source code or object code written in any combination of one or more programming languages.
- the source code or object code includes a conventional procedural programming language.
- Conventional procedural programming languages include assembler instructions, instruction set architecture (ISA) instructions, machine instructions, machine dependent instructions, microcode, firmware instructions, state setting data, or Smalltalk, JAVA, C ++, etc. It may be an object-oriented programming language and a “C” programming language or a similar programming language.
- Computer readable instructions may be directed to a general purpose computer, special purpose computer, or other programmable data processing device processor or programmable circuit locally or in a wide area network (WAN) such as a local area network (LAN), the Internet, etc. ).
- the processor or programmable circuit may execute computer readable instructions to create a means for performing the operations specified in the flowcharts or block diagrams. Examples of processors include computer processors, processing units, microprocessors, digital signal processors, controllers, microcontrollers, and the like.
- FIG. 1 shows an example of the appearance of an unmanned aerial vehicle (UAV) 100.
- the UAV 100 includes a UAV main body 102, a gimbal 200, an imaging device 300, and a plurality of imaging devices 230.
- the UAV 100 is an example of a moving object.
- the moving body is a concept including, in addition to UAV, other aircraft that moves in the air, vehicles that move on the ground, ships that move on the water, and the like.
- the gimbal 200 and the imaging device 300 are an example of an imaging system.
- the UAV main body 102 includes a plurality of rotor blades.
- the UAV main body 102 flies the UAV 100 by controlling the rotation of a plurality of rotor blades.
- the UAV main body 102 causes the UAV 100 to fly using four rotary wings.
- the number of rotor blades is not limited to four.
- the UAV 100 may be a fixed wing aircraft that does not have a rotating wing.
- the imaging device 300 is a camera for capturing a moving image or a still image.
- the plurality of imaging devices 230 are sensing cameras that image the surroundings of the UAV 100 in order to control the flight of the UAV 100.
- Two imaging devices 230 may be provided on the front surface that is the nose of the UAV 100.
- Two other imaging devices 230 may be provided on the bottom surface of the UAV 100.
- the two imaging devices 230 on the front side may be paired and function as a so-called stereo camera.
- the two imaging devices 230 on the bottom side may also be paired and function as a stereo camera.
- the distance from the UAV 100 to the object may be measured based on images captured by the plurality of imaging devices 230.
- Three-dimensional spatial data around the UAV 100 may be generated based on images captured by the plurality of imaging devices 230.
- the number of imaging devices 230 included in the UAV 100 is not limited to four.
- the UAV 100 only needs to include at least one imaging device 230.
- the UAV 100 may include at least one imaging device 230 on each of the nose, the tail, the side surface, the bottom surface, and the ceiling surface of the UAV 100.
- the angle of view that can be set by the imaging device 230 may be wider than the angle of view that can be set by the imaging device 300.
- the imaging device 230 may have a single focus lens or a fisheye lens.
- the imaging device 300 mounted on the UAV 100 configured as described above images a target at various altitudes.
- the temperature of the imaging device 300 may change.
- the hardness of the grease used to drive the focus lens of the imaging device 300 may change.
- the imaging apparatus 300 adjusts the altitude of the UAV 100, that is, the focus lens scanning range when determining the focus position of the imaging apparatus 300 according to the altitude of the imaging apparatus 300. For example, when the altitude is higher, the width of the scanning range is made narrower. This prevents the time for determining the focus position from increasing as the altitude increases.
- FIG. 2 shows an example of functional blocks of the UAV100.
- the UAV 100 includes a UAV control unit 110, a communication interface 150, a memory 160, a gimbal 200, a rotating blade mechanism 210, an imaging device 300, an imaging device 230, a GPS receiver 240, an inertial measurement device (IMU) 250, a magnetic compass 260, and an atmospheric pressure.
- An altimeter 270 is provided.
- the communication interface 150 communicates with an external transmitter.
- the communication interface 150 receives various commands for the UAV control unit 110 from a remote transmitter.
- the memory 160 stores programs necessary for the UAV control unit 110 to control the gimbal 200, the rotary blade mechanism 210, the imaging device 300, the imaging device 230, the GPS receiver 240, the IMU 250, the magnetic compass 260, and the barometric altimeter 270.
- the memory 160 may be a computer-readable recording medium and may include at least one of flash memory such as SRAM, DRAM, EPROM, EEPROM, and USB memory.
- the memory 160 may be provided inside the UAV main body 102. It may be provided so as to be removable from the UAV main body 102.
- the gimbal 200 supports the imaging direction of the imaging device 300 so that it can be adjusted.
- the gimbal 200 supports the imaging device 300 rotatably around at least one axis.
- the gimbal 200 is an example of a support mechanism.
- the gimbal 200 may support the imaging device 300 rotatably about the yaw axis, the pitch axis, and the roll axis.
- the gimbal 200 may change the imaging direction of the imaging device 300 by rotating the imaging device 300 about at least one of the yaw axis, the pitch axis, and the roll axis.
- the rotary blade mechanism 210 includes a plurality of rotary blades and a plurality of drive motors that rotate the plurality of rotary blades.
- the imaging device 230 captures the surroundings of the UAV 100 and generates image data. Image data of the imaging device 230 is stored in the memory 160.
- the GPS receiver 240 receives a plurality of signals indicating times transmitted from a plurality of GPS satellites. The GPS receiver 240 calculates the position of the GPS receiver 240, that is, the position of the UAV 100, based on the received signals.
- the inertial measurement device (IMU) 250 detects the posture of the UAV 100.
- the IMU 250 detects, as the posture of the UAV 100, acceleration in the three axial directions of the front, rear, left, and upper sides of the UAV 100, and angular velocity in the three axial directions of pitch, roll, and yaw.
- the magnetic compass 260 detects the heading of the UAV 100.
- the barometric altimeter 270 detects the altitude at which the UAV 100 flies.
- the UAV control unit 110 controls the flight of the UAV 100 in accordance with a program stored in the memory 160.
- the UAV control unit 110 may be configured by a microprocessor such as a CPU or MPU, a microcontroller such as an MCU, or the like.
- the UAV control unit 110 controls the flight of the UAV 100 according to a command received from a remote transmitter via the communication interface 150.
- the UAV control unit 110 may specify the environment around the UAV 100 by analyzing a plurality of images captured by the plurality of imaging devices 230.
- the UAV control unit 110 controls the flight while avoiding obstacles based on the environment around the UAV 100, for example.
- the UAV control unit 110 may generate three-dimensional spatial data around the UAV 100 based on a plurality of images captured by the plurality of imaging devices 230, and control the flight based on the three-dimensional spatial data.
- the UAV control unit 110 may measure the distance between the UAV 100 and the object by a triangulation method based on a plurality of images captured by the plurality of imaging devices 230.
- the UAV control unit 110 may measure the distance between the UAV 100 and the object using an ultrasonic sensor, an infrared sensor, a radar sensor, or the like.
- the imaging apparatus 300 includes an imaging control unit 310, a lens control unit 320, a lens moving mechanism 322, a lens position detection unit 324, a plurality of lenses 326, an imaging element 330, a temperature sensor 332, and a memory 340.
- the imaging control unit 310 may be configured by a microprocessor such as a CPU or MPU, a microcontroller such as an MCU, or the like.
- the imaging control unit 310 may control the imaging device 300 in accordance with an operation command for the imaging device 300 from the UAV control unit 110.
- the imaging control unit 310 is an example of a control device.
- the memory 340 may be a computer readable recording medium and may include at least one of flash memory such as SRAM, DRAM, EPROM, EEPROM, and USB memory.
- the memory 340 may be provided inside the housing of the imaging device 300.
- the memory 340 may be provided so as to be removable from the housing of the imaging apparatus 300.
- the plurality of lenses 326 includes a zoom lens and a focus lens.
- the lens 326 of the imaging device 300 may be a lens unit that can be detached from the imaging device 300.
- a lens 326, a lens controller 320, a lens position detector 324, and a temperature sensor 332 are mounted on the lens unit.
- the imaging device 330 may be configured by a CCD or a CMOS.
- the image pickup device 330 is held inside the housing of the image pickup apparatus 300, and outputs image data of an optical image formed through the plurality of lenses 326 to the image pickup control unit 310.
- the temperature sensor 332 detects the temperature of the imaging device 300.
- the temperature sensor 332 may be provided in the imaging device 300 or may be provided outside the imaging device 300.
- the temperature sensor 332 may be provided in the UAV main body 102.
- the lens control unit 320 controls the movement of the plurality of lenses 326 via the lens moving mechanism 322. Some or all of the plurality of lenses 326 are moved along the optical axis by the lens moving mechanism 322.
- the lens control unit 320 moves at least one of the plurality of lenses 326 along the optical axis in accordance with a lens operation command from the imaging control unit 310.
- the lens control unit 320 executes at least one of a zoom operation and a focus operation by moving at least one of the plurality of lenses 326 along the optical axis.
- the lens control unit 320 moves the focus lens within the scanning range designated by the imaging control unit 310 and executes an autofocus operation.
- the lens position detection unit 324 detects the position of each of the plurality of lenses 326.
- the lens position detection unit 324 detects the current zoom position and focus position.
- the imaging control unit 310 performs a series of image processing such as noise reduction, demosaicing, gamma correction, and edge cooperation on the image data.
- the imaging control unit 310 stores image data after a series of image processing in the memory 340.
- the imaging control unit 310 may output and store the image data in the memory 160 via the UAV control unit 110.
- the imaging control unit 310 performs an autofocus operation using the image data.
- the imaging control unit 310 includes an acquisition unit 312, a determination unit 314, an AF processing unit 316, a lens position management unit 318, and a detection unit 319.
- the acquisition unit 312 acquires altitude information of the imaging device 300.
- the acquisition unit 312 may acquire the altitude information of the UAV 100 from the UAV control unit 110 as the altitude information of the imaging apparatus 300.
- the acquisition unit 312 may acquire temperature information of the imaging apparatus 300.
- the acquisition unit 312 may acquire temperature information of the imaging device 300 from the temperature sensor 332.
- the determining unit 314 determines the scanning range of the focus lens when determining the focus position of the imaging apparatus 300 based on the altitude information.
- the scan range has two ends. One end is located at the end on the infinity end side of the scanning range. The other end is located at the closest end of the scanning range.
- the end on the infinity end side may be a control end on the infinity end side of the scanning range.
- the end on the close end side may be a control end on the close end side of the scanning range.
- the determination unit 314 may determine the width of the scanning range based on the altitude information. When the altitude indicated by the altitude information is the first altitude, the determination unit 314 may determine the width of the scanning range as the first width.
- the determination unit 314 may determine the width of the scanning range as a second width that is narrower than the first width.
- the determination unit 314 may narrow the width of the scanning range when the altitude indicated by the altitude information is higher.
- the determination unit 314 may determine the end on the closest end side of the scanning range to a position closer to the infinity end side.
- the determining unit 314 may determine the end on the closest end side of the scanning range as the first position.
- the determination unit 314 may determine the end on the closest end side of the scanning range as the second position on the infinity end side from the first position.
- the scanning range determined by the determination unit 314 is not limited to the above.
- the determination unit 314 is configured so that the width of the scanning range centered on a predetermined focus position between the infinity end and the close end becomes narrower when the altitude indicated by the altitude information is higher.
- the scan range may be determined.
- the determination unit 314 may determine the width of the scanning range as the width 10 when the altitude is 50 [m].
- the determination unit 314 may determine the width of the scanning range to be a width 12 narrower than the width 10 when the altitude is 150 [m].
- the determination unit 314 may determine the end on the closest end side of the scanning range as the position 14.
- the determination unit 314 may determine the end portion on the closest end side of the scanning range as the position 16 on the infinity end side from the position 14.
- the determination unit 314 may determine the width of the scanning range as the first width.
- the determination unit 314 may determine the width of the scanning range as the second width. For example, as illustrated in FIG. 4, the determination unit 314 may determine the width of the scanning range as the width 20 when the altitude is 20 [m] or less. When the altitude is higher than 20 [m], the determination unit 314 may determine the width of the scanning range as a width 22 narrower than the width 20.
- the determination unit 314 may determine the scanning range based on altitude information and temperature information.
- the determining unit 314 may determine the width of the scanning range as the first width.
- the determining unit 314 determines the width of the scanning range as the third width narrower than the first width. You can do it.
- the determination unit 314 may determine the width of the scanning range as the width 30 when the altitude is 100 [m] and the temperature is T1 [° C.].
- the determination unit 314 may determine the width of the scanning range as a width 32 narrower than the width 30.
- the AF processing unit 316 determines the focus position of the focus lens according to the contrast AF method.
- the AF processing unit 316 may determine the focus position by moving the focus lens from the end on the infinity end side to the end on the close end side of the scanning range.
- the AF processing unit 316 sequentially derives the contrast evaluation values from the image data output from the image sensor 330 while moving the focus lens through the lens control unit 320 within the scanning range determined by the determination unit 314. To do.
- the AF processing unit 316 determines the position of the focus lens when the contrast evaluation value is the highest as the focus position.
- the lens position management unit 318 manages the position information of the plurality of lenses 326 provided from the lens position detection unit 324.
- the lens position management unit 318 may register the current zoom position and the current focus position provided from the lens position detection unit 324 in the memory 340.
- the scanning range of the focus lens when determining the focus position of the imaging device 300 is determined according to the altitude of the imaging device 300. Thereby, it is possible to prevent the time for determining the focus position from increasing as the altitude increases.
- the imaging apparatus 300 images an object existing on the ground while the UAV 100 is flying.
- the scanning range of the focus lens is limited to the far end side and the scanning range is narrowed.
- the object imaged by the imaging device 300 may exist at an altitude similar to the altitude of the UAV 100 in flight.
- the scanning range of the focus lens is limited to the far end side, the focus position may not be set appropriately.
- the focus position may not be set appropriately.
- the detection unit 319 detects an object existing within a predetermined range from the imaging device 300.
- the detection unit 319 may acquire distance information indicating the distance between the UAV 100 and the object from the UAV control unit 110.
- the detection unit 319 may detect whether or not the distance indicated by the distance information is included in a predetermined range.
- the predetermined range may be a range set in advance to prevent the UAV 100 from colliding with an obstacle.
- the predetermined range may be set by the user.
- the predetermined range may be set according to the flight mode of the UAV 100. If an object exists in a predetermined range, the UAV 100 changes, for example, the flight path in order to prevent a collision with the object.
- the determination unit 314 may determine the scanning range without using altitude information.
- the determination unit 314 may determine the initial scan range as the scan range without using the altitude information.
- the determination unit 314 may determine the entire range from the infinity end to the closest end as the scanning range without using altitude information.
- FIG. 6 is a flowchart illustrating an example of a procedure in which the imaging control unit 310 determines the scanning range of the focus lens.
- the detection unit 319 determines whether or not an object exists within a predetermined range from the imaging device 300 (S100). When such an object exists, the determination unit 314 determines the initial scan range as the focus lens scan range without using altitude information (S102).
- the acquisition unit 312 acquires the altitude information of the UAV 100 provided from the UAV control unit 110 as the altitude information of the imaging apparatus 300 (S104).
- the determination unit 314 determines the scan range of the focus lens based on the altitude information, for example, according to the relationship between the altitude and the scan range as shown in FIG. 3 or FIG. 4 (S106).
- the AF processing unit 316 performs autofocus processing by the contrast AF method within the scanning range determined by the determination unit 314.
- FIG. 7 illustrates an example of a computer 1200 in which aspects of the present invention may be embodied in whole or in part.
- a program installed in the computer 1200 can cause the computer 1200 to function as an operation associated with the apparatus according to the embodiment of the present invention or as one or more “units” of the apparatus.
- the program can cause the computer 1200 to execute the operation or the one or more “units”.
- the program can cause the computer 1200 to execute a process according to an embodiment of the present invention or a stage of the process.
- Such a program may be executed by CPU 1212 to cause computer 1200 to perform certain operations associated with some or all of the blocks in the flowcharts and block diagrams described herein.
- the computer 1200 includes a CPU 1212 and a RAM 1214, which are connected to each other by a host controller 1210.
- the computer 1200 also includes a communication interface 1222 and an input / output unit, which are connected to the host controller 1210 via the input / output controller 1220.
- Computer 1200 also includes ROM 1230.
- the CPU 1212 operates according to programs stored in the ROM 1230 and the RAM 1214, thereby controlling each unit.
- the communication interface 1222 communicates with other electronic devices via a network.
- a hard disk drive may store programs and data used by CPU 1212 in computer 1200.
- the ROM 1230 stores therein a boot program executed by the computer 1200 at the time of activation and / or a program depending on the hardware of the computer 1200.
- the program is provided via a computer-readable recording medium such as a CR-ROM, a USB memory, or an IC card or a network.
- the program is installed in the RAM 1214 or the ROM 1230 that is also an example of a computer-readable recording medium, and is executed by the CPU 1212.
- Information processing described in these programs is read by the computer 1200 to bring about cooperation between the programs and the various types of hardware resources.
- An apparatus or method may be configured by implementing information operations or processing in accordance with the use of computer 1200.
- the CPU 1212 executes a communication program loaded in the RAM 1214 and performs communication processing on the communication interface 1222 based on the processing described in the communication program. You may order.
- the communication interface 1222 reads transmission data stored in a RAM 1214 or a transmission buffer area provided in a recording medium such as a USB memory under the control of the CPU 1212 and transmits the read transmission data to a network, or The reception data received from the network is written into a reception buffer area provided on the recording medium.
- the CPU 1212 allows the RAM 1214 to read all or necessary portions of a file or database stored in an external recording medium such as a USB memory, and executes various types of processing on the data on the RAM 1214. Good. The CPU 1212 may then write back the processed data to an external recording medium.
- the CPU 1212 describes various types of operations, information processing, conditional judgment, conditional branching, unconditional branching, and information retrieval that are described throughout the present disclosure for data read from the RAM 1214 and specified by the instruction sequence of the program. Various types of processing may be performed, including / replacement, etc., and the result is written back to RAM 1214.
- the CPU 1212 may search for information in files, databases, etc. in the recording medium. For example, when a plurality of entries each having an attribute value of the first attribute associated with the attribute value of the second attribute are stored in the recording medium, the CPU 1212 specifies the attribute value of the first attribute. The entry that matches the condition is searched from the plurality of entries, the attribute value of the second attribute stored in the entry is read, and thereby the first attribute that satisfies the predetermined condition is associated. The attribute value of the obtained second attribute may be acquired.
- the program or software module described above may be stored in a computer-readable storage medium on the computer 1200 or in the vicinity of the computer 1200.
- a recording medium such as a hard disk or a RAM provided in a server system connected to a dedicated communication network or the Internet can be used as a computer-readable storage medium, whereby the program is transferred to the computer 1200 via the network.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Remote Sensing (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Microelectronics & Electronic Packaging (AREA)
- Mechanical Engineering (AREA)
- Aviation & Aerospace Engineering (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Studio Devices (AREA)
- Lens Barrels (AREA)
- Camera Bodies And Camera Details Or Accessories (AREA)
- Automatic Focus Adjustment (AREA)
Abstract
Description
特許文献1 特許第4226936号公報 In
102 UAV本体
110 UAV制御部
150 通信インタフェース
160 メモリ
200 ジンバル
210 回転翼機構
230 撮像装置
240 GPS受信機
260 磁気コンパス
270 気圧高度計
300 撮像装置
310 撮像制御部
312 取得部
314 決定部
316 AF処理部
318 レンズ位置管理部
319 検出部
320 レンズ制御部
322 レンズ移動機構
324 レンズ位置検出部
326 レンズ
330 撮像素子
332 温度センサ
340 メモリ
1200 コンピュータ
1210 ホストコントローラ
1212 CPU
1214 RAM
1220 入力/出力コントローラ
1222 通信インタフェース
1230 ROM 100 UAV
102 UAV
1214 RAM
1220 Input /
Claims (14)
- 撮像装置の高度情報を取得する取得部と、
前記高度情報に基づいて、前記撮像装置のフォーカス位置を決定する場合のフォーカスレンズの走査範囲を決定する決定部と
を備える制御装置。 An acquisition unit for acquiring altitude information of the imaging device;
And a determining unit that determines a scanning range of the focus lens when determining a focus position of the imaging device based on the altitude information. - 前記決定部は、前記高度情報に基づいて前記走査範囲の幅を決定する、請求項1に記載の制御装置。 The control device according to claim 1, wherein the determination unit determines a width of the scanning range based on the altitude information.
- 前記決定部は、前記高度情報で示される高度が第1高度の場合、前記走査範囲の幅を第1幅に決定し、前記高度情報で示される高度が前記第1高度より高い第2高度の場合、前記走査範囲の幅を前記第1幅より狭い第2幅に決定する、請求項2に記載の制御装置。 When the altitude indicated by the altitude information is a first altitude, the determining unit determines the width of the scanning range as a first width, and the altitude indicated by the altitude information is a second altitude higher than the first altitude. 3. The control device according to claim 2, wherein a width of the scanning range is determined to be a second width narrower than the first width.
- 前記決定部は、前記高度情報で示される高度がより高い場合に、前記走査範囲の幅をより狭くする、請求項3に記載の制御装置。 The control device according to claim 3, wherein the determination unit narrows the width of the scanning range when the altitude indicated by the altitude information is higher.
- 前記決定部は、前記高度情報で示される高度が前記第1高度を含む第1高度範囲にある場合、前記走査範囲の幅を前記第1幅に決定し、前記高度情報で示される高度が前記第2高度を含む第2高度範囲にある場合、前記走査範囲の幅を前記第2幅に決定する、請求項3に記載の制御装置。 When the altitude indicated by the altitude information is in a first altitude range including the first altitude, the determining unit determines the width of the scanning range as the first width, and the altitude indicated by the altitude information is 4. The control device according to claim 3, wherein a width of the scanning range is determined as the second width when the second height range includes a second height. 5.
- 前記決定部は、前記高度情報で示される高度がより高い場合に、前記走査範囲の至近端側の端部をより無限遠端側に近い位置に決定する、請求項3に記載の制御装置。 4. The control device according to claim 3, wherein the determination unit determines an end on the closest end side of the scanning range to a position closer to an infinite end side when the altitude indicated by the altitude information is higher. .
- 前記決定部は、前記高度情報で示される高度が前記第1高度の場合、前記走査範囲の至近端側の端部を第1位置に決定し、前記高度情報で示される高度が前記第2高度の場合、前記走査範囲の至近端側の端部を前記第1位置より無限遠端側の第2位置に決定する、請求項3に記載の制御装置。 When the altitude indicated by the altitude information is the first altitude, the determining unit determines the end on the closest end side of the scanning range as the first position, and the altitude indicated by the altitude information is the second altitude. 4. The control device according to claim 3, wherein in the case of altitude, an end portion on the closest end side of the scanning range is determined to be a second position on the infinity end side from the first position.
- 前記取得部は、前記撮像装置の温度情報をさらに取得し、
前記決定部は、前記高度情報および前記温度情報に基づいて、前記走査範囲を決定する、請求項1に記載の制御装置。 The acquisition unit further acquires temperature information of the imaging device,
The control device according to claim 1, wherein the determination unit determines the scanning range based on the altitude information and the temperature information. - 前記決定部は、前記高度情報で示される高度が第1高度で、前記温度情報で示される温度が第1温度の場合、前記走査範囲の幅を第1幅に決定し、前記高度情報で示される高度が前記第1高度で、前記温度情報で示される温度が前記第1温度より低い第2温度の場合、前記走査範囲の幅を前記第1幅より狭い第3幅に決定する、請求項8に記載の制御装置。 When the altitude indicated by the altitude information is the first altitude and the temperature indicated by the temperature information is the first temperature, the determining unit determines the width of the scanning range as the first width and indicates the altitude information. The scanning range is determined to be a third width narrower than the first width when the altitude to be measured is the first altitude and the temperature indicated by the temperature information is a second temperature lower than the first temperature. 8. The control device according to 8.
- 前記撮像装置から予め定められた範囲内に存在する対象物を検出する検出部をさらに備え、
前記検出部が前記対象物を検出した場合、前記決定部は、前記高度情報を用いずに、前記走査範囲を決定する、請求項1に記載の制御装置。 A detection unit for detecting an object existing within a predetermined range from the imaging device;
The control device according to claim 1, wherein when the detection unit detects the object, the determination unit determines the scanning range without using the altitude information. - 請求項1から10の何れか1つに記載の制御装置と、
前記フォーカスレンズと
前記決定部により決定された前記走査範囲に基づいてフォーカスレンズの移動を制御する制御部と
を備える撮像装置。 A control device according to any one of claims 1 to 10,
An imaging apparatus comprising: the focus lens; and a control unit that controls movement of the focus lens based on the scanning range determined by the determination unit. - 請求項11に記載の撮像装置を備えて移動する移動体。 A moving body that moves with the imaging device according to claim 11.
- 撮像装置の高度情報を取得する段階と、
前記高度情報に基づいて、前記撮像装置のフォーカス位置を決定する場合のフォーカスレンズの走査範囲を決定する段階と
を備える決定方法。 Acquiring altitude information of the imaging device;
Determining a focus lens scanning range when determining a focus position of the imaging device based on the altitude information. - 撮像装置の高度情報を取得する段階と、
前記高度情報に基づいて、前記撮像装置のフォーカス位置を決定する場合のフォーカスレンズの走査範囲を決定する段階と
をコンピュータに実行させるためのプログラム。 Acquiring altitude information of the imaging device;
A program for causing a computer to execute a step of determining a scanning range of a focus lens when determining a focus position of the imaging device based on the altitude information.
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/JP2016/085978 WO2018100744A1 (en) | 2016-12-02 | 2016-12-02 | Control device, imaging device, moving body, determination method, and program |
JP2017559737A JP6543879B2 (en) | 2016-12-02 | 2016-12-02 | Unmanned aerial vehicles, decision methods and programs |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/JP2016/085978 WO2018100744A1 (en) | 2016-12-02 | 2016-12-02 | Control device, imaging device, moving body, determination method, and program |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2018100744A1 true WO2018100744A1 (en) | 2018-06-07 |
Family
ID=62241453
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2016/085978 WO2018100744A1 (en) | 2016-12-02 | 2016-12-02 | Control device, imaging device, moving body, determination method, and program |
Country Status (2)
Country | Link |
---|---|
JP (1) | JP6543879B2 (en) |
WO (1) | WO2018100744A1 (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2020052220A (en) * | 2018-09-26 | 2020-04-02 | エスゼット ディージェイアイ テクノロジー カンパニー リミテッドSz Dji Technology Co.,Ltd | Controller, imaging device, mobile body, method for control, and program |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2006154524A (en) * | 2004-11-30 | 2006-06-15 | Fuji Photo Film Co Ltd | Imaging apparatus and focusing position searching method |
JP2006317593A (en) * | 2005-05-11 | 2006-11-24 | Fuji Photo Film Co Ltd | Imaging apparatus |
Family Cites Families (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2006270457A (en) * | 2005-03-23 | 2006-10-05 | Nec Saitama Ltd | Power-off system, method, and program for mobile terminal equipment |
JP2008065193A (en) * | 2006-09-08 | 2008-03-21 | Canon Inc | Imaging apparatus and focus control method |
-
2016
- 2016-12-02 JP JP2017559737A patent/JP6543879B2/en not_active Expired - Fee Related
- 2016-12-02 WO PCT/JP2016/085978 patent/WO2018100744A1/en active Application Filing
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2006154524A (en) * | 2004-11-30 | 2006-06-15 | Fuji Photo Film Co Ltd | Imaging apparatus and focusing position searching method |
JP2006317593A (en) * | 2005-05-11 | 2006-11-24 | Fuji Photo Film Co Ltd | Imaging apparatus |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2020052220A (en) * | 2018-09-26 | 2020-04-02 | エスゼット ディージェイアイ テクノロジー カンパニー リミテッドSz Dji Technology Co.,Ltd | Controller, imaging device, mobile body, method for control, and program |
Also Published As
Publication number | Publication date |
---|---|
JPWO2018100744A1 (en) | 2018-12-06 |
JP6543879B2 (en) | 2019-07-17 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP6496955B1 (en) | Control device, system, control method, and program | |
US20190258255A1 (en) | Control device, imaging system, movable object, control method, and program | |
WO2019238044A1 (en) | Determination device, mobile object, determination method and program | |
US20210014427A1 (en) | Control device, imaging device, mobile object, control method and program | |
JP6384000B1 (en) | Control device, imaging device, imaging system, moving object, control method, and program | |
JP2020012878A (en) | Controller, moving object, control method, and program | |
JP6565072B2 (en) | Control device, lens device, flying object, control method, and program | |
US11363195B2 (en) | Control device, imaging device, imaging system, movable object, control method, and program | |
JP6587006B2 (en) | Moving body detection device, control device, moving body, moving body detection method, and program | |
JP6651693B2 (en) | Control device, moving object, control method, and program | |
WO2018100744A1 (en) | Control device, imaging device, moving body, determination method, and program | |
JP6515423B2 (en) | CONTROL DEVICE, MOBILE OBJECT, CONTROL METHOD, AND PROGRAM | |
JP6481228B1 (en) | Determination device, control device, imaging system, flying object, determination method, and program | |
WO2018109847A1 (en) | Control device, imaging device, mobile body, control method, and program | |
WO2018185940A1 (en) | Imaging control device, imaging device, imaging system, mobile body, imaging control method and program | |
WO2018116417A1 (en) | Control device, imaging device, moving body, control method, and program | |
JP6668570B2 (en) | Control device, imaging device, moving object, control method, and program | |
JP6746856B2 (en) | Control device, imaging system, moving body, control method, and program | |
JP2020016703A (en) | Control device, moving body, control method, and program | |
JP6413170B1 (en) | Determination apparatus, imaging apparatus, imaging system, moving object, determination method, and program | |
JP6696094B2 (en) | Mobile object, control method, and program | |
JP6409239B1 (en) | Imaging apparatus, imaging system, flying object, recording method, and program | |
WO2019085794A1 (en) | Control device, camera device, flight body, control method and program |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
ENP | Entry into the national phase |
Ref document number: 2017559737 Country of ref document: JP Kind code of ref document: A |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 16923089 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 09/09/2019) |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 16923089 Country of ref document: EP Kind code of ref document: A1 |