JP2022049370A - Control device, imaging device, control method, and program - Google Patents

Abstract

To provide a control device that reduces the adverse effects of strong light such as sunlight on an optical filter or an image sensor.SOLUTION: In a control device that controls an imaging device with an image sensor and an N-layer (N is an integer greater than or equal to 2) optical filter that is located on the front side of the image sensor and is insertable or retractable with respect to an optical path, in a case in which a circuit that controls the insertion or withdrawal of the N-layer optical filter into or out of the optical path detects an instruction to turn off a power supply of the imaging device, when the optical filter of the layer of N-1 or lower is inserted into the optical path, the optical filter with more layers than N-1 are inserted into the optical path.SELECTED DRAWING: Figure 5

Description

The present invention relates to a control device, an image pickup device, a control method, and a program.

Patent Document 1 describes that "filters 109 having different light transmittances are arranged between the interchangeable lens 2 and the sensor 41 at different positions in the optical axis C0 direction".
[Prior Art Document]
[Patent Document]
[Patent Document 1] Japanese Unexamined Patent Publication No. 2013-92664

Strong light, such as sunlight, can adversely affect the optical filter or image sensor.

The control device according to one aspect of the present invention includes an image sensor and an N-layer (N is an integer of 2 or more) optical filters arranged on the front side of the image sensor and inserted or retracted with respect to an optical path. It may be a control device for controlling an image pickup device including. The control device may include a circuit configured to control the insertion or evacuation of the N-layer optical filter into or out of each optical path. The circuit is configured to insert an optical filter with a layer more than N-1 into the optical path when an optical filter with a layer below N-1 is inserted in the optical path when it detects an instruction to turn off the power of the image pickup device. May be done.

The N-layer optical filters include a first optical filter with a first dimming rate, a second optical filter with a second dimming rate higher than the first dimming rate, and a third dimming rate higher than the second dimming rate. 3rd optical filter and a 4th optical filter having a 4th dimming rate higher than the 3rd dimming rate may be included. When the circuit detects an instruction to turn off the power of the image pickup device while the fourth optical filter is inserted in the optical path, the circuit inserts at least one of the first optical filter and the second optical filter into the optical path, and then the image pickup device. May be configured to power off.

The second optical filter may be arranged closer to the image sensor than the first optical filter. The third optical filter may be arranged on the image sensor side of the second optical filter. The fourth optical filter may be inserted into the optical path in the same layer as the third optical filter by replacing the third optical filter.

When the circuit detects an instruction to turn off the power of the image pickup device while the fourth optical filter is inserted in the optical path, the circuit retracts the fourth optical filter from the optical path, and causes the first optical filter, the second optical filter, and the second optical filter. After inserting the third optical filter into the optical path, it may be configured to turn off the power of the image pickup apparatus.

The N-layer optical filters include a first optical filter with a first dimming rate, a second optical filter with a second dimming rate higher than the first dimming rate, and a third dimming rate higher than the second dimming rate. 3rd optical filter and the like may be included. When the circuit detects an instruction to turn off the power of the image pickup apparatus while the third optical filter is inserted in the optical path, the circuit retracts the third optical filter from the optical path and at least the first optical filter and the second optical filter. It may be configured to turn off the power of the image pickup device after inserting one into the optical path.

The control device according to one aspect of the present invention includes an image sensor and an N-layer (N is an integer of 2 or more) optical filters arranged on the front side of the image sensor and inserted or retracted with respect to an optical path. It may be a control device for controlling an image pickup device including. The control device may include a circuit configured to control the insertion or evacuation of the N-layer optical filter into or out of each optical path. When the circuit receives an instruction to set the first set value indicating the first dimming rate, when the image pickup device is in the first image pickup mode, the M layer corresponding to the first set value (M is an integer of N or less). ) Is inserted, and when the image pickup device is in the second image pickup mode, the optical filter of the L layer smaller than M (L is an integer smaller than M) corresponding to the first set value is inserted. You can do it.

The N-layer filters include a first optical filter with a first dimming rate, a second optical filter with a second dimming rate higher than the first dimming rate, and a third dimming rate higher than the second dimming rate. A third optical filter and a fourth optical filter having a fourth dimming rate higher than the third dimming rate may be included. The total set value indicating the dimming rate when each of the first optical filter, the second optical filter, and the third optical filter is inserted into the optical path, and the dimming rate when the fourth optical filter is inserted into the optical path. The set value shown may be the first set value.

When the circuit receives an instruction to set the first set value, when the image pickup device is in the first image pickup mode, the circuit inserts each of the first optical filter, the second optical filter, and the third optical filter into the optical path and takes an image. When the device is in the second imaging mode, the fourth optical filter may be configured to be inserted into the optical path.

The second optical filter may be arranged closer to the image sensor than the first optical filter. The third optical filter may be arranged on the image sensor side of the second optical filter. The fourth optical filter may be inserted into the optical path in the same layer as the third optical filter by replacing the third optical filter.

The N-layer optical filters include a first optical filter with a first dimming rate, a second optical filter with a second dimming rate higher than the first dimming rate, and a third dimming rate higher than the second dimming rate. 3rd optical filter and the like may be included. The total set value indicating the dimming rate when each of the first optical filter and the second optical filter is inserted into the optical path, and the set value indicating the dimming rate when the third optical filter is inserted into the optical path are set. The first set value may be used. When the circuit receives an instruction to set the first set value, when the image pickup device is in the first image pickup mode, the first optical filter and the second optical filter are each inserted into the optical path, and the image pickup device is second. In the imaging mode, the third optical filter is configured to be inserted into the optical path.

The image pickup apparatus according to one aspect of the present invention may include the control device, an image sensor, and an N-layer optical filter.

The control method according to one aspect of the present invention is an image sensor and an N-layer (N is an integer of 2 or more) optical filters arranged on the front side of the image sensor and inserted or retracted with respect to an optical path. It may be a control method for controlling an image pickup apparatus including. The control method may include a step of controlling the insertion of the N-layer optical filter into each optical path or the evacuation from the optical path. The step includes the step of inserting the optical filter of the layer more than N-1 into the optical path when the optical filter of the layer below N-1 is inserted in the optical path when the instruction to turn off the power of the image pickup apparatus is detected. It's fine.

A control device that controls an image sensor equipped with an image sensor and an N-layer (N is an integer of 2 or more) optical filters arranged on the front side of the image sensor and inserted or retracted with respect to an optical path. good. The control device may include a step of controlling the insertion or withdrawal of the N-layer optical filter into or out of each optical path. When the stage receives an instruction to set the first set value indicating the first dimming rate, when the image pickup device is in the first image pickup mode, the M layer corresponding to the first set value (M is an integer of N or less). ) Is inserted, and when the image pickup device is in the second image pickup mode, the step of inserting the optical filter of the L layer smaller than M (L is an integer smaller than M) corresponding to the first set value is included. good.

The program according to one aspect of the present invention may be a program for operating a computer as the control device.

According to one aspect of the present invention, it is possible to suppress adverse effects on the optical filter or the image sensor by strong light such as sunlight.

The outline of the above invention does not list all the necessary features of the present invention. A subcombination of these feature groups can also be an invention.

It is an external perspective view seen from the image pickup surface side of an image pickup apparatus. It is a figure which shows an example of the functional block of an image pickup apparatus. It is a schematic cross-sectional view seen from the side surface side of an optical filter apparatus. It is the figure which looked at the arrangement state of the optical filter from the front side. It is the figure which looked at the arrangement state of the optical filter from the front side. It is the figure which looked at the arrangement state of the optical filter from the front side. It is a flowchart which shows an example of the control procedure of an optical filter apparatus when the power of an image pickup apparatus is turned off. It is a flowchart which shows the other example of the control procedure of the optical filter device at the time of turning off the power of the image pickup device. It is a flowchart which shows an example of the control procedure of an optical filter apparatus when ND128 is set as an ND value. It is a figure which shows an example of the appearance of an unmanned aerial vehicle and a remote control device. It is a figure which shows an example of a hardware configuration.

Hereinafter, the present invention will be described through embodiments of the invention, but the following embodiments do not limit the invention within the scope of the claims. Also, not all combinations of features described in the embodiments are essential to the means of solving the invention.

The claims, description, drawings, and abstracts include matters subject to copyright protection. The copyright holder will not object to any person's reproduction of these documents as long as they appear in the Patent Office files or records. However, in other cases, all copyrights are reserved.

Various embodiments of the present invention may be described with reference to flowcharts and block diagrams, wherein the block is (1) a stage of the process in which the operation is performed or (2) a device having a role of performing the operation. May represent a "part" of. Specific steps and "parts" may be implemented by programmable circuits and / or processors. Dedicated circuits may include digital and / or analog hardware circuits. It may include integrated circuits (ICs) and / or discrete circuits. The programmable circuit may include a reconfigurable hardware circuit. Reconfigurable hardware circuits include logical AND, logical OR, logical XOR, logical NAND, logical NOR, and other logical operations, flip-flops, registers, field programmable gate arrays (FPGA), programmable logic arrays (PLA), etc. It may include a memory element such as.

The computer readable medium may include any tangible device capable of storing instructions executed by the appropriate device. As a result, the computer-readable medium having the instructions stored therein will include the product, including instructions that can be executed to create means for performing the operation specified in the flowchart or block diagram. Examples of computer-readable media may include electronic storage media, magnetic storage media, optical storage media, electromagnetic storage media, semiconductor storage media, and the like. More specific examples of computer-readable media include floppy (registered trademark) disks, diskettes, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), Electrically erasable programmable read-only memory (EEPROM), static random access memory (SRAM), compact disc read-only memory (CD-ROM), digital versatile disc (DVD), Blu-ray (RTM) disc, memory stick, integrated A circuit card or the like may be included.

Computer-readable instructions may include either source code or object code written in any combination of one or more programming languages. Source code or object code includes traditional procedural programming languages. Traditional procedural programming languages are assembler instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcodes, firmware instructions, state setting data, or Smalltalk, JAVA®, C ++, etc. It may be an object-oriented programming language, and a "C" programming language or a similar programming language. Computer-readable instructions are used locally or to a local area network (LAN), wide area network (WAN), etc., to the processor or programmable circuit of a general purpose computer, special purpose computer, or other programmable data processing device. ) May be provided. The processor or programmable circuit may execute computer-readable instructions to create means for performing the operations specified in the flowchart or block diagram. Examples of processors include computer processors, processing units, microprocessors, digital signal processors, controllers, microcontrollers, and the like.

FIG. 1 is an external perspective view of the image pickup apparatus 100 according to the present embodiment as viewed from the image pickup surface side. The image pickup apparatus 100 includes an image sensor 120 and a mount 800 for detachably connecting an interchangeable lens to the image pickup apparatus 100.

The image pickup apparatus 100 may be supported by a support mechanism for adjusting the posture of the image pickup apparatus 100 with the interchangeable lens attached. The image pickup apparatus 100 may be mounted on a moving body. The image pickup apparatus 100 may be mounted on a moving body via a support mechanism. The moving body is a concept including a flying body moving in the air, a vehicle moving on the ground, a ship moving on the water, and the like. A flying object that moves in the air is a concept that includes an unmanned aerial vehicle (UAV), other aircraft that move in the air, an airship, a helicopter, and the like.

FIG. 2 is an example of a functional block of the image pickup apparatus 100. The image pickup device 100 includes an image pickup control unit 110, an image sensor 120, a memory 130, an optical filter device 500, and a mount 800. The image sensor 120 may be configured by CCD or CMOS. The image sensor 120 captures an optical image formed through an interchangeable lens, and outputs the captured image to the image pickup control unit 110. The image sensor 120 receives light that has passed through the optical filter device 500. The image pickup control unit 110 may be configured by a microprocessor such as a CPU or MPU, a microcontroller such as an MCU, or the like. The image pickup control unit 110 may control the image pickup device 100 in response to an operation command of the image pickup device 100.

The memory 130 may be a computer-readable recording medium and may include at least one of flash memory such as SRAM, DRAM, EPROM, EEPROM®, USB memory, and solid state drive (SSD). The memory 130 stores a program or the like necessary for the image pickup control unit 110 to control the image sensor 120 or the like. The memory 130 may be provided inside the housing of the image pickup apparatus 100. The memory 130 may be provided so as to be removable from the housing of the image pickup apparatus 100.

The optical filter device 500 is arranged on the front side of the image sensor 120 and adjusts the amount of light incident on the image sensor 120. The mount 800 has a mechanical structure for detachably connecting the interchangeable lens to the image pickup apparatus 100. The mount 800 is arranged at a position facing the image pickup surface of the image sensor 120. The mount 800 has a lock pin 801 and an electrical contact 802. The lock pin 801 is provided so as to be urged toward the object side by an elastic body such as a spring. When the interchangeable lens rotates while pressing the lock pin 801 against the image pickup surface side and the interchangeable lens rotates to a predetermined position, the lock pin 801 fits into the insertion hole for positioning the interchangeable lens, and the interchangeable lens is the image pickup device 100. Locked to. Further, when the interchangeable lens is rotated to a predetermined position, the electric contact 802 and the electric contact of the interchangeable lens are electrically connected.

FIG. 3 is a schematic cross-sectional view seen from the side surface side of the optical filter device 500. The optical filter device 500 has a three-layer optical filter. The optical filter device 500 may have an N-layer (N is an integer of 2 or more) optical filters. The optical filter device 500 is arranged on the first layer and includes a dimming filter 510 of ND2 as an optical filter that can be inserted into the optical path of the image pickup device 100. The optical filter device 500 is further provided with a clear glass 512 which is arranged in the first layer and can be inserted into the optical path by replacing the dimming filter 510. The optical filter device 500 is arranged in the second layer and includes a dimming filter 514 of ND4 as an optical filter that can be inserted into an optical path. The optical filter device 500 is further provided with clear glass 516, which is arranged in the second layer and can be inserted into the optical path by replacing the dimming filter 514. The optical filter device 500 is arranged in the third layer and includes a dimming filter 518 of the ND 16 as an optical filter that can be inserted into an optical path. The optical filter device 500 is further provided with a dimming filter 520 of the ND 128 as an optical filter that is arranged in the third layer and can be inserted into the optical path by replacing the dimming filter 518. The optical filter device 500 may include a dimming filter having a different ND value other than ND2 or ND4 instead of the clear glass 512 or the clear glass 516.

FIG. 3 shows an optical filter device 500 in a state where the dimming filter 510 of ND2 is inserted in the optical path in the first layer and the clear glass 516 is inserted in the optical path in the second layer.

4A, 4B, and 4C are views of the arrangement state of the optical filter as viewed from the front side. 4A, 4B, and 4C show the optical filter of the first layer, but the optical filters of the second layer and the third layer may have the same structure. FIG. 4A shows a state in which the clear glass 512 is inserted in the optical path. FIG. 4B shows a state in which the dimming filter 510 is inserted in the optical path. FIG. 4C shows a state in which neither the dimming filter 510 nor the clear glass 512 is inserted in the optical path.

The dimming filter 510 is held by the holding frame 511 and slides along two supports 530 that are rod-shaped axes. The clear glass 512 is held by the holding frame 513 and slides along the two supports 530. The holding frame 511 and the holding frame 513 may be mechanically engaged with the motor via the gear mechanism. The power of the motor is transmitted to the gear mechanism, and the holding frame 511 and the holding frame 513 slide along the two supports 530. As a result, the dimming filter 510 and the clear glass 512 are inserted or retracted into or retracted from the optical path of the image pickup apparatus 100.

In the image pickup apparatus 100 including the optical filter apparatus 500 configured as described above, it is possible to prevent the dimming filter or the image sensor 120 from being adversely affected by strong light such as sunlight.

A dimming filter having a high dimming rate such as ND128 has a high energy absorption rate. Therefore, if such a dimming filter is continuously irradiated with strong light such as sunlight, the dimming filter may be burnt or damaged. On the other hand, if the image sensor 120 is continuously irradiated with strong light such as sunlight without inserting a dimming filter, the image sensor 120 may have an adverse effect such as a pixel defect.

For example, if the image pickup apparatus 100 is left outdoors, the influence of sunlight may adversely affect the image sensor 120. Therefore, when the image pickup control unit 110 detects an instruction to turn off the power of the image pickup device 100, if only a number of filters smaller than the number of insertable optical filters is inserted into the optical path of the image pickup device 100, the current state is The optical filter device 500 is controlled so as to insert a larger number of filters into the optical path than the number of inserted filters.

The optical filter device 500 includes an N-layer (N is an integer of 2 or more) filters arranged so as to be insertable or retractable with respect to the optical path. When the image pickup control unit 110 detects an instruction to turn off the power of the image pickup apparatus 100, the image pickup control unit 110 inserts an optical filter having a layer more than N-1 into the optical path when an optical filter having a layer of N-1 or less is inserted in the optical path. do.

For example, the optical filter device 500 includes a three-layer optical filter that is arranged so as to be inserted or retracted with respect to an optical path. When the image pickup control unit 110 detects an instruction to turn off the power of the image pickup apparatus 100, if a one-layer optical filter is already inserted in the optical path, the image pickup control unit 110 further inserts a one-layer or two-layer optical filter into the optical path. After controlling the optical filter device 500, the power of the image pickup device 100 is turned off.

As shown in FIG. 3, the optical filter device 500 includes a dimming filter 510 of ND2, a dimming filter 514 of ND4 arranged on the image sensor 120 side of the dimming filter 510, and an image sensor 120 of the dimming filter 514. The ND 16 dimming filter 518 arranged on the side and the ND 128 dimming filter 520 arranged on the same layer as the dimming filter 518 and can be inserted in place of the dimming filter 510 may be provided.

Then, when the image pickup control unit 110 detects an instruction to turn off the power of the image pickup device 100 while the dimming filter 520 of the ND 128 is inserted in the optical path, the image pickup control unit 110 uses the dimming filter 520 of the ND 128. After retracting from the optical path, the optical filter device 500 is controlled so as to insert the dimming filter 510 of ND2, the dimming filter 514 of ND4, and the dimming filter 518 of ND16 into the optical path, and then the power supply of the image pickup device 100 is controlled. May be turned off. As a result, when the image pickup apparatus 100 is left outdoors with the dimming filter 520 of the ND 128 inserted in the optical path, it is possible to prevent the dimming filter 520 from being burnt or damaged. Further, instead of the dimming filter 520 of the ND 128, the dimming filter 510 of the ND 2, the dimming filter 514 of the ND 4, and the dimming filter 518 of the ND 16 may be inserted into the optical path. This makes it possible to prevent the image sensor 120 from having an adverse effect such as a pixel defect due to strong light such as sunlight while the image pickup apparatus 100 is left unattended.

When the optical filter device 500 includes a plurality of dimming filters having different ND values, there may be a plurality of combinations of dimming filters capable of realizing the specified ND value. For example, in the case of the optical filter device 500 as shown in FIG. 3, in the optical filter device 500, in addition to inserting the dimming filter 520 of the ND 128 into the optical path, the dimming filter 510 of the ND 2, the dimming filter 514 of the ND 4, and the dimming filter 514 of the ND 4 are used. In theory, ND128 can be realized by inserting the dimming filter 518 of ND16 into the optical path. However, there is an error in the dimming rate of each dimming filter. Therefore, the larger the number of dimming filters inserted in the optical path, the larger the error. Therefore, when the accuracy of the dimming rate is required, it is preferable that the number of dimming filters inserted in the optical path is as small as possible. On the other hand, when the image pickup device 100 takes an image in an environment of strong light such as sunlight and the accuracy of the dimming rate is not required, the strong light such as sunlight adversely affects the dimming filter or the image sensor 120. It is better to insert as many dimming filters as possible into the optical path in order to prevent them from being affected.

The image pickup control unit 110 operates in a first image pickup mode in which the suppression of the adverse effect of sunlight is prioritized over the accuracy of the dimming rate and a second image pickup mode in which the accuracy of the dimming rate is prioritized over the adverse effect of sunlight. do. The image pickup control unit 110 may operate in the second image pickup mode when the first image pickup mode is not turned on. The image pickup control unit 110 may operate in the second image pickup mode when the first image pickup mode is not selected by the user. The optical filter device 500 includes an N-layer (N is an integer of 2 or more) filters arranged so as to be insertable or retractable with respect to the optical path. In this case, when the image pickup control unit 110 receives an instruction to set the first set value indicating the first dimming rate, when the image pickup device 100 is in the first image pickup mode, the M layer corresponding to the first set value ( M controls the optical filter device 500 to insert an optical filter (an integer less than or equal to N). On the other hand, when the image pickup control unit 110 receives an instruction to set the first set value indicating the first dimming rate, the L smaller than M corresponding to the first set value when the image pickup device 100 is in the second image pickup mode. The optical filter device 500 is controlled to insert the optical filter of the layer (L is an integer smaller than M).

The N-layer optical filters include a first optical filter with a first dimming rate, a second optical filter with a second dimming rate higher than the first dimming rate, and a third dimming rate higher than the second dimming rate. 3rd optical filter and a 4th optical filter having a 4th dimming rate higher than the 3rd dimming rate may be included. The total set value indicating the dimming rate when each of the first optical filter, the second optical filter, and the third optical filter is inserted into the optical path, and the dimming rate when the fourth optical filter is inserted into the optical path. The set value shown may be the first set value. Upon receiving an instruction to set the first set value, the image pickup control unit 110 inserts each of the first optical filter, the second optical filter, and the third optical filter into the optical path when the image pickup device is in the first image pickup mode. However, when the image pickup device is in the second image pickup mode, the optical filter device 500 may be controlled so as to insert the fourth optical filter into the optical path. The total set value may be a theoretical ND value obtained by multiplying the ND values of the first optical filter, the second optical filter, and the third optical filter.

For example, when the image pickup device 100 including the optical filter device 500 shown in FIG. 3 operates in the first image pickup mode, when the image pickup control unit 110 receives an instruction to set the ND 128 as a set value, the dimming filter of the ND 2 is received. The optical filter device 500 is controlled so as to insert the dimming filter 514 of 510, ND4, and the dimming filter 518 of ND16 into the optical path. On the other hand, when the image pickup device 100 operates in the second image pickup mode, when the image pickup device 100 receives an instruction to set the ND 128 as a set value, the optical filter device so as to insert the dimming filter 520 of the ND 128 into the optical path. Control 500.

As a result, the dimming filter having a high dimming rate is prevented from being burnt or damaged due to the influence of strong light such as sunlight, or pixel defects are suppressed in the image sensor 120 to some extent. The image pickup device 100 can be made to take an image with an accurate dimming rate.

FIG. 5 is a flowchart showing an example of a control procedure of the optical filter device 500 when the power of the image pickup device 100 is turned off.

When the image pickup control unit 110 detects an instruction to turn off the power of the image pickup device 100, it determines whether or not the dimming filter 520 of the ND 128 is inserted in the optical path (S100). When the dimming filter 520 of the ND 128 is inserted in the optical path, the image pickup control unit 110 controls the optical filter device 500 so as to retract the dimming filter 520 of the ND 128 from the optical path (S102). Next, the image pickup control unit 110 controls the optical filter device 500 so as to insert the dimming filter 510 of ND2, the dimming filter 514 of ND4, and the dimming filter 518 of ND16 into the optical path (S104). The image pickup control unit 110 turns off the power of the image pickup device 100 and ends the operation.

Even when the dimming filter 520 of the ND 128 is not inserted, the image pickup control unit 110 optically inserts the dimming filter 510 of the ND 2, the dimming filter 514 of the ND 4, and the dimming filter 518 of the ND 16 into the optical path. The filter device 500 is controlled (S104). The image pickup control unit 110 turns off the power of the image pickup device 100 and ends the operation.

As a result, the power of the image pickup apparatus 100 is turned off with the dimming filter 520 of the ND 128 inserted in the optical path. Therefore, for example, when the image pickup apparatus 100 is left outdoors, it is possible to prevent sunlight from adversely affecting the dimming filter 520 or the image sensor 120 of the ND 128.

FIG. 6 is a flowchart showing another example of the control procedure of the optical filter device 500 when the power of the image pickup device 100 is turned off.

When the image pickup control unit 110 detects an instruction to turn off the power of the image pickup device 100, it determines whether or not the dimming filter 520 of the ND 128 is inserted in the optical path (S200). When the dimming filter 520 of the ND 128 is inserted in the optical path, the image pickup control unit 110 controls the optical filter device 500 so as to further insert the dimming filter 510 of the ND 2 and the dimming filter 514 of the ND 4 into the optical path. (S202). The image pickup control unit 110 turns off the power of the image pickup device 100 and ends the operation.

When the dimming filter 520 of the ND 128 is not inserted, the image pickup control unit 110 is an optical filter device so as to insert the dimming filter 510 of the ND 2, the dimming filter 514 of the ND 4, and the dimming filter 518 of the ND 16 into the optical path. Control 500 (S204). The image pickup control unit 110 turns off the power of the image pickup device 100 and ends the operation.

As a result, even when the dimming filter 520 of the ND 128 is inserted into the optical path, the dimming filter 510 of the ND 2 and the dimming filter 514 of the ND 4 are further inserted into the optical path. As a result, even if the image pickup apparatus 100 is left outdoors, the light absorbed by the ND128 dimming filter 520 can be suppressed, and the adverse effect of the ND128 on the dimming filter 520 can be suppressed. Further, when none of the dimming filters is inserted in the optical path, a plurality of dimming filters having a relatively low dimming rate are preferentially inserted. As a result, when the image pickup device 100 is left in the open air with the power turned off, sunlight is irradiated to the dimming filter having a relatively high dimming rate, which adversely affects the dimming filter. By irradiating the image sensor 120 with sunlight, it is possible to prevent the image sensor 120 from being adversely affected.

FIG. 7 is a flowchart showing an example of a control procedure of the optical filter device 500 when ND128 is set as the ND value.

When the image pickup control unit 110 receives the setting of the ND 128 as the ND value from the user, the image pickup control unit 110 determines whether or not the sun damage reduction mode is turned on as the image pickup mode of the image pickup apparatus 100 (S300). That is, the image pickup control unit 110 has set a first image pickup mode in which the suppression of the adverse effect of sunlight is prioritized over the accuracy of the dimming rate as the shooting mode of the image pickup device 100, or the dimming rate is higher than the adverse effect of sunlight. It is determined whether or not the second image pickup mode that gives priority to the accuracy of is set. When the first shooting mode is set, the image pickup control unit 110 determines that the sun damage reduction mode is on.

When the sun damage reduction mode is on, the image pickup control unit 110 inserts the ND2 dimming filter 510, the ND4 dimming filter 514, and the ND16 dimming filter 518 into the optical path in order to set the ND 128 as the ND value. The optical filter device 500 is controlled so as to perform (S302). On the other hand, when the solar damage reduction mode is off, the optical filter device 500 is controlled so as to insert the dimming filter 520 of the ND 128 into the optical path in order to set the ND 128 as the ND value (S304).

As a result, when the setting of the dimming rate with high accuracy is not required, the dimming filter and the image sensor 120 having a high dimming rate have an adverse effect from sunlight while realizing the dimming rate that should be set with a certain degree of accuracy. Can be suppressed from receiving.

The image pickup apparatus 100 as described above may be mounted on a moving body. The image pickup apparatus 100 may be mounted on an unmanned aerial vehicle (UAV) as shown in FIG. The UAV 10 may include a UAV main body 20, a gimbal 50, a plurality of image pickup devices 60, and an image pickup device 100. The gimbal 50 and the image pickup apparatus 100 are examples of an image pickup system. The UAV 10 is an example of a moving body propelled by a propulsion unit. The moving body is a concept including a UAV, a flying object such as another aircraft moving in the air, a vehicle moving on the ground, a ship moving on the water, and the like.

The UAV main body 20 includes a plurality of rotary wings. The plurality of rotor blades are an example of a propulsion unit. The UAV main body 20 flies the UAV 10 by controlling the rotation of a plurality of rotary blades. The UAV body 20 flies the UAV 10 using, for example, four rotor blades. The number of rotor blades is not limited to four. Further, the UAV 10 may be a fixed-wing aircraft having no rotor blades.

The image pickup apparatus 100 is a camera for taking an image of a subject included in a desired imaging range. The gimbal 50 rotatably supports the image pickup device 100. The gimbal 50 is an example of a support mechanism. For example, the gimbal 50 rotatably supports the image pickup device 100 on a pitch axis using an actuator. The gimbal 50 further rotatably supports the image pickup device 100 around each of the roll axis and the yaw axis by using an actuator. The gimbal 50 may change the posture of the image pickup device 100 by rotating the image pickup device 100 around at least one of the yaw axis, the pitch axis, and the roll axis.

The plurality of image pickup devices 60 are sensing cameras that image the surroundings of the UAV 10 in order to control the flight of the UAV 10. Two image pickup devices 60 may be provided in front of the nose of the UAV 10. Yet two other imaging devices 60 may be provided on the bottom surface of the UAV 10. The two image pickup devices 60 on the front side may be paired and function as a so-called stereo camera. The two image pickup devices 60 on the bottom side may also be paired and function as a stereo camera. Three-dimensional spatial data around the UAV 10 may be generated based on the images captured by the plurality of image pickup devices 60. The number of image pickup devices 60 included in the UAV 10 is not limited to four. The UAV 10 may include at least one image pickup device 60. The UAV 10 may be provided with at least one image pickup device 60 on each of the nose, tail, side surface, bottom surface, and ceiling surface of the UAV 10. The angle of view that can be set by the image pickup device 60 may be wider than the angle of view that can be set by the image pickup device 100. The image pickup apparatus 60 may have a single focus lens or a fisheye lens.

The remote control device 300 communicates with the UAV 10 to remotely control the UAV 10. The remote control device 300 may communicate wirelessly with the UAV 10. The remote control device 300 transmits to the UAV 10 instruction information indicating various commands related to the movement of the UAV 10, such as ascending, descending, accelerating, decelerating, advancing, reversing, and rotating. The instruction information includes, for example, instruction information for raising the altitude of the UAV 10. The instruction information may indicate the altitude at which the UAV 10 should be located. The UAV 10 moves so as to be located at an altitude indicated by the instruction information received from the remote control device 300. The instruction information may include an ascending instruction to elevate the UAV 10. The UAV10 rises while accepting the rise order. Even if the UAV10 accepts an ascending order, the ascending may be restricted if the altitude of the UAV10 has reached the upper limit altitude.

FIG. 9 shows an example of a computer 1200 in which a plurality of aspects of the present invention may be embodied in whole or in part. The program installed on the computer 1200 can cause the computer 1200 to function as an operation associated with the device according to an embodiment of the present invention or as one or more "parts" of the device. Alternatively, the program may cause the computer 1200 to perform the operation or the one or more "parts". The program may cause the computer 1200 to perform a process according to an embodiment of the present invention or a step of the process. Such a program may be run by the CPU 1212 to cause the computer 1200 to perform certain operations associated with some or all of the blocks of the flowcharts and block diagrams described herein.

The computer 1200 according to this embodiment includes a CPU 1212 and a RAM 1214, which are connected to each other by a host controller 1210. The computer 1200 also includes a communication interface 1222, an input / output unit, which are connected to the host controller 1210 via an input / output controller 1220. The computer 1200 also includes a ROM 1230. The CPU 1212 operates according to a program stored in the ROM 1230 and the RAM 1214, thereby controlling each unit.

The communication interface 1222 communicates with other electronic devices via the network. A hard disk drive may store programs and data used by the CPU 1212 in the computer 1200. The ROM 1230 stores in it a boot program or the like executed by the computer 1200 at the time of activation and / or a program depending on the hardware of the computer 1200. The program is provided via a computer-readable recording medium such as a CR-ROM, USB memory or IC card or a network. The program is installed in RAM 1214, which is also an example of a computer-readable recording medium, or ROM 1230, and is executed by the CPU 1212. The information processing described in these programs is read by the computer 1200 and provides a link between the program and the various types of hardware resources described above. The device or method may be configured to implement the operation or processing of information in accordance with the use of the computer 1200.

For example, when communication is executed between the computer 1200 and an external device, the CPU 1212 executes a communication program loaded in the RAM 1214, and performs communication processing with respect to the communication interface 1222 based on the processing described in the communication program. You may order. Under the control of the CPU 1212, the communication interface 1222 reads the transmission data stored in the transmission buffer area provided in the RAM 1214 or a recording medium such as a USB memory, and transmits the read transmission data to the network, or The received data received from the network is written to the reception buffer area or the like provided on the recording medium.

Further, the CPU 1212 makes the RAM 1214 read all or necessary parts of a file or a database stored in an external recording medium such as a USB memory, and executes various types of processing on the data on the RAM 1214. good. The CPU 1212 may then write back the processed data to an external recording medium.

Various types of information such as various types of programs, data, tables, and databases may be stored in recording media and processed. The CPU 1212 describes various types of operations, information processing, conditional judgment, conditional branching, unconditional branching, and information retrieval described in various parts of the present disclosure with respect to the data read from the RAM 1214. Various types of processing may be performed, including / replacement, etc., and the results are written back to the RAM 1214. Further, the CPU 1212 may search for information in a file, database, or the like in the recording medium. For example, when a plurality of entries each having an attribute value of the first attribute associated with the attribute value of the second attribute are stored in the recording medium, the CPU 1212 specifies the attribute value of the first attribute. Search for an entry that matches the condition from the plurality of entries, read the attribute value of the second attribute stored in the entry, and associate it with the first attribute that satisfies the predetermined condition. The attribute value of the second attribute obtained may be acquired.

The program or software module described above may be stored on a computer 1200 or in a computer readable storage medium near the computer 1200. Also, a recording medium such as a hard disk or RAM provided in a dedicated communication network or a server system connected to the Internet can be used as a computer readable storage medium, thereby allowing the program to be transferred to the computer 1200 over the network. offer.

Although the present invention has been described above using the embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments. It will be apparent to those skilled in the art that various changes or improvements can be made to the above embodiments. It is clear from the description of the claims that the form with such changes or improvements may be included in the technical scope of the present invention.

The order of execution of each process such as operation, procedure, step, and step in the apparatus, system, program, and method shown in the claims, specification, and drawings is particularly "before" and "prior to". It should be noted that it can be realized in any order unless the output of the previous process is used in the subsequent process. Even if the scope of claims, the specification, and the operation flow in the drawings are explained using "first", "next", etc. for convenience, it means that it is essential to carry out in this order. It's not a thing.

10 UAV
20 UAV main unit 50 gimbal 60 image pickup device 100 image pickup device 110 image pickup control unit 120 image sensor 130 memory 300 remote control device 500 optical filter device 510 dimming filter 511 holding frame 512 clear glass 513 holding frame 514 dimming filter 516 clear glass 518 reduction Optical filter 520 Dimming filter 530 Support 800 Mount 801 Lock pin 802 Electrical contact 1200 Computer 1210 Host controller 1212 CPU
1214 RAM
1220 Input / Output Controller 1222 Communication Interface 1230 ROM

Claims (13)

A control device for controlling an image sensor including an image sensor and an N-layer (N is an integer of 2 or more) optical filters arranged on the front side of the image sensor and arranged so as to be inserted or retracted with respect to an optical path. And,
A circuit configured to control the insertion or withdrawal of the N-layer optical filter into or out of the optical path is provided.
When the circuit detects an instruction to turn off the power of the image pickup apparatus, when the optical filter having a layer of N-1 or lower is inserted in the optical path, the optical filter having a layer of more than N-1 is inserted into the optical path. A control device configured to be inserted into. The N-layer optical filter includes a first optical filter having a first dimming rate, a second optical filter having a second dimming rate higher than the first dimming rate, and a third optical filter having a second dimming rate higher than the second dimming rate. A third optical filter having a dimming rate and a fourth optical filter having a fourth dimming rate higher than the third dimming rate are included.
When the circuit detects an instruction to turn off the power of the image pickup apparatus while the fourth optical filter is inserted in the optical path, the optical path passes at least one of the first optical filter and the second optical filter. The control device according to claim 1, which is configured to turn off the power of the image pickup device after being inserted into the image pickup device. The second optical filter is arranged on the image sensor side of the first optical filter, the third optical filter is arranged on the image sensor side of the second optical filter, and the fourth optical filter is located on the image sensor side. The control device according to claim 2, wherein the control device can be inserted into the optical path in the same layer as the third optical filter by replacing the third optical filter. When the circuit detects an instruction to turn off the power of the image pickup apparatus while the fourth optical filter is inserted in the optical path, the fourth optical filter is retracted from the optical path and the first optical filter is retracted. The control device according to claim 3, wherein the second optical filter and the third optical filter are inserted into the optical path and then the power of the image pickup device is turned off. The N-layer optical filter includes a first optical filter having a first dimming rate, a second optical filter having a second dimming rate higher than the first dimming rate, and a third optical filter having a second dimming rate higher than the second dimming rate. Including a third optical filter with dimming rate
When the circuit detects an instruction to turn off the power of the image pickup apparatus while the third optical filter is inserted in the optical path, the third optical filter is retracted from the optical path and the first optical filter is retracted. The control device according to claim 1, wherein the control device is configured to turn off the power of the image pickup device after inserting at least one of the second optical filter into the optical path. A control device for controlling an image sensor including an image sensor and an N-layer (N is an integer of 2 or more) optical filters arranged on the front side of the image sensor and arranged so as to be inserted or retracted with respect to an optical path. And,
A circuit configured to control the insertion or withdrawal of the N-layer optical filter into or out of the optical path is provided.
When the circuit receives an instruction to set the first set value indicating the first dimming rate, the M layer (M is N) corresponding to the first set value when the image pickup device is in the first image pickup mode. An optical filter of the following integer) is inserted, and when the image pickup device is in the second image pickup mode, an optical filter of an L layer smaller than M (L is an integer smaller than M) corresponding to the first set value is inserted. A control device configured to do so. The N-layer optical filter includes a first optical filter having a first dimming rate, a second optical filter having a second dimming rate higher than the first dimming rate, and a third optical filter having a second dimming rate higher than the second dimming rate. A third optical filter having a dimming rate and a fourth optical filter having a fourth dimming rate higher than the third dimming rate are included.
The total set value indicating the dimming rate when each of the first optical filter, the second optical filter, and the third optical filter is inserted into the optical path, and the fourth optical filter are inserted into the optical path. The set value indicating the dimming rate in the case is the first set value, and is the first set value.
When the circuit receives an instruction to set the first set value, the first optical filter, the second optical filter, and the third optical filter, respectively, when the image pickup device is in the first image pickup mode. The control device according to claim 6, wherein the fourth optical filter is inserted into the optical path when the image pickup device is in the second image pickup mode. The second optical filter is arranged on the image sensor side of the first optical filter, the third optical filter is arranged on the image sensor side of the second optical filter, and the fourth optical filter is located on the image sensor side. The control device according to claim 7, wherein the control device can be inserted into the optical path in the same layer as the third optical filter by replacing the third optical filter. The N-layer optical filter includes a first optical filter having a first dimming rate, a second optical filter having a second dimming rate higher than the first dimming rate, and a third optical filter having a second dimming rate higher than the second dimming rate. Including a third optical filter with dimming rate
The total set value indicating the dimming rate when each of the first optical filter and the second optical filter is inserted into the optical path, and the dimming rate when the third optical filter is inserted into the optical path. The set value shown is the first set value, and is the first set value.
Upon receiving an instruction to set the first set value, the circuit inserts each of the first optical filter and the second optical filter into the optical path when the image pickup device is in the first image pickup mode. The control device according to claim 6, wherein when the image pickup device is in the second image pickup mode, the third optical filter is configured to be inserted into the optical path. The control device according to any one of claims 1 to 9,
With the image sensor
An image pickup apparatus including the N-layer optical filter. A control method for controlling an image sensor including an image sensor and an N-layer (N is an integer of 2 or more) optical filters arranged on the front side of the image sensor and arranged so as to be inserted or retracted with respect to an optical path. And,
A step of controlling the insertion or withdrawal of the N-layer optical filter into or out of the optical path is provided.
When the step detects an instruction to turn off the power of the image pickup apparatus, when the optical filter having a layer of N-1 or less is inserted in the optical path, the optical filter having a layer more than N-1 is inserted into the optical path. Control method, including the step of inserting into. A control device for controlling an image sensor including an image sensor and an N-layer (N is an integer of 2 or more) optical filters arranged on the front side of the image sensor and arranged so as to be inserted or retracted with respect to an optical path. And,
A step of controlling the insertion or withdrawal of the N-layer optical filter into or out of the optical path is provided.
When the step receives an instruction to set the first set value indicating the first dimming rate, when the image pickup device is in the first image pickup mode, the M layer (M is N) corresponding to the first set value. An optical filter of the following integer) is inserted, and when the image pickup device is in the second image pickup mode, an optical filter of an L layer smaller than M (L is an integer smaller than M) corresponding to the first set value is inserted. Control method, including steps to do. A program for operating a computer as a control device according to any one of claims 1 to 9.

Images