WO2022137807A1 - レンズ装置、撮像装置、レンズ装置の作動方法、撮像装置の作動方法、及びプログラム - Google Patents
レンズ装置、撮像装置、レンズ装置の作動方法、撮像装置の作動方法、及びプログラム Download PDFInfo
- Publication number
- WO2022137807A1 WO2022137807A1 PCT/JP2021/040168 JP2021040168W WO2022137807A1 WO 2022137807 A1 WO2022137807 A1 WO 2022137807A1 JP 2021040168 W JP2021040168 W JP 2021040168W WO 2022137807 A1 WO2022137807 A1 WO 2022137807A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- lens
- image
- image sensor
- shift
- light
- Prior art date
Links
- 238000003384 imaging method Methods 0.000 title claims abstract description 29
- 238000000034 method Methods 0.000 title claims description 145
- 230000003287 optical effect Effects 0.000 claims abstract description 212
- 230000033001 locomotion Effects 0.000 claims abstract description 124
- 230000007246 mechanism Effects 0.000 claims abstract description 66
- 238000012937 correction Methods 0.000 claims description 243
- 230000008569 process Effects 0.000 claims description 35
- 230000008859 change Effects 0.000 claims description 34
- 238000000926 separation method Methods 0.000 claims description 10
- 230000002093 peripheral effect Effects 0.000 claims description 4
- 238000001514 detection method Methods 0.000 description 79
- 230000035945 sensitivity Effects 0.000 description 35
- 238000012545 processing Methods 0.000 description 31
- 239000002131 composite material Substances 0.000 description 8
- 238000004891 communication Methods 0.000 description 7
- 238000010586 diagram Methods 0.000 description 7
- 230000005540 biological transmission Effects 0.000 description 6
- 230000006870 function Effects 0.000 description 6
- 238000012986 modification Methods 0.000 description 6
- 230000004048 modification Effects 0.000 description 6
- 230000002194 synthesizing effect Effects 0.000 description 5
- 230000000694 effects Effects 0.000 description 3
- 230000001360 synchronised effect Effects 0.000 description 3
- XUIMIQQOPSSXEZ-UHFFFAOYSA-N Silicon Chemical compound [Si] XUIMIQQOPSSXEZ-UHFFFAOYSA-N 0.000 description 2
- 230000009471 action Effects 0.000 description 2
- 238000002955 isolation Methods 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 230000011514 reflex Effects 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- 229910052710 silicon Inorganic materials 0.000 description 2
- 239000010703 silicon Substances 0.000 description 2
- JBRZTFJDHDCESZ-UHFFFAOYSA-N AsGa Chemical compound [As]#[Ga] JBRZTFJDHDCESZ-UHFFFAOYSA-N 0.000 description 1
- 229910000530 Gallium indium arsenide Inorganic materials 0.000 description 1
- KXNLCSXBJCPWGL-UHFFFAOYSA-N [Ga].[As].[In] Chemical compound [Ga].[As].[In] KXNLCSXBJCPWGL-UHFFFAOYSA-N 0.000 description 1
- 230000001133 acceleration Effects 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 230000000052 comparative effect Effects 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000006073 displacement reaction Methods 0.000 description 1
- 229910052738 indium Inorganic materials 0.000 description 1
- APFVFJFRJDLVQX-UHFFFAOYSA-N indium atom Chemical compound [In] APFVFJFRJDLVQX-UHFFFAOYSA-N 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 229910044991 metal oxide Inorganic materials 0.000 description 1
- 150000004706 metal oxides Chemical class 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000003786 synthesis reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/64—Imaging systems using optical elements for stabilisation of the lateral and angular position of the image
- G02B27/646—Imaging systems using optical elements for stabilisation of the lateral and angular position of the image compensating for small deviations, e.g. due to vibration or shake
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B7/00—Mountings, adjusting means, or light-tight connections, for optical elements
- G02B7/02—Mountings, adjusting means, or light-tight connections, for optical elements for lenses
- G02B7/04—Mountings, adjusting means, or light-tight connections, for optical elements for lenses with mechanism for focusing or varying magnification
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B11/00—Filters or other obturators specially adapted for photographic purposes
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B15/00—Special procedures for taking photographs; Apparatus therefor
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B19/00—Cameras
- G03B19/02—Still-picture cameras
- G03B19/04—Roll-film cameras
- G03B19/06—Roll-film cameras adapted to be loaded with more than one film, e.g. with exposure of one or the other at will
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B5/00—Adjustment of optical system relative to image or object surface other than for focusing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
- H04N23/54—Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
- H04N23/55—Optical parts specially adapted for electronic image sensors; Mounting thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/66—Remote control of cameras or camera parts, e.g. by remote control devices
- H04N23/663—Remote control of cameras or camera parts, e.g. by remote control devices for controlling interchangeable camera parts based on electronic image sensor signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/68—Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
- H04N23/681—Motion detection
- H04N23/6812—Motion detection based on additional sensors, e.g. acceleration sensors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/68—Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
- H04N23/682—Vibration or motion blur correction
- H04N23/683—Vibration or motion blur correction performed by a processor, e.g. controlling the readout of an image memory
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/68—Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
- H04N23/682—Vibration or motion blur correction
- H04N23/685—Vibration or motion blur correction performed by mechanical compensation
- H04N23/687—Vibration or motion blur correction performed by mechanical compensation by shifting the lens or sensor position
Definitions
- the technique of the present disclosure relates to a lens device, an image pickup device, an operation method of the lens device, an operation method of the image pickup device, and a program.
- Japanese Patent Application Laid-Open No. 2017-444878 acquires image pickup means for photographing a subject through an image pickup optical system, first and second image shake correction means for correcting image shake of the image of the subject, and shake detection signals.
- the first and second image shake correction means are controlled to correct the image shake, and the first or second image shake correction means or the first and second image shake correction means are moved.
- an image pickup apparatus including a control means for controlling pixel shift to acquire a plurality of images by the image pickup means.
- At least a part of a lens group or a lens constituting a photographing lens is a movable lens group, and the control unit moves the movable lens group so as to have a component in a direction orthogonal to the optical axis.
- a method for acquiring an image is disclosed, which comprises a step of acquiring two or more images and a step of synthesizing two or more images to generate one image.
- Japanese Patent Application Laid-Open No. 2000-13670 describes an image pickup means, a shake detection means for detecting runout, an image shake correction means for correcting image shake based on the output of the shake detection means, and an image position on the image pickup means.
- Pixel shift means for minute displacement using image shake correction means, and image synthesis means for synthesizing high-resolution images based on a plurality of image data captured by shifting the position of an image on the image pickup means by the pixel shift means.
- the first shooting mode for correcting image shake and the second shooting mode for synthesizing high-resolution images can be selected, and the image shake correction is performed according to the selected shooting mode.
- An image pickup apparatus comprising: a control means for changing the drive control of the means is disclosed.
- One embodiment according to the technique of the present disclosure is, for example, a lens device, an image pickup device, a method of operating a lens device, which can move a moving lens by a moving amount according to a wavelength band of light transmitted through the moving lens.
- a method of operating an image pickup device and a program are provided.
- the first aspect according to the technique of the present disclosure is a lens device provided in an image pickup apparatus main body having an image sensor, which includes a processor, a memory connected to or built in the processor, and a moving lens, and emits incident light.
- the processor is provided with a lens to form an image on an image sensor and a drive mechanism for moving the moving lens by applying power to the moving lens along a coordinate plane intersecting the optical axis of the lens.
- it is a lens device that controls to change the amount of movement of the moving lens based on the wavelength band of light transmitted through the moving lens.
- a second aspect according to the technique of the present disclosure is a first lens, a second lens, a first drive mechanism for moving the first lens along a coordinate plane, and a second lens moving along the coordinate plane.
- a lens device according to the first aspect comprising a second drive mechanism, wherein at least one of the first lens and the second lens is a moving lens.
- a third aspect of the technique of the present disclosure is that the processor moves the first lens to the first drive mechanism in a direction in which the image blur obtained by forming light on the image sensor is corrected.
- the lens device according to the second aspect which controls and controls the second drive mechanism to move the second lens in the direction of shifting the image.
- a fourth aspect of the technique of the present disclosure is that the processor shifts the image to a position where the image shifts with respect to the second drive mechanism at a pitch equal to or higher than the pixel pitch of the image sensor or a pitch lower than the pixel pitch of the image sensor. 2
- This is a lens device according to a third aspect, which controls movement of a lens.
- a fifth aspect according to the technique of the present disclosure is that the shift amount of the image on the light receiving surface of the image sensor with respect to the movement of the second lens with the unit movement amount is the movement of the image sensor with respect to the movement of the first lens with the unit movement amount.
- the lens device according to the third aspect or the fourth aspect which is smaller than the blur correction amount of the image on the light receiving surface.
- a sixth aspect according to the technique of the present disclosure is to set the shift amount of the central ray passing through the second lens after movement on the optical axis on the light receiving surface of the image sensor with respect to the movement of the second lens by the unit movement amount.
- the shift amount of the peripheral light rays passing through the second lens after movement other than on the optical axis with respect to the movement of the second lens by the unit movement amount is S2, 0.8 ⁇
- the lens device according to any one of the third to fifth aspects, wherein the relationship of S2 / S1 ⁇ 1.2 is established.
- a seventh aspect according to the technique of the present disclosure further comprises a zoom lens, wherein the first lens and the second lens are arranged closer to the image sensor than the zoom lens, according to the second to sixth aspects. It is a lens device according to any one.
- Eighth aspect according to the technique of the present disclosure is any one of the second to sixth aspects, which is arranged closer to the subject than the image sensor and includes an optical filter that transmits near-infrared light contained in the light. It is a lens device according to one.
- a ninth aspect according to the technique of the present disclosure further comprises a focus lens, wherein the first lens and the second lens are arranged closer to the image sensor than the focus lens, according to the second to eighth aspects. It is a lens device according to any one.
- a tenth aspect according to the technique of the present disclosure is any one of the second to ninth aspects, further comprising a diaphragm, wherein the first lens and the second lens are arranged closer to the image sensor than the diaphragm. It is a lens device according to one.
- the eleventh aspect according to the technique of the present disclosure is a lens device according to any one of the first to tenth aspects, further comprising a switching mechanism for switching the wavelength band of light transmitted through the moving lens.
- a twelfth aspect according to the technique of the present disclosure is an optical separation mechanism that separates light into first light and second light, a first optical lens through which the first light is transmitted, and a second light through which the second light is transmitted.
- a lens device according to any one of the first to eleventh embodiments, comprising an optical lens, wherein at least one of the first optical lens and the second optical lens is a moving lens.
- a thirteenth aspect according to the technique of the present disclosure includes a processor, a memory connected to or built in the processor, an image sensor, a moving lens, and a lens that forms an image of incident light on the image sensor, and the light of the lens.
- a drive mechanism for moving the moving lens by applying power to the moving lens along a coordinate plane intersecting the axis is provided, and the processor has a drive mechanism for the wavelength band of light transmitted through the moving lens.
- This is an image pickup device that controls to change the amount of movement of the moving lens based on the above.
- the processor in the fourteenth aspect of the technique of the present disclosure, light is imaged on the image sensor at a pitch equal to or higher than the pixel pitch of the image sensor or a pitch lower than the pixel pitch of the image sensor with respect to the drive mechanism.
- the image sensor By controlling the movement of the moving lens to the position where the image obtained is shifted, the image sensor is made to take an image each time the image is shifted, and the images of a plurality of frames obtained by the image are combined. It is an image pickup apparatus which concerns on 13th aspects.
- a fifteenth aspect according to the technique of the present disclosure includes a moving lens, a lens that forms an image of incident light on an image sensor of an image pickup apparatus, and a moving lens along a coordinate plane that intersects the optical axis of the lens.
- a method of operating a lens device including a drive mechanism for moving a moving lens by applying power to the drive mechanism.
- a method of operating a lens device including controlling the amount to be changed.
- a sixteenth aspect of the technique of the present disclosure comprises an image sensor, a moving lens, a lens that forms an image of incident light on the image sensor, and a moving lens along a coordinate plane that intersects the optical axis of the lens. It is an operation method of an image pickup device including a drive mechanism for moving a moving lens by applying power to the drive mechanism, and the movement of the moving lens is based on the wavelength band of light transmitted through the moving lens with respect to the drive mechanism. It is a method of operating an image pickup apparatus, which includes performing control for changing the amount.
- a seventeenth aspect according to the technique of the present disclosure includes a moving lens, a lens that forms an image of incident light on an image sensor of an image pickup apparatus, and a moving lens along a coordinate plane that intersects the optical axis of the lens.
- a moving lens based on the wavelength band of light transmitted through the moving lens to a computer applied to a lens device including a driving mechanism for moving the moving lens by applying power to the driving mechanism. It is a program for executing a process including controlling to change the movement amount of the lens.
- An eighteenth aspect of the technique of the present disclosure comprises an image sensor, a moving lens, a lens that forms an image of incident light on the image sensor, and a moving lens along a coordinate plane that intersects the optical axis of the lens.
- a moving lens based on the wavelength band of light transmitted through the moving lens to a computer applied to an image pickup apparatus equipped with a driving mechanism for moving the moving lens by applying power to the driving mechanism. It is a program for executing a process including controlling to change the movement amount of the lens.
- CPU is an abbreviation for "Central Processing Unit”.
- GPU refers to the abbreviation of "Graphics Processing Unit”.
- NVM is an abbreviation for "Non-Volatile Memory”.
- RAM is an abbreviation for "RandomAccessMemory”.
- IC refers to the abbreviation of "Integrated Circuit”.
- ASIC is an abbreviation for "Application Specific Integrated Circuit”.
- PLD is an abbreviation for "Programmable Logic Device”.
- FPGA refers to the abbreviation of "Field-Programmable Gate Array”.
- SoC is an abbreviation for "System-on-a-chip”.
- SSD is an abbreviation for "Solid State Drive”.
- HDD is an abbreviation for "Hard Disk Drive”.
- EEPROM refers to the abbreviation of "Electrically Erasable and Programmable Read Only Memory”.
- SRAM is an abbreviation for "Static Random Access Memory”.
- I / F refers to the abbreviation of "Interface”.
- UI is an abbreviation for "User Interface”.
- USB is an abbreviation for "Universal Serial Bus”.
- CMOS is an abbreviation for "Complementary Metal Oxide Semiconductor”.
- CCD refers to the abbreviation of "Charge Coupled Device”.
- LAN is an abbreviation for "Local Area Network”.
- WAN is an abbreviation for "Wide Area Network”.
- BPF is an abbreviation for "Band Pass Filter”.
- Ir refers to the abbreviation of "Infrared Rays”.
- vertical means, in addition to perfect verticality, an error generally allowed in the technical field to which the technique of the present disclosure belongs, to the extent that it does not contradict the purpose of the technique of the present disclosure. Refers to the vertical in the sense including the error of.
- horizontal means, in addition to the perfect horizontal, an error generally allowed in the technical field to which the technique of the present disclosure belongs, to the extent that it does not contradict the purpose of the technique of the present disclosure. Refers to the horizontal in the sense including the error of.
- parallel means, in addition to perfect parallelism, an error generally allowed in the technical field to which the technique of the present disclosure belongs, to the extent that it does not contradict the purpose of the technique of the present disclosure. Refers to parallelism in the sense including the error of.
- orthogonality is an error generally allowed in the technical field to which the technique of the present disclosure belongs, in addition to the perfect orthogonality, and is not contrary to the purpose of the technique of the present disclosure. It refers to the orthogonality in the sense including the error of.
- match is an error generally allowed in the technical field to which the technique of the present disclosure belongs, in addition to the perfect match, to the extent that it does not contradict the purpose of the technique of the present disclosure.
- equal spacing is an error generally allowed in the technical field to which the technique of the present disclosure belongs, in addition to the perfect equal spacing, which is contrary to the purpose of the technique of the present disclosure. It refers to equal intervals in the sense that it includes errors to the extent that it does not occur.
- the surveillance system S includes a surveillance camera 10 and a management device 11.
- the surveillance camera 10 is an example of the "imaging device" according to the technique of the present disclosure.
- the surveillance camera 10 is installed on a pillar or wall inside or outside the room, captures a surveillance target as a subject, and generates a moving image by capturing the image.
- the moving image includes a multi-frame image obtained by imaging.
- the surveillance camera 10 transmits the moving image obtained by imaging to the management device 11 via the communication line 12.
- the management device 11 receives the moving image transmitted by the surveillance camera 10, displays the received moving image on the display 13, or stores the received moving image in the storage device 14.
- the X-axis shown in FIG. 1 corresponds to the pitch axis of the surveillance camera 10, the Y-axis corresponds to the yaw axis of the surveillance camera 10, and the Z-axis corresponds to the roll axis of the surveillance camera 10.
- the direction along the X-axis is referred to as the X-axis direction
- the direction along the Y-axis is referred to as the Y-axis direction
- the direction along the Z-axis is referred to as the Z-axis direction.
- the X-axis direction, the Y-axis direction, and the Z-axis direction are orthogonal to each other.
- the XY coordinate planes used in the following description are defined in the X-axis direction and the Y-axis direction.
- the surveillance camera 10 includes a surveillance camera main body 20 and a lens device 70.
- the surveillance camera main body 20 is an example of the “imaging apparatus main body” according to the technique of the present disclosure.
- the surveillance camera body 20 includes a lens mount 22.
- the lens device 70 is separate from the surveillance camera main body 20, and is detachably attached to the lens mount 22.
- the lens device 70 is provided on the surveillance camera body 20 by being attached to the lens mount 22.
- the surveillance camera body 20 includes an image sensor 24.
- the image sensor 24 is, for example, a CMOS image sensor, which photoelectrically converts the received light and outputs an electric signal corresponding to the received light.
- the CMOS image sensor is merely an example, and the image sensor 24 may be an image sensor whose operation method is different from that of a CMOS image sensor such as a CCD image sensor.
- the image sensor 24 has a light receiving surface 24A.
- the image pickup region light incident on the lens device 70 is imaged on the light receiving surface 24A by the lens device 70.
- An image is obtained by forming an image of the light in the imaging region on the light receiving surface 24A.
- a plurality of photodiodes are arranged in a matrix on the light receiving surface 24A. Each photodiode receives light in the imaging region.
- the image sensor 24 captures an imaging region by receiving light in the imaging region.
- the plurality of photodiodes include a silicon photodiode that is sensitive to visible light and an indium gallium arsenide photodiode that is sensitive to near-infrared light.
- the image sensor 24 takes an image of each of the visible light and the near-infrared light included in the image pickup region light imaged on the light receiving surface 24A.
- the lens device 70 has an optical axis OA.
- the optical axis OA is an axis that passes through the center of the light receiving surface 24A and is perpendicular to the light receiving surface 24A.
- the optical axis OA is parallel to the Z axis.
- the lens device 70 includes a focus lens 72, a zoom lens 74, an aperture 76, a filter unit 78, a blur correction lens 80, and a shift lens 82.
- the optical axis OA is an axis that passes through the center of each lens of the focus lens 72, the zoom lens 74, the blur correction lens 80, and the shift lens 82.
- the optical axis OA is also the optical axis of each lens of the focus lens 72, the zoom lens 74, the blur correction lens 80, and the shift lens 82.
- a focus lens 72, a zoom lens 74, an aperture 76, a filter unit 78, a blur correction lens 80, and a shift lens 82 are arranged in order from the subject side to the image side along the optical axis OA.
- the blur correction lens 80 and the shift lens 82 are arranged closer to the image sensor 24 than the zoom lens 74.
- the blur correction lens 80 and the shift lens 82 are arranged on the image sensor 24 side of the focus lens 72 as an example.
- the blur correction lens 80 and the shift lens 82 are arranged on the image sensor 24 side of the aperture 76 as an example.
- the filter unit 78 is arranged closer to the subject than the image sensor 24.
- the filter unit 78 is arranged between the aperture 76 and the blur correction lens 80.
- the blur correction lens 80 is an example of the "moving lens” and the “first lens” according to the technique of the present disclosure
- the shift lens 82 is an example of the "moving lens” and the “second lens” according to the technique of the present disclosure.
- a plurality of lenses including a focus lens 72, a zoom lens 74, a blur correction lens 80, and a shift lens 82 are examples of "lenses” according to the technique of the present disclosure.
- the optical axis OA is an example of the "optical axis of the lens” according to the technique of the present disclosure
- the XY coordinate plane is an example of the "coordinate plane intersecting the optical axis of the lens” according to the technique of the present disclosure. ..
- the X-axis direction is an example of the "first direction” according to the technique of the present disclosure
- the Y-axis direction is an example of the "second direction intersecting the first direction” according to the technique of the present disclosure.
- the image pickup region light is incident on the focus lens 72.
- the focus lens 72 guides the incident image pickup region light to the zoom lens 74.
- the zoom lens 74 comprises a lens group having a plurality of lenses that can move along the optical axis OA, and is used for zooming in the imaging region.
- the aperture 76 has an opening 76A.
- the imaging region light guided by the zoom lens 74 passes through the aperture 76A.
- the diaphragm 76 is a movable diaphragm whose diameter of the opening 76A can be changed. That is, the amount of light in the imaging region is changed by the aperture 76.
- the image pickup region light transmitted through the diaphragm 76 is incident on the filter unit 78.
- the filter unit 78 has a plurality of optical filters having translucency, and is included in the image pickup region light by switching the optical filter that transmits light among the plurality of optical filters. It selectively transmits light in a plurality of wavelength bands (for example, visible light and near-infrared light in different wavelength bands within the near-infrared wavelength band).
- the filter unit 78 is an example of the “switching mechanism for switching the wavelength band of light transmitted through the lens” according to the technique of the present disclosure.
- the blur correction lens 80 is a lens for correcting the blur of the image obtained by forming the image pickup region light on the image sensor 24 as described later, and the shift lens 82 receives the image on the light receiving surface of the image sensor 24. It is a lens for shifting along 24A.
- the blur correction lens 80 and the shift lens 82 form a master lens group.
- the master lens group may include a lens other than the blur correction lens 80 and the shift lens 82.
- the image pickup region light incident on the shift lens 82 is imaged on the light receiving surface 24A.
- the image pickup region light incident on the lens device 70 is guided to the image sensor 24 by the plurality of lenses provided in the lens device 70, and is imaged on the light receiving surface 24A of the image sensor 24.
- Each of the focus lens 72, the zoom lens 74, the blur correction lens 80, and the shift lens 82 may be a single lens or a lens group having a plurality of lenses.
- the lens device 70 may include other lenses in addition to the focus lens 72, the zoom lens 74, the blur correction lens 80, and the shift lens 82.
- the order of the focus lens 72, the zoom lens 74, the aperture 76, the filter unit 78, the blur correction lens 80, and the shift lens 82 may be other than the above.
- the filter unit 78 includes a disk 84.
- the disk 84 is provided with an Ir cut filter 86, a first BPF88A, a second BPF88B, a third BPF88C, and a fourth BPF88D as a plurality of optical filters at equal intervals along the circumferential direction.
- the Ir cut filter 86, the first BPF88A, the second BPF88B, the third BPF88C, and the fourth BPF88D are referred to as an optical filter unless it is necessary to separately explain them.
- the first BPF88A, the second BPF88B, the third BPF88C, and the fourth BPF88D are referred to as BPF88, unless it is necessary to explain them separately.
- the filter unit 78 selectively inserts and removes a plurality of optical filters in the lens device 70 with respect to the optical path of the imaging region light (hereinafter, simply referred to as “optical path”) in the lens device 70 by a turret method. Specifically, by rotating the filter unit 78 along the circumferential direction (for example, the direction of the arc dashed arrow shown in FIG. 3), the Ir cut filter 86, the first BPF88A, the second BPF88B, the third BPF88C, and the fourth BPF88D are It is selectively inserted and removed with respect to the optical path (in the example shown in FIG. 3, the optical axis OA). As a result, the Ir cut filter 86, the first BPF88A, the second BPF88B, the third BPF88C, and the fourth BPF88D transmit light in different wavelength bands.
- the optical axis OA penetrates the center of the optical path, and the center of the optical filter inserted into the optical path coincides with the center of the light receiving surface 24A.
- the optical axis OA penetrates the center of the Ir cut filter 86, and the center of the Ir cut filter 86 and the center of the light receiving surface 24A are one. I am doing it.
- the Ir cut filter 86 is an optical filter that cuts infrared rays and transmits only light other than infrared rays.
- BPF88 is an optical filter that transmits near-infrared light.
- the first BPF88A, the second BPF88B, the third BPF88C, and the fourth BPF88D transmit near-infrared light having different wavelength bands.
- the first BPF88A is an optical filter corresponding to a band near 1000 nm (nanometers). That is, the first BPF88A transmits only near-infrared light in the band near 1000 nm.
- the second BPF88B is an optical filter corresponding to a band near 1250 nm. That is, the second BPF88B transmits only near-infrared light in the band near 1250 nm.
- the third BPF88C is an optical filter corresponding to a band near 1550 nm. That is, the third BPF88C transmits only near-infrared light in the band near 1550 nm.
- the fourth BPF88D is an optical filter corresponding to a band near 2150 nm.
- each band mentioned here includes an error that is generally allowed in the technical field to which the technique of the present disclosure belongs and is within a range that does not deviate from the purpose of the technique of the present disclosure.
- each wavelength band mentioned here is merely an example, and may be different wavelength bands.
- the image sensor 24 has a light receiving unit 26 and a color filter unit 28.
- the light receiving unit 26 has a plurality of first light receiving elements 30 and a plurality of second light receiving elements 32.
- An example of the first light receiving element 30 is an indium gallium arsenic photodiode.
- An example of the second light receiving element 32 is a silicon photodiode.
- a color filter unit 28 is arranged on the plurality of first light receiving elements 30 and the plurality of second light receiving elements 32.
- the color filter unit 28 has an Ir filter, an R filter, a G filter, and a B filter.
- the Ir filter is a filter that transmits light of a near infrared (Ir) component.
- the R filter is a filter that transmits light of the red (R) component.
- the G filter is a filter that transmits light of a green (G) component.
- the B filter is a filter that transmits light of the blue (B) component.
- the filter arranged in the color filter unit 28 can be freely changed, and all of them may be filters that transmit light of the Ir component.
- the first light receiving element 30 is a light receiving element having sensitivity to the light of the Ir component.
- the second light receiving element 32 is roughly classified into a light receiving element 32R having sensitivity to light of R component, a light receiving element 32G having sensitivity to light of G component, and a light receiving element 32B having sensitivity to light of B component. ..
- An Ir filter is arranged on the first light receiving element 30.
- An R filter is arranged on the light receiving element 32R.
- a G filter is arranged on the light receiving element 32G.
- a B filter is arranged on the light receiving element 32B.
- a filter for blocking near-infrared light is further arranged in each of the light receiving elements 32R, 36G and 36B.
- the plurality of first light receiving elements 30 receive the near-infrared light transmitted through any of the plurality of BPF 88s, and the near-infrared light is based on the received near-infrared light.
- the image 62 is generated and output, and the plurality of second light receiving elements 32 receive the visible light transmitted through the Ir cut filter 86, and generate and output the visible light image 60 based on the received visible light.
- the surveillance camera main body 20 includes a controller 40 and a UI system device 50.
- the controller 40 controls the operation of the surveillance camera body 20.
- the controller 40 includes a CPU 42, an NVM 44, and a RAM 46.
- the CPU 42, NVM 44, and RAM 46 are connected to the bus 48.
- NVM44 stores various parameters and various programs.
- An example of the NVM44 is an EEPROM (for example, a flash type EEPROM).
- EEPROM is just an example of NVM44.
- the NVM 44 may be any non-volatile storage device such as SSD and / or HDD.
- the RAM 46 temporarily stores various information and is used as a work memory.
- An example of the RAM 46 is a DRAM.
- DRAM is just an example of RAM 46.
- the RAM 46 may be a SRAM and may be any volatile storage device.
- the CPU 42 reads a necessary program from the NVM 44 and executes the read program on the RAM 46.
- the CPU 42 executes various processes according to a program executed on the RAM 46.
- the UI device 50 is also connected to the bus 48. Under the control of the CPU 42, the UI system device 50 receives an instruction given by the user and presents various information obtained by being processed by the surveillance camera 10 to the user.
- the surveillance camera main body 20 includes an image sensor driver 52, a signal processing device 54, a blur amount detection sensor 56, and a communication I / F 58.
- the image sensor driver 52, the signal processing device 54, the blur amount detection sensor 56, and the communication I / F 58 are connected to the bus 48.
- the image sensor 24 is located on the optical axis OA after the shift lens 82, that is, on the image side of the shift lens 82.
- the image sensor 24 in a state where the Ir cut filter 86 is arranged on the optical axis OA, the image sensor 24 has an image pickup region based on the visible light imaged on the light receiving surface 24A by the shift lens 82.
- the visible light image 60 shown in FIG. 4 is generated by imaging the image, and the generated visible light image 60 is output to the subsequent stage.
- the visible light image 60 is an image showing an image pickup region by visible light.
- the image sensor 24 captures an image pickup region based on the near-infrared light imaged on the light receiving surface 24A by the shift lens 82.
- the near-infrared light image 62 shown in FIG. 4 is generated, and the generated near-infrared light image 62 is output to the subsequent stage.
- the near-infrared light image 62 is an image showing an image pickup region by near-infrared light. In the following, when it is not necessary to distinguish between the near-infrared light image 62 and the visible light image 60, they are referred to as “captured images” without reference numerals.
- an image sensor driver 52 and a signal processing device 54 are connected to the image sensor 24.
- the image sensor driver 52 outputs a timing control signal to the image sensor 24 under the control of the CPU 42.
- the timing control signal is a signal that controls imaging by the image sensor 24.
- the frame rate of the image taken by the image sensor 24 is defined by the timing control signal.
- the timing control signal includes a vertical synchronization signal and a horizontal synchronization signal.
- the vertical synchronization signal is a signal that defines the timing at which transmission of an analog image for one frame is started.
- the horizontal synchronization signal is a signal that defines the timing at which the output of an analog image for one horizontal line is started.
- the image sensor 24 starts outputting the captured image to the signal processing device 54 in frame units according to the vertical synchronization signal input from the image sensor driver 52. Further, the image sensor 24 starts outputting the captured image to the signal processing device 54 in units of horizontal lines according to the horizontal synchronization signal input from the image sensor driver 52.
- the signal processing device 54 Under the control of the CPU 42, the signal processing device 54 performs signal processing such as demosaic processing, noise removal processing, gradation correction processing, and color correction processing on the captured image input from the image sensor 24.
- the captured image after signal processing is output to the CPU 42 by the signal processing device 54.
- the CPU 42 stores the captured image input from the signal processing device 54 in a predetermined storage area (for example, NVM 44 and / or RAM 46, etc.).
- the blur amount detection sensor 56 detects, for example, the amount of blur of the surveillance camera 10 shown in FIG. 2 (hereinafter, also simply referred to as “shake amount”).
- the blurring of the surveillance camera 10 refers to a phenomenon in which the positional relationship between the optical axis OA and the light receiving surface 24A fluctuates in the surveillance camera 10.
- the image is blurred.
- an image obtained by being imaged by an image sensor and / or an optical image obtained by being imaged on the light receiving surface 24A hereinafter, simply "image” or "subject”). Also called “image”).
- image blur is a phenomenon in which the subject image deviates from the reference position due to the tilt of the optical axis OA due to the vibration phenomenon, that is, the subject is caused by the relative movement of the optical axis OA with respect to the subject. It refers to the phenomenon that the image deviates from the reference position.
- the vibration phenomenon is a lens device 70 in which vibration is generated from the outside of the surveillance camera 10 (for example, a hand, a wind, and / or a vehicle, etc.) and / or the inside of the surveillance camera 10 (for example, a motor mounted on the surveillance camera 10). Refers to a phenomenon in which the lens device 70 vibrates when transmitted to the camera.
- the optical axis OA is tilted means, for example, with respect to the reference axis (for example, the optical axis OA before the vibration phenomenon occurs (that is, the optical axis OA when the surveillance camera 10 is stationary)). It means that the optical axis OA is tilted.
- the "reference position” refers to, for example, the position of the subject image obtained in a state where vibration is not applied to the lens device 70 (for example, the position of the subject image in the light receiving surface 24A).
- the shake amount detection sensor 56 shown in FIG. 5 is, for example, a gyro sensor.
- the gyro sensor detects the amount of rotational shake around each of the X-axis, Y-axis, and Z-axis.
- the shake amount detection sensor 56 converts the amount of rotational shake around the X-axis and the amount of rotational shake around the Y-axis detected by the gyro sensor into the amount of shake in a two-dimensional plane parallel to the X-axis and the Y-axis. By converting, the amount of blurring of the surveillance camera 10 is detected.
- the meaning of parallelism in the present embodiment includes not only the meaning of perfect parallelism but also the meaning of substantially parallelism including errors allowed in design and manufacturing.
- the gyro sensor is mentioned as an example of the shake amount detection sensor 56, but this is only an example, and the shake amount detection sensor 56 may be an acceleration sensor.
- the accelerometer detects the amount of blurring in a two-dimensional plane parallel to the X-axis and the Y-axis.
- the blur amount detection sensor 56 outputs the detected blur amount to the CPU 42.
- the amount of blur is detected by a physical sensor called the blur amount detection sensor 56
- the technique of the present disclosure is not limited to this.
- the motion vector obtained by comparing the captured images stored in the NVM 44 or the RAM 46 in chronological order may be used as the amount of blur.
- the amount of blur finally used may be derived based on the amount of blur detected by the physical sensor and the motion vector obtained by the image processing.
- the communication I / F 58 is, for example, a network interface, and controls transmission of various information to and from the management device 11 via the network.
- An example of a network is a WAN such as the Internet or a public communication network.
- the communication I / F 58 controls communication between the surveillance camera 10 shown in FIG. 1 and the management device 11.
- the lens device 70 includes a controller 90.
- the controller 90 controls the operation of the lens device 70.
- the controller 90 includes a CPU 92, an NVM 94, and a RAM 96.
- the controller 90 is an example of a "computer applied to a lens device"
- the CPU 92 is an example of a “processor” according to the technique of the present disclosure
- the RAM 96 is an example of the "memory” according to the technique of the present disclosure. This is just one example.
- the CPU 92, NVM 94, and RAM 96 are connected to the bus 98.
- the lens device 70 when the lens device 70 is attached to the lens mount 22 of the surveillance camera body 20, a connector (not shown) provided on the surveillance camera body 20 and a connector provided on the lens device 70 are provided. (Not shown) is connected. Then, the CPU 42 of the surveillance camera body 20 shown in FIG. 5 and the CPU 92 of the lens device 70 shown in FIG. 6 are communicably connected via a connection path including the connector of the surveillance camera body 20 and the connector of the lens device 70. Will be done. The CPU 92 of the lens device 70 controls the operation of the lens device 70 according to an instruction given from the CPU 42 of the surveillance camera main body 20.
- NVM94 stores various parameters and various programs.
- An example of the NVM94 is an EEPROM (for example, a flash type EEPROM).
- EEPROM is just an example of NVM94.
- the NVM94 may be any non-volatile storage device such as SSD and / or HDD.
- the RAM 96 temporarily stores various information and is used as a work memory.
- An example of RAM 96 is DRAM.
- DRAM is just an example of RAM 96.
- the RAM 96 may be a SRAM, and may be any volatile storage device.
- the CPU 92 reads a necessary program from the NVM 94 and executes the read program on the RAM 96.
- the CPU 92 executes various processes according to a program executed on the RAM 96.
- the "various programs" referred to here also include an imaging support processing program 100 (see FIG. 9) described later.
- the triaxial directions orthogonal to each other are defined in the X-axis direction, the Y-axis direction, and the Z-axis direction.
- the X-axis direction, the Y-axis direction, and Z of the lens device 70 may deviate from the X-axis direction, the Y-axis direction, and the Z-axis direction of the surveillance camera 10, respectively.
- the X-axis direction, the Y-axis direction, and Z of the lens device 70 It is assumed that the axial direction coincides with the X-axis direction, the Y-axis direction, and the Z-axis direction of the surveillance camera 10, respectively.
- the X-axis direction and the Y-axis direction are directions orthogonal to the optical axis OA of the lens device 70, respectively, and the Z-axis direction is a direction parallel to the optical axis OA.
- the lens device 70 includes a first motor driver 102, a second motor driver 104, a third motor driver 106, a fourth motor driver 108, a fifth motor driver 110, and a sixth motor driver 112. To prepare for. Further, the lens device 70 includes a first motor 118, a second motor 120, a third motor 122, a fourth motor 124, a fifth motor 126, and a sixth motor 128. Further, the lens device 70 includes a first position sensor 134, a second position sensor 136, a third position sensor 138, a fourth position sensor 140, a fifth position sensor 142, and a sixth position sensor 144.
- the position sensor 138, the fourth position sensor 140, the fifth position sensor 142, and the sixth position sensor 144 are connected to the bus 98.
- each of the first position sensor 134, the second position sensor 136, the third position sensor 138, the fourth position sensor 140, the fifth position sensor 142, and the sixth position sensor 144 is a potentiometer.
- the first position sensor 134 detects the position of the focus lens 72 in the Z-axis direction.
- the second position sensor 136 detects the position of the zoom lens 74 in the Z-axis direction.
- the third position sensor 138 detects the aperture of the opening 76A formed in the aperture 76.
- the fourth position sensor 140 detects the rotational position of the filter unit 78 with respect to the optical axis OA.
- the fifth position sensor 142 detects the position of the blur correction lens 80 on the XY coordinate plane.
- the sixth position sensor 144 detects the position of the shift lens 82 on the XY coordinate plane.
- the detection result by the first position sensor 134 is output to the CPU 92 by the first position sensor 134.
- the detection result by the second position sensor 136 is output to the CPU 92 by the second position sensor 136.
- the detection result by the third position sensor 138 is output to the CPU 92 by the third position sensor 138.
- the detection result by the 4th position sensor 140 is output to the CPU 92 by the 4th position sensor 140.
- the detection result by the 5th position sensor 142 is output to the CPU 92 by the 5th position sensor 142.
- the detection result by the 6th position sensor 144 is output to the CPU 92 by the 6th position sensor 144.
- the focus lens 72 is attached to the first slide mechanism (not shown).
- the first slide mechanism is mechanically connected to the drive shaft of the first motor 118, and receives the power of the first motor 118 to move the focus lens 72 along the Z-axis direction.
- the first motor driver 102 is connected to the first motor 118 and controls the first motor 118 according to an instruction from the CPU 92.
- the CPU 92 controls the position of the focus lens 72 in the Z-axis direction by controlling the first motor 118 via the first motor driver 102 based on the detection result by the first position sensor 134.
- the zoom lens 74 is attached to a second slide mechanism (not shown).
- the second slide mechanism is mechanically connected to the drive shaft of the second motor 120, and receives the power of the second motor 120 to move the zoom lens 74 along the Z-axis direction.
- the second motor driver 104 is connected to the second motor 120 and controls the second motor 120 according to the instruction from the CPU 92.
- the CPU 92 controls the position of the zoom lens 74 in the Z-axis direction by controlling the second motor 120 via the second motor driver 104 based on the detection result by the second position sensor 136.
- the diaphragm 76 has a plurality of blades (not shown) capable of opening and closing the opening 76A.
- the plurality of blades are mechanically connected to the drive shaft of the third motor 122, and open and close the opening 76A by receiving the power of the third motor 122.
- the third motor driver 106 is connected to the third motor 122 and controls the third motor 122 according to the instruction from the CPU 92.
- the CPU 92 controls the third motor 122 via the third motor driver 106 shown in FIG. 6 based on the detection result by the third position sensor 138 and the light receiving amount on the light receiving surface 24A shown in FIG. , Adjust the opening of the opening 76A.
- the filter unit 78 is attached to a rotation mechanism (not shown).
- the rotation mechanism is mechanically connected to the drive shaft of the fourth motor 124, and receives the power of the fourth motor 124 to rotate the filter unit 78 (see FIG. 3) in the circumferential direction, thereby causing a plurality of rotation mechanisms. Insert and remove the optical filter into the optical path.
- the fourth motor driver 108 is connected to the fourth motor 124 and controls the fourth motor 124 according to the instruction from the CPU 92.
- the CPU 92 controls the rotation position of the filter unit 78 with respect to the optical axis OA by controlling the fourth motor 124 via the fourth motor driver 108 based on the detection result by the fourth position sensor 140.
- the blur correction lens 80 is attached to a fifth slide mechanism (not shown).
- the fifth slide mechanism is mechanically connected to the drive shaft of the fifth motor 126, and receives the power of the fifth motor 126 to move the blur correction lens 80 along the XY coordinate plane. That is, the blur correction lens 80 moves along both the X-axis direction and the Y-axis direction.
- the fifth motor driver 110 is connected to the fifth motor 126 and controls the fifth motor 126 according to an instruction from the CPU 92.
- the CPU 92 controls the position of the blur correction lens 80 on the XY coordinate plane by controlling the fifth motor 126 via the fifth motor driver 110 based on the detection result by the fifth position sensor 142.
- the fifth motor 126 is an example of the "drive mechanism” and the "first drive mechanism” according to the technique of the present disclosure.
- the fifth motor 126 that moves the blur correction lens 80 along the XY coordinate planes specifically includes an X-axis motor that moves the blur correction lens 80 along the X-axis direction and a blur correction lens 80. Includes a Y-axis motor that moves the lens along the Y-axis direction.
- the X-axis motor and the Y-axis motor forming the fifth motor 126 are, for example, voice coil motors.
- the fifth position sensor that detects the position of the blur correction lens 80 on the XY coordinate plane is specifically an X-axis position sensor that detects the position of the blur correction lens 80 in the X-axis direction and a Y-axis direction. Includes a Y-axis position sensor that detects the position of the blur correction lens 80 in.
- the shift lens 82 is attached to a sixth slide mechanism (not shown).
- the sixth slide mechanism is mechanically connected to the drive shaft of the sixth motor 128, and receives the power of the sixth motor 128 to move the shift lens 82 along the XY coordinate plane. That is, the shift lens 82 moves along both the X-axis direction and the Y-axis direction.
- the sixth motor driver 112 is connected to the sixth motor 128 and controls the sixth motor 128 according to the instruction from the CPU 92.
- the CPU 92 controls the position of the shift lens 82 on the XY coordinate plane by controlling the sixth motor 128 via the sixth motor driver 112 based on the detection result by the sixth position sensor 144.
- the sixth motor 128 is an example of the "drive mechanism” and the "second drive mechanism” according to the technique of the present disclosure.
- the sixth motor 128 that moves the shift lens 82 along the XY coordinate planes specifically includes an X-axis motor that moves the shift lens 82 along the X-axis direction and a shift lens 82 on the Y-axis. Includes a Y-axis motor that moves along the direction.
- the X-axis motor and the Y-axis motor forming the sixth motor 128 are, for example, DC motors.
- a piezoelectric element may be used instead of the X-axis motor and the Y-axis motor forming the sixth motor 128.
- the sixth position sensor for detecting the position of the shift lens 82 on the XY coordinate plane is specifically an X-axis position sensor for detecting the position of the shift lens 82 in the X-axis direction and a shift in the Y-axis direction. It includes a Y-axis position sensor that detects the position of the lens 82.
- the fifth motor 126 and the sixth motor 128 are separated from each other to the extent that the vibration is not transmitted. Is preferable. Further, it is preferable that the fifth motor 126 is fixed to the housing of the lens device 70 via an elastic member for vibration isolation such as a rubber sheet. Similarly, it is preferable that the sixth motor 128 is fixed to the housing of the lens device 70 via an elastic member for vibration isolation such as a rubber sheet.
- FIG. 7 shows an example of the optical characteristics of the blur correction lens 80 and the optical characteristics of the shift lens 82 in comparison.
- the optical characteristics of the blur correction lens 80 and the optical characteristics of the shift lens 82 are different.
- the optical characteristics referred to here are, for example, characteristics caused by the thickness, diameter, material, and the like of the lens, and are, for example, optical characteristics including the refractive index and the like.
- the difference between the optical characteristics of the blur correction lens 80 and the optical characteristics of the shift lens 82 will be described based on the difference between the blur correction sensitivity of the blur correction lens 80 and the shift sensitivity of the shift lens 82.
- the blur correction lens 80 shown by the alternate long and short dash line represents the blur correction lens 80 before correcting the blur of the image
- the blur correction lens 80 shown by the solid line corrects the blur of the image. It represents the blur correction lens 80 that has moved to the desired position.
- the optical axis OA represents the optical axis OA that passes through the center of the light receiving surface 24A of the image sensor 24 and is perpendicular to the light receiving surface 24A
- the optical axis OA1 is the blur correction lens 80 before correcting the blur of the image. It represents the optical axis.
- the blur correction sensitivity of the blur correction lens 80 is the ratio of the blur correction amount B1 of the image on the light receiving surface 24A of the image sensor 24 to the unit movement amount A of the blur correction lens 80.
- the unit movement amount A of the blur correction lens 80 is a predetermined constant movement amount when the blur correction lens 80 moves in the X-axis direction or the Y-axis direction.
- the image blur correction amount B1 is the amount of movement of the center of the image due to the image blur correction, and is the distance between the optical axis OA1 and the optical axis OA on the light receiving surface 24A of the image sensor 24. Equivalent to.
- correcting the blurring of an image means returning the center of the blurred image to the optical axis OA before the blurring occurs.
- the shift lens 82 shown by the alternate long and short dash line represents the shift lens 82 before shifting the image
- the blur shift lens 82 shown by the solid line shifts to the position where the image is shifted.
- the lens 82 represents the lens 82.
- the optical axis OA represents an optical axis OA that passes through the center of the light receiving surface 24A of the image sensor 24 and is perpendicular to the light receiving surface 24A
- the optical axis OA2 represents the optical axis of the shift lens 82 before shifting the image. Represents.
- the central ray E2 passing through the moved shift lens 82 on the optical axis OA2 (optical axis OA) is connected to a position shifted by the shift amount B2 from the center of the light receiving surface 24A. Be imaged.
- the shift sensitivity of the shift lens 82 is the ratio of the image shift amount B2 on the light receiving surface 24A of the image sensor 24 to the unit movement amount A of the shift lens 82.
- the unit movement amount A of the shift lens 82 is a predetermined constant movement amount when the shift lens 82 moves in the X-axis direction or the Y-axis direction.
- the image shift amount B2 is the amount of movement of the center of the image as the image is shifted.
- the difference between the blur correction sensitivity of the blur correction lens 80 and the shift sensitivity of the shift lens 82 will be specifically described on the assumption that they are the same.
- the shift sensitivity of the shift lens 82 is lower than the blur correction sensitivity of the blur correction lens 80. That is, when the unit movement amount A of the blur correction lens 80 and the unit movement amount A of the shift lens 82 are the same, the image on the light receiving surface 24A of the image sensor 24 with respect to the movement of the shift lens 82 with the unit movement amount A.
- the shift amount B2 is smaller than the blur correction amount B1 of the image on the light receiving surface 24A of the image sensor 24 with respect to the movement of the blur correction lens 80 in the unit movement amount A.
- the optical characteristic value of the blur correction lens 80 and the optical characteristic value of the shift lens 82 are set to values where the shift sensitivity of the shift lens 82 is lower than the blur correction sensitivity of the blur correction lens 80, respectively.
- the distance D1 from the center C1 in the thickness direction of the blur correction lens 80 to the light receiving surface 24A of the image sensor 24 and the light receiving surface 24A of the image sensor 24 from the center C2 in the thickness direction of the shift lens 82 was assumed that the distance to D2 was the same.
- the blur correction lens 80 and the shift lens 82 are arranged so as to be offset on the optical axis OA. Therefore, in the arrangement of the blur correction lens 80 and the shift lens 82 shown in FIG. 2, the distance from the center of the blur correction lens 80 in the thickness direction to the light receiving surface 24A of the image sensor 24 is an image from the center of the shift lens 82 in the thickness direction. It is different from the distance to the light receiving surface 24A of the sensor 24.
- FIG. 8 shows an example of the optical characteristics of the shift lens 82 in more detail.
- the shift lens 82 shown by the alternate long and short dash line represents the shift lens 82 before shifting the image
- the blur shift lens 82 shown by the solid line is the shift lens 82 moved to the position where the image is shifted.
- the optical axis OA represents an optical axis that passes through the center of the light receiving surface 24A of the image sensor 24 and is perpendicular to the light receiving surface 24A.
- the shift amount S1 is a shift amount on the light receiving surface 24A of the image sensor 24 of the central ray F1 passing through the shift lens 82 after movement on the optical axis OA with respect to the movement of the shift lens 82 in the unit movement amount A.
- the quantity S2 is a shift amount on the light receiving surface 24A of the image sensor 24 of the peripheral light ray F2 passing through the shift lens 82 after the movement other than on the optical axis OA with respect to the movement of the shift lens 82 in the unit movement amount A. Then, in the shift lens 82, the relationship of 0.8 ⁇ S2 / S1 ⁇ 1.2 is established. In other words, the optical characteristic value of the shift lens 82 is set to a value at which the relationship of 0.8 ⁇ S2 / S1 ⁇ 1.2 is established.
- the optical characteristic value of the shift lens 82 is set to a value at which the relationship of 0.8 ⁇ S2 / S1 ⁇ 1.2 is established, the image quality of the captured image is within the permissible range. Further, the resolution of the captured image is improved as compared with the case where the value of S2 / S1 is outside the above-mentioned specified range.
- the image pickup support process is realized by executing the image pickup support process program 100 by the CPU 92 of the lens device 70.
- the image pickup support processing program 100 is an example of a "program" according to the technique of the present disclosure.
- the image pickup support processing program 100 is stored in the NVM 94, and the CPU 92 reads the image pickup support processing program 100 from the NVM 94 and executes it on the RAM 96.
- the CPU 92 performs image pickup support processing according to the image pickup support processing program 100 executed on the RAM 96.
- the CPU 92 has an acquisition unit 150, a filter control unit 152, a blur correction amount calculation unit 154, a blur correction control unit 156, a shift amount calculation unit 158, and a shift control unit 160.
- the image pickup support process is a process including a filter change process (see FIG. 14), a blur correction process (see FIG. 15), and a shift process (see FIG. 16).
- the acquisition unit 150 acquires the filter designation information as the information transmitted from the CPU 42 of the surveillance camera main body 20.
- the filter designation information is command information for designating the optical filter to be used among the plurality of optical filters.
- the optical filter used is an optical filter arranged on the optical axis OA among a plurality of optical filters provided in the filter unit 78.
- the acquisition unit 150 acquires the position detection result by the fourth position sensor 140.
- the position detection result by the fourth position sensor 140 is information representing the result of detecting the rotational position of the filter unit 78 with respect to the optical axis OA.
- the filter control unit 152 issues a control command for arranging the optical filter designated by the filter designation information on the optical axis OA based on the filter designation information transmitted from the CPU 42 and the position detection result by the fourth position sensor 140. 4 Output to the motor driver 108.
- the fourth motor driver 108 controls the fourth motor 124 according to the control command.
- the optical filter designated by the filter designation information is arranged on the optical axis OA.
- the filter unit 78 is rotated and the Ir cut filter 86 is arranged on the optical axis OA.
- FIG. 10 shows, as an example, a state in which the Ir cut filter 86 is arranged on the optical axis OA. In this way, the filter unit 78 rotates, and the filter arranged on the optical axis OA among the plurality of optical filters is switched, so that the wavelength band of the light transmitted through the blur correction lens 80 and the shift lens 82 is switched. ..
- the filter designation information is stored in the RAM 96.
- the filter control unit 152 stores the filter designation information indicating that the Ir cut filter 86 is specified in the RAM 96.
- the acquisition unit 150 acquires the blur correction command and the blur detection result by the blur amount detection sensor 56 as the information transmitted from the CPU 42 of the surveillance camera main body 20.
- the blur correction command is command information to request blur correction
- the blur detection result by the blur amount detection sensor 56 is information representing the result of detecting the blur amount of the surveillance camera 10.
- the acquisition unit 150 acquires the position detection result by the fifth position sensor 142.
- the position detection result by the fifth position sensor 142 is information representing the result of detecting the position of the blur correction lens 80 on the XY coordinate plane.
- the acquisition unit 150 acquires the filter designation information stored in the RAM 96.
- the blur correction amount calculation unit 154 determines the operation direction for correcting the image blur of the fifth motor 126 based on the blur amount detection result by the blur amount detection sensor 56.
- the operating direction for correcting the blur of the image is determined in the direction opposite to the direction in which the image is blurred.
- the blur correction amount calculation unit 154 calculates an operation amount for correcting image blur for the fifth motor 126 based on the blur amount detection result by the blur amount detection sensor 56.
- the blur correction amount calculation unit 154 calculates the operation amount of the fifth motor 126 to return the position of the image blurred by the blur of the surveillance camera 10 to the position of the image before the blur of the surveillance camera 10 occurs. ..
- the position of the focal point on the image side is located.
- the deviation causes the blur correction sensitivity of the blur correction lens 80 to change.
- the light received by the image sensor 24 is received between the case where the light transmitted through the blur correction lens 80 is visible light and the case where the light transmitted through the blur correction lens 80 is near infrared light.
- the movement amount A1 of the blur correction lens 80 required for the same blur correction amount B1 on the surface 24A is different.
- the movement amount A1 required when the light transmitted through the blur correction lens 80 is visible light is such that the light transmitted through the blur correction lens 80 is near-infrared light. It is less than the movement amount A1 required when.
- the blur correction amount calculation unit 154 calculates the operating amount corresponding to the optical filter specified by the filter designation information for the operating amount of the fifth motor 126 that corrects the blur of the image. For example, when the optical filter specified by the filter designation information is the Ir cut filter 86, the blur correction amount calculation unit 154 corresponds to the Ir cut filter 86 based on the blur amount detection result by the blur amount detection sensor 56. Calculate the amount of operation. Further, when the optical filter designated by the filter designation information is BPF88, the blur correction amount calculation unit 154 calculates the operating amount corresponding to the BPF88 based on the blur amount detection result by the blur amount detection sensor 56.
- the operating amount is calculated so that the blur correction amount B1 proportional to the detection result by the blur amount detection sensor 56 can be obtained.
- the operating amount corresponding to the optical filter specified by the filter designation information may be predetermined for each of the plurality of optical filters according to the blur amount detection result by the blur amount detection sensor 56, and various calculation formulas are used. It may be calculated.
- the blur correction control unit 156 acquires the operating direction of the fifth motor 126 determined by the blur correction amount calculation unit 154 and the operating amount of the fifth motor 126 calculated by the blur correction amount calculation unit 154, the acquired fifth motor 126 is acquired.
- the operating direction and operating amount of the motor 126 are set as target values, and a control command is generated based on the position detection result by the fifth position sensor 142.
- the control command is output to the fifth motor driver 110.
- the fifth motor driver 110 generates an operation signal based on the control command generated by the blur correction control unit 156.
- the operation signal is, for example, a continuous wave.
- the fifth motor 126 operates in the operating direction and operating amount according to the operating signal.
- power is applied to the blur correction lens 80 in the direction in which the blur of the image is corrected, so that the blur correction lens 80 moves.
- the blur correction lens 80 moves with the movement amount A1 corresponding to the Ir cut filter 86
- the optical filter specified by the filter specification information is the BPF88. If this is the case, the blur correction lens 80 moves with the movement amount A1 corresponding to the BPF 88.
- the blur correction control unit 156 controls the fifth motor 126 to change the movement amount A1 of the blur correction lens 80 based on the wavelength band of the light transmitted through the blur correction lens 80. Therefore, even if the wavelength band of the light transmitted through the blur correction lens 80 changes, the influence of the change in the blur correction sensitivity of the blur correction lens 80 is suppressed, and the blur correction proportional to the detection result by the blur amount detection sensor 56 is suppressed.
- the quantity B1 is obtained.
- the surveillance camera 10 In order to correct the blurring of the image referred to here, in addition to matching the position of the image blurred by the blurring of the surveillance camera 10 with the position of the image before the blurring of the surveillance camera 10 occurs, the surveillance camera 10 It also includes bringing the position of the blurred image due to the blurring closer to the position of the image before the blurring of the surveillance camera 10.
- the control by the blur correction control unit 156 described above is a feedback control based on the blur amount detection result (that is, the blur amount of the surveillance camera 10) by the blur amount detection sensor 56.
- the acquisition unit 150 acquires the image shift command and the frame period information as the information transmitted from the CPU 42 of the surveillance camera main body 20.
- the image shift command is command information to request the image shift, and is information indicating the image shift direction and shift amount. Further, the acquisition unit 150 acquires the position detection result by the sixth position sensor 144. Further, the acquisition unit 150 acquires the filter designation information stored in the RAM 96.
- the image shift amount B2 is defined by, for example, a pitch equal to or higher than the pixel pitch of the image sensor 24 or a pitch lower than the pixel pitch of the image sensor 24.
- the pitch equal to or higher than the pixel pitch of the image sensor 24 is, for example, 1 pitch, 1.5 pitch, 2.5 pitch, 3.5 pitch, or the like.
- the pitch larger than the pixel pitch of the image sensor 24 is defined by (n + d) ⁇ p.
- the pitch less than the pixel pitch of the image sensor 24 is, for example, 0.25 pitch, 0.5 pitch, 0.75 pitch, or the like.
- the pitch less than the pixel pitch of the image sensor 24 is defined by D ⁇ p.
- the frame cycle information is information that defines the frame cycle synchronized with the timing control signal output from the CPU 42 to the image sensor driver 52 (see FIG. 5).
- the frame period is a period in which imaging is performed in frame units.
- the shift amount calculation unit 158 is based on the image shift direction represented by the image shift command, the frame cycle represented by the frame cycle information, and the position detection result by the sixth position sensor 144, and the operating direction of the sixth motor 128 for each frame cycle. To determine. The operating direction of the sixth motor 128 is determined based on the image shift direction indicated by the image shift command and the position detection result by the sixth position sensor 144.
- the wavelength band differs depending on whether the light transmitted through the shift lens 82 is visible light or the light transmitted through the shift lens 82 is near infrared light. Since they are different, the shift sensitivity of the shift lens 82 changes due to the shift of the focal position on the image side. In other words, as shown in FIG. 12, the light receiving surface 24A of the image sensor 24 depends on whether the light transmitted through the shift lens 82 is visible light or the light transmitted through the shift lens 82 is near infrared light. The movement amount A2 of the shift lens 82 required for the same shift amount B2 in the above is different.
- the movement amount A2 required when the light transmitted through the shift lens 82 is visible light is when the light transmitted through the shift lens 82 is near infrared light.
- the amount of movement required for A2 is less than that of A2.
- the shift amount calculation unit 158 calculates the operation amount corresponding to the optical filter specified by the filter designation information for the operation amount of the sixth motor 128 that shifts the image. For example, when the optical filter specified by the filter designation information is the Ir cut filter 86, the shift amount calculation unit 158 operates the amount corresponding to the Ir cut filter 86 based on the image shift amount represented by the image shift command. Is calculated. Further, when the optical filter designated by the filter designation information is BPF88, the shift amount calculation unit 158 calculates the operation amount corresponding to the BPF88 based on the shift amount of the image represented by the image shift command.
- the operating amount at which the image is shifted to the position corresponding to the image shift amount indicated by the image shift command is calculated.
- the operating amount corresponding to the optical filter specified by the filter designation information may be predetermined according to the image shift amount represented by the image shift command for each of a plurality of optical filters, and is calculated using various calculation formulas. May be done.
- the shift control unit 160 issues a control command for each frame cycle according to the operation direction of the sixth motor 128 determined by the shift amount calculation unit 158 and the operation amount of the sixth motor 128 calculated by the shift amount calculation unit 158. Generate.
- the control command is output to the sixth motor driver 112.
- the sixth motor driver 112 generates an operation signal based on the control command generated by the shift control unit 160.
- the operation signal is, for example, a pulse wave.
- the period of the operation signal is synchronized with the frame period specified by the frame period information.
- the sixth motor 128 operates with an operating amount according to the operating signal.
- power is applied to the shift lens 82 in the direction of shifting the image at each frame cycle, so that the shift lens 82 moves.
- the optical filter specified by the filter specification information is the Ir cut filter 86
- the blur correction lens 80 moves with the movement amount A2 corresponding to the Ir cut filter 86
- the optical filter specified by the filter specification information is the BPF88. If this is the case, the blur correction lens 80 moves with the movement amount A2 corresponding to the BPF 88.
- the shift control unit 160 controls the sixth motor 128 to change the movement amount A2 of the shift lens 82 based on the wavelength band of the light transmitted through the shift lens 82. Therefore, even if the wavelength band of the light transmitted through the blur correction lens 80 changes, the influence of the change in the shift sensitivity of the shift lens 82 is suppressed, and the image is positioned at a position corresponding to the image shift amount indicated by the image shift command. Is shifted.
- the control by the shift control unit 160 described above is not based on the blur amount detection result by the blur amount detection sensor 56 (that is, the blur amount of the surveillance camera 10), but is a sequence control based on a predetermined shift order.
- the image is shifted at each frame cycle in this way, and each time the image is shifted, the CPU 42 of the surveillance camera body 20 controls the image sensor 24 to perform image pickup.
- images 162 of a plurality of frames corresponding to each of the frame periods can be obtained.
- the composite image 164 is obtained by synthesizing the images 162 of the plurality of frames by the CPU 42 of the surveillance camera main body 20.
- the composite image 164 can be obtained, for example, as follows. That is, when the shift amount of the image is the same pitch as the pixel pitch of the image sensor 24, among the images 162 of the plurality of frames, a plurality of image pixels forming one image and a plurality of image pixels forming another image are formed. By superimposing the image pixels, a composite image 164 can be obtained from the images 162 of a plurality of frames. The composite image 164 thus obtained is an image that does not require demosaic processing. Further, when the shift amount of the image is a pitch larger than the pixel pitch of the image sensor 24 or when the shift amount of the image is a pitch smaller than the pixel pitch of the image sensor 24, one of the images 162 of the plurality of frames is used.
- the composite image 164 can be obtained from the images 162 of the plurality of frames.
- the composite image 164 thus obtained is an image having a higher resolution than the image 162 of a plurality of frames.
- the filter change process in the image pickup support process will be described with reference to FIGS. 10 and 14.
- the CPU 92 of the lens device 70 executes the filter change process shown in FIG.
- step ST100 the acquisition unit 150 acquires the filter designation information transmitted from the CPU 42 of the surveillance camera main body 20. Further, the acquisition unit 150 acquires the position detection result by the fourth position sensor 140.
- the filter control unit 152 places the optical filter designated by the filter designation information on the optical axis OA based on the filter designation information transmitted from the CPU 42 and the position detection result by the fourth position sensor 140.
- the control command to be arranged is output to the fourth motor driver 108.
- the fourth motor driver 108 controls the fourth motor 124 according to the control command.
- the optical filter designated by the filter designation information is arranged on the optical axis OA.
- the filter unit 78 is rotated and the Ir cut filter 86 is arranged on the optical axis OA.
- the filter unit 78 rotates, and the filter arranged on the optical axis OA among the plurality of optical filters is switched, so that the wavelength band of the light transmitted through the blur correction lens 80 and the shift lens 82 is switched. ..
- the filter control unit 152 stores the filter designation information in the RAM 96. For example, when the Ir cut filter 86 is positioned on the optical axis OA, the filter control unit 152 stores the filter designation information indicating that the Ir cut filter 86 is specified in the RAM 96.
- step ST110 the acquisition unit 150 acquires the blur correction command transmitted from the CPU 42 of the surveillance camera main body 20. Further, in step ST112, the acquisition unit 150 acquires the blur amount detection result transmitted from the CPU 42 of the surveillance camera main body 20. Further, in step ST114, the acquisition unit 150 acquires the filter designation information stored in the RAM 96. Further, the acquisition unit 150 acquires the position detection result by the fifth position sensor 142.
- the blur correction amount calculation unit 154 determines the operation direction for correcting the image blur of the fifth motor 126 based on the blur amount detection result by the blur amount detection sensor 56.
- the operating direction for correcting the blur of the image is determined in the direction opposite to the direction in which the image is blurred.
- the blur correction amount calculation unit 154 calculates the operation amount for correcting the image blur of the fifth motor 126 based on the blur amount detection result by the blur amount detection sensor 56. Specifically, the blur correction amount calculation unit 154 calculates the operation amount of the fifth motor 126 to return the position of the image blurred by the blur of the surveillance camera 10 to the position of the image before the blur of the surveillance camera 10 occurs. ..
- the blur correction amount calculation unit 154 calculates the operating amount corresponding to the optical filter specified by the filter designation information for the operating amount of the fifth motor 126 that corrects the image blur. For example, when the optical filter specified by the filter designation information is the Ir cut filter 86, the blur correction amount calculation unit 154 corresponds to the Ir cut filter 86 based on the blur amount detection result by the blur amount detection sensor 56. Calculate the amount of operation. Further, when the optical filter designated by the filter designation information is BPF88, the blur correction amount calculation unit 154 calculates the operating amount corresponding to the BPF88 based on the blur amount detection result by the blur amount detection sensor 56.
- the wavelength band of the light transmitted through the blur correction lens 80 changes, but in the blur correction amount calculation unit 154, the wavelength band of the light transmitted through the blur correction lens 80 changes. Even if it changes, the operating amount is calculated so that the blur correction amount B1 proportional to the detection result by the blur amount detection sensor 56 can be obtained.
- the blur correction control unit 156 acquires the operating direction of the fifth motor 126 determined by the blur correction amount calculation unit 154 and the operating amount of the fifth motor 126 calculated by the blur correction amount calculation unit 154. Then, the operating direction and operating amount of the acquired fifth motor 126 are set as target values, and a control command is generated based on the position detection result by the fifth position sensor 142. The control command is output to the fifth motor driver 110.
- the fifth motor driver 110 generates an operation signal based on the control command generated by the blur correction control unit 156.
- the operation signal is, for example, a continuous wave.
- the fifth motor 126 operates in the operating direction and operating amount according to the operating signal.
- power is applied to the blur correction lens 80 in the direction in which the blur of the image is corrected, so that the blur correction lens 80 moves.
- the blur correction lens 80 moves with the movement amount A1 corresponding to the Ir cut filter 86
- the optical filter specified by the filter specification information is the BPF88. If this is the case, the blur correction lens 80 moves with the movement amount A1 corresponding to the BPF 88.
- the blur correction control unit 156 controls the fifth motor 126 to change the movement amount A1 of the blur correction lens 80 based on the wavelength band of the light transmitted through the blur correction lens 80. Therefore, even if the wavelength band of the light transmitted through the blur correction lens 80 changes, the influence of the change in the blur correction sensitivity of the blur correction lens 80 is suppressed, and the blur correction proportional to the detection result by the blur amount detection sensor 56 is suppressed.
- the quantity B1 is obtained.
- the CPU 92 of the lens device 70 determines whether or not the image shift command transmitted from the CPU 42 of the surveillance camera body 20 is received by the transmission / reception interface (not shown) of the lens device 70, and if the determination is affirmed, the CPU 92 determines.
- the shift process shown in FIG. 16 is executed.
- step ST120 the acquisition unit 150 acquires the image shift command transmitted from the CPU 42 of the surveillance camera main body 20. Further, in step ST122, the acquisition unit 150 acquires the frame period information transmitted from the CPU 42 of the surveillance camera main body 20. Further, in step ST124, the acquisition unit 150 acquires the filter designation information stored in the RAM 96. Further, the acquisition unit 150 acquires the position detection result by the sixth position sensor 144.
- the shift amount calculation unit 158 is set for each frame cycle based on the image shift direction represented by the image shift command, the frame cycle represented by the frame cycle information, and the position detection result by the sixth position sensor 144. 6 Determines the operating direction of the motor 128. The operating direction of the sixth motor 128 is determined based on the image shift direction indicated by the image shift command and the position detection result by the sixth position sensor 144. Further, the shift amount calculation unit 158 of the sixth motor 128 for each frame cycle based on the image shift amount represented by the image shift command, the frame cycle represented by the frame cycle information, and the position detection result by the sixth position sensor 144. Calculate the amount of operation.
- the shift amount calculation unit 158 calculates the operation amount corresponding to the optical filter specified by the filter designation information for the operation amount of the sixth motor 128 that shifts the image. For example, when the optical filter specified by the filter designation information is the Ir cut filter 86, the shift amount calculation unit 158 operates the amount corresponding to the Ir cut filter 86 based on the image shift amount represented by the image shift command. Is calculated. Further, when the optical filter designated by the filter designation information is BPF88, the shift amount calculation unit 158 calculates the operation amount corresponding to the BPF88 based on the shift amount of the image represented by the image shift command.
- the shift amount calculation unit 158 changes the wavelength band of the light transmitted through the shift lens 82 even when the wavelength band of the light transmitted through the shift lens 82 changes.
- the operating amount at which the image is shifted to the position corresponding to the image shift amount indicated by the image shift command is calculated.
- the shift control unit 160 gives a control command according to the operation direction of the sixth motor 128 determined by the shift amount calculation unit 158 and the operation amount of the sixth motor 128 calculated by the shift amount calculation unit 158. Is generated for each frame period.
- the control command is output to the sixth motor driver 112.
- the sixth motor driver 112 generates an operation signal based on the control command generated by the shift control unit 160.
- the operation signal is, for example, a pulse wave.
- the period of the operation signal is synchronized with the frame period specified by the frame period information.
- the sixth motor 128 operates with an operating amount according to the operating signal.
- power is applied to the shift lens 82 in the direction of shifting the image at each frame cycle, so that the shift lens 82 moves.
- the optical filter specified by the filter designation information is the Ir cut filter 86
- the shift lens 82 moves with the movement amount A2 corresponding to the Ir cut filter 86
- the optical filter specified by the filter designation information is specified.
- BPF88 the shift lens 82 moves with the movement amount A2 corresponding to the BPF88.
- the shift control unit 160 controls the sixth motor 128 to change the movement amount A2 of the shift lens 82 based on the wavelength band of the light transmitted through the shift lens 82. Therefore, even if the wavelength band of the light transmitted through the blur correction lens 80 changes, the influence of the change in the shift sensitivity of the shift lens 82 is suppressed, and the image is positioned at a position corresponding to the image shift amount indicated by the image shift command. Is shifted.
- the method of operating the surveillance camera 10 described with reference to FIGS. 14, 15, and 16 described above is an example of the "operation method of the image pickup apparatus" according to the technique of the present disclosure.
- the method of operating the lens device 70 included in the method of operating the surveillance camera 10 described with reference to FIGS. 14, 15, and 16 described above is a "method of operating the lens device 70" according to the technique of the present disclosure. Is an example.
- the lens device 70 separately separates the blur correction lens 80 for correcting the blur of the image and the shift lens 82 for shifting the image along the light receiving surface 24A of the image sensor 24. Be prepared. Therefore, for example, the control and shift lens for the fifth motor 126 that moves the blur correction lens 80 as compared with the case where the blur correction lens 80 performs both image blur correction and image shift using a common motor. It is possible to easily control the sixth motor 128 that moves the 82.
- the blur correction lens 80 that performs both image blur correction and image shift is common.
- the weight can be distributed to the fifth motor 126 and the sixth motor 128 as compared with the case of moving by the motor of.
- the CPU 92 of the lens device 70 changes the movement amount A1 of the blur correction lens 80 with respect to the fifth motor 126 based on the wavelength band of the light transmitted through the blur correction lens 80. Take control. Therefore, even if the wavelength band of the light transmitted through the blur correction lens 80 changes, the influence of the change in the blur correction sensitivity of the blur correction lens 80 is suppressed, and the blur correction proportional to the detection result by the blur amount detection sensor 56 is suppressed.
- the quantity B1 can be obtained.
- the CPU 92 of the lens device 70 controls the sixth motor 128 to change the movement amount A2 of the shift lens 82 based on the wavelength band of the light transmitted through the shift lens 82. conduct. Therefore, even if the wavelength band of the light transmitted through the blur correction lens 80 changes, the influence of the change in the shift sensitivity of the shift lens 82 is suppressed, and the image is positioned at a position corresponding to the image shift amount indicated by the image shift command. Can be shifted.
- the shift sensitivity of the shift lens 82 is lower than the blur correction sensitivity of the blur correction lens 80. That is, the shift amount B2 of the image on the light receiving surface 24A of the image sensor 24 with respect to the movement of the shift lens 82 with the unit movement amount A is the light receiving surface 24A of the image sensor 24 with respect to the movement of the blur correction lens 80 with the unit movement amount A. It is smaller than the blur correction amount B1 of the image in. Therefore, for example, the error of the image shift amount with respect to the error of the movement amount of the shift lens 82 can be reduced as compared with the case where the shift sensitivity of the shift lens 82 is higher than the blur correction sensitivity of the blur correction lens 80.
- the shift amount on the light receiving surface 24A of the image sensor 24 of the central ray F1 passing through the shift lens 82 after the movement on the optical axis OA with respect to the movement of the shift lens 82 in the unit movement amount A. was set to S1
- the shift amount of the peripheral light rays F2 passing through the shift lens 82 after movement other than on the optical axis OA on the light receiving surface 24A of the image sensor 24 with respect to the movement of the shift lens 82 in the unit movement amount A was set to S2.
- the relationship of 0.8 ⁇ S2 / S1 ⁇ 1.2 is established.
- the blur correction lens 80 and the shift lens 82 are arranged closer to the image sensor 24 than the zoom lens 74.
- the blur correction lens 80 and the shift lens 82 are arranged closer to the subject than the zoom lens 74, the light transmitted through the blur correction lens 80 and the shift lens 82 passes through the zoom lens 74 and is an image sensor. Since the image is formed on the 24, the blur correction sensitivity of the blur correction lens 80 and the shift sensitivity of the shift lens 82 change as the zoom lens 74 moves in the Z-axis direction.
- the blur correction lens 80 and the shift lens 82 are arranged closer to the image sensor 24 than the zoom lens 74, the blur correction lens 80 and the shift lens 82 are arranged closer to the image sensor 24 than the zoom lens 74.
- the blur correction lens 80 and the shift lens 82 can be made smaller in diameter than in the case where the lens 80 is used.
- the weight of the blur correction lens 80 and the shift lens 82 can be reduced.
- the drive load of the fifth motor 126 that moves the blur correction lens 80 and the drive load of the sixth motor 128 that moves the shift lens 82 can be reduced.
- the filter unit 78 of the lens device 70 includes a plurality of BPF 88s.
- the filter unit 78 is arranged closer to the subject than the image sensor 24, and the plurality of BPF 88s transmit near-infrared light contained in the light. Therefore, a near-infrared light image can be obtained by forming a near-infrared light image on the image sensor 24.
- the CPU 92 of the lens device 70 moves the shift lens 82 to a position where the image shifts at a pitch equal to or higher than the pixel pitch of the image sensor 24 or a pitch lower than the pixel pitch of the image sensor 24.
- the sixth motor 128 is controlled to be operated. Therefore, as shown in FIG. 13, a composite image 164 can be obtained by synthesizing the obtained images 162 of a plurality of frames.
- the blur correction lens 80 and the shift lens 82 are arranged closer to the image sensor 24 than the focus lens 72.
- the blur correction lens 80 and the shift lens 82 are arranged closer to the subject than the focus lens 72, the light transmitted through the blur correction lens 80 and the shift lens 82 passes through the focus lens 72 and is an image sensor. Since the image is formed on the 24, the blur correction sensitivity of the blur correction lens 80 and the shift sensitivity of the shift lens 82 change as the focus lens 72 moves in the Z-axis direction. Therefore, when the focus lens 72 moves in the Z-axis direction, control is performed to adjust the movement amount A1 of the blur correction lens 80 and the movement amount A2 of the shift lens 82 according to the movement of the focus lens 72 in the Z-axis direction.
- the blur correction lens 80 and the shift lens 82 are arranged closer to the image sensor 24 than the aperture 76.
- a second slide mechanism (illustrated) that supports the zoom lens 74 so as to be movable in the Z-axis direction.
- the fifth slide mechanism (not shown) that slidably supports the blur correction lens 80 along the XY coordinate plane
- the shift lens 82 slidably supports along the XY coordinate plane.
- the sixth slide mechanism (not shown) is arranged adjacent to each other, which complicates the structure of the lens device 70.
- the movement accuracy of the blur correction lens 80 and the movement accuracy of the shift lens 82 may decrease.
- the blur correction lens 80 and the shift lens 82 are arranged closer to the image sensor 24 than the aperture 76, for example, the blur correction lens 80 and the shift lens 82 are located between the aperture 76 and the zoom lens 74.
- the movement accuracy of the blur correction lens 80 and the movement accuracy of the shift lens 82 can be improved as compared with the case where the lens 80 is arranged.
- the lens device 70 includes a blur correction lens 80 and a filter unit 78 that switches the wavelength band of the light transmitted through the shift lens 82. Therefore, for example, as compared with the case where the optical filter of one of the plurality of optical filters is selectively attached to the lens device 70 in order to change the wavelength band of the light transmitted through the blur correction lens 80 and the shift lens 82. Therefore, the wavelength band of the light transmitted through the blur correction lens 80 and the shift lens 82 can be easily switched.
- the CPU 92 of the lens device 70 controls the movement amount A1 of the blur correction lens 80 to be changed and the movement of the shift lens 82 based on the wavelength band of the light transmitted through the blur correction lens 80 and the shift lens 82. Both controls are performed so that the quantity A2 is changed.
- the CPU 92 of the lens device 70 may control only one of the control in which the movement amount A1 of the blur correction lens 80 is changed and the control in which the movement amount A2 of the shift lens 82 is changed.
- a plurality of optical filters are arranged in a ring shape and rotated to cause an optical axis among the plurality of optical filters.
- a rotary filter unit 78 is used in which the optical filter arranged on the OA can be switched.
- a slide type filter unit may be used in which a plurality of optical filters are arranged in a straight line and the optical filters arranged on the optical axis OA among the plurality of optical filters can be switched by sliding.
- an optical filter of one of a plurality of optical filters may be selectively attached to the lens device 70.
- control for changing the movement amount A1 of the blur correction lens 80 based on the wavelength band of the light transmitted through the blur correction lens 80 is not limited to the above mode, and various modes other than the above can be taken. ..
- control for changing the movement amount A2 of the shift lens 82 based on the wavelength band of the light transmitted through the shift lens 82 is not limited to the above embodiment, and various embodiments other than the above can be taken.
- the focus lens 72, the zoom lens 74, the aperture 76, the filter unit 78, the blur correction lens 80, and the shift lens 82 are arranged in order from the subject side to the image side along the optical axis OA.
- the zoom lens 74, the aperture 76, the filter unit 78, the blur correction lens 80, the focus lens 72, and the shift lens 82 are sequentially arranged from the subject side to the image side along the optical axis OA. It may be arranged.
- the order of the focus lens 72, the zoom lens 74, the aperture 76, the filter unit 78, the blur correction lens 80, and the shift lens 82 may be other than the order shown in FIG. 2 and the order shown in FIG.
- the lens device 70 is provided on the surveillance camera body 20 by mounting the lens device 70 on the surveillance camera body 20 having the image sensor 24.
- the image sensor is provided.
- the lens device 70 may be provided on the surveillance camera main body 20.
- the surveillance camera 10 may be configured as follows. That is, as an example, in the modified example of the surveillance camera 10 shown in FIG. 19, the lens device 70 is the first optical system 202, the second optical system 204, the color separation prism 206, the third optical system 208, and the fourth optical system 210. To prepare for. Further, the surveillance camera main body 20 includes a first image sensor 214 and a second image sensor 216.
- the color separation prism 206 is an example of the "optical separation mechanism" according to the technique of the present disclosure, and the first image sensor 214 and the second image sensor 216 are an example of the "image sensor" according to the technique of the present disclosure.
- the first optical system 202 has a plurality of lenses 218, 220, 222, and 224, and a first aperture 230.
- the second optical system 204 is arranged between the first optical system 202 and the color separation prism 206.
- the second optical system 204 has a lens 228.
- the color separation prism 206 separates the light into the first light G1 and the second light G2.
- the first light G1 is infrared light and the second light G2 is visible light.
- the optical axis OA is branched into a first optical axis OAa and a second optical axis OAb by a color separation prism 206.
- the third optical system 208 is arranged between the color separation prism 206 and the first image sensor 214.
- the third optical system 208 includes a first filter unit 231, a first blur correction lens 232, and a first shift lens 234. Similar to the above-mentioned blur correction lens 80 (see FIG. 6), the first blur correction lens 232 moves along the XY coordinate plane when power is applied by the first drive mechanism (not shown). Similar to the shift lens 82 (see FIG. 6), the first shift lens 234 moves along the XY coordinate plane when power is applied by the second drive mechanism (not shown).
- the first blur correction lens 232 and the first shift lens 234 are examples of the "first optical lens” and the "moving lens" according to the technique of the present disclosure, respectively.
- the fourth optical system 210 is arranged between the color separation prism 206 and the second image sensor 216.
- the fourth optical system 210 includes a second aperture 236, a second filter unit 238, a second blur correction lens 240, and a second shift lens 242. Similar to the above-mentioned blur correction lens 80 (see FIG. 6), the second blur correction lens 240 moves along the XX coordinate plane when power is applied by the third drive mechanism (not shown). Similar to the shift lens 82 (see FIG. 6), the second shift lens 242 moves along the XZ coordinate plane when power is applied by the fourth drive mechanism (not shown).
- the second blur correction lens 240 and the second shift lens 242 are examples of the "second optical lens” and the "moving lens" according to the technique of the present disclosure, respectively.
- the first light G1 transmitted through the first blur correction lens 232 and the first shift lens 234 is imaged on the light receiving surface 214A of the first image sensor 214, and the second blur correction is performed on the light receiving surface 216A of the second image sensor 216.
- the second light G2 transmitted through the lens 240 and the second shift lens 242 is imaged.
- the movement amount of the first blur correction lens 232 is based on the wavelength band of the first light G1 transmitted through the first blur correction lens 232 and the first shift lens 234, as in the above embodiment. Control to change the amount of movement of the first shift lens 234 and control to change the amount of movement of the first shift lens 234 are performed.
- the second blur correction lens 240 is based on the wavelength band of the second light G2 transmitted through the second blur correction lens 240 and the second shift lens 242, as in the above embodiment. Control to change the movement amount and control to change the movement amount of the second shift lens 242 are performed, respectively.
- one of the first blur correction lens 232 and the first shift lens 234 may be a fixed lens.
- one of the second blur correction lens 240 and the second shift lens 242 may be a fixed lens.
- the lens device 70 is provided with a controller 90 different from the controller 40 of the surveillance camera main body 20, but the lens device 70 may not be provided with the controller 90. Further, the functions of the controller 90 of the lens device 70 may be integrated into the controller 40 of the surveillance camera main body 20, and the lens device 70 may be controlled by the controller 40 of the surveillance camera main body 20. In this case, the controller 90 is an example of "a computer applied to an image pickup device".
- the imaging process may be executed by a computer of an external device that is communicably connected to the surveillance camera 10 via a network such as LAN or WAN.
- the above-mentioned external device and the surveillance camera 10 may execute the imaging process in a distributed manner, or a plurality of devices including the above-mentioned external device and the surveillance camera 10 may execute the imaging process in a distributed manner. You may try to do it.
- the surveillance camera 10 has been described as an example of the image pickup device, but the technique of the present disclosure is not limited to this, and the technique shown in the above embodiment can be applied to various image pickup devices.
- the image pickup device referred to here includes, for example, a digital camera that is interchangeable and does not use a reflex mirror, a digital camera with a fixed lens, a digital camera that uses a reflex mirror, a smart device, a wearable terminal, and a cell observation device. , An ophthalmic observation device, a digital camera built in various electronic devices such as a surgical microscope, and the like.
- the technique shown in the above embodiment may be applied to an image pickup apparatus including an image sensor having sensitivity to light having a wavelength band other than the wavelength band of near infrared light.
- the image pickup support processing program 100 is stored in the NVM 94
- the image pickup support processing program 100 is stored in a portable storage medium such as an SSD or a USB memory.
- the imaging support processing program 100 may be stored in a non-temporary storage medium.
- the image pickup support processing program 100 stored in the non-temporary storage medium is installed and used in, for example, a lens device 70 or the like.
- controller 40 is built in the surveillance camera 10
- the technique of the present disclosure is not limited to this, and for example, the controller 40 is provided outside the surveillance camera 10. You may be able to do it.
- the CPU 42 of the surveillance camera main body 20 is a single CPU, but may be a plurality of CPUs. Further, the GPU may be applied instead of the CPU 42. Similarly, the CPU 92 of the lens device 70 is a single CPU, but may be a plurality of CPUs. Further, the GPU may be applied instead of the CPU 92.
- the surveillance camera main body 20 includes a controller 40, but the technique of the present disclosure is not limited to this, and a device including an ASIC, FPGA, and / or PLD is applied instead of the controller 40. You may. Further, instead of the controller 40, a combination of a hardware configuration and a software configuration may be used.
- the lens device 70 includes a controller 90, but the technique of the present disclosure is not limited thereto, and a device including an ASIC, FPGA, and / or PLD is applied instead of the controller 90. May be good. Further, instead of the controller 90, a combination of a hardware configuration and a software configuration may be used.
- the processor includes software, that is, a CPU, which is a general-purpose processor that functions as a hardware resource for executing image pickup support processing by executing a program.
- examples of the processor include a dedicated electric circuit, which is a processor having a circuit configuration specially designed for executing a specific process such as FPGA, PLD, or ASIC.
- a memory is built-in or connected to any processor, and each processor executes imaging support processing by using the memory.
- the hardware resource that performs the imaging support process may consist of one of these various processors, or a combination of two or more processors of the same type or dissimilarity (eg, a combination of multiple FPGAs, or a combination of multiple FPGAs). It may be composed of a combination of a CPU and an FPGA). Further, the hardware resource for executing the image pickup support process may be one processor.
- one processor is configured by a combination of one or more CPUs and software, and this processor functions as a hardware resource for executing image pickup support processing. ..
- SoC SoC
- a processor that realizes the functions of the entire system including a plurality of hardware resources for executing image pickup support processing with one IC chip is used.
- the image pickup support process is realized by using one or more of the above-mentioned various processors as a hardware resource.
- a and / or B is synonymous with "at least one of A and B". That is, “A and / or B” means that it may be only A, it may be only B, or it may be a combination of A and B. Further, in the present specification, when three or more matters are connected and expressed by "and / or", the same concept as “A and / or B" is applied.
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Studio Devices (AREA)
Abstract
Description
一例として図1に示すように、監視システムSは、監視カメラ10及び管理装置11を備える。監視カメラ10は、本開示の技術に係る「撮像装置」の一例である。
一例として図2に示すように、監視カメラ10は、監視カメラ本体20及びレンズ装置70を備える。監視カメラ本体20は、本開示の技術に係る「撮像装置本体」の一例である。監視カメラ本体20は、レンズマウント22を備える。レンズ装置70は、監視カメラ本体20とは別体であり、レンズマウント22に着脱可能に装着される。レンズ装置70は、レンズマウント22に装着されることにより、監視カメラ本体20に設けられる。
一例として図3に示すように、フィルタユニット78は、円板84を備える。一例として、円板84には、周方向に沿って等間隔に複数の光学フィルタとして、Irカットフィルタ86、第1BPF88A、第2BPF88B、第3BPF88C、及び第4BPF88Dが設けられている。以下では、特に区別して説明する必要がない場合、Irカットフィルタ86、第1BPF88A、第2BPF88B、第3BPF88C、及び第4BPF88Dを光学フィルタと称する。また、以下では、特に区別して説明する必要がない場合、第1BPF88A、第2BPF88B、第3BPF88C、及び第4BPF88DをBPF88と称する。
一例として図4に示すように、イメージセンサ24は、受光部26及び色フィルタ部28を有する。受光部26は、複数の第1受光素子30及び複数の第2受光素子32を有する。第1受光素子30の一例としては、インジウム・ガリウム・ヒ素フォトダイオードが挙げられる。第2受光素子32の一例としては、シリコンフォトダイオードが挙げられる。
一例として図5に示すように、監視カメラ本体20は、コントローラ40及びUI系装置50を備える。
一例として図6に示すように、レンズ装置70は、コントローラ90を備える。コントローラ90は、レンズ装置70の動作を制御する。コントローラ90は、CPU92、NVM94、及びRAM96を備える。コントローラ90は、「レンズ装置に対して適用されるコンピュータ」の一例であり、CPU92は、本開示の技術に係る「プロセッサ」の一例であり、RAM96は、本開示の技術に係る「メモリ」の一例である。CPU92、NVM94、及びRAM96は、バス98に接続されている。
図7には、ぶれ補正レンズ80の光学特性及びシフトレンズ82の光学特性の一例が比較して示されている。ぶれ補正レンズ80の光学特性及びシフトレンズ82の光学特性は相違する。ここで言う光学特性とは、例えば、レンズの厚み、径、及び材料等に起因する特性であり、例えば、屈折率等を含む光学的な特性である。以下、ぶれ補正レンズ80の光学特性及びシフトレンズ82の光学特性の相違を、ぶれ補正レンズ80のぶれ補正感度及びシフトレンズ82のシフト感度の相違に基づいて説明する。
一例として図9に示すように、撮像支援処理は、レンズ装置70のCPU92によって撮像支援処理プログラム100が実行されることで実現される。撮像支援処理プログラム100は、本開示の技術に係る「プログラム」の一例である。図9に示す例では、NVM94に撮像支援処理プログラム100が記憶されており、CPU92が、NVM94から撮像支援処理プログラム100を読み出し、RAM96上で実行する。
Claims (18)
- イメージセンサを有する撮像装置本体に設けられるレンズ装置であって、
プロセッサと、
前記プロセッサに接続又は内蔵されたメモリと、
移動レンズを含み、入射した光を前記イメージセンサに結像させるレンズと、
前記レンズの光軸と交差する座標面に沿って前記移動レンズに対して動力を付与することで、前記移動レンズを移動させる駆動機構と、
を備え、
前記プロセッサは、前記駆動機構に対し、前記移動レンズを透過する前記光の波長帯域に基づいて、前記移動レンズの移動量を変更する制御を行う
レンズ装置。 - 第1レンズと、
第2レンズと、
前記座標面に沿って前記第1レンズを移動させる第1駆動機構と、
前記座標面に沿って前記第2レンズを移動させる第2駆動機構と、
を備え、
前記第1レンズ及び前記第2レンズのうちの少なくとも一方は、前記移動レンズである
請求項1に記載のレンズ装置。 - 前記プロセッサは、
前記第1駆動機構に対し、前記イメージセンサに前記光が結像されることで得られる像のぶれが補正される方向へ前記第1レンズを移動させる制御を行い、
前記第2駆動機構に対し、前記像をシフトさせる方向へ前記第2レンズを移動させる制御を行う
請求項2に記載のレンズ装置。 - 前記プロセッサは、前記第2駆動機構に対し、前記イメージセンサの画素ピッチ以上のピッチ、又は、前記イメージセンサの画素ピッチ未満のピッチで前記像がシフトする位置へ、前記第2レンズを移動させる制御を行う
請求項3に記載のレンズ装置。 - 前記第2レンズの単位移動量での移動に対する前記イメージセンサの受光面での前記像のシフト量は、前記第1レンズの前記単位移動量での移動に対する前記イメージセンサの受光面での前記像のぶれ補正量よりも小さい
請求項3又は請求項4に記載のレンズ装置。 - 前記第2レンズの単位移動量での移動に対する、前記光軸上において移動後の前記第2レンズを通る中心光線の前記イメージセンサの受光面でのシフト量をS1とし、前記第2レンズの前記単位移動量に対する、前記光軸上以外において移動後の前記第2レンズを通る周辺光線の前記イメージセンサの受光面でのシフト量をS2とした場合に、
0.8≦S2/S1≦1.2の関係が成立する
請求項3から請求項5の何れか一項に記載のレンズ装置。 - ズームレンズをさらに備え、
前記第1レンズ及び前記第2レンズは、前記ズームレンズよりも前記イメージセンサ側に配置されている
請求項2から請求項6の何れか一項に記載のレンズ装置。 - 前記イメージセンサよりも被写体側に配置され、前記光に含まれる近赤外光を透過させる光学フィルタを備える
請求項2から請求項6の何れか一項に記載のレンズ装置。 - フォーカスレンズをさらに備え、
前記第1レンズ及び前記第2レンズは、前記フォーカスレンズよりも前記イメージセンサ側に配置されている
請求項2から請求項8の何れか一項に記載のレンズ装置。 - 絞りをさらに備え、
前記第1レンズ及び前記第2レンズは、前記絞りよりも前記イメージセンサ側に配置されている
請求項2から請求項9の何れか一項に記載のレンズ装置。 - 前記移動レンズを透過する光の波長帯域を切り替える切替機構をさらに備える
請求項1から請求項10の何れか一項に記載のレンズ装置。 - 前記光を第1光と第2光とに分離する光分離機構と、
前記第1光が透過する第1光レンズと、
前記第2光が透過する第2光レンズと、
を備え、
前記第1光レンズ及び前記第2光レンズのうちの少なくとも一方は、前記移動レンズである
請求項1から請求項11の何れか一項に記載のレンズ装置。 - プロセッサと、
前記プロセッサに接続又は内蔵されたメモリと、
イメージセンサと、
移動レンズを含み、入射した光を前記イメージセンサに結像させるレンズと、
前記レンズの光軸と交差する座標面に沿って前記移動レンズに対して動力を付与することで、前記移動レンズを移動させる駆動機構と、
を備え、
前記プロセッサは、前記駆動機構に対し、前記移動レンズを透過する前記光の波長帯域に基づいて、前記移動レンズの移動量を変更する制御を行う
撮像装置。 - 前記プロセッサは、
前記駆動機構に対し、前記イメージセンサの画素ピッチ以上のピッチ、又は、前記イメージセンサの画素ピッチ未満のピッチで、前記イメージセンサに前記光が結像されることで得られる像がシフトする位置へ、前記移動レンズを移動させる制御を行い、
前記像がシフトする毎に前記イメージセンサに対し撮像を行わせ、
前記撮像によって得られた複数のフレームの画像を合成する
請求項13に記載の撮像装置。 - 移動レンズを含み、入射した光を撮像装置本体のイメージセンサに結像させるレンズと、
前記レンズの光軸と交差する座標面に沿って前記移動レンズに対して動力を付与することで、前記移動レンズを移動させる駆動機構と、
を備えるレンズ装置の作動方法であって、
前記駆動機構に対し、前記移動レンズを透過する前記光の波長帯域に基づいて、前記移動レンズの移動量を変更する制御を行う
ことを含む、レンズ装置の作動方法。 - イメージセンサと、
移動レンズを含み、入射した光を前記イメージセンサに結像させるレンズと、
前記レンズの光軸と交差する座標面に沿って前記移動レンズに対して動力を付与することで、前記移動レンズを移動させる駆動機構と、
を備える撮像装置の作動方法であって、
前記駆動機構に対し、前記移動レンズを透過する前記光の波長帯域に基づいて、前記移動レンズの移動量を変更する制御を行う
ことを含む、撮像装置の作動方法。 - 移動レンズを含み、入射した光を撮像装置本体のイメージセンサに結像させるレンズと、
前記レンズの光軸と交差する座標面に沿って前記移動レンズに対して動力を付与することで、前記移動レンズを移動させる駆動機構と、
を備えるレンズ装置に対して適用されるコンピュータに、
前記駆動機構に対し、前記移動レンズを透過する前記光の波長帯域に基づいて、前記移動レンズの移動量を変更する制御を行う
ことを含む処理を実行させるためのプログラム。 - イメージセンサと、
移動レンズを含み、入射した光を前記イメージセンサに結像させるレンズと、
前記レンズの光軸と交差する座標面に沿って前記移動レンズに対して動力を付与することで、前記移動レンズを移動させる駆動機構と、
を備える撮像装置に対して適用されるコンピュータに、
前記駆動機構に対し、前記移動レンズを透過する前記光の波長帯域に基づいて、前記移動レンズの移動量を変更する制御を行う
ことを含む処理を実行させるためのプログラム。
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2022571925A JPWO2022137807A1 (ja) | 2020-12-25 | 2021-10-29 | |
CN202180086529.8A CN116648666A (zh) | 2020-12-25 | 2021-10-29 | 透镜装置、摄像装置、透镜装置的动作方法、摄像装置的动作方法及程序 |
US18/337,033 US20230333401A1 (en) | 2020-12-25 | 2023-06-18 | Lens device, imaging apparatus, operation method of lens device, operation method of imaging apparatus, and program |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2020-217840 | 2020-12-25 | ||
JP2020217840 | 2020-12-25 |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US18/337,033 Continuation US20230333401A1 (en) | 2020-12-25 | 2023-06-18 | Lens device, imaging apparatus, operation method of lens device, operation method of imaging apparatus, and program |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2022137807A1 true WO2022137807A1 (ja) | 2022-06-30 |
Family
ID=82159049
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2021/040168 WO2022137807A1 (ja) | 2020-12-25 | 2021-10-29 | レンズ装置、撮像装置、レンズ装置の作動方法、撮像装置の作動方法、及びプログラム |
Country Status (4)
Country | Link |
---|---|
US (1) | US20230333401A1 (ja) |
JP (1) | JPWO2022137807A1 (ja) |
CN (1) | CN116648666A (ja) |
WO (1) | WO2022137807A1 (ja) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2022149033A (ja) * | 2021-03-25 | 2022-10-06 | キヤノン株式会社 | 制御装置、撮像装置、レンズ装置、カメラシステム、制御方法、及びプログラム |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2004354714A (ja) * | 2003-05-29 | 2004-12-16 | Fuji Photo Optical Co Ltd | 可視光・赤外光撮影用レンズシステム |
JP2014126860A (ja) * | 2012-12-27 | 2014-07-07 | Canon Inc | 光学機器および撮像装置、及びその制御方法、プログラム、記憶媒体 |
JP2017044878A (ja) * | 2015-08-27 | 2017-03-02 | キヤノン株式会社 | 撮像装置およびその制御方法 |
JP2018112605A (ja) * | 2017-01-10 | 2018-07-19 | キヤノン株式会社 | 撮像装置 |
-
2021
- 2021-10-29 WO PCT/JP2021/040168 patent/WO2022137807A1/ja active Application Filing
- 2021-10-29 JP JP2022571925A patent/JPWO2022137807A1/ja active Pending
- 2021-10-29 CN CN202180086529.8A patent/CN116648666A/zh active Pending
-
2023
- 2023-06-18 US US18/337,033 patent/US20230333401A1/en active Pending
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2004354714A (ja) * | 2003-05-29 | 2004-12-16 | Fuji Photo Optical Co Ltd | 可視光・赤外光撮影用レンズシステム |
JP2014126860A (ja) * | 2012-12-27 | 2014-07-07 | Canon Inc | 光学機器および撮像装置、及びその制御方法、プログラム、記憶媒体 |
JP2017044878A (ja) * | 2015-08-27 | 2017-03-02 | キヤノン株式会社 | 撮像装置およびその制御方法 |
JP2018112605A (ja) * | 2017-01-10 | 2018-07-19 | キヤノン株式会社 | 撮像装置 |
Also Published As
Publication number | Publication date |
---|---|
CN116648666A (zh) | 2023-08-25 |
JPWO2022137807A1 (ja) | 2022-06-30 |
US20230333401A1 (en) | 2023-10-19 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP6029380B2 (ja) | 画像処理装置、画像処理装置を具備する撮像装置、画像処理方法、及びプログラム | |
EP3110132B1 (en) | Automatic tracking image-capture apparatus | |
JP5917054B2 (ja) | 撮像装置、画像データ処理方法、およびプログラム | |
US20160366340A1 (en) | Photographing apparatus, photographing controller, photographing control method, and photographing control program | |
US11678055B2 (en) | Imaging support device, imaging support system, imaging system, imaging support method, and program | |
WO2022137807A1 (ja) | レンズ装置、撮像装置、レンズ装置の作動方法、撮像装置の作動方法、及びプログラム | |
JP7314204B2 (ja) | 撮像装置、撮像方法、及びプログラム | |
JP2024069348A (ja) | 撮像装置、撮像装置の作動方法、及びプログラム | |
WO2016194178A1 (ja) | 撮像装置、内視鏡装置及び撮像方法 | |
JPWO2017094122A1 (ja) | 撮像装置、内視鏡装置及び撮像方法 | |
JPWO2016194179A1 (ja) | 撮像装置、内視鏡装置及び撮像方法 | |
JP5393877B2 (ja) | 撮像装置および集積回路 | |
WO2022137800A1 (ja) | レンズ装置、撮像装置、レンズ装置の作動方法、撮像装置の作動方法、及びプログラム | |
JPWO2022137807A5 (ja) | ||
JP6896181B2 (ja) | 撮像素子、撮像装置、画像データ処理方法、及びプログラム | |
WO2022138604A1 (ja) | レンズ装置、撮像装置、レンズ装置の作動方法、撮像装置の作動方法、及びプログラム | |
US11917297B2 (en) | Imaging support device, imaging apparatus, imaging system, imaging support system, imaging support method, and program | |
JP7289996B2 (ja) | 検出装置、撮像装置、検出方法、及びプログラム | |
US12022193B2 (en) | Imaging apparatus and operation method thereof | |
US10951829B2 (en) | Image capturing apparatus and method for controlling display | |
CN111263131A (zh) | 影像撷取装置及影像撷取方法 | |
JP2011082795A (ja) | 撮像装置及びデジタルカメラ |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 21909963 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2022571925 Country of ref document: JP Kind code of ref document: A |
|
WWE | Wipo information: entry into national phase |
Ref document number: 202180086529.8 Country of ref document: CN |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 21909963 Country of ref document: EP Kind code of ref document: A1 |