WO2022130662A1 - 撮像装置、信号処理方法 - Google Patents

撮像装置、信号処理方法 Download PDF

Info

Publication number
WO2022130662A1
WO2022130662A1 PCT/JP2021/023240 JP2021023240W WO2022130662A1 WO 2022130662 A1 WO2022130662 A1 WO 2022130662A1 JP 2021023240 W JP2021023240 W JP 2021023240W WO 2022130662 A1 WO2022130662 A1 WO 2022130662A1
Authority
WO
WIPO (PCT)
Prior art keywords
value
pixel
saturation
output
image pickup
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2021/023240
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
真一 藤井
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Group Corp
Original Assignee
Sony Group Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Group Corp filed Critical Sony Group Corp
Priority to EP21906029.0A priority Critical patent/EP4254937A4/en
Priority to CN202180083011.9A priority patent/CN116724262A/zh
Priority to US18/256,388 priority patent/US12425730B2/en
Priority to JP2022569694A priority patent/JP7704155B2/ja
Publication of WO2022130662A1 publication Critical patent/WO2022130662A1/ja
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B7/00—Mountings, adjusting means, or light-tight connections, for optical elements
    • G02B7/28—Systems for automatic generation of focusing signals
    • G02B7/34—Systems for automatic generation of focusing signals using different areas in a pupil plane
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/67—Focus control based on electronic image sensor signals
    • H04N23/672—Focus control based on electronic image sensor signals based on the phase difference signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80—Camera processing pipelines; Components thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80—Camera processing pipelines; Components thereof
    • H04N23/81—Camera processing pipelines; Components thereof for suppressing or minimising disturbance in the image signal generation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/60—Noise processing, e.g. detecting, correcting, reducing or removing noise
    • H04N25/62—Detection or reduction of noise due to excess charges produced by the exposure, e.g. smear, blooming, ghost image, crosstalk or leakage between pixels
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/70—SSIS architectures; Circuits associated therewith
    • H04N25/703—SSIS architectures incorporating pixels for producing signals other than image signals
    • H04N25/704—Pixels specially adapted for focusing, e.g. phase difference pixel sets

Definitions

  • the present technique relates to an image pickup device provided with an image pickup element having a pixel group for outputting a phase difference signal, and a signal processing method thereof.
  • Some image pickup devices have a function of acquiring focus information about a subject in order to perform autofocus (hereinafter, may be referred to as "AF") control.
  • AF autofocus
  • an image sensor equipped with a pixel for detecting a focus is known.
  • Patent Document 1 when a plurality of pupil-divided image signals are read out by an image sensor to perform focus detection, the limit value is set for a signal that has saturated (overflow) regardless of the symmetry of the pupil division.
  • a technique that enables focus detection by performing a replacement operation is disclosed.
  • one pixel constituting an image is a photodiode (hereinafter, may be referred to as “PD”) divided pixel.
  • This PD division pixel is configured by dividing and arranging a pair of PD pixels on the left and right.
  • a plurality of pupil-divided image signals pixel values
  • the balance of the output values of the left and right PD pixels is in the original state. It may be different from the above, and the defocus amount may not be obtained accurately.
  • the method of Patent Document 1 can perform focus detection on a saturated signal, it cannot be said to be sufficient in terms of detection accuracy. Therefore, in this technique, sufficient detection accuracy can be obtained even when an overflow occurs in an image pickup device having PD divided pixels.
  • the image pickup apparatus has an image pickup element including a photodiode divided pixel including a first photodiode pixel and a second photodiode pixel that output separate pixel signals, and an output value of the pixel signal.
  • a signal processing unit that performs saturation-corresponding processing for correcting an output value based on the saturation value and an output predicted value when the saturation value is reached is provided.
  • the output value of the image signal from the photodiode (PD) pixel is limited by the saturation threshold value, which is the maximum value when the amount of charge due to light reception overflows. Therefore, when overflow occurs, the output value of the PD pixel is not an accurate value. In this case, the saturation corresponding process for correcting the output value is performed.
  • the saturation corresponding process includes a process of calculating a difference value between the output predicted value and the saturation value. The difference between the predicted output value and the saturation value is calculated and used to correct the output value.
  • the output predicted value and the saturation are obtained for one of the first photodiode pixel and the second photodiode pixel. It is conceivable to calculate the difference value of the values. In the photodiode divided pixel, there is an event that the photodiode pixel on one side overflows. In order to deal with this, the difference between the output predicted value and the saturation value is calculated for one of the overflowed photodiode pixels, and this is used to correct the output value.
  • the difference value calculated for the one photodiode pixel is added to the output value of the one photodiode pixel, and the difference value is added to the output value of the one photodiode pixel. It is conceivable to perform a process of subtracting from the output value of the other photodiode pixel.
  • the photodiode split pixel has a structure in which when one photodiode pixel overflows, the excess charge leaks to the other photodiode pixel side. In that case, correct the leak.
  • the image pickup apparatus of the present technology described above includes a control unit that determines the in-focus state and causes the signal processing unit to execute the saturation-corresponding process according to the in-focus state.
  • the saturation processing is performed.
  • the control unit outputs the output value of the first photodiode pixel and the output of the second photodiode pixel in a state where the signal processing unit does not execute the saturation corresponding process.
  • the signal processing unit After performing autofocus control based on the defocus amount obtained by using the value, after the condition of the in-focus state is satisfied, the signal processing unit is made to execute the saturation corresponding process, and the first step is performed. It is conceivable to perform autofocus control based on the defocus amount obtained by using the output value of the photodiode pixel 1 and the output value of the second photodiode pixel. First, the autofocus control is performed without performing the saturation processing, and then the autofocus control is performed in the state where the saturation processing is performed.
  • the output predicted value is a value obtained based on the light receiving angle characteristics and the lens information of the first photodiode pixel and the second photodiode pixel. .. Since the light-receiving angle characteristics are known, the predicted output value can be obtained by acquiring lens information such as lens vignetting for the attached lens barrel.
  • the image pickup device of the present technology described above is an image pickup device to which an interchangeable lens barrel can be attached, and it is conceivable that the lens information is received from the lens barrel.
  • an interchangeable lens it is possible to acquire lens information according to the lens barrel and obtain an output predicted value.
  • the signal processing unit changes the output value due to the image height with respect to the output value of the first photodiode pixel and the output value of the second photodiode pixel. It is conceivable to perform uniform pupil imbalance correction.
  • the pupil imbalance correction corrects the output value so that the characteristics are flat regardless of the image height.
  • the signal processing unit has a response to the output value of the first photodiode pixel and the output value of the second photodiode pixel after the saturation-corresponding process has been performed. It is conceivable to perform the pupil imbalance correction. The pupil imbalance is corrected for the output value after the overflow is reflected by the saturation processing.
  • an image pickup device including an image pickup device including a photodiode divided pixel including a first photodiode pixel and a second photodiode pixel that output separate pixel signals is described above.
  • the saturation correspondence process for correcting the output value based on the saturation value and the output prediction value is performed. As a result, the output value is optimized even when saturation occurs.
  • Configuration of image pickup device The appearance of the image pickup apparatus 1 according to this embodiment is shown in FIGS. 1 and 2.
  • the subject side is the front and the imager side is the rear, but these directions are for convenience of explanation and are limited to these directions with respect to the implementation of the present technique. There is no.
  • the image pickup apparatus 1 is a lens mirror that can be attached to and detached from the camera housing 2 in which the required parts are arranged inside and outside and the camera housing 2 and is attached to the front portion 2a.
  • a cylinder 3 is provided.
  • the lens barrel 3 is detachable as a so-called interchangeable lens as an example, and may be a lens barrel that cannot be removed from the camera housing 2.
  • a rear monitor 4 is arranged on the rear surface portion 2b of the camera housing 2.
  • the rear monitor 4 displays a live view image, a reproduced image of the recorded image, and the like.
  • the rear monitor 4 is a display device such as a liquid crystal display (LCD) or an organic EL (Electro-Luminescence) display, for example.
  • the rear monitor 4 is rotatable with respect to the camera housing 2.
  • the lower end of the rear monitor 4 can be rotated around the upper end of the rear monitor 4 as a rotation axis so that the lower end of the rear monitor 4 moves rearward.
  • the right end portion and the left end portion of the rear monitor 4 may be a rotation axis. Further, it may be rotatable in a plurality of axial directions.
  • An EVF (Electric Viewfinder) 5 is arranged on the upper surface portion 2c of the camera housing 2.
  • the EVF 5 includes an EVF monitor 5a and a frame-shaped enclosure 5b projecting rearward so as to surround the upper side and the left and right sides of the EVF monitor 5a.
  • the EVF monitor 5a is formed by using an LCD, an organic EL display, or the like.
  • An optical finder OVF: Optical View Finder
  • Various controls 6 are provided on the rear surface portion 2b and the upper surface portion 2c.
  • a play menu start button for example, a play menu start button, an enter button, a cross key, a cancel button, a zoom key, a slide key, and the like.
  • These controls 6 include various embodiments such as buttons, dials, pressing and rotatable compound controls.
  • the controls 6 in various modes enable, for example, menu operation, playback operation, mode selection / switching operation, focus operation, zoom operation, and parameter selection / setting such as shutter speed and F value.
  • a shutter button 6S release button
  • the AF operation is performed by half-pressing the shutter button 6S.
  • FIG. 1 The internal configuration of such an image pickup apparatus 1 is shown in FIG. Inside and outside the camera housing 2 of the image pickup device 1, an image sensor 7, a camera signal processing unit 8, a recording unit 9, a display unit 10, an output unit 11, an operation unit 12, a power supply unit 13, a camera control unit 14, and a memory unit 15, RAM 21, etc. are provided.
  • the lens barrel 3 includes an optical system 16, a driver unit 17, a lens barrel control unit 18, an operation unit 19, a memory unit 20, and the like.
  • the optical system 16 includes various lenses such as an incident end lens, a zoom lens, a focus lens, and a condenser lens, and a lens or an iris (so that sensing is performed while the signal charge is not saturated and is within the dynamic range. It is equipped with a diaphragm mechanism that controls exposure by adjusting the aperture amount by the diaphragm) and a shutter unit such as a focal plane shutter. A part of each part constituting the optical system 16 may be provided in the camera housing 2.
  • the image sensor 7 is, for example, a CCD (Charge Coupled Device) type or a CMOS (Complementary Metal-Oxide Semiconductor) type, and controls the exposure of light from a subject incident on the optical system 16.
  • the electrical signal photoelectrically converted by the pixels is provided with a processing unit that performs, for example, CDS (Correlated Double Sampling) processing, AGC (Automatic Gain Control) processing, and A / D (Analog / Digital) conversion processing. Therefore, the image sensor 7 outputs the captured image signal as digital data to the camera signal processing unit 8 and the camera control unit 14.
  • the sensor surface of the image pickup element 7 is configured to have a sensing element in which a plurality of pixels are two-dimensionally arranged. As shown in FIG. 4, the image pickup device 7 is formed by arranging PD division pixels 40 on a matrix in the row direction and the column direction. Each PD division pixel 40 is composed of two PD pixels.
  • the configuration of the PD division pixel 40 is schematically shown in FIG.
  • the PD division pixel 40 includes two PD pixels, that is, a left PD pixel 41L as a left PD pixel, a right PD pixel 41R as a right division pixel, and a pixel boundary metal 45 arranged in front of the left PD pixel 41L. It includes an inner lens 42, a color filter 43, and an on-chip microlens 44.
  • the color filter 43 is either a color filter having a red (R) spectral sensitivity, a color filter having a green (G) spectral sensitivity, or a color filter having a blue (B) spectral sensitivity.
  • R red
  • G green
  • B blue
  • the left PD pixel 41L receives the light that has passed through the right pupil region EPR of the exit pupil EP.
  • the right PD pixel 41R receives light that has passed through the left pupil region EPL. This realizes the pupil division function.
  • Such PD division pixels 40 are arranged as R pixels, G pixels, and B pixels as shown in FIG. 4 due to the difference in the color filter 43.
  • the signal obtained as the added value of the left PD pixel 41L and the right PD pixel 41R becomes the signal of one G pixel.
  • phase difference detection can be performed by the values of the left PD pixel 41L and the right PD pixel 41R.
  • the camera signal processing unit 8 is composed of, for example, a microprocessor specialized for digital signal processing such as a DSP (Digital Signal Processor), a microcomputer, or the like.
  • a microprocessor specialized for digital signal processing such as a DSP (Digital Signal Processor), a microcomputer, or the like.
  • the camera signal processing unit 8 performs various signal processing on the digital signal (image pickup image signal) sent from the image pickup element 7. Specifically, processing such as correction processing between R, G, and B color channels, white balance correction, aberration correction, and shading correction is performed. Further, the camera signal processing unit 8 generates (separates) a luminance (Y) signal and a color (C) signal from the image data of R, G, and B, a YC generation process, a process of adjusting the luminance and the color, and a knee. Perform each process such as correction and gamma correction. Further, the camera signal processing unit 8 performs conversion to the final output format by performing resolution conversion processing, codec processing for coding for recording and communication, and the like.
  • the image data converted into the final output format is stored in the memory unit 15. Further, by outputting the image data to the display unit 10, the image is displayed on the rear monitor 4 and the EVF monitor 5a. Further, by outputting from the external output terminal, it is displayed on a device such as a monitor provided outside the image pickup apparatus 1.
  • the camera signal processing unit 8 also performs phase difference detection processing.
  • the phase difference detection process is a process of performing phase difference detection from the output values of the left PD pixel 41L and the right PD pixel 41R of the PD division pixel 40. Further, the camera signal processing unit 8 calculates the defocus amount based on the detected phase difference information.
  • the calculated defocus amount is used for AF control in the camera control unit 14. That is, the camera control unit 14 controls the drive of the focus lens in the optical system 16 via the lens barrel control unit 18 based on the defocus amount, and executes the AF operation.
  • the calculated defocus amount may be used to present information regarding the focus condition of the subject to the user.
  • the RAM 21 is shown as a memory that temporarily stores the output values of the left PD pixel 41L and the right PD pixel 41R in the process of phase difference detection processing.
  • the recording unit 9 is composed of, for example, a non-volatile memory, and stores an image file (content file) such as still image data and moving image data, attribute information of the image file, a thumbnail image, and the like.
  • the image file is stored in a format such as JPEG (Joint Photographic Experts Group), TIFF (Tagged Image File Format), GIF (Graphics Interchange Format), or the like.
  • the actual form of the recording unit 9 can be considered in various ways.
  • the recording unit 9 may be configured as a flash memory built in the image pickup device 1, or may be stored in or read from a memory card (for example, a portable flash memory) that can be attached to and detached from the image pickup device 1 and the memory card. It may be composed of an access unit that performs access for. Further, it may be realized as an HDD (Hard Disk Drive) or the like as a form built in the image pickup apparatus 1.
  • HDD Hard Disk Drive
  • the display unit 10 executes processing for performing various displays on the imager.
  • the display unit 10 is, for example, a rear monitor 4 or an EVF monitor 5a.
  • the display unit 10 performs a process of displaying image data converted to an appropriate resolution input from the camera signal processing unit 8. As a result, a so-called through image, which is a captured image during the standby of the release, is displayed. Further, the display unit 10 realizes on the screen the display of various operation menus, icons, messages, etc. as a GUI (Graphical User Interface) based on the instruction from the camera control unit 14. Further, the display unit 10 can display a reproduced image of the image data read from the recording medium in the recording unit 9.
  • GUI Graphic User Interface
  • the output unit 11 performs data communication and network communication with an external device by wire or wirelessly. For example, captured image data (still image file or moving image file) is transmitted to an external display device, recording device, playback device, or the like. Further, the output unit 11 may function as a network communication unit. For example, communication may be performed by various networks such as the Internet, a home network, and a LAN (Local Area Network), and various data may be transmitted and received to and from a server, a terminal, or the like on the network.
  • networks such as the Internet, a home network, and a LAN (Local Area Network)
  • the operation unit 12 provided in the camera housing 2 includes not only the various controls 6 described above but also a rear monitor 4 that employs a touch panel method, and various operations such as tap operation and swipe operation of the imager.
  • the operation information according to the above is output to the camera control unit 14.
  • the operation unit 12 may function as a reception unit for an external operation device such as a remote controller that is separate from the image pickup device 1.
  • the power supply unit 13 generates a power supply voltage (Vcc) required for each unit from, for example, a battery filled inside, and supplies it as an operating voltage.
  • Vcc power supply voltage
  • the power supply voltage Vcc by the power supply unit 13 is also supplied to the circuit in the lens barrel 3. Even if the power supply unit 13 is formed with a circuit for charging the battery or a circuit for generating the power supply voltage Vcc using the DC voltage converted and input by the AC adapter connected to the commercial AC power supply as the power supply. good.
  • the camera control unit 14 is composed of a microcomputer (arithmetic processing device) equipped with a CPU (Central Processing Unit), and performs overall control of the image pickup device 1. For example, control of the shutter speed according to the operation of the imager, instructions for various signal processing in the camera signal processing unit 8, control of imaging operation and recording operation according to the user's operation, playback operation of the recorded image file, and the like. I do.
  • the camera control unit 14 gives an instruction to the lens barrel control unit 18 in order to control various lenses included in the optical system 16. For example, instructions such as zoom control and AF system are given. Further, the camera control unit 14 performs a process of designating an aperture value in order to secure a necessary amount of light for AF control, an operation instruction of an aperture mechanism according to the aperture value, and the like.
  • the camera control unit 14 is capable of acquiring various lens information included in the optical system 16 via the lens barrel control unit 18.
  • the lens information includes, for example, information on the model number of the lens, the position of the zoom lens, the F value, information on the exit pupil position, and the like. Further, the camera control unit 14 is capable of acquiring the aperture value of the aperture mechanism included in the optical system 16.
  • the memory unit 15 stores information and the like used for processing executed by the camera control unit 14.
  • a ROM Read Only Memory
  • RAM Random Access Memory
  • flash memory and the like are comprehensively shown.
  • the memory unit 15 and the above-mentioned RAM 21 may be a memory area built in the microcomputer chip as the camera control unit 14, or may be configured by a separate memory chip.
  • Programs and the like used by the camera control unit 14 are stored in the ROM, flash memory, and the like of the memory unit 15.
  • ROM, flash memory, etc. in addition to content files such as an OS (Operating System) for the CPU to control each part and an image file, application programs and firmware for various operations are stored.
  • the camera control unit 14 controls the entire image pickup apparatus 1 and the lens barrel 3 by executing the program.
  • the RAM of the memory unit 15 is used as a work area of the camera control unit 14 by temporarily storing data, programs, and the like used in various data processing executed by the CPU of the camera control unit 14.
  • the lens barrel control unit 18 of the lens barrel 3 is configured by, for example, a microcomputer, and outputs a control signal to the driver unit 17 in order to actually drive various lenses of the optical system 16 based on the instruction of the camera control unit 14. I do.
  • Information communication between the camera control unit 14 and the lens barrel control unit 18 may be possible only when the lens barrel 3 is mounted on the camera housing 2, or the lens barrel can be communicated by wireless communication. It may be possible in a state where 3 is not attached to the camera housing 2.
  • the lens barrel control unit 18 transmits information on the exit pupil position and the pupil distance of the exit pupil to the camera control unit 14 based on the types and drive positions of various lenses included in the optical system 16. Specifically, the information regarding the pupil distance is acquired from the information stored in the ROM as the memory unit 20 and transmitted to the camera control unit 14.
  • the driver unit 17 is provided with, for example, a motor driver for the zoom lens drive motor, a motor driver for the focus lens drive motor, an aperture mechanism driver for the motor that drives the aperture mechanism, and the like. Each driver supplies a drive current to the corresponding drive motor in response to an instruction from the lens barrel control unit 18.
  • the operation unit 19 of the lens barrel 3 indicates an operator provided on the lens barrel 3 side.
  • the operation information by the operation unit 19 is supplied to the lens barrel control unit 18, and is notified to the camera control unit 14 via the lens barrel control unit 18.
  • the lens barrel control unit 18 controls the operation of the optical system 16, and the camera control unit 14 performs various settings and operation control.
  • the operation unit 19 may function as a reception unit for an external operation device such as a remote controller that is separate from the lens barrel 3.
  • the memory unit 20 is composed of a ROM, a flash memory, or the like, and stores programs, data, and the like used by the lens barrel control unit 18.
  • the memory unit 20 stores an OS (Operating System) for the CPU to control each unit, application programs and firmware for various operations, and the like. Further, the information stored in the memory unit 20 includes information such as the pupil distance of the exit pupil of the optical system 16.
  • FIG. 6 shows a configuration related to phase difference detection processing in the camera signal processing unit 8 and a configuration related to AF control based on the configuration.
  • the camera signal processing unit 8 includes a difference calculation unit 51, a saturation corresponding processing unit 52, a pupil imbalance correction unit 53, and a correlation calculation unit 54 as a configuration related to phase difference detection processing.
  • the output value of the PD division pixel 40 is supplied from the image sensor 7 to the difference calculation unit 51.
  • each PD divided pixel 40 reads out a normal pixel signal for image generation. Not only can the output values of the left and right PDs be obtained separately.
  • the amount of defocus for AF control can be calculated from the output values of the left and right PDs.
  • the (L + R) value and the L value are read out for one PD divided pixel 40.
  • the "(L + R) value” refers to an output value obtained by adding charges from the left PD pixel 41L and the right PD pixel 41R.
  • the “L value” is an output value obtained by reading the charge from the left PD pixel 41L.
  • the (L + R) value that is, the added value of the read charges from the left PD pixel 41L and the right PD pixel 41R has a meaning as the pixel value of the PD divided pixel 40, and is therefore a signal used for image generation. Further, L reading is performed to obtain an output value (L value) of the left PD pixel 41L, and an output value (R value) of the right PD pixel 41R is obtained from the (L + R) value ⁇ L value. The phase difference of the pixel component divided into pupils can be obtained by this "L value” R value ".
  • the 6 performs such a calculation of the (L + R) value ⁇ L value, and obtains the output value (R value) of the right PD pixel 41R.
  • the L value is supplied to the difference calculation unit 51 and also to the saturation corresponding processing unit 52.
  • the example of reading out the (L + R) value and the L value will be described as described above, but by reading out the (L + R) value and the R value, L can be read in the same way. You can get the value and the R value.
  • the saturation handling processing unit 52 performs a process of correcting the L value and the R value to the original values accordingly. It can be said that this is a process of restoring the output value when it is assumed that the output range of the L value and the R value is wide in the direction in which the overflow level is higher. Therefore, the saturation corresponding processing unit 52 performs necessary calculation processing while temporarily storing the L value and the R value in the RAM 21, and obtains the corrected L value and the R value.
  • the saturation-corresponding processing unit 52 is instructed by the control signal SON from the camera control unit 14 whether or not to execute the saturation-corresponding processing.
  • the saturation corresponding processing unit 52 performs the saturation corresponding processing.
  • the saturation corresponding processing unit 52 transfers the input L value and R value as they are to the pupil imbalance correction unit 53.
  • the pupil imbalance correction unit 53 makes the fluctuation of the output value generated according to the image height flat with respect to the L value and the R value, and makes the L value and the R value flat regardless of the image height. Correction to match the output level of (left and right PD pixel pupil imbalance correction) is performed. For this left / right PD pixel pupil imbalance correction, the lens vignetting information stored in the memory unit 15 and the light receiving angle characteristics of the left PD pixel 41L and the right PD pixel 41R are used. Details of the saturation handling process and the left / right PD pixel pupil imbalance correction will be described later.
  • the correlation calculation unit 54 performs a correlation calculation on a signal having an L value, an R value, that is, a phase difference input from the pupil imbalance correction unit 53.
  • the phase difference detection by this correlation operation will be described below.
  • FIG. 7 shows an output waveform obtained by arranging the output values of the PD division pixels 40 on the image sensor 7.
  • the signal waveform based on the L value output from the left PD pixel 41L (left PD pixel output 60L) is shown by a solid line
  • the signal waveform based on the R value output from the right PD pixel 41R (right PD pixel output 60R) is shown by a broken line. There is.
  • FIG. 8A shows the waveform of the left PD pixel output 60L shifted to the right of the graph by a certain distance as the waveform 60L1.
  • FIG. 8B shows the waveform 60L1 further shifted to the right by a certain distance as the waveform 60L2.
  • FIG. 8C shows the waveform 60L2 obtained by further shifting the waveform 60L2 to the right by a certain distance as the waveform 60L3.
  • the absolute value of the difference integrated value between the waveform of the left PD pixel output 60L and the waveform of the right PD pixel output 60R is shown as a shaded portion.
  • FIG. 9 shows a graph of the difference integrated values shown in the shaded areas in FIGS. 7, 8A, 8B, and 8C.
  • the difference integral value becomes smaller as the shift amount is increased, and when the predetermined shift amount is exceeded, the difference integral value becomes larger again as the shift amount is increased.
  • the shift amount with the smallest difference integral value is the phase difference amount. That is, appropriate AF control can be performed by moving the focus lens so that the outputs of the left PD pixel 41L and the right PD pixel 41R are phase-difference-shifted and the waveforms of the left PD pixel output 60L and the right PD pixel output 60R substantially overlap. can.
  • the so-called front pin and rear pin can be distinguished by the direction in which the waveform of the left PD pixel output 60L is shifted. That is, in the state of FIG. 9, the difference integrated value can be minimized by shifting the waveform of the left PD pixel output 60L to the right. This state is the so-called front pin state. On the other hand, when the difference integrated value can be minimized by shifting the waveform of the left PD pixel output 60L to the left, it is in the so-called rear pin state.
  • FIG. 10 shows the relationship between the shift amount and the defocus amount.
  • the shift amount is a shift amount in which the difference integral value shown in FIG. 7 is originally smaller, and can be rephrased as a phase difference.
  • the relationship between the shift amount and the defocus amount can be generally expressed by a linear function. The larger the shift amount, the larger the defocus amount, and the larger the shift amount, that is, the out-of-focus state.
  • the defocus amount DF can be calculated from the shift amount.
  • the correlation calculation unit 54 obtains this defocus amount DF and outputs it to the camera control unit 14.
  • the camera control unit 14 can perform AF control using the defocus amount DF.
  • FIG. 11 schematically shows the state of overflow of one-sided PD.
  • the incident light has an intermediate brightness to a high brightness
  • an overflow may occur in one PD pixel of the PD division pixel 40, and the output value may become a saturation value.
  • incident light enters diagonally.
  • the (L + R) value from the PD divided pixel 40 is also used as a pixel signal for image generation. That is, one pixel constituting the image is formed by a pair of the left PD pixel 41L and the right PD pixel 41R. For this reason, it is not desirable to discard the excess charge when an overflow occurs in one of the PD pixels. This is because the accuracy of the brightness value of the pixel deteriorates. Therefore, the PD division pixel 40 has a pixel circuit configuration such that when an overflow occurs in one PD pixel, the surplus charge leaks to the other PD pixel.
  • FIG. 11 shows the state of leakage from the left PD pixel 41L to the right PD pixel 41R.
  • the L value is clipped by the saturation value, so that the value is smaller than the original output value, and the R value becomes a value larger than the original output value due to leakage. It ends up. This lowers the detection accuracy of the defocus amount DF based on the difference integrated value of the waveforms of the L value and the R value. That is, the AF accuracy is lowered.
  • FIG. 12A shows L and R values with the horizontal axis as the H image height (horizontal image height) and the vertical axis as the output value.
  • the horizontal axis can be considered as the horizontal direction of the image pickup device 7.
  • it is an output value corresponding to the pixel position when an all-white subject is incident on all the pixels of the image sensor 7.
  • the alternate long and short dash line indicates the overflow level.
  • the solid line and the broken line show the output value (L value) of the left PD pixel 41L and the output value (R value) of the right PD pixel 41R in a state where overflow is not considered.
  • the actual L value and R value are as shown in FIG. 12B. That is, the output value is clipped at the pixel exceeding the overflow level, and the value of the other PD pixel increases due to leakage. As a result, the accuracy of the phase difference detection between the L value and the R value is lowered, and the detection accuracy of the defocus amount DF is lowered.
  • the left and right PD pixel pupil imbalance correction corrects the level difference caused by the incident light angle according to the H image height, and corresponds to the horizontal pixel address (coordinate value in the horizontal line direction of the pixel in the image pickup element 7).
  • the correction coefficient is used to make the level characteristics of the L value and the R value flat in the horizontal direction.
  • the level difference according to the pixel positions of the L value and the R value can be eliminated, and the AF accuracy can be improved.
  • this is a case where the left and right PD pixel pupil imbalance correction is performed on the L value and R value in the ideal state of FIG. 12A without overflow.
  • FIG. 13 shows the L value and the R value with the horizontal axis as the H image height and the vertical axis as the output value, similarly to FIG. 12A.
  • the alternate long and short dash line indicates the overflow level, and the solid line and the broken line indicate the output value (L value) of the left PD pixel 41L and the output value (R value) of the right PD pixel 41R in a state where overflow is not considered.
  • the L value (L_PD [i]) overflows when considering the actual L value and R value of the PD division pixel 40 at a certain pixel address [i] in the horizontal direction. Become a level. Further, the R value (R_PD [i]) becomes a level higher by the leakage amount x than the actual value due to the influence of the leakage due to the overflow.
  • the leakage amount x can be said to be the amount of electric charge scraped by the overflow on the left PD pixel 41L side.
  • the L value and the R value shown by the solid line and the broken line in FIG. 13 are ideal values when overflow does not occur, the value of the portion exceeding the overflow level cannot be actually obtained. Therefore, such an ideal value can be acquired as an output predicted value (L_PD_Pre [i]) and (R_PD_Pre [i]) of the L value and the R value. That is, it is an output predicted value of each PD pixel according to the pixel address [i]. If such an output predicted value is obtained, the original output value, that is, the L value and the R value that would have been obtained if overflow did not occur, can be obtained by using the output predicted value and the actual output value. ..
  • the output predicted value can be obtained based on the light receiving angle characteristic of the PD pixel and the information of the lens vignetting.
  • the light receiving angle characteristics of the right PD pixel 41R and the left PD pixel 41L will be described with reference to FIG.
  • FIG. 14A shows the light receiving angle characteristics of the right PD pixel 41R and the left PD pixel 41L, and shows the distribution of the light receiving sensitivity on the pan axis (pan angle) and the tilt axis (tilt angle) with contour lines.
  • the light receiving sensitivity is higher toward the center of the contour lines.
  • FIG. 14B shows the light receiving angle characteristics of the right PD pixel 41R and the left PD pixel 41L in a cross section at a tilt axis of 0 ° with the horizontal axis as the pan axis and the vertical axis as the sensitivity.
  • FIG. 14C shows a light receiving image of the right PD pixel 41R and the left PD pixel 41L.
  • the right PD pixel 41R is highly sensitive to light rays from the right direction
  • the left PD pixel 41L is highly sensitive to light rays from the left direction.
  • FIG. 15A shows the lens vignetting 90 on the contour line of the light receiving angle characteristic for the PD divided pixel 40 which is the center in the H direction (horizontal direction) and the center in the V direction (vertical direction) in the image pickup element 7.
  • the horizontal axis is the pan axis angle
  • the vertical axis is the tilt angle.
  • the integrated value of the light receiving sensitivity in the lens vignetting 90 is the output value of the PD pixel. In the case of this pixel, the output value (R value) of the right PD pixel 41R and the output value (L value) of the left PD pixel 41L are equivalent.
  • FIG. 15B shows the lens vignetting 90 on the contour line of the light receiving angle characteristic for the PD divided pixel 40 which is the + side end portion in the H direction and the center in the V direction in the image sensor 7. From the integrated value of the light receiving sensitivity in the lens vignetting 90, R value> L value.
  • FIG. 15C shows the lens vignetting 90 on the contour line of the light receiving angle characteristic for the PD split pixel 40 which is the + side end portion in the H direction and the + side end portion in the V direction in the image sensor 7. .. From the integrated value of the light receiving sensitivity in the lens vignetting 90, R value> L value.
  • the output predicted value can be obtained by the integrated value of the light receiving sensitivity in the lens vignetting 90.
  • the light receiving angle characteristic is fixed because it is a characteristic of the mounted image sensor 7, and can be stored in, for example, the memory unit 15.
  • the camera control unit 14 can provide information on the light receiving angle characteristic to the saturation-corresponding processing unit 52.
  • the information on the lens vignetting 90 is based on the lens barrel 3, the F value, and the like.
  • the camera control unit 14 can obtain information on the lens vignetting 90 in real time by communicating with the lens barrel control unit 18, and can provide it to the saturation-corresponding processing unit 52.
  • the camera control unit 14 may calculate the output predicted value from the light receiving angle characteristic of the image sensor 7 and the information of the lens vignetting 90, and provide the output predicted value to the saturation corresponding processing unit 52.
  • the saturation processing unit 52 can obtain an output predicted value from the light receiving angle characteristic of the image sensor 7 and the information of the lens vignetting 90.
  • the saturation-corresponding processing unit 52 specifically performs the saturation-corresponding processing as shown in FIG.
  • the saturation-corresponding processing unit 52 detects an overflow. This is because by detecting the overflowing PD divided pixel 40, it can be determined that saturation corresponding processing is necessary for the PD divided pixel 40. Specifically, when the output value as the L value or the R value is at the overflow level, it can be determined that an overflow has occurred. For example, when the output value is 12 bits and the maximum value is "FFF" in hexadecimal notation, it can be determined to be overflow.
  • the overflow level is not necessarily limited to the maximum value such as "0xFFF", and there may be a design in which an overflow occurs even if the voltage value is less than "0xFFF". In that case, the overflow judgment is performed based on the set overflow value.
  • the saturation-corresponding processing unit 52 holds the output value of the PD pixel that has not overflowed as a calculated value to be used in a later step S4 (temporarily stored for calculation). For example, if the L value has overflowed, the saturation-corresponding processing unit 52 sets the L_PD [i] value to "0xFFF", which is the overflow level, but the output value (R) of the right PD pixel 41R that has not overflowed. Value) is retained for calculation as R_PD [i].
  • step S3 the saturation corresponding processing unit 52 holds the output predicted values of the left PD pixel 41L and the right PD pixel 41R for the overflowed PD division pixel 40 as the calculated values to be used in the later step S4.
  • Output predicted value of right PD pixel 41R R_PD_Pre [i]
  • Output predicted value of left PD pixel 41L L_PD_Pre [i]
  • step S4 the saturation-corresponding processing unit 52 obtains the leakage amount x.
  • (L_PD [i] + x) / (R_PD [i] -x) L_PD_Pre [i] / R_PD_Pre [i]
  • the leakage amount x is obtained from this equation. This is based on the assumption that the leakage amount x is a ratio of the predicted output values.
  • the saturation corresponding processing unit 52 corrects the L value and the R value in step S5.
  • the above processing is saturation-corresponding processing, and the original L value and R value when overflow does not occur can be obtained.
  • appropriate corrections can be made as shown in FIG. 12B, and deterioration of AF accuracy can be prevented.
  • step S101 of FIG. 17 the camera control unit 14 monitors the half-pressing of the shutter button 6S. When half-pressing is not performed, other processing (not shown) is performed. When the half-press is performed, the process of FIG. 17 proceeds to step S102 and subsequent steps.
  • the camera control unit 14 instructs the camera signal processing unit 8 to calculate the defocus amount DF.
  • the execution of the saturation corresponding process by the control signal SON is not instructed. Therefore, the camera signal processing unit 8 obtains the defocus amount without performing the saturation corresponding processing.
  • the camera signal processing unit 8 reads out the PD division pixel 40 in step S102, corrects the left and right PD pixel pupil imbalance in step S103, and performs the correlation calculation in step S104.
  • the defocus amount DF thus obtained is supplied to the camera control unit 14.
  • the camera control unit 14 determines the defocus amount DF in step S106, and controls the focus lens drive according to the defocus amount DF in step S107. Then, the process returns to step S102. Therefore, the camera signal processing unit 8 obtains the defocus amount DF at the next timing, and the camera control unit 14 determines in step S105 whether or not the defocus amount DF ⁇ 0.
  • the camera control unit 14 proceeds to step S110 and branches the process depending on whether or not an overflow has occurred in the AF control process up to this point. If no overflow has occurred, the accuracy of the defocus amount DF has not decreased in the control so far, and therefore the focus lens should have been moved to the in-focus position. Therefore, the process proceeds to step S116, and the lens movement is stopped as the in-focus position. This is suitable when the defocus amount DF ⁇ 0 is within an acceptable range for the in-focus state.
  • the camera control unit 14 stores in advance a value that defines a range in which the defocus amount DF ⁇ 0.
  • the camera signal processing unit 8 instructs the camera signal processing unit 8 to calculate the defocus amount DF in step S111 and subsequent steps. At this time, the execution of the saturation correspondence process by the control signal SON is instructed.
  • the camera signal processing unit 8 obtains the defocus amount DF after performing saturation-corresponding processing.
  • the camera signal processing unit 8 performs saturation corresponding processing in step S111 for the L value and R value read in step S102 immediately before, performs left / right PD pixel pupil imbalance correction again in step S112, and performs correlation calculation again in step S113. Go to find the defocus amount DF.
  • the camera control unit 14 determines the defocus amount DF in step S114, and controls the focus lens drive according to the defocus amount in step S115. Then, in step S116, the lens movement is stopped.
  • AF control is first performed without performing saturation processing, and the camera is driven to a certain degree of focusing. Then, as a result of the correlation calculation, when the result of the defocus amount DF ⁇ 0 is obtained, if an overflow pixel occurs, the process of performing the saturation corresponding process and then performing the correlation calculation again to move the focus lens as a fine adjustment. Become.
  • the saturation handling process is a process of rebating the charge amount (leakage amount x) leaked from one overflowing PD pixel to the other PD pixel to the output value on the overflowing side. That is, it is premised that the leakage amount x is originally added to the output value on the overflow side.
  • the left PD pixel output 60L which is an L value waveform
  • the right PD pixel output 60R which is an R value waveform
  • the fact that the waveforms are out of alignment means that the right PD pixel 41R and the left PD pixel 41L receive different subject light in one PD division pixel 40
  • the fact that the waveforms overlap means that the right PD pixel 41R and the left PD pixel. It means that 41L receives the same subject light.
  • the difference between the L value and the R value may be affected by the leakage amount x of the subject. I don't know if the difference is affecting it. In other words, the leakage amount x cannot be calculated accurately. Therefore, it can be said that the saturation-corresponding process functions properly in the in-focus or near-focus state. Therefore, in the processing of FIG. 17, AF control is performed without performing saturation-corresponding processing until near the in-focus state, and if an overflow occurs when the in-focus state is almost in-focused, saturation is supported. After processing, the defocus amount DF is obtained again and AF control is performed to perform fine adjustment.
  • the image pickup device 1 of the embodiment includes a PD division pixel 40 including a left PD pixel 41L (first PD pixel) and a right PD pixel 41R (second PD pixel) that output separate pixel signals. It has an image pickup element 7. Further, the camera signal processing unit 8 is provided to perform saturation-corresponding processing for correcting the output value based on the saturation value and the output prediction value when the output value of the pixel signal reaches the saturation value (overflow level).
  • both the output value of the overflow side and the output value of the side to which the leakage amount x is added are corrected, but one of them may be used. For example, it is conceivable that the output value that has reached the clip level is only corrected to the original value, or the output value that has leaked is only corrected to the state where there is no leakage.
  • the saturation corresponding process described in the embodiment includes a process of calculating the difference value between the output predicted value and the saturation value.
  • the level that fluctuates due to overflow can be estimated from the difference between the output predicted value and the saturation value.
  • the difference value between the output predicted value and the saturation value is calculated for one of the left PD pixel 41L and the right PD pixel 41R.
  • the difference between the output predicted value and the saturation value may be obtained for one PD pixel.
  • the difference value calculated for one PD pixel is added to the output value of one PD pixel and subtracted from the output value of the other PD pixel.
  • the charge overflowing in one PD pixel leaks into the other PD pixel.
  • the output value of the PD divided pixel 40 as a whole can be maintained accurately.
  • the output values of the left PD pixel 41L and the right PD pixel 41R can be optimized, and the AF operation accuracy can be improved.
  • the image pickup apparatus 1 of the embodiment includes a camera control unit 14 that determines the in-focus state and causes the camera signal processing unit 8 to execute saturation-corresponding processing according to the in-focus state. That is, in the AF control, for example, when the focus state is almost reached, the saturation corresponding process is performed (see FIG. 16). If the left PD pixel 41L and the right PD pixel 41R in the PD division pixel 40 are in a state where the light of the same subject is incident, the electric charge leaked from one PD pixel to the other PD pixel causes an image of the same subject. Since it is configured, there is no problem in performing saturation-corresponding processing (addition of leakage amount x to one output value and subtraction from the other output value).
  • the saturation corresponding process is performed in the vicinity of the in-focus state in which the left PD pixel 41L and the right PD pixel 41R are incident with the same subject light. As a result, the effect of the saturation-corresponding process can be appropriately exerted.
  • the camera control unit 14 performs AF control based on the defocus amount DF obtained by using the L value and the R value without causing the camera signal processing unit 8 to execute the saturation corresponding process. , Based on the defocus amount DF obtained using the L and R values in a state where the camera signal processing unit 8 is allowed to perform saturation processing after the in-focus condition (DF ⁇ 0) is satisfied. AF control was performed (see FIG. 16). By performing AF control based on the amount of defocus obtained without performing the saturation-corresponding process, the focus state is approached.
  • the left PD pixel 41L and the right PD pixel 41R are in a state where the light of the same subject is incident, and the leakage amount can be correctly obtained and the output value can be corrected by the saturation handling process, so fine adjustment is made. AF control is possible. As a result, the AF accuracy can be significantly improved.
  • the output predicted value is a value obtained based on the light receiving angle characteristics of the left PD pixel 41L and the right PD pixel 41R and the lens information.
  • the output predicted value it is possible to easily obtain a difference value from the saturation value at the time of overflow for each pixel. Since the light receiving angle characteristic is known, it may be stored in the memory unit 15, and vignetting information according to the type of lens may also be stored. As a result, an appropriate output prediction value can be obtained and the saturation correspondence process can be executed.
  • the image pickup device 1 of the embodiment is an image pickup device to which an interchangeable lens barrel 3 can be attached, and the lens information is received from the lens barrel 3.
  • an appropriate output prediction value corresponding to the lens barrel 3 can be used.
  • the technique described in the embodiment can be applied even to the lens-integrated image pickup apparatus. In that case, since the camera control unit 14 can grasp the information of the lens vignetting 90, the F value, and the like, the output predicted value may be obtained based on them.
  • the camera signal processing unit 8 of the embodiment has described an example of performing pupil imbalance correction for equalizing the fluctuation of the output value depending on the image height with respect to the output values of the left PD pixel 41L and the right PD pixel 41R.
  • the AF control using the output values of the left PD pixel 41L and the right PD pixel 41R it is possible to prevent the influence of the H image height by performing the pupil imbalance correction.
  • the camera signal processing unit 8 of the embodiment is intended to perform the pupil imbalance correction on the output values of the left PD pixel 41L and the right PD pixel 41R after the saturation corresponding processing is performed.
  • the overflow amount of each output value of the left PD pixel 41L and the right PD pixel 41R is reduced, or overcorrection due to pupil imbalance correction in a state of being added due to leakage congestion is prevented from occurring. It is possible to improve the signal accuracy.
  • An image pickup element including a photodiode divided pixel including a first photodiode pixel and a second photodiode pixel, each of which outputs a separate pixel signal.
  • An image pickup apparatus including a signal processing unit that performs saturation-corresponding processing for correcting an output value based on the saturation value and an output prediction value when the output value of the pixel signal becomes a saturation value.
  • the saturation corresponding process includes a process of calculating a difference value between the output predicted value and the saturation value.
  • the image pickup apparatus comprising a control unit for determining a focused state and causing the signal processing unit to execute the saturation corresponding process according to the focused state.
  • the control unit Autofocus based on the defocus amount obtained by using the output value of the first photodiode pixel and the output value of the second photodiode pixel without causing the signal processing unit to execute the saturation corresponding process. After controlling After the in-focus condition is satisfied, the output value of the first photodiode pixel and the output value of the second photodiode pixel are used in a state where the signal processing unit is made to execute the saturation corresponding process.
  • the image pickup apparatus which performs autofocus control based on the obtained defocus amount.
  • the output predicted value is a value obtained based on the light receiving angle characteristics of the first photodiode pixel and the second photodiode pixel and lens information.
  • the output prediction value is described in any one of (1) to (6) above.
  • Imaging device. (8) An image pickup device that can be equipped with an interchangeable lens barrel.
  • the image pickup apparatus according to (7) above, wherein the lens information is received from the lens barrel.
  • the signal processing unit The pupil imbalance correction is performed to equalize the fluctuation of the output value depending on the image height with respect to the output value of the first photodiode pixel and the output value of the second photodiode pixel (1) to (8). ).
  • the image pickup apparatus according to any one of. (10) The signal processing unit The image pickup apparatus according to (9) above, wherein the pupil imbalance correction is performed on the output value of the first photodiode pixel and the output value of the second photodiode pixel after the saturation corresponding process is performed. .. (11)
  • Image sensor 2 Camera housing 3 Lens lens barrel 6S Shutter button 7 Image sensor 8
  • Image sensor 8 Camera signal processing unit 14
  • Camera control unit 40 PD division pixel 41L Left PD pixel 41R Right PD pixel

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Focusing (AREA)
  • Studio Devices (AREA)
  • Automatic Focus Adjustment (AREA)
PCT/JP2021/023240 2020-12-17 2021-06-18 撮像装置、信号処理方法 Ceased WO2022130662A1 (ja)

Priority Applications (4)

Application Number Priority Date Filing Date Title
EP21906029.0A EP4254937A4 (en) 2020-12-17 2021-06-18 IMAGING DEVICE AND SIGNAL PROCESSING METHOD
CN202180083011.9A CN116724262A (zh) 2020-12-17 2021-06-18 成像装置和信号处理方法
US18/256,388 US12425730B2 (en) 2020-12-17 2021-06-18 Imaging apparatus and signal processing method for handling saturation of split pixel
JP2022569694A JP7704155B2 (ja) 2020-12-17 2021-06-18 撮像装置、信号処理方法

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2020-209466 2020-12-17
JP2020209466 2020-12-17

Publications (1)

Publication Number Publication Date
WO2022130662A1 true WO2022130662A1 (ja) 2022-06-23

Family

ID=82059381

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2021/023240 Ceased WO2022130662A1 (ja) 2020-12-17 2021-06-18 撮像装置、信号処理方法

Country Status (5)

Country Link
US (1) US12425730B2 (https=)
EP (1) EP4254937A4 (https=)
JP (1) JP7704155B2 (https=)
CN (1) CN116724262A (https=)
WO (1) WO2022130662A1 (https=)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004191629A (ja) * 2002-12-11 2004-07-08 Canon Inc 焦点検出装置
JP2015142364A (ja) * 2014-01-30 2015-08-03 キヤノン株式会社 画像処理装置、撮像装置、及び画像処理方法
JP2015163915A (ja) * 2014-02-28 2015-09-10 キヤノン株式会社 画像処理装置、撮像装置、画像処理方法、プログラム、および、記憶媒体
JP2016109938A (ja) 2014-12-08 2016-06-20 キヤノン株式会社 撮像装置、焦点検出方法、プログラム、及び記憶媒体
JP2019121972A (ja) * 2018-01-10 2019-07-22 キヤノン株式会社 画像処理方法、画像処理装置、撮像装置、画像処理プログラム、および、記憶媒体

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2012220790A (ja) * 2011-04-11 2012-11-12 Canon Inc 撮像装置
JP5943655B2 (ja) * 2012-03-12 2016-07-05 キヤノン株式会社 画像処理装置、焦点検出装置、および、画像処理プログラム
CN104205797B (zh) * 2012-03-28 2015-10-21 富士胶片株式会社 摄像装置
JP2014142497A (ja) 2013-01-24 2014-08-07 Canon Inc 撮像装置及びその制御方法
JP5701942B2 (ja) * 2013-07-10 2015-04-15 オリンパス株式会社 撮像装置、カメラシステム及び画像処理方法
JP2015212772A (ja) 2014-05-02 2015-11-26 キヤノン株式会社 測距装置、撮像装置、測距方法、および測距パラメータ算出方法
JP6600170B2 (ja) * 2014-07-07 2019-10-30 キヤノン株式会社 撮像素子及びその制御方法並びに撮像装置
JP2017022528A (ja) * 2015-07-09 2017-01-26 キヤノン株式会社 画像処理装置及びその制御方法、プログラムならびに撮像装置
JP2017040704A (ja) 2015-08-18 2017-02-23 キヤノン株式会社 撮像装置および撮影システム

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004191629A (ja) * 2002-12-11 2004-07-08 Canon Inc 焦点検出装置
JP2015142364A (ja) * 2014-01-30 2015-08-03 キヤノン株式会社 画像処理装置、撮像装置、及び画像処理方法
JP2015163915A (ja) * 2014-02-28 2015-09-10 キヤノン株式会社 画像処理装置、撮像装置、画像処理方法、プログラム、および、記憶媒体
JP2016109938A (ja) 2014-12-08 2016-06-20 キヤノン株式会社 撮像装置、焦点検出方法、プログラム、及び記憶媒体
JP2019121972A (ja) * 2018-01-10 2019-07-22 キヤノン株式会社 画像処理方法、画像処理装置、撮像装置、画像処理プログラム、および、記憶媒体

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP4254937A4

Also Published As

Publication number Publication date
EP4254937A4 (en) 2024-04-17
JP7704155B2 (ja) 2025-07-08
EP4254937A1 (en) 2023-10-04
CN116724262A (zh) 2023-09-08
JPWO2022130662A1 (https=) 2022-06-23
US20240022813A1 (en) 2024-01-18
US12425730B2 (en) 2025-09-23

Similar Documents

Publication Publication Date Title
JP5322783B2 (ja) 撮像装置及び該撮像装置の制御方法
CN101285989B (zh) 自动对焦装置、图像拾取装置和自动对焦方法
JP2018107727A (ja) 画像処理装置および画像処理方法、撮像装置、プログラム
US9826167B2 (en) Imaging apparatus and imaging method which perform focus adjustment while performing live-view display
JP5967865B2 (ja) 撮像装置、撮像装置の制御方法及びプログラム
CN101540848A (zh) 摄像元件和摄像装置
JP4265029B2 (ja) 画像取り込み装置および交換レンズ
US10044957B2 (en) Imaging device and imaging method
CN109964479B (zh) 摄像设备及其控制方法
GB2462161A (en) An apparatus and method for adjusting the focus of a digital image
JP6960755B2 (ja) 撮像装置及びその制御方法、プログラム、記憶媒体
JP2014239316A (ja) 撮像装置およびその制御方法
JP7704155B2 (ja) 撮像装置、信号処理方法
JP7655316B2 (ja) 撮像装置、撮像方法
CN106993110A (zh) 摄像设备及其控制方法
JP6515962B2 (ja) 制御装置、制御方法および露光制御システム
JP5493273B2 (ja) 撮像装置、撮影方法及びプログラム
JP7447901B2 (ja) 撮像装置、絞り機構制御方法
JP7679771B2 (ja) 撮像装置、デフォーカス量算出方法
US12238434B2 (en) Imaging device and imaging method for autofocus control
JP4164522B2 (ja) 撮像装置
JP2006352434A (ja) 撮影装置
JP2016092798A (ja) 撮像装置及び撮像装置の制御方法
JP2007033997A (ja) 焦点検出装置
JP2004194360A (ja) 撮像装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21906029

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2022569694

Country of ref document: JP

Kind code of ref document: A

WWE Wipo information: entry into national phase

Ref document number: 18256388

Country of ref document: US

WWE Wipo information: entry into national phase

Ref document number: 202180083011.9

Country of ref document: CN

ENP Entry into the national phase

Ref document number: 2021906029

Country of ref document: EP

Effective date: 20230627

NENP Non-entry into the national phase

Ref country code: DE

WWG Wipo information: grant in national office

Ref document number: 18256388

Country of ref document: US