WO2019155981A1 - 画像処理装置、撮像装置、画像処理方法、およびプログラム - Google Patents

画像処理装置、撮像装置、画像処理方法、およびプログラム Download PDF

Info

Publication number
WO2019155981A1
WO2019155981A1 PCT/JP2019/003403 JP2019003403W WO2019155981A1 WO 2019155981 A1 WO2019155981 A1 WO 2019155981A1 JP 2019003403 W JP2019003403 W JP 2019003403W WO 2019155981 A1 WO2019155981 A1 WO 2019155981A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
viewpoint
unit
image processing
area
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2019/003403
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
昌彦 奥沢
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Canon Inc
Original Assignee
Canon Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Canon Inc filed Critical Canon Inc
Publication of WO2019155981A1 publication Critical patent/WO2019155981A1/ja
Priority to US16/984,343 priority Critical patent/US11323689B2/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/282—Image signal generators for generating image signals corresponding to three or more geometrical viewpoints, e.g. multi-view systems
    • H—ELECTRICITY
    • H10—SEMICONDUCTOR DEVICES; ELECTRIC SOLID-STATE DEVICES NOT OTHERWISE PROVIDED FOR
    • H10F—INORGANIC SEMICONDUCTOR DEVICES SENSITIVE TO INFRARED RADIATION, LIGHT, ELECTROMAGNETIC RADIATION OF SHORTER WAVELENGTH OR CORPUSCULAR RADIATION
    • H10F39/00—Integrated devices, or assemblies of multiple devices, comprising at least one element covered by group H10F30/00, e.g. radiation detectors comprising photodiode arrays
    • H10F39/10—Integrated devices
    • H10F39/12—Image sensors
    • H10F39/18—Complementary metal-oxide-semiconductor [CMOS] image sensors; Photodiode array image sensors
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T1/00—General purpose image data processing
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/111—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/156—Mixing image signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/67—Focus control based on electronic image sensor signals
    • H04N23/673—Focus control based on electronic image sensor signals based on contrast or high frequency components of image signals, e.g. hill climbing method
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80—Camera processing pipelines; Components thereof
    • H—ELECTRICITY
    • H10—SEMICONDUCTOR DEVICES; ELECTRIC SOLID-STATE DEVICES NOT OTHERWISE PROVIDED FOR
    • H10F—INORGANIC SEMICONDUCTOR DEVICES SENSITIVE TO INFRARED RADIATION, LIGHT, ELECTROMAGNETIC RADIATION OF SHORTER WAVELENGTH OR CORPUSCULAR RADIATION
    • H10F39/00—Integrated devices, or assemblies of multiple devices, comprising at least one element covered by group H10F30/00, e.g. radiation detectors comprising photodiode arrays
    • H10F39/80—Constructional details of image sensors
    • H10F39/802—Geometry or disposition of elements in pixels, e.g. address-lines or gate electrodes
    • H—ELECTRICITY
    • H10—SEMICONDUCTOR DEVICES; ELECTRIC SOLID-STATE DEVICES NOT OTHERWISE PROVIDED FOR
    • H10F—INORGANIC SEMICONDUCTOR DEVICES SENSITIVE TO INFRARED RADIATION, LIGHT, ELECTROMAGNETIC RADIATION OF SHORTER WAVELENGTH OR CORPUSCULAR RADIATION
    • H10F39/00—Integrated devices, or assemblies of multiple devices, comprising at least one element covered by group H10F30/00, e.g. radiation detectors comprising photodiode arrays
    • H10F39/80—Constructional details of image sensors
    • H10F39/806—Optical elements or arrangements associated with the image sensors
    • H10F39/8063—Microlenses

Definitions

  • the present invention relates to an image processing technique for generating an image whose viewpoint is changed from a plurality of images having parallax.
  • an imaging device that can acquire viewpoint image data from different viewpoints by phase difference detection using an imaging device in which a pixel unit is configured by a plurality of microlenses and a photoelectric conversion unit corresponding to each microlens.
  • the imaging apparatus disclosed in Patent Document 1 detects a focus from two viewpoint images using an imaging device in which one pixel is configured by one microlens and two subpixels. By adding the pixel values of the sub-pixels sharing one microlens, it can be handled as one pixel value and an image output can be obtained.
  • a parallax image is a plurality of images with different viewpoints.
  • the viewpoint position can be set to a different position after shooting, and the image can be regenerated.
  • Patent Document 2 discloses a technique for changing the viewpoint position based on a parallax image. If the user unintentionally blurs in front of the target when shooting, the viewpoint can be moved to a position where the blur does not cover the subject using the above technique. Images can be acquired.
  • Patent Document 2 as a method of changing the viewpoint based on the parallax image, a UI (user interface) in which the user specifies the moving direction of the viewpoint is realized.
  • this UI for example, in a front blurred photo in which the blur area is covered on the front side of the subject, the direction of movement of the viewpoint and the direction in which the previous blur moves are opposite to each other.
  • the front blur is a phenomenon in which the main subject is hidden in the blur area when the blur of the second subject (foreground) located in front of the first subject as the main subject is large.
  • An object of the present invention is to provide an image processing apparatus capable of changing a viewpoint with an easy-to-understand operation when generating an image from a plurality of images having different viewpoints.
  • An image processing apparatus is an image processing apparatus that generates image data based on data of a plurality of viewpoint images with different viewpoints, and an acquisition unit that acquires the data of the plurality of viewpoint images;
  • the designation means for designating the position in the image displayed by the display means, the detection means for detecting the movement direction and the movement amount of the position designated by the designation means, and the movement direction detected by the detection means are opposite to each other.
  • the image processing apparatus of the present invention it is possible to provide an image processing apparatus capable of changing the viewpoint with an easy-to-understand operation when generating an image from a plurality of images having different viewpoints.
  • FIG. 1 is a configuration diagram of an image processing apparatus according to an embodiment of the present invention. It is a mimetic diagram showing an example of pixel arrangement of an image sensor. It is a schematic diagram which shows the pixel structure in an image sensor. It is a figure explaining the correspondence of a pixel structure and pupil division. It is a figure which shows the relationship between pupil division and defocus amount, and image shift amount. It is a figure which shows the example of a viewpoint image and a synthesized image. It is a block diagram which shows the structural example of an image process part. It is a flowchart explaining the control in 1st Embodiment. It is a flowchart which shows the process following FIG. It is explanatory drawing of the example of a display of 1st Embodiment.
  • viewpoint images images with different viewpoints acquired by the imaging unit in the imaging apparatus to which the image processing apparatus according to the present invention is applied are referred to as viewpoint images. It is assumed that the parallax image is composed of a plurality of viewpoint images.
  • FIG. 1 is a configuration diagram of an image processing apparatus 100 according to the present embodiment.
  • the image processing apparatus 100 has an imaging function and can record images having parallax, that is, data of a plurality of viewpoint images. Further, the image processing apparatus 100 performs image processing on a plurality of viewpoint images to generate one image, and performs screen display and recording processing.
  • the image pickup unit 101 includes a lens, a shutter, a diaphragm, and an image sensor, and picks up an image of a subject through a lens constituting the image pickup optical system.
  • the imaging device includes a photoelectric conversion unit in which each pixel unit is divided in the left-right direction, and can acquire a pair of image signals. Details of the pixel structure will be described later with reference to FIG.
  • a bus 102 connects each unit in the image processing apparatus 100 and transmits and receives data and control signals.
  • the system control unit 103 controls the entire image processing apparatus 100.
  • the system control unit 103 includes a CPU (Central Processing Unit), and implements each process of this embodiment by executing a program stored in a non-illustrated nonvolatile memory or the like.
  • the memory 104 stores viewpoint image data obtained from the imaging unit 101, intermediate data for image processing, and the like.
  • the memory 104 has a storage capacity sufficient to store a predetermined number of captured image data.
  • the image processing unit 105 generates data of one composite image from a plurality of viewpoint images stored in the memory 104 and stores the data in the memory 104.
  • the image processing unit 105 performs various image processing such as gamma correction, noise reduction, and color space conversion.
  • the image processing unit 105 performs format conversion such as JPEG (Joint Photographic Experts Group) on the image processed data, generates recording output data and display image data, and stores them in the memory 104.
  • JPEG Joint Photographic Experts Group
  • the display unit 106 includes a liquid crystal display panel and the like, and displays display image data stored in the memory 104, a GUI (Graphical User Interface) screen, and the like.
  • the operation unit 107 receives a user operation on the image processing apparatus 100 and an instruction for performing image processing on a captured image.
  • the operation unit 107 includes operation buttons provided on the apparatus main body of the image processing apparatus 100, a touch panel that can be operated on the display screen of the display unit 106, and notifies the system control unit 103 of user operation instructions.
  • the distance information acquisition unit 108 obtains an image shift amount and a defocus amount from a pair of viewpoint image data stored in the memory 104 and acquires subject distance information.
  • the distance information is depth information in the depth direction of the captured image, and it can be determined using the distance information whether or not the subject at the specified location is in front of the imaging position.
  • the image shift amount is obtained from the pair of viewpoint image data, and the subject at the designated position is in front of the image formation position by the sign of the defocus amount calculated from the image shift amount using the defocus coefficient. It can be determined whether or not.
  • the position where the defocus amount is zero corresponds to the image forming position, and the front-rear relationship on the optical axis of the imaging optical system is determined by the sign of the defocus amount.
  • the recording medium I / F unit 110 is an interface unit that transmits / receives data to / from a recording medium 111 such as a memory card.
  • the recording medium 111 is composed of a semiconductor memory or the like, and records captured image data and information related to the data. Data is recorded on the recording medium 111 via the recording medium I / F unit 110, and data is read from the recording medium 111.
  • FIG. 2 is a schematic diagram illustrating a pixel arrangement example in the image sensor in the imaging unit 101, and representatively illustrates an area in which 4 horizontal pixels ⁇ 4 vertical pixels are arranged.
  • the imaging element can divide the pupil region of the imaging optical system and generate a plurality of image signals based on the light fluxes that have passed through different pupil partial regions. Specifically, the photoelectric conversion unit constituting each pixel unit is divided into two in the horizontal direction (pupil division direction).
  • the 2 ⁇ 2 pixel group 200 at the upper left in FIG. 2 corresponds to a repeating unit of a primary color Bayer array color filter provided in the image sensor.
  • a pixel 200R having a spectral sensitivity of R (red) is arranged at the upper left
  • a pixel 200G having a spectral sensitivity of G (green) is arranged at the upper right and the lower left.
  • a pixel 200B having a spectral sensitivity of B (blue) is arranged at the lower right.
  • the left half is the photoelectric conversion unit 201 and the right half photoelectric conversion unit 202 is.
  • the first image data obtained from the output of the photoelectric conversion unit 201 and the second image data obtained from the output of the photoelectric conversion unit 202 constitute parallax image data (a pair of viewpoint image data). That is, a parallax image can be generated by one imaging. Moreover, captured image data can be acquired by adding and reading the outputs of the photoelectric conversion units 201 and 202. The parallax image data and the captured image data are stored in the memory 104.
  • FIG. 3A shows a plan view of one pixel 200G in the image sensor when viewed from the light receiving surface side (+ z direction).
  • the direction perpendicular to the paper surface is defined as the z direction
  • the horizontal direction is defined as the x direction
  • the vertical direction is defined as the y direction.
  • the near side is defined as + z direction
  • the right direction is defined as + x direction
  • the upward direction is defined as + y direction.
  • FIG. 3B shows a cross-sectional view of the aa cross section of FIG. 3A viewed from the ⁇ y direction.
  • the direction perpendicular to the paper surface is the y direction
  • the horizontal direction is the x direction
  • the vertical direction is the z direction.
  • a microlens 305 for condensing incident light is formed on the light receiving surface side.
  • the photoelectric conversion unit 300 N H divided in the x-direction, is N V divided in the y direction.
  • the photoelectric conversion units 301 and 302 have a configuration of a pin structure photodiode in which an intrinsic layer is sandwiched between a p-type layer and an n-type layer, or a pn junction photodiode in which the intrinsic layer is omitted.
  • a color filter 306 is formed between the microlens 305 and the photoelectric conversion units 301 and 302. If necessary, the spectral transmittance of the color filter is changed for each photoelectric conversion unit, or the color filter is omitted.
  • the light that has entered the pixel 200G is collected by the microlens 305, and the light is received by the photoelectric conversion units 301 and 302 after being separated by the color filter 306, respectively.
  • a pair of electrons and holes are generated according to the amount of received light, separated by a depletion layer, and then negatively charged electrons are accumulated in an n-type layer (not shown).
  • the holes are discharged to the outside of the image sensor through a p-type layer connected to a constant voltage source (not shown).
  • the electrons accumulated in the n-type layers of the photoelectric conversion units 301 and 302 are transferred to the capacitance unit (FD) via the transfer gate, converted into a voltage signal, and output as a pixel signal.
  • FIG. 4 is a diagram for explaining the correspondence between the pixel structure shown in FIG. 3 and pupil division.
  • the lower side of FIG. 4 shows a cross-sectional view of the pixel structure taken along the line aa when viewed from the + y direction, and the upper side shows the exit pupil plane of the imaging optical system (see the exit pupil 410).
  • the figure when seen from the -Z direction is shown.
  • the x axis and the y axis are shown reversed from the state shown in FIG. 3 in the sectional view of the pixel structure.
  • the first pupil partial region 401 is generally conjugated by the microlens 305 with respect to the light receiving surface of the photoelectric conversion unit 301 whose center of gravity is deviated in the ⁇ x direction. That is, the first pupil partial region 401 represents a pupil region that can be received by the photoelectric conversion unit 301, and the center of gravity is biased in the + X direction on the exit pupil plane.
  • the second pupil partial region 402 is substantially conjugated by the microlens 305 with respect to the light receiving surface of the photoelectric conversion unit 302 whose center of gravity is decentered in the + x direction.
  • the second pupil partial region 402 represents a pupil region that can be received by the photoelectric conversion unit 202, and the center of gravity is deviated in the ⁇ X direction on the exit pupil plane.
  • a region 400 shown in FIG. 4 is a pupil region that can receive light in the entire pixel 200G when the photoelectric conversion unit 301 and the photoelectric conversion unit 302 are combined.
  • the correspondence between the image sensor and pupil division is shown in the schematic diagram of FIG.
  • the light beams that have passed through the first pupil partial region 401 and the second pupil partial region 402 are incident on the pixels of the image sensor at different angles.
  • Incident light on the imaging surface 500 is received by the photoelectric conversion units 301 and 302 divided into two, and each photoelectric conversion unit converts the light into an electrical signal.
  • the image data picked up by the image pickup unit 101 is stored in the memory 104.
  • An example of viewpoint image data will be described with reference to FIG.
  • a first viewpoint image 701 shown in FIG. 6A is an image acquired through the imaging optical system, and shows regions of the subjects O1 to O3.
  • the subjects O1 to O3 exist at distances d1 to d3 from the imaging unit 101, respectively.
  • a second viewpoint image 702 shown in FIG. 6B is an image acquired through the imaging optical system.
  • the viewpoint image 702 has a different viewpoint from the viewpoint image 701, and the area of the subject O1 and the area of the subject O2 overlap. This means that the subject O1 is closer to the imaging unit 101 than the subject O2.
  • the image processing unit 105 reads the viewpoint image data from the memory 104, performs predetermined image processing, and combines the parallax images into one image.
  • FIG. 6C shows a composite image 703 when the first viewpoint image 701 and the second viewpoint image 702 are combined at a ratio of 1: 1.
  • the position of the subject O2 in the viewpoint images 701 and 702 is the same, and no image shift occurs in the composite image 703.
  • the regions of the subjects O1 and O3 in the viewpoint images 701 and 702 have different horizontal positions. Therefore, in the composite image 703, an image shift occurs in the areas of the subjects O1 and O3.
  • the subject O1 overlaps the subject O2. This is because the subject O1 overlaps the subject O2 in the viewpoint image 702 in FIG.
  • FIG. 6D shows a composite image 704 when the composition ratio of the viewpoint image 701 and the viewpoint image 702 is changed to 2: 0 for the subject O1 and the subject O2. It is assumed that the subject O3 is synthesized at a synthesis ratio of the viewpoint images 701 and 702 of 1: 1. In the composite image 704, the areas of the subject O1 and the subject O2 do not overlap. When the subject O2 existing at the distance d2 and the subject O1 existing on the near side (imaging unit side) from the subject O2 overlap due to the influence of parallax generated between the two images to be combined, the combining ratio is changed. Thus, it is possible to reduce the overlap of the subject areas in the composite image. In other words, in the composite image, a blur that reduces or eliminates the front blur caused by combining the image of the subject area positioned in front of it with the image of the subject area positioned near the predetermined reference distance. Correction processing is possible.
  • the image processing unit 105 performs predetermined image processing on the composite image, stores the image data in the memory 104, and further records the image data on the recording medium 111 via the recording medium I / F unit 110. At this time, the parallax image data before synthesis can be recorded on the recording medium 111 as RAW data. A series of these processes is controlled by the system control unit 103.
  • FIG. 7 schematically illustrates functional elements related to processing for generating a composite image from a parallax image as a configuration example of the image processing unit 105.
  • the image processing unit 105 includes a blur region detection unit 105a, an image composition unit 105b, and a composition ratio calculation unit 105c.
  • the blur region detection unit 105a detects a blur region among the peripheral regions of the focus region in the plurality of viewpoint images based on the distance information from the distance information acquisition unit 108 and the plurality of viewpoint images. That is, an area where blur is generated in the second subject in front of the first subject in focus is detected.
  • the composition ratio calculation unit 105c determines the composition ratio for each pixel position of the plurality of viewpoint images based on the detection result of the blur region detection unit 105a.
  • the image synthesis unit 105b acquires a plurality of viewpoint image data, and synthesizes the plurality of viewpoint images using the synthesis ratio calculated by the synthesis ratio calculation unit 105c, thereby generating synthesized image data. Image synthesis is performed by weighted addition.
  • the first viewpoint image is generated by collecting the light reception signals of the first photoelectric conversion unit 301 of each pixel unit of the image sensor, and the second light reception signal of the second photoelectric conversion unit 302 is collected by collecting the light reception signals.
  • a viewpoint image is generated.
  • the image processing unit 105 generates image signals having a predetermined resolution by performing addition reading of the first photoelectric conversion unit 301 and the second photoelectric conversion unit 302 for each pixel unit of the image sensor, and outputs image data captured. Output.
  • FIG. 5B the relationship between the image shift amount and the defocus amount between the first viewpoint image and the second viewpoint image will be described.
  • an image sensor (not shown) is arranged on the imaging surface 500.
  • the exit pupil 410 of the imaging optical system is divided into a first pupil partial region 401 and a second pupil partial region 402 in two.
  • of the defocus amount d represents the distance from the imaging position of the subject image to the imaging surface 500.
  • the front pin state (d ⁇ 0) and the rear pin state (d> 0) are collectively referred to as a defocus state (
  • the luminous flux that has passed through the first pupil partial area 401 (or the second pupil partial area 402) out of the luminous flux from the subject 602 is once condensed and then the center of gravity of the luminous flux.
  • the width G1 (or ⁇ 2) extends around the position G1 (or G2).
  • the image is blurred on the imaging surface 500.
  • the blurred image is received by the photoelectric conversion unit 301 (or the photoelectric conversion unit 302) constituting each pixel arranged in the image sensor, and a first viewpoint image (or a second viewpoint image) is generated.
  • the first viewpoint image (or the second viewpoint image) is detected as a subject image (blurred image) having the width ⁇ 1 (or ⁇ 2) at the gravity center position G1 (or G2) on the imaging surface 500.
  • the width ⁇ 1 (or ⁇ 2) of the subject image increases approximately proportionally as the magnitude
  • is the magnitude of the defocus amount d
  • the image shift amount p is defined as a difference “G1 ⁇ G2” in the center of gravity position of the light beam, and its magnitude
  • the image shift direction of the subject image between the first viewpoint image and the second viewpoint image is opposite to that in the front pin state, but there is a similar tendency.
  • the defocus amount of the imaging signal obtained by adding the first viewpoint image and the second viewpoint image or the first viewpoint image and the second viewpoint image increases, The amount of image shift between the viewpoint image and the second viewpoint image increases.
  • the focus lens is driven according to the magnitude and sign of the defocus amount, and the focus lens is moved to the in-focus position where a predetermined subject is in focus.
  • the image processing unit 105 generates a defocus map representing the distribution of the defocus amount.
  • the user can use the operation unit 107 to instruct the image processing apparatus 100 to shift to the image editing mode.
  • the image processing apparatus 100 reads image data recorded on the recording medium 111.
  • the blur shift function is a function of changing the position of the blur area by blur correction processing. With this function, the relative position of the blurred area with respect to a predetermined subject area in the image can be changed.
  • the image processing apparatus 100 extracts RAW data including parallax images and displays a list of thumbnail images on the screen of the display unit 106. When the user selects a desired thumbnail image, a parallax image corresponding to the selected thumbnail image is displayed on the screen, and the mode shifts to the blur shift edit mode.
  • FIGS. 8 to 10 the blur shift process in the image editing function will be described.
  • FIG. 8 and FIG. 9 are flowcharts for explaining viewpoint change in the blur shift editing function, and the following processing is realized by the CPU of the system control unit 103 executing a program.
  • FIG. 10 is a diagram illustrating a display example of the display unit 106.
  • FIG. 10A shows a state before editing, and shows a state in which a front blur is generated in a region 1002 indicated by a dotted frame before a subject region 1001 corresponding to an imaging target.
  • the user uses the operation unit 107 to specify a target to be moved from the image displayed on the display unit 106.
  • the system control unit 103 stores the coordinate data on the image designated by the user operation in the memory 104 (S2001).
  • the image processing unit 105 detects the previous blurred region for the image being edited (S2002). The detection of the front blur area is performed by detecting a blur area in the image and extracting only the blur on the near side (imaging device side) from the imaging position. Details of the blur region detection processing will be described later with reference to FIG.
  • the image processing unit 105 uses the distance information obtained by the distance information acquisition unit 108 to set the area determined to be a blur area in front of the imaging position as the previous blur area.
  • the system control unit 103 determines whether the position designated by the user is within the previous blur area from the coordinate data stored in the memory 104 in S2001 and the previous blur area detected in S2002 (S2003). ). As a result of the determination, if the position designated by the user is within the previous blur area, the process proceeds to S2004. If the position designated by the user is not within the previous blur area, the process proceeds to S2005.
  • step S2004 the system control unit 103 executes a process of highlighting the previous blur area detected in S2002 and updating the display content of the display unit 106.
  • step S2005 the system control unit 103 executes a process of updating the display content of the display unit 106 by highlighting an area other than the previous blur area detected in step S2002.
  • S2006 in order to clearly indicate the operable range of the user after selection, the possible range of slide operation is displayed on the screen of the display unit 106 around the point selected by the user. A specific example will be described with reference to FIG.
  • FIG. 10B is a diagram illustrating a state in which the position specified by the user in the blur shift editing function is determined to be within the previous blur area in the process of S2003.
  • An area 1003 indicates that the position designated by the user is within the previous blur area by emphasizing that it is the previous blur area.
  • a possible slide operation range 1004 represents a range in which the user can perform a slide operation in S2006.
  • the possible range 1004 has a predetermined width centered on the position designated by the user, and FIG. 10 shows an example of scale display.
  • the possible range 1004 of the slide operation to be displayed it is not necessary to display the distance that the previous blur area moves on the screen.
  • a possible slide operation range 1004 on the screen is displayed so that the user can finely adjust the movement of the previous blur area due to the viewpoint change, and the scale adjustment can be performed by the user operation. Further, not only the slide operation but also a similar operation may be performed by a drag operation, a flick operation, or the like.
  • the above operation is an operation in which the user directly operates by touching the touch panel of the screen unit of the display unit 106 with a finger.
  • the method is not limited to this, and a method may be used in which the cursor is displayed on the screen of the display unit 106 and the user moves the cursor with a button or a pointing device arranged on the image processing apparatus 100 to select a predetermined location. In this case, the operable range may be displayed in another place.
  • FIG. 10C shows an example when it is determined in S2003 of FIG. 8 that an external area other than the previous blurred area is designated.
  • the area 1005 is highlighted so that it can be seen that the external area of the previous blurred area has been selected.
  • the highlighting method shown in FIG. 10C is an example.
  • the image processing apparatus 100 may perform a subject area recognition process and display only the subject area 1001 or only its outline area.
  • the system control unit 103 determines whether or not the user's slide operation has been performed (S2007). When the slide operation is performed within the range indicated by the possible range 1004 from the position designated by the user, the process proceeds to S2008. While the slide operation is not performed, the determination process in S2007 is repeated.
  • step S2008 the system control unit 103 calculates the direction in which the user performed the slide operation and the slide distance from the coordinate data after the slide operation and the coordinate data stored in step S2001.
  • the system control unit 103 determines the viewpoint movement amount from the slide distance calculated in S2008 (S2009).
  • the system control unit 103 determines whether or not the area detected in S2002 is the previous blurred area (FIG. 9: S2010). If it is determined that the previous blur area is designated, the process proceeds to S2011. If it is determined that an area other than the previous blur area is designated, the process proceeds to S2012.
  • the system control unit 103 determines the viewpoint movement direction in the direction opposite to the slide operation direction calculated in S2008 (for example, the left direction in FIG. 10B). In step S2012, the system control unit 103 determines the viewpoint movement direction in the same direction as the slide operation direction calculated in step S2008 (for example, the right direction in FIG. 10C). After S2011 or S2012, in S2013, the system control unit 103 determines the viewpoint position based on the determined viewpoint movement amount and viewpoint movement direction.
  • the image processing unit 105 performs a parallax image synthesis process according to the viewpoint position determined in S2013, generates data for a recording image and a display image, and stores the data in the memory 104 (S2014). A specific example will be described with reference to FIG.
  • FIG. 10D shows an example of displaying a composite image after moving the viewpoint.
  • a viewpoint moving operation is performed by a user operation, and a viewpoint changing process is executed.
  • the front blur region 1002 that covers the subject region 1001 has moved to a region 1006 that does not cover the subject region 1001, and an image intended by the user can be obtained.
  • the display unit 106 reads the display image data stored in the memory 104 and updates the display content. At this time, a GUI display for designating whether or not to save the result displayed on the screen of the display unit 106 is performed, and a process of receiving an instruction from the user is executed.
  • the system control unit 103 determines whether to accept the user operation and save the display data. When it is determined that the user has instructed to save data, the process proceeds to S2017. In S2017, the system control unit 103 and the image processing unit 105 synthesize image data for storage based on the viewpoint position determined in S2013, and record the image data on the recording medium 111 after performing various image processing. Quit the edit mode. If the user does not instruct data saving in S2016, the editing mode is terminated without saving the data.
  • FIG. 11 is a flowchart showing a composite image generation process.
  • the image A is a first viewpoint image and the image B is a second viewpoint image.
  • the image processing unit 105 acquires the parallax images A and B from the memory 104, the recording medium 111, an external device, or the like, and supplies the acquired data to the image composition unit 105b.
  • the image composition unit 105b synthesizes the data of the parallax images A and B acquired in S401 at the reference composition ratio 1: 1 to generate data of the composite image C.
  • the blur region detection unit 105a detects a blur region included in the subject region located near the in-focus distance from the parallax images A and B and the synthesized image C based on the distance information related to the parallax image.
  • This blur area is a front blur area caused by a subject located on the near side (imaging device side) of the subject at the in-focus distance.
  • the image processing unit 105 determines whether or not a blur region is detected by the blur region detection unit 105a. If it is determined that a blurred area has been detected, the process proceeds to S406. If it is determined that no blur area has been detected, the process proceeds to S405. In step S405, the image processing unit 105 outputs the composite image C data generated in step S402, and ends the composite image generation process.
  • the composition ratio calculation unit 105c determines the composition ratio for each pixel of the parallax images A and B according to the viewpoint movement direction and the movement amount.
  • a combination ratio of the parallax images A and B with respect to the blurred area is calculated.
  • the synthesis ratio between the parallax images A and B is set to the reference synthesis ratio “1: 1” for pixels that are a predetermined distance or longer from the blur area.
  • the combined ratio is calculated by linear interpolation according to the combined ratio of the blurred area, the reference combined ratio, the distance, and the like.
  • the distance from the blur region for the target pixel can be the shortest distance between the pixel and the pixel forming the outer edge of the blur region.
  • the composition ratio calculation unit 105c determines the composition ratio for each pixel, the process proceeds to S407.
  • the image composition unit 105b combines the parallax images A and B using the composition ratio determined for each pixel by the composition ratio calculation unit 105c, and generates and outputs data of the composite image D.
  • the front blurring in which the image quality of the image of the first subject is deteriorated by synthesizing the blurred image of the second subject existing in front of the first subject at the in-focus position is the parallax images A and B. It can be suppressed by changing the composition ratio and correcting.
  • step S501 the image processing unit 105 generates a defocus map from the data of the parallax images A and B.
  • the defocus map is information representing the defocus amount for each area of the image or for each pixel.
  • the defocus amount corresponds to the distance from the imaging device to the subject, and corresponds to subject distance information representing depth information in the depth direction of the captured image.
  • a method for generating a defocus map is known. For example, the parallax images A and B are each divided into a plurality of regions, and processing for detecting the relative movement amount that maximizes the correlation amount of the pixel values in the corresponding divided regions is performed.
  • the relative movement amount corresponds to a shift amount or an image shift amount, and is detected as a phase difference with respect to the region of interest.
  • the defocus amount is calculated by multiplying the image shift amount by a predetermined conversion coefficient, and a defocus map indicating the distribution of the defocus amount is generated.
  • the conversion coefficient is determined based on the aperture of the imaging optical system, the center of gravity interval of the sensitivity distribution of the parallax images A and B, and the like.
  • the subject distance information is not limited to the defocus map, but may be an image displacement amount map indicating the distribution of the image displacement amount, or a distance map in which the defocus amount is converted into subject distance information.
  • the blurred area detection unit 105a selects an area where the defocus amount is equal to or less than a predetermined threshold and its peripheral area from the defocus map generated in S501.
  • the area of the subject at the focal distance and the surrounding area are detected. For example, it is assumed that an area within the focal depth is selected based on the defocus map.
  • the aperture value (F value) of the imaging optical system is denoted by F and the allowable confusion circle diameter is denoted by ⁇
  • the absolute value of the defocus amount is 2F ⁇ or less.
  • a region is selected.
  • one pixel unit has a configuration of vertical N ⁇ horizontal N photoelectric conversion units, a region where the absolute value of the defocus amount is NF ⁇ or less is selected.
  • the blur area detection unit 105a detects whether or not a blur area is included in each of the areas selected in S502. Specifically, the image composition unit 105b sets the composition ratio of the parallax images A and B to ⁇ : (2.0 ⁇ ), and changes the value of ⁇ within a range of 0 ⁇ ⁇ ⁇ 2.0. A composite image K ( ⁇ ) is generated. The composite image K ( ⁇ ) may be generated only for the region selected in S502, but may be generated for all regions. The blurred area detection unit 105a calculates an evaluation value for each composite image K ( ⁇ ) for each small area obtained by further dividing each area selected in S502.
  • the evaluation value is calculated and integrated as a sum of absolute differences of pixel values of the composite image K ( ⁇ ) and the composite image C generated in S402.
  • the blur area detection unit 105a stores the ⁇ value that maximizes the evaluation value in the memory for each small area.
  • the ⁇ value is determined based on the processing capability of the image processing unit 105, the image quality required for the composite image, and the like.
  • the blurred region detection unit 105a integrates the evaluation values in each small region with respect to a predetermined number of synthesized images K ( ⁇ ), and detects a small region whose integrated value is equal to or greater than a predetermined threshold.
  • the detected small area is an area in which the evaluation value is significantly changed by changing the synthesis ratio from the reference synthesis ratio 1: 1, and corresponds to an area where blur correction by changing the synthesis ratio is effective.
  • the blurred area detection unit 105a associates and stores in the memory the ⁇ value that maximizes the evaluation value (the sum of absolute differences of pixel values) for each small area detected in S504.
  • the composition ratio that provides the best blur correction effect for a small region is ⁇ : (2.0 ⁇ ).
  • an area focused by the user is specified, and a viewpoint changing process is performed by determining a viewpoint moving direction and a moving amount according to the specified area, a slide operation direction, and an operation amount.
  • the user can specify an area to be moved in the image and can perform an operation for specifying a moving direction and a moving amount of the specified area. Therefore, the viewpoint change process can be performed with an intuitive operation for the user.
  • the area to be synthesized by changing the viewpoint is not particularly specified, but the viewpoint changing process may be applied only to a predetermined area designated by the user.
  • the viewpoint changing process may be applied only to a predetermined area designated by the user.
  • the difference from the first embodiment is that the direction specified by the user is the direction in which the front blur moves.
  • differences from the first embodiment will be mainly described, and the same configurations as those in the first embodiment will be omitted by using the reference numerals already used.
  • the system control unit 103 stores the slide start position in the memory 104 (S4001).
  • the system control unit 103 performs control to display a possible slide operation range (see FIG. 10B) near the slide start position on the image (S4002).
  • the system control unit 103 uses the coordinate data stored in S4001 and the coordinate data after the slide operation, and the direction and slide in which the user performed the slide operation. The distance is calculated (S4003).
  • the system control unit 103 determines the viewpoint movement amount from the slide distance calculated in S4003, and determines the viewpoint movement direction in the direction opposite to the slide operation direction calculated in S4003 so that the front blur area moves in the slide operation direction. (S4004).
  • the system control unit 103 determines the viewpoint position based on the determined viewpoint movement amount and viewpoint movement direction (S4005).
  • the image processing unit 105 combines the parallax image data, generates recording image data and display image data, and stores them in the memory 104 (S4006).
  • the display unit 106 reads the display image data stored in the memory 104 and updates the display content (S4007). At this time, a GUI display for designating whether to save the display result on the screen of the display unit 106 is performed, and a process of receiving an instruction from the user is executed.
  • step S4008 the system control unit 103 determines whether to save display data. If it is determined that the user has instructed to save data, the process proceeds to S4009. In step S4009, the system control unit 103 and the image processing unit 105 generate image data for storage, perform various image processing, record the image data on the recording medium 111, and end the editing mode. If the user does not instruct to save the display data in S4008, the editing mode is terminated without saving the data. Here, when the slide operation is performed again by the user, the edit mode is started again, and the process proceeds to S4001.
  • the blurred area detection unit 105a starts a process of generating a composite image K ( ⁇ ) in which the composite ratio of the parallax images A and B is changed.
  • the blurred area detection unit 105a calculates an evaluation value for each of the areas selected in S502 for each composite image K ( ⁇ ).
  • This evaluation value is a contrast evaluation value representing the degree of focus.
  • the contrast evaluation value can be calculated by a known method. For example, the blur region detection unit 105a extracts a component of a predetermined frequency band by applying a band pass filter to an image region for which a contrast evaluation value is obtained, and applies a differential filter to the extracted component to thereby calculate a difference between adjacent pixels. Calculate the value.
  • the blur area detection unit 105a detects the maximum value of the calculated difference value for each line of the image area to be processed, and uses the integrated value as the contrast evaluation value of the image area.
  • the blurred area detection unit 105a determines whether or not the contrast evaluation values of the image areas to be processed have been calculated for all the composite images K ( ⁇ ). If it is determined that all the contrast evaluation values have been calculated, the process proceeds to S604. If it is determined that the calculation has not been completed, the process returns to S602 and the process is continued.
  • step S604 the blurred area detection unit 105a calculates the difference between the maximum value and the minimum value as the amount of change in the contrast evaluation value calculated for each image area.
  • step S ⁇ b> 605 the blurred region detection unit 105 a selects an image region in which the amount of change in the contrast evaluation value and the tendency of the change satisfy the following conditions (1) and (2).
  • the amount of change in contrast evaluation value is greater than or equal to a threshold value.
  • Contrast evaluation value monotonously increases for a composite image K ( ⁇ ) in which the composition ratio of one viewpoint image (for example, A) is gradually increased and the composition ratio of the other viewpoint image (for example, B) is gradually decreased. Or monotonously decreasing.
  • the region where the contrast evaluation value has a certain difference or more due to the change of the composition ratio is the region where the degree of focus is changed by changing the composition ratio. That is, this area is an area where blur correction is effective.
  • the contrast evaluation value of the region where no blur is caused by the image composition is constant regardless of the composition ratio of the parallax image B.
  • the contrast evaluation value of a region where blur is generated by image synthesis monotonously decreases in accordance with, for example, monotonic increase in the synthesis ratio of parallax image B.
  • the threshold used for the determination of the condition (1) is a fixed value or a variable value set in advance. In the case of a variable value, the threshold value changes according to a combination of shooting sensitivity, subject brightness, and the like.
  • step S606 the blurred area detection unit 105a stores the combined ratio of the combined image K ( ⁇ ) having the maximum contrast evaluation value in the memory 104 for each image area to be processed.
  • This composition ratio indicates a composition ratio at which the blur correction effect is most obtained in each image area.
  • the viewpoint changing process can be performed with a more intuitive operation.
  • the example in which the parallax image data is acquired by the imaging element having the photoelectric conversion unit that is pupil-divided in the left-right direction has been described, but the present invention is not limited to this.
  • a multi-lens camera that can acquire parallax images in the left and right and up and down directions may be used.
  • the slide operation performed by the user can be specified in the two-dimensional direction (up / down / left / right direction) in the image, and the moving direction of the viewpoint can be similarly determined in the two-dimensional direction.
  • the present invention supplies a program that realizes one or more functions of the above-described embodiments to a system or apparatus via a network or a storage medium, and one or more processors in a computer of the system or apparatus read and execute the program
  • This process can be realized. It can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Studio Devices (AREA)
  • Image Processing (AREA)
PCT/JP2019/003403 2018-02-06 2019-01-31 画像処理装置、撮像装置、画像処理方法、およびプログラム Ceased WO2019155981A1 (ja)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US16/984,343 US11323689B2 (en) 2018-02-06 2020-08-04 Image processing device, imaging device, image processing method, and recording medium

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2018-019449 2018-02-06
JP2018019449A JP7098342B2 (ja) 2018-02-06 2018-02-06 画像処理装置、撮像装置、画像処理方法、およびプログラム

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US16/984,343 Continuation US11323689B2 (en) 2018-02-06 2020-08-04 Image processing device, imaging device, image processing method, and recording medium

Publications (1)

Publication Number Publication Date
WO2019155981A1 true WO2019155981A1 (ja) 2019-08-15

Family

ID=67549614

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2019/003403 Ceased WO2019155981A1 (ja) 2018-02-06 2019-01-31 画像処理装置、撮像装置、画像処理方法、およびプログラム

Country Status (3)

Country Link
US (1) US11323689B2 (https=)
JP (1) JP7098342B2 (https=)
WO (1) WO2019155981A1 (https=)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10818721B2 (en) * 2018-08-22 2020-10-27 Stmicroelectronics (Research & Development) Limited Pixel circuit and method of operating the same in an always-on mode
GB2608496B (en) 2021-05-07 2024-04-24 Canon Kk Image processing apparatus and method, and image capturing apparatus and control method thereof, program, and storage medium
JP7600179B2 (ja) * 2022-07-15 2024-12-16 キヤノン株式会社 距離計測装置の校正方法、距離計測装置及びコンピュータプログラム
CN117011507B (zh) * 2023-09-04 2024-01-26 南京诺源医疗器械有限公司 一种2cmos图像识别数据分析方法和系统

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2014526096A (ja) * 2011-07-21 2014-10-02 クォルコム・メムズ・テクノロジーズ・インコーポレーテッド タッチ感知ディスプレイデバイス及びそれに関連した方法
JP2015193280A (ja) * 2014-03-31 2015-11-05 富士通テン株式会社 車両制御装置及び車両制御方法
JP2017098929A (ja) * 2015-11-17 2017-06-01 キヤノン株式会社 画像処理装置および画像処理方法
JP2017184217A (ja) * 2016-03-24 2017-10-05 キヤノン株式会社 画像処理装置、撮像装置およびこれらの制御方法ならびにプログラム

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3774597B2 (ja) 1999-09-13 2006-05-17 キヤノン株式会社 撮像装置
US7710461B2 (en) * 2004-12-21 2010-05-04 Sony Corporation Image processing device, image processing method, and image processing program
JP5230684B2 (ja) * 2010-05-13 2013-07-10 パナソニック株式会社 電子機器、表示方法、及びプログラム
JP2012114816A (ja) * 2010-11-26 2012-06-14 Sony Corp 画像処理装置、画像処理方法及び画像処理プログラム
JP2013116138A (ja) * 2011-12-01 2013-06-13 Sony Corp 画像処理装置及び方法
JP5800996B2 (ja) * 2012-09-26 2015-10-28 富士フイルム株式会社 画像処理装置、方法及びプログラム、プリンタ、表示装置
WO2014165244A1 (en) * 2013-03-13 2014-10-09 Pelican Imaging Corporation Systems and methods for synthesizing images from image data captured by an array camera using restricted depth of field depth maps in which depth estimation precision varies
CN104049898A (zh) * 2014-06-26 2014-09-17 苏宁云商集团股份有限公司 触摸屏操作方法和装置以及触摸终端
CN106716985B (zh) * 2014-09-08 2019-07-30 富士胶片株式会社 摄像控制装置、摄像控制方法、及相机系统
US10085005B2 (en) * 2015-04-15 2018-09-25 Lytro, Inc. Capturing light-field volume image and video data using tiled light-field cameras
CN105898460A (zh) * 2015-12-10 2016-08-24 乐视网信息技术（北京）股份有限公司 调整智能电视的全景视频播放视角的方法和装置
US10524018B2 (en) * 2016-08-30 2019-12-31 Samsung Electronics Co., Ltd. Apparatus and method for displaying image
US10614606B2 (en) * 2016-11-30 2020-04-07 Ricoh Company, Ltd. Information processing apparatus for creating an animation from a spherical image
JP7154789B2 (ja) * 2018-03-27 2022-10-18 キヤノン株式会社 表示制御装置、その制御方法、プログラム及び記憶媒体

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2014526096A (ja) * 2011-07-21 2014-10-02 クォルコム・メムズ・テクノロジーズ・インコーポレーテッド タッチ感知ディスプレイデバイス及びそれに関連した方法
JP2015193280A (ja) * 2014-03-31 2015-11-05 富士通テン株式会社 車両制御装置及び車両制御方法
JP2017098929A (ja) * 2015-11-17 2017-06-01 キヤノン株式会社 画像処理装置および画像処理方法
JP2017184217A (ja) * 2016-03-24 2017-10-05 キヤノン株式会社 画像処理装置、撮像装置およびこれらの制御方法ならびにプログラム

Also Published As

Publication number Publication date
JP7098342B2 (ja) 2022-07-11
US11323689B2 (en) 2022-05-03
US20200366882A1 (en) 2020-11-19
JP2019140439A (ja) 2019-08-22

Similar Documents

Publication Publication Date Title
CN103828361B (zh) 图像处理装置、方法，立体图像获取装置，便携式电子设备，打印机和立体图像播放器装置
CN103098459B (zh) 立体摄像装置及阴影校正方法
JP5470458B2 (ja) 撮像装置、画像処理装置および画像処理方法
US8774551B2 (en) Image processing apparatus and image processing method for reducing noise
US11323689B2 (en) Image processing device, imaging device, image processing method, and recording medium
CN104717476B (zh) 图像处理方法、图像处理装置和图像捕获装置
WO2012133106A1 (ja) 撮像装置、撮像素子、画像処理方法、絞り制御方法、およびプログラム
JP2015072324A (ja) 画像処理装置、撮像装置及び画像処理方法
CN102472882B (zh) 进行自动调焦控制的摄像设备以及摄像设备的控制方法
WO2021054140A1 (ja) 画像処理装置および画像処理方法、撮像装置、プログラム
US20130250167A1 (en) Image capturing apparatus, image processing method, and storage medium
JP2018107654A (ja) 画像処理装置および画像処理方法、プログラム、記憶媒体
JP2013044806A (ja) 撮像装置
JP2016197177A (ja) 表示制御装置及びその制御方法、及び撮像装置
US20130083169A1 (en) Image capturing apparatus, image processing apparatus, image processing method and program
JP6808333B2 (ja) 表示制御装置及び方法、及び撮像装置
US12333752B2 (en) Image processing apparatus and method, and image capturing apparatus and control method thereof, and storage medium
JP2017028611A (ja) 撮像装置
JP2022173069A (ja) 画像処理装置及び方法、及び、撮像装置及びその制御方法、プログラム、記憶媒体
JP2015215571A (ja) 撮像装置およびその制御方法
JP6728020B2 (ja) 画像処理装置、画像処理方法およびプログラム
JP6467823B2 (ja) 撮像装置
JP6856999B2 (ja) 画像処理装置、画像処理方法及びプログラム
JP6652294B2 (ja) 画像処理装置、撮像装置、画像処理方法、プログラム、および、記憶媒体
JP2017098929A (ja) 画像処理装置および画像処理方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19750873

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19750873

Country of ref document: EP

Kind code of ref document: A1