WO2016178310A1 - Image processing apparatus, method for controlling the same, and image capture apparatus - Google Patents

Image processing apparatus, method for controlling the same, and image capture apparatus Download PDF

Info

Publication number
WO2016178310A1
WO2016178310A1 PCT/JP2016/002172 JP2016002172W WO2016178310A1 WO 2016178310 A1 WO2016178310 A1 WO 2016178310A1 JP 2016002172 W JP2016002172 W JP 2016002172W WO 2016178310 A1 WO2016178310 A1 WO 2016178310A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
data
images
file
processing apparatus
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2016/002172
Other languages
English (en)
French (fr)
Inventor
Atsushi Fukuda
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Canon Inc
Original Assignee
Canon Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Canon Inc filed Critical Canon Inc
Priority to US15/569,246 priority Critical patent/US10382740B2/en
Publication of WO2016178310A1 publication Critical patent/WO2016178310A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/189—Recording image signals; Reproducing recorded image signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/139—Format conversion, e.g. of frame-rate or size
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/207—Image signal generators using stereoscopic image cameras using a single two-dimensional [2D] image sensor
    • H04N13/218—Image signal generators using stereoscopic image cameras using a single two-dimensional [2D] image sensor using spatial multiplexing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N2013/0074—Stereoscopic image analysis
    • H04N2013/0088—Synthesising a monoscopic image signal from stereoscopic images, e.g. synthesising a panoramic or high resolution monoscopic image

Definitions

  • the present invention relates to an image processing apparatus, a method for controlling the same, and an image capture apparatus, and in particular relates to a technique for storing image data.
  • Ren Ng et al, "Light Field Photography with a Hand-Held Plenoptic Camera", Stanford Tech Report CTSR 2005-02, 2005.4.20) discloses a refocus technique in which the in-focus position of the captured image is changed after shooting by using LF data to combine images in an imaging plane (virtual imaging plane) different from that at the time of shooting.
  • the amount of image data is that of n times the number of images that would have been generated if the pupil region was not divided. Furthermore, if an image corresponding to a normal image is generated by adding together the parallax images with consideration given to compatibility with a device that does not support parallax images, the amount of data corresponds to a factor of n+1.
  • the file size will be extremely large, the consumption amount of the storage medium will increase, the amount of time needed for reading and writing will increase, and battery consumption will increase.
  • the parallax images are stored, for example, there may also be a problem with file compatibility with apparatuses that do not support parallax images. This kind of problem occurs also when generating an image file containing data of images having a relationship between a part and the whole (or in which one image is generated from another image), as with the multiple parallax images (first images) and a normal image (second image).
  • the present invention has been made in view of such problems in the conventional technology.
  • the present invention provides an image processing apparatus and a method for controlling the same, the image processing apparatus being capable of generating a versatile image file with a suppressed file size from a portion of multiple first images and a second image generated from the multiple first images.
  • an image processing apparatus comprising: first obtaining means for obtaining data of one or more of a plurality of first images; second obtaining means for obtaining data of a second image that can be generated from the plurality of first images; and file generation means for generating an image file containing the data of the second image and data of a portion of the plurality of first images, wherein the file generation means generates the image file such that the image file does not contain, among the plurality of first images, data of a first image that can be generated from a first image and the second image stored in the image file.
  • an image capture apparatus comprising: an image sensor capable of generating data of a plurality of first images and data of a second image; and the image processing apparatus according to the present invention.
  • an electronic device comprising: obtaining means for obtaining an image file containing data for a portion of a plurality of first images, and data of a second image that can be generated from the plurality of first images; generation means for generating data of, among the plurality of first images, a first image not contained in the image file from the data of the second image and the data of the first image contained in the image file; and image processing means for applying image processing to the data of the first image contained in the file and to the data of the first image generated by the generation means.
  • an image processing system comprising: the image processing apparatus according to the present invention, or the image capture apparatus according to the present invention; and the electronic device according to the present invention, the image processing apparatus or the image capture apparatus, and the electronic device being communicably connected.
  • a method for controlling an image processing apparatus comprising: obtaining data of one or more of a plurality of first images; obtaining data of a second image corresponding to a combined image of the plurality of first images; and generating an image file containing the data of the second image and data of a portion of the plurality of first images, wherein the image file is generated such that the image file does not contain data of, among the plurality of first images, a first image that can be generated from a first image and the second image stored in the image file.
  • a method for controlling an electronic device comprising: obtaining an image file containing data of a portion of a plurality of first images, and data of a second image corresponding to a combined image of the plurality of first images; generating data of, among the plurality of first images, a first image not contained in the image file from the data of the second image and the data of the first image contained in the image file; and applying image processing to the data of the first image contained in the image file and to the data of the first image generated in the generating.
  • a computer-readable storage medium containing a program for causing a computer to function as the means included in the image processing apparatus according to the present invention.
  • a computer-readable storage medium containing a program for causing a computer to function as the means included in the electronic device according to the invention.
  • FIG. 1 is a block diagram showing an example of a functional configuration of an image capture apparatus serving as an example of an image processing apparatus according to an embodiment of the present invention.
  • FIG. 2 is a diagram schematically showing a circuit configuration of an image sensor shown in FIG. 1.
  • FIG. 3A is a diagram schematically showing examples of configurations of pixels of the image sensor shown in FIG. 1 that are arranged in a pixel array.
  • FIG. 3B is a diagram schematically showing examples of configurations of pixels of the image sensor shown in FIG. 1 that are arranged in a pixel array.
  • FIG. 4 is a diagram schematically showing a pixel array in which pixels with the configuration shown in FIG. 3B are arranged.
  • FIG. 3A is a diagram schematically showing examples of configurations of pixels of the image sensor shown in FIG. 1 that are arranged in a pixel array.
  • FIG. 3B is a diagram schematically showing examples of configurations of pixels of the image sensor shown in FIG. 1 that are arranged in a pixel array.
  • FIG. 5 is a diagram schematically showing a relationship between light fluxes received by PDs and regions of an exit pupil in the image sensor having the pixel array shown in FIG. 4.
  • FIG. 6A is a block diagram showing examples of functional configurations of a video signal processing circuit according to an embodiment.
  • FIG. 6B is a block diagram showing examples of functional configurations of a video signal processing circuit according to an embodiment.
  • FIG. 6C is a block diagram showing examples of functional configurations of a video signal processing circuit according to an embodiment.
  • FIG. 7A is a flowchart showing examples of operations at a time when an image capture apparatus according to a first embodiment performs shooting.
  • FIG. 7B is a flowchart showing examples of operations at a time when an image capture apparatus according to a first embodiment performs shooting.
  • FIG. 7A is a flowchart showing examples of operations at a time when an image capture apparatus according to a first embodiment performs shooting.
  • FIG. 7B is a flowchart showing examples of operations at a
  • FIG. 8A is a schematic diagram for illustrating the structure of an image file according to a first embodiment.
  • FIG. 8B is a schematic diagram for illustrating the structure of an image file according to a first embodiment.
  • FIG. 9 is a block diagram showing an example of a functional configuration of a computer device serving as an example of an electronic device capable of using an image file generated by an image capture apparatus according to an embodiment.
  • FIG. 10A is a flowchart showing examples of operations performed by the electronic device of FIG. 9.
  • FIG. 10B is a flowchart showing examples of operations performed by the electronic device of FIG. 9.
  • FIG. 11 is a flowchart showing another example of an operation performed by the electronic device of FIG. 9.
  • FIG. 12 is a schematic diagram for illustrating the structure of an image file according to a second embodiment.
  • FIG. 13 is a flowchart showing an example of an operation at a time when an image capture apparatus according to a second embodiment performs shooting.
  • FIG. 14 is a schematic diagram for illustrating the structure of an image file according to a modified example of the second embodiment.
  • FIG. 15 is a schematic diagram for illustrating the structure of an image file according to another modified example of the second embodiment.
  • FIG. 1 is a block diagram showing an example of a functional configuration of an image capture apparatus 100, or more specifically, a digital single-lens reflex camera, which serves as an example of an image processing apparatus according to an embodiment of the present invention.
  • a microcomputer 123 that functions as a control unit has a ROM and a RAM, executes programs stored in the ROM or a non-volatile memory 130 by loading them in the RAM, and controls the units of the image capture apparatus 100, whereby the various functions of the image capture apparatus 100 are realized.
  • An AF driving unit 102 includes a DC motor or a stepping motor, for example, and changes the position of a focus lens of a shooting lens 101 in accordance with control performed by the microcomputer 123, thereby changing the focus distance of the shooting lens 101.
  • a zoom driving unit 103 includes a DC motor or a stepping motor, for example, and changes the position of a magnification lens of the shooting lens 101 in accordance with control performed by the microcomputer 123, thereby changing the focus distance of the shooting lens 101.
  • a diaphragm driving unit 105 drives a diaphragm 104 in accordance with control performed by the microcomputer 123 and changes the aperture value (diaphragm value).
  • a main mirror 106 switches the advancing direction of a light flux incident thereon from the shooting lens 101 between toward an optical finder 108 and toward an image sensor 112.
  • the optical finder 108 is constituted by a pentaprism, a focus plate, an eyepiece lens, and the like.
  • the main mirror 106 When shooting is not being performed, the main mirror 106 is at a position (not shown) of reflecting an incident light flux toward the optical finder 108, and when shooting is being performed, the main mirror 106 withdraws to a position of not reflecting the incident light flux (mirror up), allowing the image sensor 112 to be exposed to light.
  • the main mirror 106 is a half-mirror in the central portion thereof, and a portion of the light flux is transmitted at the position shown in the diagram.
  • the transmitted light flux is reflected by a sub-mirror 107 arranged on the rear surface of the main mirror 106 and is incident on a focus detection sensor included in a focus detection circuit 109.
  • the focus detection circuit 109 is a circuit for phase-difference AF and includes a focus detection optical system and a focus detection sensor.
  • a focus misalignment amount (defocus amount) and misalignment direction of the shooting lens 101 can be detected using the output of the focus detection circuit 109.
  • the microcomputer 123 converts the detection result into the drive amount and drive direction of the focus lens so as to control the AF drive unit 102 and drive the focus lens of the shooting lens.
  • a shutter driving circuit 111 opens and closes a focal plane shutter 110 in accordance with control performed by the microcomputer 123.
  • the image sensor 112 is a CCD image sensor, a CMOS image sensor, or the like, and converts a subject image formed by the shooting lens 101 into an electric signal.
  • a clamp circuit 113 and an AGC circuit 114 apply analog signal processing before A/D conversion to the output of the image sensor 112.
  • the clamp level and the AGC reference level are controlled by the microcomputer 123.
  • An A/D conversion unit 115 converts the output of the AGC circuit 114 into a digital signal and outputs the resulting signal to a video signal processing circuit 116.
  • An EVF driving circuit 117 performs display control of an EVF (electronic view finder) monitor 118.
  • a memory controller 119 controls communication of data between the memory 120, an interface 121, a buffer memory 122, and the video signal processing circuit 116.
  • the interface 121 realizes communication with an external device such as a computer.
  • the memory controller 119 stores unprocessed digital images and audio data input from the video signal processing circuit 116 in the buffer memory 122 and stores processed digital images and audio data in the memory 120.
  • the memory controller 119 also outputs images and audio data contained in the buffer memory 122 and the memory 120 to the video signal processing circuit 116.
  • the memory 120 can be removed from the image capture apparatus 100 in some cases.
  • the memory controller 119 can output the digital images and audio data contained in the memory 120 to an external apparatus via the interface 121.
  • the video signal processing circuit 116 is realized by a logic device such as a gate array, for example.
  • the video signal processing circuit 116 applies filter processing, color conversion processing, gamma processing, encoding processing, and the like to the image data according to necessity and settings, and outputs the resulting data to the memory controller 119.
  • the video signal processing circuit 116 performs compression processing on an audio signal from a microphone 132 or an audio line input 133 and outputs the resulting signal to the memory controller 119.
  • the video signal processing circuit 116 can output image data from the A/D conversion unit 115 and image data input from the memory controller 119 to the EVF (electronic view finder) monitor 118 through the EVF driving circuit 117. These functions are switched between in accordance with instructions from the microcomputer 123.
  • the video signal processing circuit 116 can output luminance information, white balance information, and the like of the image data (captured image data) signal from the A/D conversion unit 115 to the microcomputer 123, as needed. Based on these pieces of information, the microcomputer 123 performs instruction of white balance and gain adjustment.
  • the video signal processing circuit 116 stores the unprocessed captured (shot) image data in the buffer memory 122. Then, after the shooting operation ends, the video signal processing circuit 116 reads out the unprocessed captured image data from the buffer memory 122 through the memory controller 119 and applies image processing and encoding processing thereto. Accordingly, the number of images that can be imaged continuously depends on the capacity of the buffer memory 122. Audio data input from the microphone 132 or the audio line input 133 through the A/D conversion unit 134 can also be output to the speaker 136 through a D/A conversion unit 135 by the video signal processing circuit 116.
  • An operation member 124 is a group of input devices for allowing a user to give instructions to the image capture apparatus 100, and includes a button, a switch, a dial, a touch panel, a key, and the like. An operation of the operation member 124 is detected by the microcomputer 123, and the microcomputer 123 performs processing in accordance with the operation.
  • Representative examples of input devices included in the operation member 124 include a release switch, an ISO setting button, an image size setting button, an image quality setting button, an information display button, a menu button, a direction key, an execution key, and the like.
  • a first switch 125 and a second switch 126 are switches that are turned on by a half-press operation and a full-press operation performed on a release button included in the operation member 124.
  • the turning-on of the first switch 125 is an instruction to start a shooting preparation operation, whereby the microcomputer 123 starts auto-focus and automatic exposure control.
  • the turning-on of the first switch 125 and the second switch 126 is an instruction to start the actual shooting (shooting processing for record), whereby the microcomputer 123 executes the exposure of the image sensor 112 and a series of operations on the captured image data. Also, while both the first switch 125 and the second switch 126 continue to be turned on, the microcomputer 123 executes a continuous shooting operation.
  • a display driving circuit 127 drives a main display device 128 and an auxiliary display device 129 in accordance with control performed by the microcomputer 123.
  • the main display device 128 and the auxiliary display device 129 are liquid crystal displays, for example, and generally, the main display device 128 is arranged on the back surface of the housing and the auxiliary display device 129 is arranged inside of the optical finder. Also, a backlight such as an LED (not shown) is arranged on the auxiliary display device 129, and the LED is also driven by the display driving circuit 127.
  • the microcomputer 123 can calculate the remaining number of images that can be imaged upon checking the capacity of the memory through the memory controller 119.
  • the remaining number of images that can be imaged can also be displayed on the main display device 128 and the auxiliary display device 129 as needed.
  • a non-volatile memory (EEPROM) 130 stores programs, setting information, and the like.
  • a power source unit 131 supplies a power source needed for the units of the image capture apparatus 100.
  • FIG. 2 is a diagram schematically showing a circuit configuration of the image sensor 112.
  • the image sensor 112 includes a pixel array 201, a vertical selection circuit 202 that selects a row of the pixel array 201, and a horizontal selection circuit 204 that selects a column of the pixel array 201. Also, a readout circuit 203 reads out signals of pixels selected by the vertical selection circuit 202 among the pixels in the pixel array 201.
  • a serial interface (SI) 205 is provided in order to make it possible to set the operation mode and the like of the circuits in the image sensor 112 from outside of the image sensor 112 (here, from the video signal processing circuit 116).
  • the readout circuit 203 includes a memory for storing signals, a gain amplifier, an AD converter, and the like for each row.
  • the vertical selection circuit 202 selects multiple rows of the pixel array 201 in sequence and reads them out to the readout circuit 203.
  • the image sensor 112 includes the horizontal selection circuit 204, which selects multiple pixel signals read out to the readout circuit 203 in sequence for each row.
  • FIGS. 3A and 3B are diagrams schematically showing examples of configurations of pixels arranged in the pixel array 201 of the image sensor 112 of the present invention.
  • pixels 300 and 310 include microlenses 301 and 311 respectively, and multiple photodiodes (hereinafter referred to as PDs) or photoelectric conversion regions.
  • the pixel 300 shown in FIG. 3A has two PDs 302a and 302b
  • the pixel 310 shown in FIG. 3B has four PDs 312a, 312b, 312c, and 312d. Note that any number of PDs per pixel can be used as long as it is two or more, and the number of pixels in the horizontal direction and the vertical direction may be different.
  • the image sensor 112 is configured to be able to perform readout by adding together the outputs of the multiple PDs in the pixels in any combination.
  • the added outputs of the PDs 312a and 312c and the added outputs of the PDs 312b and 312d may be read out from the pixel 310 shown in FIG. 3B.
  • the added outputs of the PDs 312a and 312b and the added outputs of the PDs 312c and 312d may be read out.
  • the added outputs of the PDs 312a, 312b, 312c, and 312d may also be read out. Note that the outputs of the PDs may also be added together after being read out.
  • the pixels 300 and 310 are also provided with pixel amplification amplifiers for reading out signals of PDs to the readout circuit 203, selection switches for selecting a row, reset switches for resetting the signals of the PDs, and the like, for example.
  • FIG. 4 is a diagram schematically showing the pixel array 201, in which pixels 400 with the configuration shown in FIG. 3B are arranged.
  • the pixel array 201 has a configuration in which N pixels are arranged linearly in the horizontal direction and M pixels are arranged linearly in the vertical direction, in order to provide a two-dimensional image.
  • Each pixel 400 in the pixel array 201 is provided with a red, green, or blue color filter, and here, pixels in odd-numbered rows are alternatingly provided with red and green color filters, and pixels in even-numbered rows are alternatingly provided with green and blue color filters.
  • FIG. 5 will be used to describe the relationship between light fluxes received by the PDs and regions of the exit pupil in the image sensor 112 with the pixel array 201 having the configuration shown in FIG. 4.
  • Light exiting from an exit pupil 506 of the shooting lens 101 is incident on the image sensor 112 centered about an optical axis 509.
  • the outer edges of a light flux exiting from a partial region 507 of the exit pupil are denoted by reference numerals 510 and 511, and the outer edges of a light flux exiting from a partial region 508 are denoted by reference numerals 512 and 513.
  • the image capture apparatus 100 of the present embodiment has the image sensor 112, which is capable of generating multiple parallax images (first images) with one shooting operation.
  • image data obtained from the group of PDs shown on the right side of the pixels in FIGS. 3A and 3B will be referred to as a "right image”
  • image data obtained from the group of PDs on the left side of the pixels (PDs 312a and 312c in FIG. 3B) will be referred to as a "left image”.
  • an image obtained by adding together the right image and the left image will be referred to as a "normal image” (non-parallax image).
  • a normal image can be generated using a method of generating a normal image by reading out the right image and the left image separately and then adding them together, or using a method of reading out the added outputs of the PDs from each pixel.
  • the normal image and the right image are read out from the image sensor 112. Note that if the image sensor 112 has the pixel configuration shown in FIG. 3A, it is sufficient that the image data obtained from the group of PDs 302b is used as the right image and the image data obtained from the group of PDs 302a is used as the left image.
  • FIG. 6A is a block diagram showing an example of a functional configuration of a portion of the video signal processing circuit 116.
  • a normal image extraction unit 601 (second obtaining unit) extracts a normal image from a normal image and a right image read out from the image sensor 112 and outputs the normal image to a developing processing unit 602 and a lossless compression processing unit 606.
  • a right image extraction unit 605 (first obtaining unit) extracts only the right image from the normal image and the right image read out from the image sensor 112 and outputs the right image to the lossless compression processing unit 606.
  • the developing processing unit 602 performs developing processing such as white balance adjustment, color interpolation, color correction, gamma conversion, edge enhancement, resolution conversion, and the like on the normal image and outputs the resulting image to a lossy compression processing unit 603.
  • the lossy compression processing unit 603 generates a lossy compressed image by performing lossy compression processing in accordance with a standard such as JPEG format, for example, on the developed normal image.
  • the lossy compression processing unit 603 outputs the lossy compressed image to the buffer memory 122 via a memory interface 604 and the memory controller 119.
  • the lossless compression processing unit 606 generates lossless compressed images by performing lossless compression processing on both the normal image and the right image, and outputs the lossless compressed images to the buffer memory 122 via the memory interface 604 and the memory controller 119.
  • FIG. 7A operations at a time of shooting performed by the image capture apparatus 100 of the present embodiment will be described with a focus on operations performed by the image signal processing circuit 116 (file generation unit).
  • the processing shown in FIG. 7A is started due to the microcomputer 123 detecting a shooting start instruction (e.g., turning-on of the second switch 126).
  • the microcomputer 123 controls the operations of the diaphragm 104 and the focal plane shutter 110 according to exposure conditions determined in shooting preparation processing and exposes the image sensor 112 to light.
  • step S101 the video signal processing circuit 116 performs setting such that the normal image and the right image are read out to the image sensor 112 through the SI 205, and obtains the normal image and the right image.
  • step S102 the normal image extraction unit 601 extracts the normal image and the right image extraction unit 605 extracts the right image.
  • the extracted image data is stored in the buffer memory 122 via the memory interface 604 and the memory controller 119.
  • step S110 steps S120 and S121, and step S130 can be executed in parallel, or a portion thereof may be performed sequentially, according to how much space is left in the memory 120, the processing speed of the video signal processing circuit 116, and the like.
  • step S110 the lossless compression processing unit 606 applies lossless compression processing to the normal image so as to generate a lossless compressed image and stores the lossless compressed image in the buffer memory 122 via the memory interface 604 and the memory controller 119.
  • step S120 the developing processing unit 602 applies the above-described developing processing to the normal image and outputs the resulting image to the lossy compression processing unit 603.
  • step S121 the lossy compression processing unit 603 applies lossy compression processing to the developed normal image so as to generate a lossy compressed image and scales down the lossy compressed image so as to generate a thumbnail image.
  • the lossy compressed image is a display image.
  • the lossy compression processing unit 603 stores the lossy compressed image (display image) and the thumbnail image in the buffer memory 122 via the memory interface 604 and the memory controller 119.
  • step S130 the lossless compression processing unit 606 applies lossless compression processing to the right image so as to generate a lossless compressed image (right) and stores the resulting image in the buffer memory 122 via the memory interface 604 and the memory controller 119.
  • the video signal processing circuit 116 moves to the processing of step S140 and generates an image file.
  • the video signal processing circuit 116 reads out the lossless compressed image, the lossless compressed image (right), the display image, and the thumbnail image from the buffer memory 122 and generates the image file.
  • the image file generation processing performed in step S140 and the image file configuration will be described in detail later.
  • step S141 the video signal processing circuit 116 stores the generated image file in the memory 120 via the memory interface 604 and the memory controller 119, and the shooting processing ends.
  • FIG. 8A is a diagram showing the structure of an image file conforming to a Tagged Image File Format (TIFF) serving as an example of a file format corresponding to a multi-page file in which multiple pages of image data are contained in one file.
  • An image file 800 shown in FIG. 8A is constituted by a TIFF header portion 801, multiple Image File Directory (IFD) portions 802 to 805, and multiple image data portions 806 to 809.
  • TIFF Tagged Image File Format
  • the TIFF header portion 801 is a region containing data for identifying that the file has a TIFF-format file structure, an offset to the first IFD portion, and the like.
  • the IFD portions 802 to 805 are regions containing metadata A to D, such as shooting information and parameters relating to the image data contained in the image data portions 806 to 809, offset values E to H to the image data portions 806 to 809, and offset values to subsequent IFD portions.
  • the final IFD portion contains a specific offset value that indicates that there is no subsequent IFD portion.
  • the IFD portions 802 to 805 are such that information such as the size of the image data (number of vertical and horizontal pixels) contained in the corresponding image data portion, information regarding whether or not the image is a scaled-down image, and the type, namely whether the image is a left image or a right image, are included in the metadata A to D. Accordingly, an apparatus that performs processing using the image file 810 can reference the IFD portions 802 to 805 so as to read out the appropriate image data corresponding to the application from the multiple pieces of image data.
  • a 0th IFD portion 802 is a region corresponding to a 0th image data portion 806.
  • One IFD portion corresponds to one image data portion, and the start positions of the pieces of image data in the image file 800 are specified by the offset values E to H of the IFD portions 802 to 805.
  • FIG. 8B is a diagram showing an example of the structure of an image file generated by the image capture apparatus 100 (video signal processing circuit 116) of the present embodiment.
  • an example of the structure in the case of generating a TIFF-format image file containing a lossy compressed image (display image), thumbnail image, lossless compressed image, and lossless compressed image (right) generated at the time of shooting is shown.
  • the image file 810 is constituted by a TIFF header portion 811, a 0th IFD portion 812 to a 3rd IFD portion 815, a thumbnail image portion 817, a display image portion 816, a normal image portion 818, and a right image portion 819.
  • the TIFF header portion 811 contains data for identifying that the file has a TIFF file structure.
  • the 0th IFD portion 813 contains metadata B such as shooting information and parameters relating to the display image portion 816, and the offset value F to the display image portion 816.
  • the 1st IFD portion 812 contains metadata A such as shooting information and parameters relating to the thumbnail image portion 817, and the offset value E to the thumbnail image portion 817.
  • the 2nd IFD portion 814 contains metadata C such as shooting information and parameters relating to the normal image portion 818, and the offset value G to the normal image portion 818.
  • the 3rd IFD portion 815 contains metadata D such as shooting information and parameters relating to the right image portion 819, and the offset value H to the right image portion 819.
  • offset values E to H can be used to specify the start positions of the pieces of image data in the image file.
  • the display image portion 816 is a region containing the display image generated by the lossy compression processing unit 603 in order to perform display thereof on the main display device 128 or the like.
  • the display image is in a JPEG format.
  • the thumbnail image portion 817 is a region containing a thumbnail image to be used when performing index display such as a screen showing a list of images in the memory 120 on the main display device 128, or the like, and is an image obtained by scaling down the display image by performing thinning or the like.
  • the normal image portion 818 is a region containing the normal image, which is obtained by adding together or combining the left image and the right image, and which is obtained by subjecting an undeveloped normal image in a so-called RAW format to lossless compression with the lossless compression processing unit 606.
  • the right image portion 819 is a region containing the right image obtained by subjecting the right image in a RAW format to lossless compression with the lossless compression processing unit 606.
  • An image corresponding to the left image can be generated by subtracting the right image from the normal image.
  • the right image and the left image can be used to perform refocus processing, viewpoint changing processing, three-dimensional image generation processing, and the like.
  • Data of developed images to be used in general-purpose display processing such as the thumbnail image and the display image
  • the thumbnail image and the display image are arranged in front of the normal image, which requires developing processing, and the right image, which is not used by an application that does not support parallax images. For this reason, the amount of time needed before the start of readout of image data with a high likelihood of being used can be shortened.
  • FIG. 9 is a block diagram showing an example of a functional configuration of a computer device 200 serving as an example of an electronic device that can use the image data stored in the image file generated by the image capture apparatus 100 of the present embodiment.
  • a CPU 1 functioning as a control unit reads out programs contained in a storage device 10, for example, which here are a developing processing application, a refocus processing application, a viewpoint changing processing application, and the like, to a RAM 3, and executes them so as to realize later-described image processing.
  • the storage device 10 is a hard disk drive (HDD), a solid-state drive (SSD), or the like, and stores basic software (OS), device drivers, application programs, and the like.
  • GUI data for displaying menu screens and the like, user setting data, initial setting data of applications, and the like are also stored in the storage device 10.
  • the ROM 2 stores programs and firmware that are needed for the computer device 200 to start up, such as a bootstrap loader, and the like. At least a portion of the ROM 2 may be rewritable.
  • the RAM 3 is used as a region for dispatching programs to be executed by the CPU 1, and as a temporary storage region for variables, data, and the like.
  • a memory card 4 may be a detachable memory 120.
  • the computer device 200 can obtain an image file from the memory card 4 mounted in the memory card slot 5, an external device 40 connected to a communication interface 20, or the storage device 10.
  • the display unit 6 is a dot-matrix display device represented by a liquid crystal display (LCD) or an organic EL display. Note that FIG. 9 shows a configuration in which the display unit 6 is built into the computer device 200, but the display unit 6 may be connected as an external apparatus. Also, the display unit 6 may be constituted by both a built-in display and an external display.
  • LCD liquid crystal display
  • organic EL display organic EL
  • the operation unit 8 is a device that allows a user to input instructions to the computer device 200, and is represented by one or more input device such as a pointing device (mouse, etc.) or a touch detection device (touch panel, etc.).
  • the keyboard may be a hardware keyboard or a software keyboard.
  • the display unit 6 may be provided with the touch panel, or a mode of using a touch pad often found in laptop personal computers may also be used.
  • the operation unit 8 may also include these sensors.
  • a non-contact input device such as an audio input device or an eyesight input device may also be included in the operation unit 8.
  • the communication interface 20 is, for example, one or more communication interfaces for performing data communication with the external device 40, such as the image capture apparatus 100.
  • the communication interface 20 includes a configuration conforming to a wired and/or wireless communication standard such as USB, Ethernet (registered trademark), or IEEE 802.11x.
  • the image capture apparatus 100 and the computer device 200 can form an image processing system by being communicably connected via the communication interface 20.
  • FIG. 10A is a flowchart showing an operation at a time of displaying a thumbnail image contained in the thumbnail image portion 817 of the image file 810.
  • the thumbnail image is a scaled-down image, for example, it is used in the application of roughly displaying the contents of the images contained in the image file in a case where a list of the contents of image files contained in a specific location of the memory card 4 or the storage device 10 is to be displayed, or the like.
  • the processing of FIG. 10A is executed for each individual image file.
  • step S1601 the CPU 1 reads out the TIFF header portion 811 of the target image file 810 and stores it in the RAM 3.
  • step S1603 the CPU 1 determines, based on the information of the 0th IFD portion 812, whether or not the 0th image portion (display image portion 816) corresponding to the 0th IFD portion 812 contains the thumbnail image (scaled-down image).
  • the 0th image portion is the display image portion 816, and therefore the CPU 1 moves to the processing of step S1604, increments N by 1, and returns to the processing of step S1602.
  • step S1603 Upon reading out the 1st IFD portion 813 in step S1602, the CPU 1 determines in step S1603 that the corresponding 1st image portion contains the scaled-down image, and moves to the processing of step S1605.
  • step S1605 the CPU 1 reads out the thumbnail image data from the 1st image portion (thumbnail image portion 817) and stores it in the display image region of the RAM 3.
  • step S1606 the CPU 1 causes the thumbnail image to be displayed on the display unit 6 in a pre-determined layout.
  • FIG. 10B is flowchart showing an operation at a time of displaying a display image (lossy compressed image) contained in the display image portion 816 of the image file 810. Steps in which processing is performed which is the same as that in FIG. 10A are denoted by the same reference numerals thereas.
  • the number of pixels (resolution) of the display image is the same as that of the normal image, but the image quality is reduced due to having been subjected to lossy compression.
  • the display image since the display image has been developed, whereas the normal image has not been developed, the display image can be displayed using a general-purpose apparatus.
  • a case of displaying a display image for one image file 810 will be described.
  • steps S1601 and S1602 are the same as in FIG. 10A, and therefore description thereof will not be repeated here.
  • step S1607 the CPU 1 determines, based on the information of the 0th IFD portion 812, whether or not the 0th image portion (display image portion 816) corresponding to the 0th IFD portion 812 contains the display image.
  • the 0th image portion is the display image portion 816, and therefore the CPU 1 moves to the processing of step S1608.
  • step S1608 the CPU 1 reads out the display image data from the 0th image portion (display image portion 816) and stores it in the display image region of the RAM 3.
  • step S1609 the CPU 1 causes the display image to be displayed on the display unit 6 in a pre-determined layout.
  • FIG. 11 is a flowchart showing an operation at a time of generating parallax images using images contained in the normal image portion 818 and the right image portion 819 of the image file 810 and performing processing using the parallax images. Steps in which processing that is the same as that in FIG. 10A are denoted by the same reference numerals thereas. Here, processing using the normal image and the right image included in the one image file 810 will be described.
  • steps S1601 and S1602 are the same as that in FIG. 10A, and therefore description thereof will not be repeated here.
  • step S1610 the CPU 1 determines, based on the information of the 0th IFD portion 812, whether or not the 0th image portion (display image portion 816) corresponding to the 0th IFD portion 812 contains the normal image.
  • the 0th image portion is the display image portion 816, and therefore the CPU 1 moves to the processing of step S1612, and determines, based on the information of the 0th IFD portion 812, whether or not the 0th image portion (display image portion 816) corresponding to the 0th IFD portion 812 contains the right image.
  • the 0th image portion is the display image portion 816, and therefore the CPU 1 moves to the processing of S1604, increments N by 1, and returns to the processing of step S1602.
  • step S1611 the CPU 1 reads out the normal image data from the 2nd image portion (normal image portion 818) and stores it in the RAM 3. Then, the CPU 1 moves to the processing of step S1604, increments N by 1, and returns to the processing of step S1602.
  • step S1613 the CPU 1 reads out the right image data from the 3rd image portion (right image portion 819) and stores it in the RAM 3.
  • step S1614 the CPU 1 generates the left image from the normal image read out in step S1611 and the right image read out in step S1613.
  • the normal image corresponds to an added image or a combined image of the right image and the left image, and therefore the left image can be generated by subtracting the right image from the normal image.
  • step S1615 the CPU 1 applies processing similar to that performed by the developing processing unit 602 to the right image and the left image. Note that depending on the content of the parallax image processing executed in step S1616, the developing processing may be applied after the parallax image processing and not in step S1615.
  • step S1616 the CPU 1 performs image processing using the parallax images, such as refocus processing, viewpoint changing processing, defocus map generation processing, and three-dimensional image generation processing, on the developed right image and left image.
  • image processing such as refocus processing, viewpoint changing processing, defocus map generation processing, and three-dimensional image generation processing, on the developed right image and left image.
  • an image file is generated which contains data of a normal image corresponding to a combined image of multiple parallax images, and data of parallax images excluding parallax images that can be generated from the normal image and other parallax images, among the multiple parallax images.
  • the normal image it is possible to achieve compatibility with a device that does not support parallax images, and by not storing the parallax images that can be generated using the normal image and other parallax images, it is possible to suppress the size of the image file.
  • a developed normal image as the normal image it is possible to further increase the versatility or compatibility of the image file.
  • the file size can be suppressed. Also, by arranging the parallax images at the end of the file, it is possible to reduce the amount of time needed to obtain the desired image data in an apparatus or application that does not use parallax images.
  • steps S1001 to S1003 in FIG. 7B are executed instead of steps S101 and S102 in FIG. 7A.
  • the normal image is extracted by the normal image extraction unit 601
  • the left image is extracted by the left image extraction unit 901 in step S1002.
  • the right image generation unit 902 generates the right image from the normal image and the extracted left image. Thereafter, processing similar to that in FIG. 7A may be used.
  • an image file is generated which contains a normal image generated from the right image and the left image, and one of the right image and the left image.
  • two right-side outputs and two left-side outputs of an image sensor having four PDs or photoelectric conversion regions per pixel shown in FIG. 3B were each handled as a group, and were handled in substantially the same manner as parallax images obtained with the pixel configuration shown in FIG. 3A.
  • the idea of the present embodiment can be applied also in the case of generating four parallax images by reading out four PDs separately. In this case, it is sufficient that at least (1) a normal image, (2) a right image or a left image, (3) an upper-right or lower-right image, and (4) an upper-left or lower-left image are contained.
  • the upper-right image is an image generated from the group of PDs 312b
  • the lower-right image is an image generated from the group of PDs 312d
  • the upper-left image is an image generated from the group of PDs 312a
  • the lower-left image is an image generated from the group of PDs 312c.
  • the right image corresponds to addition or combination of the upper-right image and the lower-right image
  • the left image corresponds to addition or combination of the upper-left image and the lower-left image.
  • an image file containing a normal image, a right image, an upper-right image, and an upper-left image is generated.
  • the left image can be generated as the difference between the normal image and the right image
  • the lower-right image can be generated as the difference between the right image and the upper-right image
  • the lower-left image can be generated as the difference between the left image and the upper-left image.
  • the combination of PDs stated in the present embodiment is merely an example, and it is possible to use an upper image (addition of PDs 312a and 312b), a lower image (addition of PDs 312c and 312d), or addition in a diagonal direction (e.g., addition of PDs 312a and 312d).
  • the present invention can be applied to a parallax image obtained with an image sensor having a configuration in which the number of PDs per pixel is greater than four.
  • the present embodiment is similar to the first embodiment, except for the configuration of the video signal processing circuit and the image file generation operation, and therefore only the differences therefrom will be described.
  • FIG. 6C is a block diagram showing an example of a functional configuration of the video signal processing circuit 116 of the present embodiment, constituent elements that are the same as those of the first embodiment are denoted by the same reference numerals as in FIG. 6A or 6B, and redundant description thereof is not included here.
  • the video signal processing circuit 116 of the present embodiment includes the right image extraction unit 605 shown in FIG. 6A instead of the left image extraction unit 901 shown in FIG. 6B, and includes a left image generation unit 902' instead of the right image generation unit 902. Note that the left image generation unit 902' is substantially the same constituent element as the right image generation unit 902, in that it obtains the difference between a normal image and a parallax image.
  • FIG. 12 is a diagram showing an example of a structure of an image file 1100 generated by the video signal processing circuit 116 of the present embodiment, in which constituent elements in common with the first embodiment are denoted by the same reference numerals as in FIG. 8B, and redundant description thereof will not be repeated here.
  • the image file 1100 of the present embodiment has a structure obtained by adding a right thumbnail image portion 1104, a left thumbnail image portion 1105, and a 3rd IFD portion 1101 and 4th IFD portion 1102 corresponding thereto to the image file 810 of the first embodiment. Also, the 3rd IFD portion 815 in the image file 810 has been brought down to the 5th IFD portion 1103.
  • step S1200 the left image generation unit 902' generates the left image by subtracting the right image from the normal image.
  • steps S110, steps S120 and S121, step S130, steps S1210 and S1211, and steps S1220 and S1221 can be performed in parallel. Note that at least a portion thereof may be performed sequentially, according to how much space is left in the memory 120, the processing speed of the video signal processing circuit 116, and the like.
  • step S1210 the developing processing unit 602 applies the above-described developing processing to the right image and outputs the resulting image to the lossy compression processing unit 603.
  • step S1211 the lossy compression processing unit 603 generates a lossy compressed image (right) by applying lossy compression processing to the developed right image, and generates the right thumbnail image by scaling down the lossy compressed image (right).
  • the lossy compression processing unit 603 stores the right thumbnail image in the buffer memory 122 via the memory interface 604 and the memory controller 119.
  • steps S1220 and S1221 the developing processing unit 602 and the lossy compression processing unit 603 generate a left thumbnail image by executing processing similar to that of steps S1210 and S1211 on the left image.
  • the lossy compression processing unit 603 stores the left thumbnail image in the buffer memory 122 via the memory interface 604 and the memory controller 119.
  • the video signal processing circuit 116 moves to the processing of step S140 and generates the image file.
  • the video signal processing circuit 116 generates the image file by reading out a lossless compressed image, a lossless compressed image (right), a display image, a thumbnail image, a right thumbnail image, and a left thumbnail image from the buffer memory 122.
  • the image file 1100 generated in the present embodiment has the following configuration added to the image file 810 generated in the first embodiment. That is, the 3rd IFD portion 1101, which is an IFD for the right thumbnail image, the 4th IFD portion 1102, which is an IFD for the left thumbnail image, the 5th IFD portion 1103, which is an IFD for the right image, the right thumbnail image portion 1104, and the left thumbnail image portion 1105.
  • the 3rd IFD portion 1101 contains metadata I such as shooting information and parameters relating to the right thumbnail image portion 1104, and an offset value L to the right thumbnail image portion 1104.
  • the 4th IFD portion 1102 contains metadata J such as shooting information and parameters relating to the left thumbnail image portion 1105, and an offset value M to the left thumbnail image portion 1105.
  • the 5th IFD portion 1103 contains metadata D such as shooting information and parameters relating to the right image portion 819, and an offset value H to the right image portion 819.
  • offset values H, L, and M can be used to specify the start positions of the pieces of image data in the image file.
  • the right thumbnail image portion 1104 and the left thumbnail image portion 1105 are regions containing images to be used in the case of displaying parallax images in index display, such as a screen with a list of images, on the main display device 128, for example, or when displaying an image generated using parallax images.
  • the right thumbnail image and the left thumbnail image which are thumbnail images of parallax images, are furthermore included in the image file.
  • display using parallax images and display of images generated using parallax images can be performed easily with an apparatus capable of using parallax images.
  • the file size increases by a significantly smaller amount compared to the case of performing storage by adding the left image to the image file of the first embodiment, and there is no need to perform developing processing, and therefore the load of the apparatus using the parallax images can also be reduced.
  • Modified Example 1 Note that in the second embodiment, a configuration may be used in which an image file including a right display image and a left display image instead of a right thumbnail image and a left thumbnail image is generated.
  • the structure of the image file is like that shown in FIG. 14.
  • a right display image portion 1304 and a left display image portion 1305 are included instead of the right thumbnail image portion 1104 and the left thumbnail image portion 1105.
  • the 3rd IFD portion 1301 and the 4th IFD portion 1302 include information corresponding to the right display image portion 1304 and the left display image portion 1305, respectively.
  • the processing during shooting may be basically the same as that shown in FIG. 13, or it is sufficient to use a configuration in which in step S140, the image file contains a right display image and a left display image generated before the right thumbnail image and the left thumbnail image are generated in steps S1211 and S1221.
  • Modified Example 2 Note that in the second embodiment, a configuration may be used in which an image file furthermore including the right display image and the left display image in addition to the right thumbnail image and the left thumbnail image is generated.
  • the structure of the image file is like that shown in FIG. 15.
  • the right display image portion 1304 and the left display image portion 1305 are added (inserted) after the thumbnail images and before the right image.
  • the 5th IFD portion 1401 and the 6th IFD portion 1402 include information corresponding to the right display image portion 1304 and the left display image portion 1305.
  • the position of the IFD portion corresponding to the right image portion 819 has been changed to that of the 7th IFD portion 1403.
  • the processing during shooting may be basically the same as that shown in FIG. 13, and it is sufficient to use a configuration in which in step S140, the image file contains the right display image, the left display image, the right thumbnail image, and the left thumbnail image, which are generated in steps S1211 and S1221.
  • the file size is greater than in the basic form of the second embodiment, but display processing using parallax images with higher resolutions can be performed easily, and parallax images with resolutions corresponding to the application thereof can be used. Accordingly, the modified examples are particularly useful in the case where the processing ability of the apparatus using the image files is low.
  • Embodiments of the present invention can also be realized by a computer of a system or apparatus that reads out and executes computer executable instructions (e.g., one or more programs) recorded on a storage medium (which may also be referred to more fully as a 'non-transitory computer-readable storage medium') to perform the functions of one or more of the above-described embodiments and/or that includes one or more circuits (e.g., application specific integrated circuit (ASIC)) for performing the functions of one or more of the above-described embodiments, and by a method performed by the computer of the system or apparatus by, for example, reading out and executing the computer executable instructions from the storage medium to perform the functions of one or more of the above-described embodiments and/or controlling the one or more circuits to perform the functions of one or more of the above-described embodiments.
  • ASIC application specific integrated circuit
  • the computer may comprise one or more processors (e.g., central processing unit (CPU), micro processing unit (MPU)) and may include a network of separate computers or separate processors to read out and execute the computer executable instructions.
  • the computer executable instructions may be provided to the computer, for example, from a network or the storage medium.
  • the storage medium may include, for example, one or more of a hard disk, a random-access memory (RAM), a read only memory (ROM), a storage of distributed computing systems, an optical disk (such as a compact disc (CD), digital versatile disc (DVD), or Blu-ray Disc (BD) TM ), a flash memory device, a memory card, and the like.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)
  • Stereoscopic And Panoramic Photography (AREA)
  • Television Signal Processing For Recording (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
PCT/JP2016/002172 2015-05-01 2016-04-25 Image processing apparatus, method for controlling the same, and image capture apparatus Ceased WO2016178310A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US15/569,246 US10382740B2 (en) 2015-05-01 2016-04-25 Image processing apparatus, method for controlling the same, and image capture apparatus

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2015-094440 2015-05-01
JP2015094440A JP6618271B2 (ja) 2015-05-01 2015-05-01 画像処理装置およびその制御方法、撮像装置

Publications (1)

Publication Number Publication Date
WO2016178310A1 true WO2016178310A1 (en) 2016-11-10

Family

ID=56080435

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2016/002172 Ceased WO2016178310A1 (en) 2015-05-01 2016-04-25 Image processing apparatus, method for controlling the same, and image capture apparatus

Country Status (3)

Country Link
US (1) US10382740B2 (https=)
JP (1) JP6618271B2 (https=)
WO (1) WO2016178310A1 (https=)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7365133B2 (ja) * 2019-04-19 2023-10-19 キヤノン株式会社 通信装置およびその制御方法、プログラム

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4410804A (en) 1981-07-13 1983-10-18 Honeywell Inc. Two dimensional image panel with range measurement capability
EP2046020A1 (en) * 2007-10-05 2009-04-08 Fujifilm Corporation Image recording apparatus and image recording method
US20100195920A1 (en) * 2009-01-30 2010-08-05 Sony Corporation Recording device, recording method, recording medium, reproducing device, reproducing method, editing device, and editing method
US20110007087A1 (en) * 2009-07-13 2011-01-13 Echostar Technologies L.L.C. Systems and methods for a common image data array file
US20130076869A1 (en) * 2011-09-22 2013-03-28 Canon Kabushiki Kaisha Imaging apparatus and method for controlling same
US20130083166A1 (en) * 2011-10-04 2013-04-04 Canon Kabushiki Kaisha Imaging apparatus and method for controlling same
US20130093859A1 (en) * 2010-04-28 2013-04-18 Fujifilm Corporation Stereoscopic image reproduction device and method, stereoscopic image capturing device, and stereoscopic display device
US20130222553A1 (en) * 2010-09-24 2013-08-29 Fujifilm Corporation Image pickup device and image pickup apparatus

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3531003B2 (ja) * 2001-03-30 2004-05-24 ミノルタ株式会社 画像処理装置、画像処理プログラムが記録された記録媒体、および、画像再生装置
JP4415508B2 (ja) * 2001-04-20 2010-02-17 株式会社富士通ゼネラル 監視画像録画装置
JP2005026800A (ja) * 2003-06-30 2005-01-27 Konica Minolta Photo Imaging Inc 画像処理方法、撮像装置、画像処理装置及び画像記録装置
JP5911276B2 (ja) * 2011-12-02 2016-04-27 キヤノン株式会社 撮像装置およびその制御方法、画像処理装置
JP6053276B2 (ja) * 2011-12-02 2016-12-27 キヤノン株式会社 撮像装置およびその制御方法、画像処理装置

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4410804A (en) 1981-07-13 1983-10-18 Honeywell Inc. Two dimensional image panel with range measurement capability
EP2046020A1 (en) * 2007-10-05 2009-04-08 Fujifilm Corporation Image recording apparatus and image recording method
US20100195920A1 (en) * 2009-01-30 2010-08-05 Sony Corporation Recording device, recording method, recording medium, reproducing device, reproducing method, editing device, and editing method
US20110007087A1 (en) * 2009-07-13 2011-01-13 Echostar Technologies L.L.C. Systems and methods for a common image data array file
US20130093859A1 (en) * 2010-04-28 2013-04-18 Fujifilm Corporation Stereoscopic image reproduction device and method, stereoscopic image capturing device, and stereoscopic display device
US20130222553A1 (en) * 2010-09-24 2013-08-29 Fujifilm Corporation Image pickup device and image pickup apparatus
US20130076869A1 (en) * 2011-09-22 2013-03-28 Canon Kabushiki Kaisha Imaging apparatus and method for controlling same
US20130083166A1 (en) * 2011-10-04 2013-04-04 Canon Kabushiki Kaisha Imaging apparatus and method for controlling same

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
REN NG ET AL.: "Light Field Photography with a Hand-Held Plenoptic Camera", STANFORD TECH REPORT CTSR 2005-02, 20 April 2005 (2005-04-20)

Also Published As

Publication number Publication date
US10382740B2 (en) 2019-08-13
JP6618271B2 (ja) 2019-12-11
JP2016213622A (ja) 2016-12-15
US20180124377A1 (en) 2018-05-03

Similar Documents

Publication Publication Date Title
JP5054583B2 (ja) 撮像装置
US9279955B2 (en) Image pickup apparatus, control method thereof, and program
JP6659148B2 (ja) 表示制御装置及びその制御方法、プログラム、並びに記憶媒体
JP5665013B2 (ja) 画像処理装置、画像処理方法、及びプログラム
US9344617B2 (en) Image capture apparatus and method of controlling that performs focus detection
KR101889932B1 (ko) 촬영 장치 및 이에 적용되는 촬영 방법
US10477101B2 (en) Focus detection apparatus, control method and storage medium
US20130120642A1 (en) Digital photographing apparatus and method of controlling the same
US8902294B2 (en) Image capturing device and image capturing method
JP7049163B2 (ja) 電子機器およびその制御方法、プログラム並びに記憶媒体
JP5627438B2 (ja) 撮像装置、その制御方法、プログラム及び記憶媒体
US9451175B2 (en) Imaging apparatus, information processing device, image pickup method, and non-transitory computer-readable storage medium storing a program therefor for obtaining light field information
US10382740B2 (en) Image processing apparatus, method for controlling the same, and image capture apparatus
US12238260B2 (en) Device, capturing device, control method, and storage medium operable for outputting pair of captured images pertaining to binocular stereopsis
JP6858059B2 (ja) 撮像装置及びその制御方法、プログラム、記憶媒体
JP2014137704A (ja) 撮像装置
JP2015139018A (ja) 電子機器及び制御プログラム
JP5648563B2 (ja) 画像処理装置、画像処理方法、及びプログラム
JP5911530B2 (ja) 撮像装置
JP5641352B2 (ja) 画像処理装置、画像処理方法、及びプログラム
KR20110090086A (ko) 복수의 표시부들 각각에 다른 영상을 디스플레이할 수 있는 디지털 영상 신호 처리 장치 및 이의 제어 방법
JP6592330B2 (ja) 撮像装置及び撮像方法
JP2014102400A (ja) 撮像装置および撮像装置の制御方法
JP2015219284A (ja) 撮像装置及び撮像装置の制御方法
JP5333949B2 (ja) 撮像装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16724980

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 15569246

Country of ref document: US

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16724980

Country of ref document: EP

Kind code of ref document: A1