WO2013136134A1 - Method, apparatus and computer program for capturing images - Google Patents
Method, apparatus and computer program for capturing images Download PDFInfo
- Publication number
- WO2013136134A1 WO2013136134A1 PCT/IB2012/051249 IB2012051249W WO2013136134A1 WO 2013136134 A1 WO2013136134 A1 WO 2013136134A1 IB 2012051249 W IB2012051249 W IB 2012051249W WO 2013136134 A1 WO2013136134 A1 WO 2013136134A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- images
- image processing
- subset
- image capturing
- capturing apparatus
- Prior art date
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/64—Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/95—Computational photography systems, e.g. light-field imaging systems
- H04N23/951—Computational photography systems, e.g. light-field imaging systems by using two or more images to influence resolution, frame rate or aspect ratio
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/74—Circuitry for compensating brightness variation in the scene by influencing the scene brightness using illuminating means
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/741—Circuitry for compensating brightness variation in the scene by increasing the dynamic range of the image compared to the dynamic range of the electronic image sensors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/50—Control of the SSIS exposure
- H04N25/57—Control of the dynamic range
- H04N25/58—Control of the dynamic range involving two or more exposures
- H04N25/587—Control of the dynamic range involving two or more exposures acquired sequentially, e.g. using the combination of odd and even image fields
- H04N25/589—Control of the dynamic range involving two or more exposures acquired sequentially, e.g. using the combination of odd and even image fields with different integration times, e.g. short and long exposures
Definitions
- Embodiments of the present invention relate to a method, apparatus and computer program for capturing images.
- they relate to a method, apparatus and computer program for capturing images which may be used with an image processing algorithm.
- Apparatus which enable a user to capture images such as digital cameras are known. Such apparatus may enable a user to select image processing algorithms to enable high quality images to be obtained in different lighting and imaging conditions. Such algorithms may comprise, for example, high dynamic range (HDR) algorithms or flash-no-flash algorithms. Some of these algorithms may require a plurality of images to be captured. The plurality of images may then be combined to provide a single image with modified image properties.
- HDR high dynamic range
- Such apparatus require a user to select which algorithm to use before the image is captured. This may make such apparatus more difficult for a user to use as, in order to obtain a high quality image, the user may need to understand a plurality of different types of algorithms which may be available as well as understand the effects that different imaging conditions, such as light levels and movement, would have on these algorithms. It may be beneficial to provide an apparatus for capturing images which is simpler for a user to use.
- a method comprising; detecting an input; and in response to detecting the input, causing an image capturing apparatus to capture a plurality of images; wherein the image capturing apparatus is configured to have a first set of parameters to capture a first subset of the plurality of images such that the first subset of the plurality of images are configured for use with a first image processing algorithm and the image capturing apparatus is configured to have a second set of parameters to capture a second subset of the plurality of images such that the second subset of the plurality of images are configured for use with a second image processing algorithm.
- the image capturing apparatus may be configured to capture more than two subsets of images where for each of the subsets of images the image capturing apparatus is configured to have a different set of parameters to enable each of the subsets of images to be used with a different image processing algorithm.
- the subsets of images may be captured in a sequence where the order of the sequence is determined by the image processing algorithms associated with each subset of images.
- the sequence in which the images are captured may be determined by a user input.
- the sequence in which the images are captured may be determined by a detected physical condition.
- the detected physical condition may comprise a physical condition of the image capturing apparatus.
- the detected physical condition may comprise at least one of a distance to an object to be imaged, motion of the image capturing apparatus.
- the detected physical condition may comprise a physical condition of an object to be imaged.
- the detected physical condition may comprise at least one of lux level, contrast of a scene to be imaged, dimensions of object, type of object, motion of the object.
- the detected input may comprise a user input.
- the detected input may comprise a user selecting at least one image processing algorithm.
- the method may further comprise storing the plurality of images such that the image processing algorithms may be performed on the stored images.
- the image processing algorithms may be performed in response to a user input. In some embodiments of the disclosure the image processing algorithms may be performed automatically.
- an apparatus comprising: at least one processor; and at least one memory including computer program code; wherein the at least one memory and the computer program code are configured to, with the at least one processor, enable the apparatus to: detect an input; and in response to detecting the input, cause an image capturing apparatus to capture a plurality of images; wherein the image capturing apparatus is configured to have a first set of parameters to capture a first subset of the plurality of images such that the first subset of the plurality of images are configured for use with a first image processing algorithm and the image capturing apparatus is configured to have a second set of parameters to capture a second subset of the plurality of images such that the second subset of the plurality of images are configured for use with a second image processing algorithm.
- the image capturing apparatus may be configured to capture more than two subsets of images where for each of the subsets of images the image capturing apparatus is configured to have a different set of parameters to enable each of the subsets of images to be used with a different image processing algorithm.
- the image capturing apparatus may be configured to capture the subsets of images in a sequence where the order of the sequence is determined by the image processing algorithms associated with each subset of images.
- the sequence in which the images are captured may be determined by a user input.
- the sequence in which the images are captured may be determined by a detected physical condition.
- the detected physical condition may comprise a physical condition of the image capturing apparatus.
- the detected physical condition may comprise at least one of a distance to an object to be imaged, motion of the image capturing apparatus.
- the detected physical condition may comprise a physical condition of an object to be imaged.
- the detected physical condition may comprise at least one of lux level, contrast of a scene to be imaged, dimensions of object, type of object, motion of the object.
- the detected input may comprise a user input.
- the detected input may comprises a user selecting at least one image processing algorithm.
- the at least one memory and the computer program code may be further configured to, with the at least one processor, enable the apparatus to store the plurality of images such that the image processing algorithms may be performed on the stored images.
- the at least one memory and the computer program code may be further configured to, with the at least one processor, enable the apparatus to perform the image processing algorithms in response to a user input. In some embodiments the at least one memory and the computer program code may be further configured to, with the at least one processor, enable the apparatus to perform the image processing algorithms automatically.
- a computer program comprising computer program instructions that, when executed by at least one processor, enable an apparatus at least to perform: detecting an input; and in response to detecting the input, causing an image capturing apparatus to capture a plurality of images; wherein the image capturing apparatus is configured to have a first set of parameters to capture a first subset of the plurality of images such that the first subset of the plurality of images are configured for use with a first image processing algorithm and the image capturing apparatus is configured to have a second set of parameters to capture a second subset of the plurality of images such that the second subset of the plurality of images are configured for use with a second image processing algorithm.
- the computer program may comprise program instructions for causing a computer to perform any of the methods described above.
- a physical entity embodying the computer program as described above there may be provided an electromagnetic carrier signal carrying the computer program as described above.
- the apparatus may be for capturing images.
- Fig. 1 schematically illustrates an apparatus according to an examplary embodiment of the disclosure
- Fig. 2 illustrates a touch sensitive display configured to provide a tactile indication according to a second examplary embodiment of the disclosure
- Fig. 3 is a block diagram which schematically illustrates a method according to an examplary embodiment of the disclosure.
- Fig. 4 is a block diagram which schematically illustrates a method according to another examplary embodiment of the disclosure.
- the Figures illustrate an apparatus 1 , method, computer program 9 and apparatus 1 wherein the method comprises detecting 41 , 51 an input; and in response to detecting 41 , 51 the input, causing 43, 55 an image capturing apparatus 13 to capture a plurality of images; wherein the image capturing apparatus 13 is configured to have a first set of parameters to capture a first subset of the plurality of images such that the first subset of the plurality of images are configured for use with a first image processing algorithm and the image capturing apparatus 13 is configured to have a second set of parameters to capture a second subset of the plurality of images such that the second subset of the plurality of images are configured for use with a second image processing algorithm.
- Fig. 1 schematically illustrates an apparatus 1 according to an exemplary embodiment of the invention.
- the apparatus 1 may be an electronic apparatus which is configured to enable images to be captured.
- the apparatus 1 may be, for example, a camera, a mobile cellular telephone, a personal computer or any other apparatus which may be configured to enable images to be captured.
- the apparatus 1 may be a handheld apparatus 1 which can be carried in a user's hand, handbag or pocket of their clothing for example.
- the apparatus 1 may comprise additional features that are not illustrated.
- the apparatus 1 may also comprise a transmitter and receiver configured to enable wireless communication.
- the apparatus 1 schematically illustrated in Fig. 1 comprises: a controller 4, an image capturing apparatus 13, at least one detector 21 and a user interface 23.
- the controller 4, image capturing apparatus 13, detector 21 and user interface 23 are operationally coupled. It is to be appreciated that any number or combination of intervening elements may be provided between the respective components of the apparatus 1 including no intervening elements.
- the controller 4, image capturing apparatus 13, detector 21 and user interface 23 may be located within a housing.
- the controller 4 comprises at least one processor 3 and at least one memory 5.
- the controller 4 provides means for controlling the apparatus 1 .
- the controller 4 may be implemented using instructions that enable hardware functionality, for example, by using executable computer program instructions 1 1 in one or more general-purpose or special-purpose processors 3 that may be stored on a computer readable storage medium 29 (e.g. disk, memory etc) to be executed by such processors 3.
- a computer readable storage medium 29 e.g. disk, memory etc
- the controller 4 may be configured to control the apparatus 1 to perform a plurality of different functions.
- the controller 4 may be configured to control the apparatus 1 to capture and store images.
- the controller 4 may also be configured to perform image processing on the captured images.
- the controller 4 may also be configured to enable the apparatus 1 to detect 41 , 51 an input; and in response to detecting 41 , 51 the input, cause 43, 55 the image capturing apparatus 13 to capture a plurality of images; wherein the image capturing apparatus 13 is configured to have a first set of parameters to capture a first subset of the plurality of images such that the first subset of the plurality of images are configured for use with a first image processing algorithm and the image capturing apparatus 13 is configured to have a second set of parameters to capture a second subset of the plurality of images such that the second subset of the plurality of images are configured for use with a second image processing algorithm.
- the at least one processor 3 may be configured to receive input commands from the user interface 23, the image capturing apparatus 13 and the detector 21 .
- the at least one processor may also be configured to provide output commands to the user interface 23, the image capturing apparatus 13 and the detector 21 .
- the at least one processor 3 is also configured to write to and read from the at least one memory 5.
- the image capturing apparatus 13 comprises an optical arrangement 17 and an image sensor 15.
- the image capturing apparatus 13 may also comprise one or more drives 19.
- the image sensor 15 may comprise any means which is configured to convert light incident on the image sensor 15 into an electrical signal to enable an image to be produced.
- the image sensor 15 may comprise, for example, a digital image sensor such as a charge-coupled-device (CCD) or a complementary metal-oxide-semiconductor (CMOS).
- CMOS complementary metal-oxide-semiconductor
- the at least one processor 3 may be configured to receive inputs from the image sensor 15.
- the at least one processor 3 may be configured to retrieve an electrical signal comprising image data from the image sensor 15 and store it in the at least one memory 5.
- the image data may be in the form of a still image or a video image
- the optical arrangement 17 may comprise any means configured to focus or deflect incident light from an object onto the image sensor 15.
- the optical arrangement 17 may receive the incident light from an object or scene external to the apparatus 1 through an aperture in a housing of the apparatus 1 .
- the optical arrangement 17 may comprise, for example, one or more optical devices such as one or more lenses.
- the apparatus 1 may also comprise one or more drives 19.
- the one or more drives 19 may comprise any means which enables movement of at least part of the optical arrangement 17 relative to the image sensor 15.
- the one or more drives 19 may comprise an electric motor.
- the one or more drives may enable movement of some or all of the plurality of components.
- the apparatus 1 may also comprise one or more detectors 21 .
- the detectors 21 may comprise any means which may be configured to detect a physical condition and provide an input to the controller 4 indicative of the detected condition.
- the one or more detectors 21 may comprise detectors configured to detect a physical condition of the apparatus 1 or image capturing apparatus 13.
- the physical condition may comprise motion of the apparatus 1 or image capturing apparatus 13.
- the detector 21 may comprise any suitable means for detecting motion of apparatus 1 or image capturing apparatus 13 such as one or more accelerometers and/or a gyroscope.
- the detected physical condition may comprise the distance between the apparatus 1 and an object which is to be imaged.
- the at least one detector 21 may comprise a detector for detecting a reflected signal such as an ultra-sound or infra red signal or any other suitable detectors.
- the one or more detectors 21 may comprise detectors configured to detect a physical condition of the scene or object to be imaged.
- the one or more detectors 21 may be configured to detect the lux level, the contrast of a scene, the dimensions of an object, the type of object to be imaged or motion of the object or any other suitable physical condition.
- the at least one detector 21 may comprise a light level sensor, means for detecting a reflected signal such as an ultra-sound or infra red signal or any other suitable detectors.
- the user interface 23 comprises a user input device 27 and a display 25.
- the user input device 27 may comprise any means which enables a user input to be detected.
- the detection of a user input may enable the user of the apparatus 1 to input information which may be used to control the apparatus 1 .
- the user input device 27 may enable a user to make an input indicating that an image should be captured by the image capturing apparatus 13.
- the user input device 27 may also enable the user to make a user input selecting one or more imaging processing algorithms which should be used to process the captured images.
- the user input device 27 may comprise a touch sensitive display, a keypad or a combination of a number of different types of user input devices.
- the display 25 may comprise any means which enables information to be displayed to a user of the apparatus 1 .
- the information displayed on the display 25 may comprise images which have been captured by the image capturing apparatus 13.
- the information displayed on the display 25 may comprise images which have been stored in the one or more memories 5.
- the at least one memory 5 may be configured to store a computer program code 9 comprising computer program instructions 1 1 that control the operation of the apparatus 1 when loaded into the at least one processor 3.
- the computer program instructions 1 1 provide the logic and routines that enable the apparatus 1 to perform the methods illustrated in Figs. 3 and 4.
- the at least one processor 3 by reading the at least one memory 5 is able to load and execute the computer program 9.
- the computer program instructions 1 1 may provide computer readable program means configured to control the apparatus 1 .
- the program instructions 1 1 may provide, when loaded into the controller 4; means for detecting 41 , 51 an input; and means for causing 43, 55, in response to detecting 41 , 51 the input, an image capturing apparatus 13 to capture a plurality of images; wherein the image capturing apparatus 13 is configured to have a first set of parameters to capture a first subset of the plurality of images such that the first subset of the plurality of images are configured for use with a first image processing algorithm and the image capturing apparatus 13 is configured to have a second set of parameters to capture a second subset of the plurality of images such that the second subset of the plurality of images are configured for use with a second image processing algorithm.
- the computer program 9 may arrive at the apparatus 1 via any suitable delivery mechanism 31 .
- the delivery mechanism 31 may be, for example, a computer-readable storage medium, a computer program product 29, a memory device, a record medium such as a CD-ROM or DVD, an article of manufacture that tangibly embodies the computer program 9.
- the delivery mechanism may be a signal configured to reliably transfer the computer program 9.
- the apparatus 1 may propagate or transmit the computer program 9 as a computer data signal.
- memory 5 is illustrated as a single component it may be implemented as one or more separate components some or all of which may be integrated/removable and/or may provide permanent/semi-permanent/ dynamic/cached storage.
- references to 'computer-readable storage medium', 'computer program product', 'tangibly embodied computer program' etc. or a 'controller', 'computer', 'processor' etc. should be understood to encompass not only computers having different architectures such as single/multi- processor architectures and sequential (e.g. Von Neumann)/parallel architectures but also specialized circuits such as field-programmable gate arrays (FPGA), application integration specific circuits (ASIC), signal processing devices and other devices.
- References to computer program, instructions, code etc. should be understood to encompass software for a programmable processor or firmware such as, for example, the programmable content of a hardware device whether instructions for a processor, or configuration settings for a fixed-function device, gate array or programmable logic device etc.
- Fig. 2 illustrates an apparatus 1 ' according to another embodiment of the invention.
- the apparatus 1 ' illustrated in Fig. 2 may be a chip or a chip-set.
- the apparatus 1 ' comprises at least one processor 2 and at least one memory 5 as described above in relation to Fig. 1 .
- Figs. 3 and 4 schematically illustrate methods according to embodiments of the disclosure.
- the embodiments may be implemented using the apparatus 1 , 1 ' of Figs. 1 and 2.
- an input is detected.
- the input may comprise any external event which may be detected by the apparatus 1 .
- the input may comprise a user input.
- the user input may be detected using the user input device 27 of the examplary apparatus 1 illustrated in Fig. 1 .
- the user input which is detected at block 41 may comprise an indication from the user that they would like an image to be captured.
- the user input which is detected at block 41 may comprise a user selection of an imaging processing algorithm which is to be used on the images captured in response to the input.
- a plurality of images are captured.
- the plurality of images may be captured using the image capturing apparatus 13 as described above in relation to Fig. 1 .
- the plurality of images captured at block 43 comprises a plurality of subsets of images.
- the plurality of images captured may comprise a first subset of images and a second subset of images.
- Each of the subset of images may comprise one or more images. It is to be appreciated that any number of subsets of images may be captured. It also to be appreciated that each of the subsets of images may comprise any number of individual images.
- each of the subsets of images may be distinct so that there is no overlap between the different subsets of images. In such embodiments each image which is captured is only a member of one subset of images. In other embodiments of the disclosure there may be some overlap between the different subsets of images.
- an image which is captured may be a member of more than one subset of images. Therefore, in some embodiments of the disclosure some of the subsets of images may share one or more common images.
- the subsets of images which are captured may be associated with different image processing algorithms.
- the image capturing apparatus 13 may capture the images such that the captured images are suitable for use with different image processing algorithms. This may enable different image processing algorithms to be used on the different subsets of images.
- at least one of the image processing algorithms which is associated with a subset of images may comprise an algorithm which has been selected by the user of the apparatus 1 .
- some of the subsets of images may share one or more common images.
- a single image may be associated with different image processing algorithms.
- the image processing algorithms may comprise any algorithms which may be used to modify the images captured by the image sensor 15.
- the image processing algorithms may comprise algorithms which combine a plurality of different images. Therefore these algorithms may require a plurality of images to be captured.
- the plurality of different images may be captured simultaneously using different imaging sensors 15 or sequentially over a short period of time so that the images are of the same scene or object.
- Image processing algorithms which may be used in examplary embodiments of the disclosure may comprise high dynamic range (HDR) algorithms, flash- no-flash algorithms, bracketing algorithms such as focus bracketing, multi- frame noise filtering, super-resolution, panoramic imaging algorithms, night time imaging algorithms aperture bracketing or any other suitable image processing algorithms.
- the image capturing apparatus 13 may be configured to have a first set of parameters to capture a first subset of the plurality of images and the image capturing apparatus 13 may be configured to have a second set of parameters to capture a second subset of the plurality of images.
- each image may be captured with the image capturing apparatus 13 in a different configuration.
- a single image may be part of more than one subset and so may be used with more than one different image processing algorithm.
- the parameters of the image capturing apparatus 13 may comprise any physical characteristic of the image capturing apparatus 13 which may affect the properties of the images provided by the image sensor 15.
- the parameters may comprise, the exposure time, the size of the aperture, the focal length of the optical arrangement 17, the relative distance between the optical arrangement 17 and the image sensor 15 whether or not flash is used and variation in gain or any other suitable parameter.
- the parameters of the imaging apparatus 13 may affect properties of the images provided by the image sensor 15 such as the resolution of the image, the contrast of the image, which portions within the image are in focus or any other suitable property. Where the parameter comprises the relative distance between the optical arrangement 17 and the image sensor 15 this may be varied using the one or more drives 19.
- the parameters of imaging apparatus 13 may be controlled so that the images which are captured are suitable for use with the image processing algorithms. For example, when capturing the first subset of the plurality of images the image processing apparatus 13 may be configured to have a first set of parameters such that the images produced by the image sensor 15 are suitable for use with an algorithm associated with the first subset of images. Similarly, when capturing the second subset of the plurality of images the image processing apparatus 13 may be configured to have a second set of parameters such that the images produced by the image sensor 15 are suitable for use with an algorithm associated with the second subset of images. In some embodiments of the disclosure the image processing apparatus 13 may be configured to have a different set of parameters for each subset of images which may enable each subset of captured images to be used with a different image processing algorithm.
- the images within the subsets of images may be captured using different parameters of the image capturing apparatus 13.
- a subset of images comprises a plurality of images each image within the subset of images may be captured with the image capturing apparatus 13 having a different set of parameters.
- the image processing algorithm comprises a flash no flash algorithm the subset of images may comprise at least two images.
- the image capturing apparatus 13 may be configured to provide a flash and when a second image is captured the image capturing apparatus 13 may be configured to provide no flash.
- the subset of images may comprise a plurality of images where each of the images has a different exposure value.
- the image capturing apparatus 13 may be configured to have a first exposure time and aperture size.
- the image capturing apparatus 13 may be configured to have a second exposure time and aperture size which may be different to the first exposure time and aperture size.
- the at least one memory 5 may store computer code which enables the image capturing apparatus 13 to be configured to have the parameters needed to capture images for use with the available algorithms. Configuring the image capturing apparatus 13 to have different parameters may comprise using the drive 19 to move the optical arrangement 17 relative to the image sensor 15, varying the exposure time used, varying the aperture available or any other suitable change in parameters.
- the at least one memory 5 may also store computer code which enables the available algorithms to be implemented on the plurality of captured images.
- Fig. 4 illustrates a method according to another embodiment of the disclosure which may also be implemented using an apparatus 1 , 1 ' as illustrated in Figs. 1 and 2 and as described above.
- the detected input may comprise a user input.
- the user input may be detected using the user input device 17 of the examplary apparatus illustrated in Fig. 1 .
- the user input which is detected may comprise an indication from the user that they would like an image to be captured.
- the user input may comprise a user selection of an imaging processing algorithm which is to be used on the captured images.
- a plurality of image processing algorithms which may be used may be determined. In some embodiments a plurality of image processing algorithms may be available to be used on images captured by the image capturing apparatus 1 .
- the method may comprise determining which algorithms are likely to provide the best images and selecting these algorithms from the plurality of algorithms available.
- the image processing algorithms which are selected to be used may be determined using the detected input.
- the detected input may comprise user selection of an algorithm.
- the image processing algorithms selected at block 53 may comprise at least the image processing algorithm selected by the user.
- the plurality of image processing algorithms selected at block 53 may also include image processing algorithms which have not been selected by the user.
- the automatically selected image processing algorithms may be selected based on detected physical conditions.
- the physical conditions may be determined by image analysis.
- the at least one detector 21 may be used to detect the physical conditions.
- the detected physical condition may comprise a physical condition of the image capturing apparatus.
- the detected physical condition may comprise a physical condition such as a distance to an object to be imaged, motion of the image capturing apparatus or any other suitable physical condition.
- the detected physical condition may comprise a physical condition of an object to be imaged.
- the detected physical condition may comprise a physical condition such as lux level, contrast of a scene to be imaged, dimensions of object, type of object, motion of the object or any other suitable physical condition.
- the distance between the image capturing apparatus 13 and the object to be imaged may be used to select whether or not it is appropriate to use a flash to capture the images and so determine which image processing algorithms may be appropriate to use.
- a face or other type of object is to be imaged. This may be determined, for example, by performing image analysis. In such case the image processing algorithms which are selected may be suitable for providing high quality reproductions of the face or other type of object.
- the image processing algorithms which are selected may require a plurality of different images or subsets of images to be captured.
- the method may also comprise, at block 53 determining the sequence in which the plurality of images are to be captured.
- the sequence in which the plurality of images are to be captured may be determined automatically without any further input from the user of the apparatus 1 .
- the physical conditions which may have been detected by the at least one detector 21 may be used to determine the sequence in which the subsets of images are to be captured.
- the subsets of images may be prioritised such that the subsets of images associated with image processing algorithms which have been selected by a user may be captured first or with a higher priority.
- the image processing algorithms which are selected automatically may be automatically prioritized.
- the automatic prioritization may be based on detected physical conditions. The automatic prioritization may determine which image processing algorithms are likely to give the highest quality images and give these a higher priority than other image processing algorithms.
- the subsets of images to be captured which are associated with the highest priority image processing algorithms may then be given a higher priority than the subsets of images to be captured which are associated with the lower priority image processing algorithms.
- the subsets of images may then be captured in order of the determined priority.
- the subsets of images may be prioritized so that each subset of images is captured sequentially. In such embodiments all of the images associated with a first subset of images are captured, followed by all of the images of a second subset and then all of the images for a further subset. In other embodiments the images may be prioritized so that some images for a second subset images may be captured before all of the images associated with a first subset of images is captured. This allows for prioritization of images rather than subsets of images.
- the plurality of images are captured.
- the at least one processor 3 may provide control signals to the image capturing apparatus 13 to enable the plurality of images to be captured in the sequence determined at block 43.
- the plurality of images may be captured as described above in relation to block 43 of Fig. 3.
- An example of the logic which may be used to determine which image processing algorithms should be used and how the image capturing apparatus 13 needs to be configured may be as follows:
- the apparatus 1 may be used to capture images for a HDR algorithm and a flash-no-flash (FNF) image processing algorithm. Two images may be captured for the FNF algorithm and 3 images may be captured for the HDR algorithm. In such embodiments the images may be captured in the sequence HDR1 , FNF1 , HDR2, HDR3, FNF2 so that some of the images for the FNF algorithm are captured before all of the images are captured for the HDR image, even if the HDR algorithm has been assigned a higher priority.
- FNF flash-no-flash
- some of the images used for the FNF algorithm and the HDR algorithm may be the same.
- the sequence of images used may comprise FNF1 , COMMON, HDR2, HDR3.
- the FNF2 and HDR1 image are the same. It is to be appreciated that in other implementations other images could be the common images.
- the plurality of captured images may be stored in the one or more memories 5.
- the plurality of captured images may be stored in the one or more memories 5 so as to enable the plurality of image processing algorithms selected at block 53 to be performed on the captured images.
- the image processing of the stored images may occur automatically without any further user input.
- the user may then be provided with processed images on the display 25.
- the user may then be able to select between the automatically processed images.
- the image processing of the stored images may occur in response to a user input.
- the user may be informed which algorithms may be used on the subsets of the stored images and may be able to select the image processing algorithms which they would like to be carried out.
- the apparatus 1 may also be configured so that the user may also be able to select an image without performing any image processing on the images.
- the image processing may be carried out by the apparatus 1 .
- the captured images may be stored in the one or more memories so that the image processing may be carried out at a later date by a different apparatus.
- Embodiments of the disclosure provide an apparatus which may be used to capture a plurality of images which enable a plurality of different image processing algorithms to be used. This means that a user does not need to know which image processing algorithms may give the best quality images as a plurality of different images may be captured automatically for use with a plurality of different image processing algorithms. This may enable the user to choose the image processing algorithm to be used after the images have been captured, which may make the apparatus 1 easier for a user to use to produce high quality images.
- inventions of the disclosure may enable a plurality of image processing algorithms to be selected based on detected physical conditions. This may enable different image processing algorithms to be selected for different physical conditions and so may enable higher quality images to be provided. Also in the embodiments of the disclosure the sequence in which the plurality of images are captured may be determined automatically. This may enable the images most likely to provide a high quality image to be captured first and so may enable high quality images to be provided to the user of the apparatus 1 even if the user does not have very much understanding of the image processing algorithms or the imaging conditions.
- the blocks illustrated in Figs. 3 and 4 may represent steps in a method and/or sections of code in the computer program 9. The illustration of a particular order to the blocks does not necessarily imply that there is a required or preferred order for the blocks and the order and arrangement of the block may be varied. Furthermore, it may be possible for some blocks to be omitted.
- an image which is captured may be a member of more than one subset of images.
- the image processing algorithms to be used comprise auto focus bracketing, exposure bracketing and a saturation bracketing image processing algorithm one or more images could be included in each of the different subsets of images associated with each image processing algorithm.
- meta data when an image is captured meta data may be assigned to the image.
- the meta data may comprise information indicative of the image processing algorithm or algorithms associated with the image.
- the meta data may also comprise information indicative of the parameters of the image capturing apparatus used to capture the image.
- the meta data may comprise information which may enable a user to select which image processing algorithms to use. Such information may be particularly beneficial if the image processing is being carried out at a later date after the images were captured.
- the image data which is input into the image processing algorithm may comprise any suitable type of data such as Raw Bayer, Processed Bayer, YUV, RGB, JPG, non-bayer Raw or any other suitable type of data.
- Different image processing algorithms may use different types of input data format. For example, a flash-no-flash image processing algorithm may use input data in a bayer format and a high dynamic range algorithm may use input data in a YUV format.
- more than one image processing algorithm may be applied to an image or subset of images.
- the output of a multiframe noise filter image processing algorithm may be used as an input for a high dynamic range image processing algorithm.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computing Systems (AREA)
- Theoretical Computer Science (AREA)
- Studio Devices (AREA)
- Image Processing (AREA)
Abstract
The Figures illustrate an apparatus, method, computer program and apparatus wherein the method comprises detecting an input;and in response to detecting the input, causing an image capturing apparatus to capture a plurality of images; wherein the image capturing apparatus is configured to have a first set of parameters to capture a first subset of the plurality of images such that the first subset of the plurality of images are configured for use with a first image processing algorithm and the image capturing apparatus is configured to have a second set of parameters to capture a second subset of the plurality of images such that the second subset of the plurality of images are configured for use with a second image processing algorithm.
Description
TITLE
Method, Apparatus and Computer Program for Capturing Images TECHNOLOGICAL FIELD
Embodiments of the present invention relate to a method, apparatus and computer program for capturing images. In particular, they relate to a method, apparatus and computer program for capturing images which may be used with an image processing algorithm.
BACKGROUND
Apparatus which enable a user to capture images such as digital cameras are known. Such apparatus may enable a user to select image processing algorithms to enable high quality images to be obtained in different lighting and imaging conditions. Such algorithms may comprise, for example, high dynamic range (HDR) algorithms or flash-no-flash algorithms. Some of these algorithms may require a plurality of images to be captured. The plurality of images may then be combined to provide a single image with modified image properties.
Such apparatus require a user to select which algorithm to use before the image is captured. This may make such apparatus more difficult for a user to use as, in order to obtain a high quality image, the user may need to understand a plurality of different types of algorithms which may be available as well as understand the effects that different imaging conditions, such as light levels and movement, would have on these algorithms. It may be beneficial to provide an apparatus for capturing images which is simpler for a user to use.
BRIEF SUMMARY
According to various, but not necessarily all, embodiments of the disclosure there is provided a method comprising; detecting an input; and in response to detecting the input, causing an image capturing apparatus to capture a plurality of images; wherein the image capturing apparatus is configured to have a first set of parameters to capture a first subset of the plurality of images such that the first subset of the plurality of images are configured for use with a first image processing algorithm and the image capturing apparatus is configured to have a second set of parameters to capture a second subset of the plurality of images such that the second subset of the plurality of images are configured for use with a second image processing algorithm. In some embodiments the image capturing apparatus may be configured to capture more than two subsets of images where for each of the subsets of images the image capturing apparatus is configured to have a different set of parameters to enable each of the subsets of images to be used with a different image processing algorithm.
In some embodiments the subsets of images may be captured in a sequence where the order of the sequence is determined by the image processing algorithms associated with each subset of images. The sequence in which the images are captured may be determined by a user input. The sequence in which the images are captured may be determined by a detected physical condition. The detected physical condition may comprise a physical condition of the image capturing apparatus. The detected physical condition may comprise at least one of a distance to an object to be imaged, motion of the image capturing apparatus. The detected physical condition may comprise a physical condition of an object to be imaged. The detected physical condition may comprise at least one of lux level, contrast of a scene to be imaged, dimensions of object, type of object, motion of the object.
In some embodiments of the disclosure the detected input may comprise a user input. In some embodiments of the disclosure the detected input may comprise a user selecting at least one image processing algorithm.
In some embodiments of the disclosure the method may further comprise storing the plurality of images such that the image processing algorithms may be performed on the stored images.
In some embodiments of the disclosure the image processing algorithms may be performed in response to a user input. In some embodiments of the disclosure the image processing algorithms may be performed automatically.
According to various, but not necessarily all, embodiments of the disclosure there is provided an apparatus comprising: at least one processor; and at least one memory including computer program code; wherein the at least one memory and the computer program code are configured to, with the at least one processor, enable the apparatus to: detect an input; and in response to detecting the input, cause an image capturing apparatus to capture a plurality of images; wherein the image capturing apparatus is configured to have a first set of parameters to capture a first subset of the plurality of images such that the first subset of the plurality of images are configured for use with a first image processing algorithm and the image capturing apparatus is configured to have a second set of parameters to capture a second subset of the plurality of images such that the second subset of the plurality of images are configured for use with a second image processing algorithm.
In some embodiments the image capturing apparatus may be configured to capture more than two subsets of images where for each of the subsets of images the image capturing apparatus is configured to have a different set of parameters to enable each of the subsets of images to be used with a different image processing algorithm. The image capturing apparatus may be configured to capture the subsets of images in a sequence where the order of the sequence is determined by the image processing algorithms associated with each subset of images. In some embodiments the sequence in which the images are captured may be determined by a user input. The sequence in which the images are captured may be determined by a detected physical condition. The detected physical condition may comprise a physical condition of the image capturing apparatus. The detected physical condition may comprise at least one of a distance to an object to be imaged, motion of the image capturing apparatus. The detected physical condition may comprise a physical condition of an object to be imaged. The detected physical condition may comprise at least one of lux level, contrast of a scene to be imaged, dimensions of object, type of object, motion of the object.
In some embodiments the detected input may comprise a user input. The detected input may comprises a user selecting at least one image processing algorithm.
In some embodiments the at least one memory and the computer program code may be further configured to, with the at least one processor, enable the apparatus to store the plurality of images such that the image processing algorithms may be performed on the stored images.
In some embodiments the at least one memory and the computer program code may be further configured to, with the at least one processor, enable the apparatus to perform the image processing algorithms in response to a user input.
In some embodiments the at least one memory and the computer program code may be further configured to, with the at least one processor, enable the apparatus to perform the image processing algorithms automatically. According to various, but not necessarily all, embodiments of the disclosure there is provided a computer program comprising computer program instructions that, when executed by at least one processor, enable an apparatus at least to perform: detecting an input; and in response to detecting the input, causing an image capturing apparatus to capture a plurality of images; wherein the image capturing apparatus is configured to have a first set of parameters to capture a first subset of the plurality of images such that the first subset of the plurality of images are configured for use with a first image processing algorithm and the image capturing apparatus is configured to have a second set of parameters to capture a second subset of the plurality of images such that the second subset of the plurality of images are configured for use with a second image processing algorithm.
In some embodiments the computer program may comprise program instructions for causing a computer to perform any of the methods described above.
In some embodiments there may be provided a physical entity embodying the computer program as described above. In some embodiments there may be provided an electromagnetic carrier signal carrying the computer program as described above.
The apparatus may be for capturing images.
BRIEF DESCRIPTION
For a better understanding of various examples of embodiments of the present disclosure reference will now be made by way of example only to the accompanying drawings in which:
Fig. 1 schematically illustrates an apparatus according to an examplary embodiment of the disclosure;
Fig. 2 illustrates a touch sensitive display configured to provide a tactile indication according to a second examplary embodiment of the disclosure; Fig. 3 is a block diagram which schematically illustrates a method according to an examplary embodiment of the disclosure; and
Fig. 4 is a block diagram which schematically illustrates a method according to another examplary embodiment of the disclosure.
DETAILED DESCRIPTION The Figures illustrate an apparatus 1 , method, computer program 9 and apparatus 1 wherein the method comprises detecting 41 , 51 an input; and in response to detecting 41 , 51 the input, causing 43, 55 an image capturing apparatus 13 to capture a plurality of images; wherein the image capturing apparatus 13 is configured to have a first set of parameters to capture a first subset of the plurality of images such that the first subset of the plurality of images are configured for use with a first image processing algorithm and the image capturing apparatus 13 is configured to have a second set of parameters to capture a second subset of the plurality of images such that the second subset of the plurality of images are configured for use with a second image processing algorithm.
Fig. 1 schematically illustrates an apparatus 1 according to an exemplary embodiment of the invention. The apparatus 1 may be an electronic apparatus which is configured to enable images to be captured. The apparatus 1 may be, for example, a camera, a mobile cellular telephone, a personal computer or any other apparatus which may be configured to enable images to be captured. The apparatus 1 may be a handheld apparatus 1
which can be carried in a user's hand, handbag or pocket of their clothing for example.
Only features referred to in the following description are illustrated in Fig. 1 . However, it should be appreciated that the apparatus 1 may comprise additional features that are not illustrated. For example, in embodiments of the invention where the apparatus 1 is a mobile cellular telephone, the apparatus 1 may also comprise a transmitter and receiver configured to enable wireless communication.
The apparatus 1 schematically illustrated in Fig. 1 comprises: a controller 4, an image capturing apparatus 13, at least one detector 21 and a user interface 23. The controller 4, image capturing apparatus 13, detector 21 and user interface 23 are operationally coupled. It is to be appreciated that any number or combination of intervening elements may be provided between the respective components of the apparatus 1 including no intervening elements. The controller 4, image capturing apparatus 13, detector 21 and user interface 23 may be located within a housing. In the illustrated embodiment the controller 4 comprises at least one processor 3 and at least one memory 5. The controller 4 provides means for controlling the apparatus 1 . The controller 4 may be implemented using instructions that enable hardware functionality, for example, by using executable computer program instructions 1 1 in one or more general-purpose or special-purpose processors 3 that may be stored on a computer readable storage medium 29 (e.g. disk, memory etc) to be executed by such processors 3.
The controller 4 may be configured to control the apparatus 1 to perform a plurality of different functions. For example the controller 4 may be configured to control the apparatus 1 to capture and store images. In some
embodiments of the disclosure the controller 4 may also be configured to perform image processing on the captured images.
The controller 4 may also be configured to enable the apparatus 1 to detect 41 , 51 an input; and in response to detecting 41 , 51 the input, cause 43, 55 the image capturing apparatus 13 to capture a plurality of images; wherein the image capturing apparatus 13 is configured to have a first set of parameters to capture a first subset of the plurality of images such that the first subset of the plurality of images are configured for use with a first image processing algorithm and the image capturing apparatus 13 is configured to have a second set of parameters to capture a second subset of the plurality of images such that the second subset of the plurality of images are configured for use with a second image processing algorithm. The at least one processor 3 may be configured to receive input commands from the user interface 23, the image capturing apparatus 13 and the detector 21 . The at least one processor may also be configured to provide output commands to the user interface 23, the image capturing apparatus 13 and the detector 21 . The at least one processor 3 is also configured to write to and read from the at least one memory 5.
In the examplary embodiment illustrated in Fig. 1 the image capturing apparatus 13 comprises an optical arrangement 17 and an image sensor 15. In some embodiments of the disclosure the image capturing apparatus 13 may also comprise one or more drives 19.
The image sensor 15 may comprise any means which is configured to convert light incident on the image sensor 15 into an electrical signal to enable an image to be produced. The image sensor 15 may comprise, for example, a digital image sensor such as a charge-coupled-device (CCD) or a complementary metal-oxide-semiconductor (CMOS). The at least one processor 3 may be configured to receive inputs from the image sensor 15.
For example, the at least one processor 3 may be configured to retrieve an electrical signal comprising image data from the image sensor 15 and store it in the at least one memory 5. The image data may be in the form of a still image or a video image
The optical arrangement 17 may comprise any means configured to focus or deflect incident light from an object onto the image sensor 15. The optical arrangement 17 may receive the incident light from an object or scene external to the apparatus 1 through an aperture in a housing of the apparatus 1 . The optical arrangement 17 may comprise, for example, one or more optical devices such as one or more lenses.
In some examplary embodiments of the disclosure the apparatus 1 may also comprise one or more drives 19. The one or more drives 19 may comprise any means which enables movement of at least part of the optical arrangement 17 relative to the image sensor 15. In some examplary embodiments of the disclosure the one or more drives 19 may comprise an electric motor. In embodiments of the disclosure, where the optical arrangement 17 comprises a plurality of components, the one or more drives may enable movement of some or all of the plurality of components.
The apparatus 1 may also comprise one or more detectors 21 . The detectors 21 may comprise any means which may be configured to detect a physical condition and provide an input to the controller 4 indicative of the detected condition.
In some embodiments of the disclosure the one or more detectors 21 may comprise detectors configured to detect a physical condition of the apparatus 1 or image capturing apparatus 13. For example the physical condition may comprise motion of the apparatus 1 or image capturing apparatus 13. In such embodiments the detector 21 may comprise any suitable means for detecting
motion of apparatus 1 or image capturing apparatus 13 such as one or more accelerometers and/or a gyroscope.
In other embodiments the detected physical condition may comprise the distance between the apparatus 1 and an object which is to be imaged. In such embodiments the at least one detector 21 may comprise a detector for detecting a reflected signal such as an ultra-sound or infra red signal or any other suitable detectors. In some embodiments of the disclosure the one or more detectors 21 may comprise detectors configured to detect a physical condition of the scene or object to be imaged. For example, the one or more detectors 21 may be configured to detect the lux level, the contrast of a scene, the dimensions of an object, the type of object to be imaged or motion of the object or any other suitable physical condition. In such embodiments the at least one detector 21 may comprise a light level sensor, means for detecting a reflected signal such as an ultra-sound or infra red signal or any other suitable detectors.
In the examplary embodiment illustrated in Fig. 1 the user interface 23 comprises a user input device 27 and a display 25.
The user input device 27 may comprise any means which enables a user input to be detected. The detection of a user input may enable the user of the apparatus 1 to input information which may be used to control the apparatus 1 . For example the user input device 27 may enable a user to make an input indicating that an image should be captured by the image capturing apparatus 13. In some embodiments of the disclosure the user input device 27 may also enable the user to make a user input selecting one or more imaging processing algorithms which should be used to process the captured images. The user input device 27 may comprise a touch sensitive display, a keypad or a combination of a number of different types of user input devices.
The display 25 may comprise any means which enables information to be displayed to a user of the apparatus 1 . The information displayed on the display 25 may comprise images which have been captured by the image capturing apparatus 13. The information displayed on the display 25 may comprise images which have been stored in the one or more memories 5.
The at least one memory 5 may be configured to store a computer program code 9 comprising computer program instructions 1 1 that control the operation of the apparatus 1 when loaded into the at least one processor 3. The computer program instructions 1 1 provide the logic and routines that enable the apparatus 1 to perform the methods illustrated in Figs. 3 and 4. The at least one processor 3 by reading the at least one memory 5 is able to load and execute the computer program 9.
The computer program instructions 1 1 may provide computer readable program means configured to control the apparatus 1 . The program instructions 1 1 may provide, when loaded into the controller 4; means for detecting 41 , 51 an input; and means for causing 43, 55, in response to detecting 41 , 51 the input, an image capturing apparatus 13 to capture a plurality of images; wherein the image capturing apparatus 13 is configured to have a first set of parameters to capture a first subset of the plurality of images such that the first subset of the plurality of images are configured for use with a first image processing algorithm and the image capturing apparatus 13 is configured to have a second set of parameters to capture a second subset of the plurality of images such that the second subset of the plurality of images are configured for use with a second image processing algorithm.
The computer program 9 may arrive at the apparatus 1 via any suitable delivery mechanism 31 . The delivery mechanism 31 may be, for example, a computer-readable storage medium, a computer program product 29, a memory device, a record medium such as a CD-ROM or DVD, an article of
manufacture that tangibly embodies the computer program 9. The delivery mechanism may be a signal configured to reliably transfer the computer program 9. The apparatus 1 may propagate or transmit the computer program 9 as a computer data signal.
Although the memory 5 is illustrated as a single component it may be implemented as one or more separate components some or all of which may be integrated/removable and/or may provide permanent/semi-permanent/ dynamic/cached storage.
References to 'computer-readable storage medium', 'computer program product', 'tangibly embodied computer program' etc. or a 'controller', 'computer', 'processor' etc. should be understood to encompass not only computers having different architectures such as single/multi- processor architectures and sequential (e.g. Von Neumann)/parallel architectures but also specialized circuits such as field-programmable gate arrays (FPGA), application integration specific circuits (ASIC), signal processing devices and other devices. References to computer program, instructions, code etc. should be understood to encompass software for a programmable processor or firmware such as, for example, the programmable content of a hardware device whether instructions for a processor, or configuration settings for a fixed-function device, gate array or programmable logic device etc.
Fig. 2 illustrates an apparatus 1 ' according to another embodiment of the invention. The apparatus 1 ' illustrated in Fig. 2 may be a chip or a chip-set. The apparatus 1 ' comprises at least one processor 2 and at least one memory 5 as described above in relation to Fig. 1 .
Figs. 3 and 4 schematically illustrate methods according to embodiments of the disclosure. The embodiments may be implemented using the apparatus 1 , 1 ' of Figs. 1 and 2.
At block 41 of the examplary method illustrated in Fig. 3 an input is detected. The input may comprise any external event which may be detected by the apparatus 1 . In some embodiments of the disclosure the input may comprise a user input. In such embodiments the user input may be detected using the user input device 27 of the examplary apparatus 1 illustrated in Fig. 1 .
The user input which is detected at block 41 may comprise an indication from the user that they would like an image to be captured. In some embodiments of the disclosure the user input which is detected at block 41 may comprise a user selection of an imaging processing algorithm which is to be used on the images captured in response to the input.
At block 43, in response to the detection of the input at block 41 , a plurality of images are captured. The plurality of images may be captured using the image capturing apparatus 13 as described above in relation to Fig. 1 .
In the examplary embodiment of the disclosure the plurality of images captured at block 43 comprises a plurality of subsets of images. For example, the plurality of images captured may comprise a first subset of images and a second subset of images. Each of the subset of images may comprise one or more images. It is to be appreciated that any number of subsets of images may be captured. It also to be appreciated that each of the subsets of images may comprise any number of individual images. In some embodiments of the disclosure each of the subsets of images may be distinct so that there is no overlap between the different subsets of images. In such embodiments each image which is captured is only a member of one subset of images. In other embodiments of the disclosure there may be some overlap between the different subsets of images. In such embodiments an image which is captured may be a member of more than one subset of images. Therefore, in some embodiments of the disclosure some of the subsets of images may share one or more common images.
In examplary embodiments of the disclosure the subsets of images which are captured may be associated with different image processing algorithms. The image capturing apparatus 13 may capture the images such that the captured images are suitable for use with different image processing algorithms. This may enable different image processing algorithms to be used on the different subsets of images. In examplary embodiments of the disclosure where the detected input comprises a user input, at least one of the image processing algorithms which is associated with a subset of images may comprise an algorithm which has been selected by the user of the apparatus 1 .
As mentioned above, in some embodiments of the disclosure, some of the subsets of images may share one or more common images. In such embodiments a single image may be associated with different image processing algorithms.
The image processing algorithms may comprise any algorithms which may be used to modify the images captured by the image sensor 15. In some embodiments of the disclosure the image processing algorithms may comprise algorithms which combine a plurality of different images. Therefore these algorithms may require a plurality of images to be captured. The plurality of different images may be captured simultaneously using different imaging sensors 15 or sequentially over a short period of time so that the images are of the same scene or object.
Image processing algorithms which may be used in examplary embodiments of the disclosure may comprise high dynamic range (HDR) algorithms, flash- no-flash algorithms, bracketing algorithms such as focus bracketing, multi- frame noise filtering, super-resolution, panoramic imaging algorithms, night time imaging algorithms aperture bracketing or any other suitable image processing algorithms.
In the examplary embodiments of the disclosure the image capturing apparatus 13 may be configured to have a first set of parameters to capture a first subset of the plurality of images and the image capturing apparatus 13 may be configured to have a second set of parameters to capture a second subset of the plurality of images. In some embodiments of the disclosure each image may be captured with the image capturing apparatus 13 in a different configuration. A single image may be part of more than one subset and so may be used with more than one different image processing algorithm.
The parameters of the image capturing apparatus 13 may comprise any physical characteristic of the image capturing apparatus 13 which may affect the properties of the images provided by the image sensor 15. For example, in some embodiments of the disclosure the parameters may comprise, the exposure time, the size of the aperture, the focal length of the optical arrangement 17, the relative distance between the optical arrangement 17 and the image sensor 15 whether or not flash is used and variation in gain or any other suitable parameter. The parameters of the imaging apparatus 13 may affect properties of the images provided by the image sensor 15 such as the resolution of the image, the contrast of the image, which portions within the image are in focus or any other suitable property. Where the parameter comprises the relative distance between the optical arrangement 17 and the image sensor 15 this may be varied using the one or more drives 19.
The parameters of imaging apparatus 13 may be controlled so that the images which are captured are suitable for use with the image processing algorithms. For example, when capturing the first subset of the plurality of images the image processing apparatus 13 may be configured to have a first set of parameters such that the images produced by the image sensor 15 are suitable for use with an algorithm associated with the first subset of images. Similarly, when capturing the second subset of the plurality of images the image processing apparatus 13 may be configured to have a second set of parameters such that the images produced by the image sensor 15 are
suitable for use with an algorithm associated with the second subset of images. In some embodiments of the disclosure the image processing apparatus 13 may be configured to have a different set of parameters for each subset of images which may enable each subset of captured images to be used with a different image processing algorithm.
In some embodiments of the disclosure the images within the subsets of images may be captured using different parameters of the image capturing apparatus 13. For example, where a subset of images comprises a plurality of images each image within the subset of images may be captured with the image capturing apparatus 13 having a different set of parameters. For instance, where the image processing algorithm comprises a flash no flash algorithm the subset of images may comprise at least two images. When a first image is captured the image capturing apparatus 13 may be configured to provide a flash and when a second image is captured the image capturing apparatus 13 may be configured to provide no flash.
Similarly where the image processing algorithm comprises a HDR algorithm the subset of images may comprise a plurality of images where each of the images has a different exposure value. When a first image is captured the image capturing apparatus 13 may be configured to have a first exposure time and aperture size. When a second image is captured the image capturing apparatus 13 may be configured to have a second exposure time and aperture size which may be different to the first exposure time and aperture size.
It is to be appreciated that more than two subsets of images may be captured. Each of the subsets of images may be associated with a different processing algorithm so that for each of the subsets of images the image capturing apparatus 13 has a different set of parameters.
In embodiments of the disclosure where the method is implemented using the apparatus 1 of Figs. 1 and 2 the at least one memory 5 may store computer code which enables the image capturing apparatus 13 to be configured to have the parameters needed to capture images for use with the available algorithms. Configuring the image capturing apparatus 13 to have different parameters may comprise using the drive 19 to move the optical arrangement 17 relative to the image sensor 15, varying the exposure time used, varying the aperture available or any other suitable change in parameters. The at least one memory 5 may also store computer code which enables the available algorithms to be implemented on the plurality of captured images.
Fig. 4 illustrates a method according to another embodiment of the disclosure which may also be implemented using an apparatus 1 , 1 ' as illustrated in Figs. 1 and 2 and as described above.
At block 51 of the method illustrated in Fig. 4 an input is detected. As described above in relation to Fig. 3 the detected input may comprise a user input. For example the user input may be detected using the user input device 17 of the examplary apparatus illustrated in Fig. 1 . The user input which is detected may comprise an indication from the user that they would like an image to be captured. In some embodiments of the disclosure the user input may comprise a user selection of an imaging processing algorithm which is to be used on the captured images. At block 53, in response to the detection of the input, a plurality of image processing algorithms which may be used may be determined. In some embodiments a plurality of image processing algorithms may be available to be used on images captured by the image capturing apparatus 1 . In such embodiments the method may comprise determining which algorithms are likely to provide the best images and selecting these algorithms from the plurality of algorithms available.
The image processing algorithms which are selected to be used may be determined using the detected input. For example, the detected input may comprise user selection of an algorithm. In such embodiments the image processing algorithms selected at block 53 may comprise at least the image processing algorithm selected by the user.
In some examplary embodiments the plurality of image processing algorithms selected at block 53 may also include image processing algorithms which have not been selected by the user. In such embodiments the automatically selected image processing algorithms may be selected based on detected physical conditions. In some embodiments the physical conditions may be determined by image analysis.
In some embodiments of the disclosure the at least one detector 21 , as described above in relation to Fig. 1 may be used to detect the physical conditions.
In some examplary embodiments of the disclosure the detected physical condition may comprise a physical condition of the image capturing apparatus. In such examplary embodiments the detected physical condition may comprise a physical condition such as a distance to an object to be imaged, motion of the image capturing apparatus or any other suitable physical condition. In some examplary embodiments of the disclosure the detected physical condition may comprise a physical condition of an object to be imaged. In such examplary embodiments the detected physical condition may comprise a physical condition such as lux level, contrast of a scene to be imaged, dimensions of object, type of object, motion of the object or any other suitable physical condition.
For example, in some embodiments of the disclosure the distance between the image capturing apparatus 13 and the object to be imaged may be used to select whether or not it is appropriate to use a flash to capture the images and so determine which image processing algorithms may be appropriate to use.
In another example, it may be determined that a face or other type of object is to be imaged. This may be determined, for example, by performing image analysis. In such case the image processing algorithms which are selected may be suitable for providing high quality reproductions of the face or other type of object.
The image processing algorithms which are selected may require a plurality of different images or subsets of images to be captured. In some examplary embodiments the method may also comprise, at block 53 determining the sequence in which the plurality of images are to be captured. The sequence in which the plurality of images are to be captured may be determined automatically without any further input from the user of the apparatus 1 . The physical conditions which may have been detected by the at least one detector 21 may be used to determine the sequence in which the subsets of images are to be captured.
The subsets of images may be prioritised such that the subsets of images associated with image processing algorithms which have been selected by a user may be captured first or with a higher priority. The image processing algorithms which are selected automatically may be automatically prioritized. The automatic prioritization may be based on detected physical conditions. The automatic prioritization may determine which image processing algorithms are likely to give the highest quality images and give these a higher priority than other image processing algorithms. The subsets of images to be captured which are associated with the highest priority image processing algorithms may then be given a higher priority than the subsets of images to
be captured which are associated with the lower priority image processing algorithms. The subsets of images may then be captured in order of the determined priority. In some embodiments of the disclosure the subsets of images may be prioritized so that each subset of images is captured sequentially. In such embodiments all of the images associated with a first subset of images are captured, followed by all of the images of a second subset and then all of the images for a further subset. In other embodiments the images may be prioritized so that some images for a second subset images may be captured before all of the images associated with a first subset of images is captured. This allows for prioritization of images rather than subsets of images.
At block 55 of the method of Fig. 4 the plurality of images are captured. The at least one processor 3 may provide control signals to the image capturing apparatus 13 to enable the plurality of images to be captured in the sequence determined at block 43. The plurality of images may be captured as described above in relation to block 43 of Fig. 3. An example of the logic which may be used to determine which image processing algorithms should be used and how the image capturing apparatus 13 needs to be configured may be as follows:
If flash is proposed (for example, by user selection), images for use with flash- no-flash algorithm are captured
Elseif low light conditions are detected, images for use with multiframe noise filter algorithm are captured
Elseif high contrast within the scene to be imaged is detected, images for use with HDR algorithm are captured
Else images for use with superresolution algorithm (MM1 ) are captured.
It is to be appreciated that other logic and algorithms may be used in other implementations of the disclosure.
For instance in other exemplary embodiments of the disclosure the apparatus 1 may be used to capture images for a HDR algorithm and a flash-no-flash (FNF) image processing algorithm. Two images may be captured for the FNF algorithm and 3 images may be captured for the HDR algorithm. In such embodiments the images may be captured in the sequence HDR1 , FNF1 , HDR2, HDR3, FNF2 so that some of the images for the FNF algorithm are captured before all of the images are captured for the HDR image, even if the HDR algorithm has been assigned a higher priority.
In some embodiments some of the images used for the FNF algorithm and the HDR algorithm may be the same. In such embodiments the sequence of images used may comprise FNF1 , COMMON, HDR2, HDR3. In this examplary embodiment the FNF2 and HDR1 image are the same. It is to be appreciated that in other implementations other images could be the common images.
At block 57 the plurality of captured images may be stored in the one or more memories 5. The plurality of captured images may be stored in the one or more memories 5 so as to enable the plurality of image processing algorithms selected at block 53 to be performed on the captured images.
In some embodiments of the disclosure the image processing of the stored images may occur automatically without any further user input. The user may then be provided with processed images on the display 25. The user may then be able to select between the automatically processed images.
In some embodiments of the disclosure the image processing of the stored images may occur in response to a user input. For example the user may be informed which algorithms may be used on the subsets of the stored images and may be able to select the image processing algorithms which they would like to be carried out. The apparatus 1 may also be configured so that the
user may also be able to select an image without performing any image processing on the images.
The image processing may be carried out by the apparatus 1 . In some embodiments the captured images may be stored in the one or more memories so that the image processing may be carried out at a later date by a different apparatus.
Embodiments of the disclosure provide an apparatus which may be used to capture a plurality of images which enable a plurality of different image processing algorithms to be used. This means that a user does not need to know which image processing algorithms may give the best quality images as a plurality of different images may be captured automatically for use with a plurality of different image processing algorithms. This may enable the user to choose the image processing algorithm to be used after the images have been captured, which may make the apparatus 1 easier for a user to use to produce high quality images.
Also embodiments of the disclosure may enable a plurality of image processing algorithms to be selected based on detected physical conditions. This may enable different image processing algorithms to be selected for different physical conditions and so may enable higher quality images to be provided. Also in the embodiments of the disclosure the sequence in which the plurality of images are captured may be determined automatically. This may enable the images most likely to provide a high quality image to be captured first and so may enable high quality images to be provided to the user of the apparatus 1 even if the user does not have very much understanding of the image processing algorithms or the imaging conditions.
The blocks illustrated in Figs. 3 and 4 may represent steps in a method and/or sections of code in the computer program 9. The illustration of a particular order to the blocks does not necessarily imply that there is a required or preferred order for the blocks and the order and arrangement of the block may be varied. Furthermore, it may be possible for some blocks to be omitted.
Although embodiments of the present invention have been described in the preceding paragraphs with reference to various examples, it should be appreciated that modifications to the examples given can be made without departing from the scope of the invention as claimed. For example, in some embodiments of the disclosure an image which is captured may be a member of more than one subset of images. For example where the image processing algorithms to be used comprise auto focus bracketing, exposure bracketing and a saturation bracketing image processing algorithm one or more images could be included in each of the different subsets of images associated with each image processing algorithm.
In some embodiments of the disclosure when an image is captured meta data may be assigned to the image. The meta data may comprise information indicative of the image processing algorithm or algorithms associated with the image. The meta data may also comprise information indicative of the parameters of the image capturing apparatus used to capture the image. The meta data may comprise information which may enable a user to select which image processing algorithms to use. Such information may be particularly beneficial if the image processing is being carried out at a later date after the images were captured.
In some embodiments of the disclosure there may be additional processing performed on the image data in addition to the image processing algorithms. For example, the image data which is input into the image processing algorithm may comprise any suitable type of data such as Raw Bayer, Processed Bayer, YUV, RGB, JPG, non-bayer Raw or any other suitable type
of data. Different image processing algorithms may use different types of input data format. For example, a flash-no-flash image processing algorithm may use input data in a bayer format and a high dynamic range algorithm may use input data in a YUV format.
In some embodiments of the disclosure more than one image processing algorithm may be applied to an image or subset of images. For example the output of a multiframe noise filter image processing algorithm may be used as an input for a high dynamic range image processing algorithm.
Features described in the preceding description may be used in combinations other than the combinations explicitly described.
Although functions have been described with reference to certain features, those functions may be perfornnable by other features whether described or not.
Although features have been described with reference to certain embodiments, those features may also be present in other embodiments whether described or not.
Whilst endeavoring in the foregoing specification to draw attention to those features of the invention believed to be of particular importance it should be understood that the Applicant claims protection in respect of any patentable feature or combination of features hereinbefore referred to and/or shown in the drawings whether or not particular emphasis has been placed thereon.
I/we claim:
Claims
1. A method comprising;
detecting an input; and
in response to detecting the input, causing an image capturing apparatus to capture a plurality of images; wherein
the image capturing apparatus is configured to have a first set of parameters to capture a first subset of the plurality of images such that the first subset of the plurality of images are configured for use with a first image processing algorithm and the image capturing apparatus is configured to have a second set of parameters to capture a second subset of the plurality of images such that the second subset of the plurality of images are configured for use with a second image processing algorithm.
2. A method as claimed in claim 1 wherein the image capturing apparatus is configured to capture more than two subsets of images where for each of the subsets of images the image capturing apparatus is configured to have a different set of parameters to enable each of the subsets of images to be used with a different image processing algorithm.
3. A method as claimed in claim 2 wherein the subsets of images are captured in a sequence where the order of the sequence is determined by the image processing algorithms associated with each subset of images.
4. A method as claimed in claim 3 wherein the sequence in which the images are captured is determined by a user input.
5. A method as claimed in any of claims 3 to 4 wherein the sequence in which the images are captured is determined by a detected physical condition.
6. A method as claimed in claim 5 wherein the detected physical condition comprises a physical condition of the image capturing apparatus.
7. A method as claimed in claim 6 wherein the detected physical condition comprises at least one of a distance to an object to be imaged, motion of the image capturing apparatus.
8. A method as claimed in any of claims 6 to 5 wherein the detected physical condition comprises a physical condition of an object to be imaged.
9. A method as claimed in claim 8 wherein the detected physical condition comprises at least one of lux level, contrast of a scene to be imaged, dimensions of object, type of object, motion of the object.
10. A method as claimed in any preceding claim wherein the detected input comprises a user input.
1 1 . A method as claimed in claim 10 wherein the detected input comprises a user selecting at least one image processing algorithm.
12. A method as claimed in any preceding claim wherein the method further comprises storing the plurality of images such that the image processing algorithms may be performed on the stored images.
13. A method as claimed in any preceding claim wherein the image processing algorithms are performed in response to a user input.
14. A method as claimed in any preceding claim wherein the image processing algorithms are performed automatically.
15. An apparatus comprising:
at least one processor; and at least one memory including computer program code; wherein the at least one memory and the computer program code are configured to, with the at least one processor, enable the apparatus to:
detect an input; and
in response to detecting the input, cause an image capturing apparatus to capture a plurality of images; wherein
the image capturing apparatus is configured to have a first set of parameters to capture a first subset of the plurality of images such that the first subset of the plurality of images are configured for use with a first image processing algorithm and the image capturing apparatus is configured to have a second set of parameters to capture a second subset of the plurality of images such that the second subset of the plurality of images are configured for use with a second image processing algorithm.
16. An apparatus as claimed in claim 15 wherein the image capturing apparatus is configured to capture more than two subsets of images where for each of the subsets of images the image capturing apparatus is configured to have a different set of parameters to enable each of the subsets of images to be used with a different image processing algorithm.
17. An apparatus as claimed in claim 16 wherein the image capturing apparatus is configured to capture the subsets of images in a sequence where the order of the sequence is determined by the image processing algorithms associated with each subset of images.
18. An apparatus as claimed in claim 17 wherein the sequence in which the images are captured is determined by a user input.
19. An apparatus as claimed in any of claims 17 to 18 wherein the sequence in which the images are captured is determined by a detected physical condition.
20. An apparatus as claimed in claim 19 wherein the detected physical condition comprises a physical condition of the image capturing apparatus.
21 . An apparatus as claimed in claim 20 wherein the detected physical condition comprises at least one of a distance to an object to be imaged, motion of the image capturing apparatus.
22. An apparatus as claimed in any of claims 19 to 21 wherein the detected physical condition comprises a physical condition of an object to be imaged.
23. An apparatus as claimed in claim 22 wherein the detected physical condition comprises at least one of lux level, contrast of a scene to be imaged, dimensions of object, type of object, motion of the object.
24. An apparatus as claimed in any of claims 15 to 23 wherein the detected input comprises a user input.
25. An apparatus as claimed in claim 24 wherein the detected input comprises a user selecting at least one image processing algorithm.
26. An apparatus as claimed in any of claims 15 to 25 wherein the at least one memory and the computer program code are further configured to, with the at least one processor, enable the apparatus to store the plurality of images such that the image processing algorithms may be performed on the stored images.
27. An apparatus as claimed in any of claims 15 to 26 wherein the at least one memory and the computer program code are further configured to, with the at least one processor, enable the apparatus to perform the image processing algorithms in response to a user input.
28. An apparatus as claimed in any of claims 15 to 27 wherein the at least one memory and the computer program code are further configured to, with the at least one processor, enable the apparatus to perform the image processing algorithms automatically.
29. A computer program comprising computer program instructions that, when executed by at least one processor, enable an apparatus at least to perform:
detecting an input; and
in response to detecting the input, causing an image capturing apparatus to capture a plurality of images; wherein
the image capturing apparatus is configured to have a first set of parameters to capture a first subset of the plurality of images such that the first subset of the plurality of images are configured for use with a first image processing algorithm and the image capturing apparatus is configured to have a second set of parameters to capture a second subset of the plurality of images such that the second subset of the plurality of images are configured for use with a second image processing algorithm.
30. A computer program comprising program instructions for causing a computer to perform the method of any of claims 1 to 14.
31 . A physical entity embodying the computer program as claimed in any of claims 29 to 30.
32. An electromagnetic carrier signal carrying the computer program as claimed in any of claims 29 to 30.
Priority Applications (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP12871128.0A EP2792139A4 (en) | 2012-03-15 | 2012-03-15 | Method, apparatus and computer program for capturing images |
CN201280071271.5A CN104170369B (en) | 2012-03-15 | 2012-03-15 | Method, equipment and computer-readable recording medium for capture images |
US14/383,130 US9621796B2 (en) | 2012-03-15 | 2012-03-15 | Method, apparatus and computer program for capturing images with multiple image capture and image modification |
PCT/IB2012/051249 WO2013136134A1 (en) | 2012-03-15 | 2012-03-15 | Method, apparatus and computer program for capturing images |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/IB2012/051249 WO2013136134A1 (en) | 2012-03-15 | 2012-03-15 | Method, apparatus and computer program for capturing images |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2013136134A1 true WO2013136134A1 (en) | 2013-09-19 |
Family
ID=49160315
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/IB2012/051249 WO2013136134A1 (en) | 2012-03-15 | 2012-03-15 | Method, apparatus and computer program for capturing images |
Country Status (4)
Country | Link |
---|---|
US (1) | US9621796B2 (en) |
EP (1) | EP2792139A4 (en) |
CN (1) | CN104170369B (en) |
WO (1) | WO2013136134A1 (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2016149012A1 (en) * | 2015-03-17 | 2016-09-22 | Microsoft Technology Licensing, Llc | Automatic image frame processing possibility detection |
Families Citing this family (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR101694076B1 (en) * | 2015-11-12 | 2017-01-17 | 현대자동차주식회사 | System and method for controlling torque intervention of hybrid electric vehicle |
WO2020034083A1 (en) * | 2018-08-14 | 2020-02-20 | Huawei Technologies Co., Ltd. | Image processing apparatus and method for feature extraction |
CN109243289B (en) * | 2018-09-05 | 2021-02-05 | 武汉中海庭数据技术有限公司 | Method and system for extracting parking spaces of underground garage in high-precision map manufacturing |
WO2021217463A1 (en) * | 2020-04-28 | 2021-11-04 | 深圳市大疆创新科技有限公司 | Image processing algorithm device, image processing method, and camera |
CN113949803B (en) * | 2020-07-16 | 2023-08-25 | 华为技术有限公司 | Photographing method and electronic equipment |
Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1292106A2 (en) * | 2001-09-04 | 2003-03-12 | Eastman Kodak Company | Camera having electronic images corresponding to current film images automatically excluded from first in-first out overwriting and method |
US20060012690A1 (en) | 2004-07-14 | 2006-01-19 | Konica Minolta Photo Imaging, Inc., | Image capturing apparatus and method of acquiring image |
US20060181614A1 (en) | 2005-02-17 | 2006-08-17 | Jonathan Yen | Providing optimized digital images |
US20070058064A1 (en) * | 2005-09-14 | 2007-03-15 | Sony Corporation | Image processing apparatus and method, and program therefor |
US7358988B1 (en) * | 1999-08-13 | 2008-04-15 | Fujifilm Corporation | Image signal processor for performing image processing appropriate for an output device and method therefor |
EP1950704A2 (en) * | 2007-01-26 | 2008-07-30 | Conversion Works, Inc. | Methodology for 3D scene reconstruction from 2D image sequences |
US20090153737A1 (en) * | 2007-12-17 | 2009-06-18 | Ati Technologies Ulc | Method, apparatus and machine-readable medium for apportioning video processing between a video source device and a video sink device |
WO2009097552A1 (en) * | 2008-02-01 | 2009-08-06 | Omnivision Cdm Optics, Inc. | Image data fusion systems and methods |
WO2012177149A1 (en) * | 2011-06-24 | 2012-12-27 | Tomra Systems Asa | Method and apparatus for detecting fraud attempts in reverse vending machines |
Family Cites Families (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7133070B2 (en) | 2001-09-20 | 2006-11-07 | Eastman Kodak Company | System and method for deciding when to correct image-specific defects based on camera, scene, display and demographic data |
JP3988461B2 (en) * | 2001-12-28 | 2007-10-10 | 株式会社ニコン | Electronic camera |
US7184590B2 (en) | 2002-07-17 | 2007-02-27 | Lockheed Martin Corporation | Algorithm selector |
US7881496B2 (en) * | 2004-09-30 | 2011-02-01 | Donnelly Corporation | Vision system for vehicle |
US7962033B2 (en) | 2008-01-23 | 2011-06-14 | Adobe Systems Incorporated | Methods and apparatus for full-resolution light-field capture and rendering |
US8537229B2 (en) * | 2008-04-10 | 2013-09-17 | Hankuk University of Foreign Studies Research and Industry—University Cooperation Foundation | Image reconstruction |
US8866920B2 (en) * | 2008-05-20 | 2014-10-21 | Pelican Imaging Corporation | Capturing and processing of images using monolithic camera array with heterogeneous imagers |
US8520979B2 (en) * | 2008-08-19 | 2013-08-27 | Digimarc Corporation | Methods and systems for content processing |
KR101520068B1 (en) * | 2008-12-16 | 2015-05-13 | 삼성전자 주식회사 | Apparatus and method of blending multiple image |
US20100265313A1 (en) | 2009-04-17 | 2010-10-21 | Sony Corporation | In-camera generation of high quality composite panoramic images |
JP5319415B2 (en) * | 2009-06-22 | 2013-10-16 | キヤノン株式会社 | Image processing apparatus and image processing method |
JP4993012B2 (en) * | 2009-10-14 | 2012-08-08 | 株式会社ニコン | Imaging apparatus and image processing apparatus |
JP4973719B2 (en) * | 2009-11-11 | 2012-07-11 | カシオ計算機株式会社 | Imaging apparatus, imaging method, and imaging program |
-
2012
- 2012-03-15 WO PCT/IB2012/051249 patent/WO2013136134A1/en active Application Filing
- 2012-03-15 EP EP12871128.0A patent/EP2792139A4/en not_active Ceased
- 2012-03-15 CN CN201280071271.5A patent/CN104170369B/en active Active
- 2012-03-15 US US14/383,130 patent/US9621796B2/en active Active
Patent Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7358988B1 (en) * | 1999-08-13 | 2008-04-15 | Fujifilm Corporation | Image signal processor for performing image processing appropriate for an output device and method therefor |
EP1292106A2 (en) * | 2001-09-04 | 2003-03-12 | Eastman Kodak Company | Camera having electronic images corresponding to current film images automatically excluded from first in-first out overwriting and method |
US20060012690A1 (en) | 2004-07-14 | 2006-01-19 | Konica Minolta Photo Imaging, Inc., | Image capturing apparatus and method of acquiring image |
US20060181614A1 (en) | 2005-02-17 | 2006-08-17 | Jonathan Yen | Providing optimized digital images |
US20070058064A1 (en) * | 2005-09-14 | 2007-03-15 | Sony Corporation | Image processing apparatus and method, and program therefor |
EP1950704A2 (en) * | 2007-01-26 | 2008-07-30 | Conversion Works, Inc. | Methodology for 3D scene reconstruction from 2D image sequences |
US20090153737A1 (en) * | 2007-12-17 | 2009-06-18 | Ati Technologies Ulc | Method, apparatus and machine-readable medium for apportioning video processing between a video source device and a video sink device |
WO2009097552A1 (en) * | 2008-02-01 | 2009-08-06 | Omnivision Cdm Optics, Inc. | Image data fusion systems and methods |
WO2012177149A1 (en) * | 2011-06-24 | 2012-12-27 | Tomra Systems Asa | Method and apparatus for detecting fraud attempts in reverse vending machines |
Non-Patent Citations (1)
Title |
---|
See also references of EP2792139A4 |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2016149012A1 (en) * | 2015-03-17 | 2016-09-22 | Microsoft Technology Licensing, Llc | Automatic image frame processing possibility detection |
US11962908B2 (en) | 2015-03-17 | 2024-04-16 | Microsoft Technology Licensing, Llc. | Automatic image frame processing possibility detection |
Also Published As
Publication number | Publication date |
---|---|
US20150015736A1 (en) | 2015-01-15 |
CN104170369A (en) | 2014-11-26 |
US9621796B2 (en) | 2017-04-11 |
CN104170369B (en) | 2017-12-19 |
EP2792139A4 (en) | 2015-09-16 |
EP2792139A1 (en) | 2014-10-22 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US8184196B2 (en) | System and method to generate depth data using edge detection | |
US9154697B2 (en) | Camera selection based on occlusion of field of view | |
JP5946970B2 (en) | Imaging apparatus and imaging method | |
US9621796B2 (en) | Method, apparatus and computer program for capturing images with multiple image capture and image modification | |
JP6267502B2 (en) | IMAGING DEVICE, IMAGING DEVICE CONTROL METHOD, AND PROGRAM | |
CN109417592B (en) | Imaging device, imaging method, and imaging program | |
WO2016168783A1 (en) | Methods and apparatus for filtering image data to reduce noise and/or generating an image | |
US9432563B2 (en) | Three-dimensional imaging through multi-image processing | |
US8854503B2 (en) | Image enhancements through multi-image processing | |
WO2016011872A1 (en) | Image photographing method and apparatus and computer storage medium | |
CN107079096A (en) | Imaging device and imaging method | |
US8681235B2 (en) | Apparatus for processing digital image signal that obtains still image at desired point in time and method of controlling the apparatus | |
US9674437B2 (en) | Imaging apparatus, imaging method and computer readable recording medium having program for performing interval shooting | |
US8897617B2 (en) | Digital image capturing apparatus and method of controlling the same | |
US10999489B2 (en) | Image processing apparatus, image processing method, and image capture apparatus | |
US9986163B2 (en) | Digital photographing apparatus and digital photographing method | |
US20200358955A1 (en) | Image processing apparatus, image processing method, and recording medium | |
KR101140414B1 (en) | Digital Camera Apparatus for Supporting Deblurring and Method thereof | |
JP2013062711A (en) | Photographing device, photographed image processing method, and program | |
JP5832618B2 (en) | Imaging apparatus, control method thereof, and program | |
CN107431756B (en) | Method and apparatus for automatic image frame processing possibility detection | |
JP6622555B2 (en) | Image processing apparatus and control method therefor, imaging apparatus, program, and storage medium | |
JP2017022596A (en) | Image processing apparatus, control method of the same, and program | |
CN118541965A (en) | User interface for image capture | |
CN117409449A (en) | Image processing method, device, electronic equipment and storage medium |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 12871128 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2012871128 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 14383130 Country of ref document: US |
|
NENP | Non-entry into the national phase |
Ref country code: DE |