CN108718376B - Thin multi-aperture imaging system with auto-focus and method of use thereof - Google Patents
Thin multi-aperture imaging system with auto-focus and method of use thereof Download PDFInfo
- Publication number
- CN108718376B CN108718376B CN201810567323.7A CN201810567323A CN108718376B CN 108718376 B CN108718376 B CN 108718376B CN 201810567323 A CN201810567323 A CN 201810567323A CN 108718376 B CN108718376 B CN 108718376B
- Authority
- CN
- China
- Prior art keywords
- camera
- color
- sub
- image
- dual
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 39
- 238000003384 imaging method Methods 0.000 title claims description 17
- 230000003287 optical effect Effects 0.000 claims abstract description 68
- 230000007246 mechanism Effects 0.000 claims abstract description 47
- 230000008569 process Effects 0.000 claims abstract description 13
- 230000004927 fusion Effects 0.000 claims description 16
- YBJHBAHKTGYVGT-ZKWXMUAHSA-N (+)-Biotin Chemical compound N1C(=O)N[C@@H]2[C@H](CCCCC(=O)O)SC[C@@H]21 YBJHBAHKTGYVGT-ZKWXMUAHSA-N 0.000 claims description 8
- FEPMHVLSLDOMQC-UHFFFAOYSA-N virginiamycin-S1 Natural products CC1OC(=O)C(C=2C=CC=CC=2)NC(=O)C2CC(=O)CCN2C(=O)C(CC=2C=CC=CC=2)N(C)C(=O)C2CCCN2C(=O)C(CC)NC(=O)C1NC(=O)C1=NC=CC=C1O FEPMHVLSLDOMQC-UHFFFAOYSA-N 0.000 claims description 8
- 238000007781 pre-processing Methods 0.000 claims description 5
- 230000000903 blocking effect Effects 0.000 claims description 3
- 230000009977 dual effect Effects 0.000 claims description 2
- 238000013461 design Methods 0.000 description 13
- 239000000758 substrate Substances 0.000 description 8
- 238000012937 correction Methods 0.000 description 7
- 238000013459 approach Methods 0.000 description 5
- 230000008901 benefit Effects 0.000 description 5
- 230000004075 alteration Effects 0.000 description 4
- 239000011159 matrix material Substances 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- 238000005070 sampling Methods 0.000 description 3
- 241001428800 Cell fusing agent virus Species 0.000 description 2
- 239000003086 colorant Substances 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 208000036971 interstitial lung disease 2 Diseases 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 230000004044 response Effects 0.000 description 2
- 230000003595 spectral effect Effects 0.000 description 2
- 238000001228 spectrum Methods 0.000 description 2
- 230000006641 stabilisation Effects 0.000 description 2
- 238000011105 stabilization Methods 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 238000010521 absorption reaction Methods 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 239000006059 cover glass Substances 0.000 description 1
- 230000002950 deficient Effects 0.000 description 1
- 238000006073 displacement reaction Methods 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000007499 fusion processing Methods 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 238000002329 infrared spectrum Methods 0.000 description 1
- 238000001746 injection moulding Methods 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 230000008450 motivation Effects 0.000 description 1
- 238000010606 normalization Methods 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 238000012805 post-processing Methods 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 238000013519 translation Methods 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B19/00—Cameras
- G03B19/18—Motion-picture cameras
- G03B19/22—Double cameras
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/64—Imaging systems using optical elements for stabilisation of the lateral and angular position of the image
- G02B27/646—Imaging systems using optical elements for stabilisation of the lateral and angular position of the image compensating for small deviations, e.g. due to vibration or shake
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B7/00—Mountings, adjusting means, or light-tight connections, for optical elements
- G02B7/28—Systems for automatic generation of focusing signals
- G02B7/36—Systems for automatic generation of focusing signals using image sharpness techniques, e.g. image processing techniques for generating autofocus signals
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B30/00—Camera modules comprising integrated lens units and imaging units, specially adapted for being embedded in other devices, e.g. mobile phones or vehicles
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
- H04N23/13—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths with multiple sensors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/20—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from infrared radiation only
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/45—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
- H04N23/55—Optical parts specially adapted for electronic image sensors; Mounting thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/67—Focus control based on electronic image sensor signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
- H04N23/84—Camera processing pipelines; Components thereof for processing colour signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/95—Computational photography systems, e.g. light-field imaging systems
- H04N23/951—Computational photography systems, e.g. light-field imaging systems by using two or more images to influence resolution, frame rate or aspect ratio
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/10—Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
- H04N25/11—Arrangement of colour filter arrays [CFA]; Filter mosaics
- H04N25/13—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements
- H04N25/133—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements including elements passing panchromatic light, e.g. filters passing white light
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/10—Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
- H04N25/11—Arrangement of colour filter arrays [CFA]; Filter mosaics
- H04N25/13—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements
- H04N25/134—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements based on three different wavelength filter elements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/2628—Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/30—Transforming light or analogous information into electric information
- H04N5/33—Transforming infrared radiation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/64—Circuits for processing colour signals
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B2205/00—Adjustment of optical system relative to image or object surface other than for focusing
- G03B2205/0053—Driving means for the movement of one or more optical element
- G03B2205/0069—Driving means for the movement of one or more optical element using electromagnetic actuators, e.g. voice coils
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
- H04N23/84—Camera processing pipelines; Components thereof for processing colour signals
- H04N23/843—Demosaicing, e.g. interpolating colour pixel values
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Computing Systems (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Studio Devices (AREA)
- Cameras In General (AREA)
- Automatic Focus Adjustment (AREA)
- Diaphragms For Cameras (AREA)
- Color Television Image Signal Generators (AREA)
Abstract
The present invention provides dual-aperture digital cameras with auto-focus (AF) and related methods for obtaining focused and optionally optically stabilized color images of an object or scene. The dual-aperture camera includes: a first sub-camera having a first optical element module and a color image sensor for providing a color image, a second sub-camera having a second optical element module and a transparent image sensor for providing a luminance image, wherein the first and second sub-cameras have substantially the same field of view; an AF mechanism mechanically coupled to at least the first optical element module; and a camera controller coupled to the AF mechanism and to the two image sensors, configured to control the AF mechanism, calculate a zoom difference and a sharpness difference between the color and luminance images due to the AF mechanism, and process the color and luminance images into a fused color image using the calculated differences.
Description
Cross Reference to Related Applications
The application is a divisional application of Chinese patent application with application number 201480043316.7, which is filed 2016, 1, 31 and the parent; this parent application is a chinese national phase application of international application PCT/IB2014/063393 and claims priority to U.S. provisional patent application No. 61/861,185 filed on 1.8.2013, having the same title, which is incorporated herein by reference in its entirety.
Technical Field
Embodiments disclosed herein relate generally to digital cameras and, more particularly, to thin multi-aperture digital cameras with auto-focus.
Background
In recent years, mobile devices such as cellular phones, tablet devices, and laptop computers have become ubiquitous. Most of these devices include one or two compact cameras-a primary camera that faces rearward (i.e., the camera on the back of the device, which faces away from the user and is often used for casual photography) and a secondary camera that faces forward (i.e., the camera on the front of the device, which is often used for video conferencing).
Although relatively compact in nature, most of these cameras are still designed much like the conventional structure of a digital still camera, that is, they include an optical assembly (or a string of several optical elements and a primary aperture) placed over an image sensor. The optical components, which are also referred to as "optics", refract incoming light rays and bend them to produce an image of the scene on the sensor. The specifications of these cameras are determined to a large extent by the size of the sensor and by the height of the optical elements. These factors are typically linked together by the focal length ("f") of the lens and its field of view (FOV) -a lens that must image a particular FOV onto a sensor of a particular size has a particular focal length. By keeping the FOV constant, the larger the gauge of the sensor (e.g., in the X-Y plane), the larger the focal length and the optical element height.
As the size of mobile devices shrinks, the size of compact cameras is becoming a more and more critical factor limiting the thickness of the devices. Several approaches have been proposed to reduce the compact camera thickness in order to alleviate this constraint. Recently, multi-aperture systems have been proposed for this purpose. In such systems, instead of one aperture with a string of optical elements, the camera is divided into several apertures, each with a dedicated optical element, and all apertures share a similar field of view. Each such aperture together with the optical elements and the sensor area on which the image is formed is later defined as a "sub-camera". Generally, in a multi-aperture camera design, each sub-camera produces a smaller image on the image sensor than the image produced by a reference single-aperture camera. Accordingly, the height of each sub-camera can be smaller than the height of a single-aperture camera, which can reduce the overall height of the camera and allow for a more slim mobile device design.
Fig. 1A and 1B show schematic designs of a conventional camera and a dual-aperture camera with two sub-cameras, respectively. The conventional camera 100' in fig. 1A includes an image sensor 102 and a lens 106 disposed on a substrate 104. "camera height" is defined as the height of the camera module from the base plate 104 to the top of the lens 106. The dual-aperture camera 100 "in fig. 1B comprises two sub-cameras, namely sub-camera 1 with image sensor 112a and lens 116a having optical axis 118a, and sub-camera 2 with image sensor 112B and lens 116B having optical axis 118B. Two sensors are placed on the substrates 114a and 114b, respectively. For comparison, it is assumed that the reference single-aperture camera and the dual-aperture camera have the same field of view (FOV) and that their sensors have the same pixel size. But the image sensor 102 has a higher resolution (number of pixels) than the image sensor 112a or the image sensor 112b and thus is also larger in size. One can appreciate the potential advantages in camera height of a dual-aperture camera (i.e., the thickness from substrate 114a to the top of lens 116a and from substrate 114b to the top of lens 116 b).
Several significant challenges are involved in multi-aperture camera design. First, the sensor area of each sub-camera is smaller compared to the sensor area of a single aperture camera. The resolution of the image captured by each sub-camera is less than the resolution captured by the single aperture camera if the pixel size in each sub-camera sensor is kept the same as the pixel size in the single aperture camera sensor. If the resolution of the output image is to be kept the same, it is necessary to combine images from different sub-cameras into a higher resolution image. This is usually done in the digital domain by a dedicated algorithm. Several methods have been proposed for combining lower resolution images to produce higher resolution images. Some algorithms in such an approach require a registration step between sets of low resolution images in order to account for parallax (which is present in multi-aperture camera systems due to the shift of the viewpoint between sub-cameras). One such algorithm is described in commonly assigned PCT patent application PCT/IB2014/062180 entitled "Dual aperture zoom digital camera," which is incorporated herein by reference in its entirety.
Another challenge relates to the requirement that the camera provide an in-focus image for a wide range of object distances (typically from a few centimeters to infinity in a compact camera module). To meet this requirement, single aperture cameras may include an Auto Focus (AF) mechanism that controls the focus position of the optical element by moving the optical element along the optical axis, thereby changing its height above the sensor. In order to support in-focus images for a wide range of object distances in a multi-aperture camera, a straightforward approach would be to provide a dedicated AF mechanism in each sub-camera. This approach has several drawbacks including increased size and cost of the cameras, higher operating power, and more complex control, since the AF mechanism of each sub-camera needs to be synchronized to ensure that all sub-cameras are focused to the same location.
Another difficulty that may arise when using the AF mechanism in a multi-aperture camera is related to the algorithm that combines the lower resolution sub-camera images to produce a higher resolution image. Since the AF mechanism moves the optical element along the optical axis over the sensor, it scales the image formed on the sensor to some extent. A slight difference between the focus positions of the different AF mechanisms in each sub-camera may result in different scales being applied to the lower resolution sub-camera images. Such a difference in scale may degrade the performance of the image registration step in the algorithm. Due to the dynamic nature of the scales, correction for different scales is not trivial — the scale applied on an image depends on the focal position of the optical element, which in turn changes with object distance. This means that the scale cannot be easily corrected by calibrating the multi-aperture camera and applying a fixed correction, instead the correct scale must be estimated at each image. In the presence of parallax (where different objects appear at different positions as a function of their distance from the camera) and in the presence of possible occlusions of objects in one aperture but not in the other, it is not trivial to estimate from the image the correct scale to apply. Therefore, there is a need for a method that can accurately estimate and correct the scaling difference on a per-image basis.
As an alternative to the use of AF, multi-aperture camera designs have been proposed that do not have an AF mechanism at all. Such a design relies on a smaller focal length for each sub-camera to provide an increased depth of focus (DOF) compared to a corresponding single aperture camera supporting a larger sensor. The AF mechanism can be eliminated since a larger DOF means that a wider range of object distances is imaged onto the sensor in focus. While this approach is advantageous in terms of cost, size, and system complexity, the larger DOF resulting from the shorter focal length of the multi-aperture camera is often insufficient to support in-focus images for object distances ranging from a few centimeters to infinity. In these cases, satisfying a multi-aperture camera with fixed focusing optics results in poor imaging performance at close object distances.
There is a need for a multi-aperture camera system that combines the benefits of the AF mechanisms without adding additional complexity and cost to the camera system, between using multiple AF mechanisms and using only fixed focus optics.
Disclosure of Invention
Embodiments disclosed herein provide a design for a multi-aperture camera with an AF mechanism, describe an algorithm to dynamically correct for the scale differences between sub-camera images, and propose a Color Filter Array (CFA) design that can yield higher resolution and sensitivity when combining sub-camera images compared to a CFA.
In various embodiments, dual-aperture digital cameras having auto-focus (AF) for imaging an object or scene are provided, each such dual-aperture digital camera comprising: a first sub-camera comprising a first optical element module and a color image sensor having a first number of pixels, the first camera adapted to provide a color image of an object or scene; a second sub-camera comprising a second optical element module and a transparent image sensor having a second number of pixels, the second sub-camera being adapted to provide a luminance image of the object or scene, wherein the first and second sub-cameras have substantially the same field of view; an AF mechanism mechanically coupled to at least the first optical element module; and a camera controller coupled to the AF mechanism and to the two image sensors, configured to control the AF mechanism, calculate a zoom difference and a sharpness difference between the color and luminance images due to the AF mechanism, and process the color and luminance images into a fused color image using the calculated differences.
The first number of pixels and the second number of pixels may be equal or different. The first and second image sensors are formed on a single substrate. The first sub-camera may include an Infrared (IR) filter that blocks IR wavelengths from entering the color image sensor, and the second sub-camera may be configured to allow at least some IR wavelengths to enter the transparent image sensor. In some embodiments, the color image sensor may include a non-standard Color Filter Array (CFA).
In one embodiment, the AF mechanism may be mechanically coupled to the first optel module and the second optel module may have a fixed focus position. In one embodiment, the fixed focus position may be such that the DOF range of the second sub-camera is between infinity and less than about 100 cm. In one embodiment, the AF mechanism may be mechanically coupled to the first and second optical element modules and adapted to move the corresponding optical element modules together in a common direction of their optical axes.
In one embodiment, the camera may further include an optical image stabilization mechanism mechanically coupled to the first and second optel modules and in a direction perpendicular to the optical axis of the corresponding optel module to optically stabilize the AF-fused color image.
In one embodiment, a method for obtaining a focused color image of an object or scene with a dual-aperture camera is provided, comprising the steps of: simultaneously obtaining an autofocus color image and an autofocus or fixed focus luminance image of the object or scene, wherein the color image has a first resolution, a first effective resolution, and a first signal-to-noise ratio (SNR), and wherein the luminance image has a second resolution, a second effective resolution, and a second SNR; pre-processing the two images to obtain corresponding rectified, normalized and scaled color and luminance images, taking into account the differences in scaling and sharpness caused by the AF action; performing local registration between the rectified, normalized and scaled color and luminance images, thereby obtaining a registered image; and fusing the registered images into a focus-fused color image.
In one embodiment, the pre-processing step to obtain the scaled color and luminance images comprises computing a set of respective points in the color and luminance images, extracting a single coordinate from each respective point, and using the single coordinate to estimate a scaling factor S between the color and luminance images. The extracted coordinates are Y, and the scaling factor S may be given by S ═ (Y2 '× W × Y2) \ Y2' × W × Y1, where Y1 is the vector of the Y coordinates of the points taken from one image, Y2 is the vector of the Y coordinates of the points taken from the other image, and W is a diagonal matrix that holds the absolute values of Y2.
In one embodiment, a method may further include scaling one of the images to match the other image using a scaling factor S to obtain a registered image.
In one embodiment, a method may further include performing optical stabilization on the obtained color and luminance images.
Drawings
Non-limiting examples of embodiments disclosed herein will be described with reference to the figures listed after this paragraph. The drawings and their description are intended to illustrate and clarify the embodiments disclosed herein and should not be taken as limiting in any way.
FIG. 1A schematically illustrates a design of a conventional digital camera;
FIG. 1B schematically shows a design of a multi-aperture camera;
FIG. 2 schematically illustrates in (a) a general isometric view and (b) a cross-sectional isometric view one embodiment of a dual-aperture imaging system with auto-focusing as disclosed herein;
FIG. 3 illustrates one embodiment of an image sensor for use in the imaging system of FIG. 2, wherein one sub-camera has a CFA sensor and the other sub-camera has a transparent sensor;
FIG. 4A schematically illustrates a flow chart of one embodiment of a method disclosed herein;
FIG. 4B shows in a flow chart details of the scaling step in the method shown in FIG. 4A;
FIG. 4C shows two images with corresponding points;
FIG. 5A schematically illustrates in a cross-sectional isometric view another embodiment of a dual-aperture imaging system having a single autofocus mechanism as disclosed herein;
FIG. 5B schematically illustrates in a flow chart one embodiment of a method for autofocus imaging with the imaging system of FIG. 5A;
figure 6 schematically illustrates in a cross-sectional isometric view another embodiment of a dual-aperture imaging system numbered with a single autofocus mechanism.
Detailed Description
Figure 2 schematically illustrates one embodiment of the dual-aperture imaging system with autofocus disclosed herein in (a) a generally isometric view and (b) a cross-sectional isometric view. In the description that follows, "imaging system" and "camera" may be used interchangeably. System 200 includes two sub-cameras, labeled 202 and 204, each having its own optical elements. Accordingly, sub-camera 202 includes an optical element module 206 having an aperture 208 and an optical lens module 210, and a sensor 212. Similarly, sub-camera 204 includes an optics module 214 having an aperture 216 and an optical lens module 218, and a sensor 220. The sensors are also referred to hereinafter as "sensor 1" (212) and "sensor 2" (220). It should be mentioned that the two sensors may be implemented as two different areas on the same substrate, not necessarily as two separate sensors. Each optical lens module may include several lens elements and an Infrared (IR) filter 222a, b. In some embodiments, some or all of the lens elements belonging to different apertures may be formed on the same substrate. The two sub-cameras are placed next to each other with a smaller baseline 224 between the two apertures 208 and 216. Each sub-camera also includes an autofocus mechanism 226 and 228, respectively.
The sensor used in each sub-camera may have a different Color Filter Array (CFA). In some embodiments, sensor 1 may have one type of CFA and sensor 2 may have another type of CFA. In some embodiments, sensor 1 may have a CFA, and sensor 2 may have a "white" or "clear" filter array (labeled W) where all pixels absorb the same broad wavelength range, e.g., between 400nm and 700nm (rather than each pixel absorbing a smaller portion of the spectrum). A sensor having a color filter array may be referred to hereinafter as a "color image sensor", while a sensor having a transparent or W filter array is referred to as a "transparent image sensor".
Fig. 3 shows a sensor embodiment 300 in which the number "1" represents sensor 1 (which has a CFA) and the number "2" represents sensor 2 (which has a transparent "white" filter array). Circles 302a, 302b mark the image circles formed by the optical elements on the sensor, and white areas 304 mark the substrate on which the sensor is located. The circles 302a, 302b may be larger than the corresponding size of the sensor on which the image is formed. In some cases, overlap between two image circles may occur, and a mechanical light blocking element (e.g., a wall plate) may be required to prevent optical crosstalk between sub-cameras. Using the CFA on sensor 1, sub-camera 1 captures color information about the scene, and sub-camera 2 captures luminance information about the scene.
The CFA of sensor 1 may be standard or non-standard. As used herein, a "standard CFA" may include known CFAs such as Bayer, RGBE, CYYM, CYGM and various RGBW filters such as RGBW #1, RGBW #2 and RGBW # 3. "non-standard" CFA patterns may include, by way of example: a repetition of 2x2 microcells, wherein the color filter sequence is RRBB, RBBR, or YCCY, wherein Y ═ yellow ═ green + red, C ═ cyan ═ green + blue; a repetition of 3x3 microcells, where the color filter sequence is GBRRGBBRG (as in sensor 1 in fig. 3); and 6x6 microcell repetitions, wherein the color filter sequence is one of the following options:
1. line 1: RBBRRB. Line 2: RWBB. Line 3: BBRBRR. Line 4: RRBRBB. Line 5: BWBRWR. Line 6: BRRBBR.
2. Line 1: BBGRRG. Line 2: RGRBGB. Line 3: GBRGRB. Line 4: RRGBBG. Line 5: BGBRGR. Line 6: GRBGBR.
3. Line 1: RBBRRB. Line 2: RGRBGB. Line 3: BBRBRR. Line 4: RRBRBB. Line 5: BGBRGR. Line 6: BRRBBR.
4. Line 1: RBRBRBRB. Line 2: BGBRGR. Line 3: RBRBRBRB. Line 4: and (3) BRBRBR. Line 5: RGRBGB. Line 6: and (3) BRBRBR.
One advantage of the CFA pattern of sensor 1 using some of the non-standard CFAs listed above over the standard Bayer pattern is that it evenly divides the red, green and blue colors over the sensor pixels. This results in finer sampling for red and blue, and coarser sampling for green, compared to the standard Bayer pattern. But since the image captured by the sensor 2 is used to extract luminance information about the scene (rather than relying on the green channel for this purpose as is the case when using the Bayer pattern), green pixels are used for color information only.
In conventional compact camera designs, a filter that allows light in the visible range to enter and blocks light in the IR range is typically placed in the optical path, sometimes as part of a cover glass that protects the sensor. While blocking of IR light can waste photons, it allows for more accurate estimation of color in the scene because it reduces color crosstalk from the spectral response of R, G and the B color filter (which may be sensitive to IR light). In one embodiment, the transparent sensor 2 is made sensitive to IR light, either by removing the IR filter or by redesigning its spectral response to allow some light in the IR range to enter. The motivation for capturing IR light, in addition to light in the visible range, is to improve the signal-to-noise ratio (SNR) in images, since many natural and artificial light sources also emit photons in the IR spectrum. Unlike a sensor with a colored CFA (i.e., sensor 1), absorption of IR light does not introduce color crosstalk in the transparent sensor 2 (since the sensor records a full color image of the scene).
Removing the IR filter may have some negative impact on image quality. For example, extending the range of wavelengths captured by a camera may result in longitudinal chromatic aberration, which may reduce the quality of the Point Spread Function (PSF) resulting in a blurred image. To address this problem, in one embodiment, the optics of the sub-camera 2 are optimized over both the visible and IR ranges to mitigate the effects of chromatic aberration and to achieve a more compact PSF compared to standard compact camera optics using IR filters. This is in contrast to standard optimization processes which only consider wavelengths in the visible range.
In use, the two sub-cameras share a similar FOV and have substantially equal (limited only by manufacturing tolerances) focal lengths. The image capture process is synchronized so that the two sub-cameras capture images of the scene at a particular moment in time. Due to the small baseline between the two apertures of the sub-camera (which may be only a few millimeters, e.g. 6.5mm or 8.5mm), the output image may exhibit parallax, depending on the object distance in the scene. Digital image processing algorithms combine two images into one image in a process called "image fusion". Hereinafter, an algorithm for implementing this process is referred to as an "image fusion algorithm". The resulting image of the algorithm may have a higher resolution (in terms of image pixels) and/or a higher "effective resolution" (in terms of the ability to resolve spatial frequencies in the scene, a higher "effective resolution" meaning the ability to resolve a higher spatial resolution) and/or a higher SNR than one sub-camera image.
In terms of resolution and by way of example, if each sub-camera produces a 5 megapixel (2592x1944 pixel) image, the image fusion algorithm may combine the two images to produce an image having an 8 megapixel (3264x2448 pixel) resolution. In terms of effective resolution, assuming that the imaged object or scene includes spatial frequencies, the overall improvement in effective resolution results from using the dual-aperture camera disclosed herein with a transparent sensor and a color sensor because of the ability of the transparent sensor to resolve the higher spatial frequencies of the luminance components of the scene as compared to the color sensor. The fusion of color and transparent images implemented in the methods disclosed herein (see below) adds information in higher spatial frequencies than possible with a color (e.g., Bayer) sub-camera.
To generate a higher resolution or higher effective resolution image, the image fusion algorithm combines the color information from sub-camera 1 with the luminance information from sub-camera 2. Since the transparent sensor 2 samples the scene at a higher effective spatial sampling rate than any color channel in the color sensor 1 or its luminance, the algorithm synthesizes an image that includes information at higher spatial frequencies than the output image from the sub-camera 1 alone. The goal of the algorithm is to achieve a spatial resolution similar to that obtained from a single-aperture camera with a higher number of pixels. Continuing with the previous example, the algorithm may combine two 5 megapixel images (a color image and a luminance image) to produce an 8 megapixel image with information content similar to a single aperture 8 megapixel color camera.
In addition to improved spatial resolution, the image fusion algorithm also uses luminance information from the transparent sensor 2 to generate an image with improved SNR compared to an image from a corresponding single-aperture camera. The fact that the pixels of the sensor 2 are not covered by the color filter allows each pixel to absorb light in a broader wavelength spectrum, resulting in a significant increase in light efficiency compared to color CFA cameras. In one embodiment, the fusion of the transparent image information with the color image information then provides a +3dB SNR improvement compared to a single aperture digital camera.
Since the transparent sensor 2 is more sensitive than the color sensor 1, it may be necessary to adjust the exposure time or analog gain in order to match the digital signal level between the two cameras. This can be achieved by fixing the same exposure time for both sensors and configuring a different analog gain for each sensor, or by fixing the analog gain in both sensors and configuring a different exposure time for each sensor.
FIG. 4A schematically illustrates in a flow chart one embodiment of a method disclosed herein. FIG. 4B shows in a flow chart details of the scaling step in the method shown in FIG. 4A. Two images 400a and 400b from sub-cameras 1 and 2, respectively, serve as inputs. The two images are subjected to pre-processing in step 402a corresponding to the color image of sensor 1 and step 402b corresponding to the luminance image of sensor 2, respectively. Step 402a includes digital Image Signal Processing (ISP) in an ISP pipeline. The ISP generates a full color image with R, G, B values at each image pixel. If the CFA pattern on sensor 1 is non-standard, the ISP includes non-standard demosaicing (demosaicing) to interpolate the missing colors at each pixel location. In addition to demosaicing, other standard ISP pipeline algorithms known in the art may be applied on the image, such as black level correction, defective pixel correction, noise removal, and the like. The luminance image from the sub-camera 2 is also pre-processed to correct for imperfections, noise, shadow distribution, blur and other optical, analog and digital aberrations. Normalization, rectification and scaling are then applied to the two images in step 404. First, the two images are normalized to have the same mean signal strength and standard deviation (which is a measure for the dynamic range of the image). This is achieved by subtracting the mean from each pixel in each image and dividing each pixel by the standard deviation. The image is then corrected by applying the two projection matrices to correct for different rotations about the x, y and z axes, to correct for x-y translation of the optical centers of the two cameras, and to fix lens distortion. The projection matrix parameters are pre-calculated from calibration data, which may be obtained by calibration steps applied for each camera module during assembly of the camera module. The data may be stored in one-time programmable memory or EEPROM in the camera module. After the rectification step, the epipolar lines in both images are more or less parallel to the horizontal axis of the image in the case where the two sub-cameras are placed side by side along the X-axis, or parallel to the vertical axis of the image in the case where the two sub-cameras are placed side by side along the Y-axis.
The adjustment of the scale performed after the corrective step will now be described in more detail with reference to fig. 4B. Preprocessed and rectified images 418a and 418b (which are also exemplarily shown in fig. 4C) from sub-cameras 1 and 2, respectively, serve as input. In step 420, the corresponding point between the two images is found. In one embodiment, the set of corresponding points is computed over the entire image. In another embodiment, a set of corresponding points is found for a particular region of interest (ROI) in each image. Fig. 4C schematically shows two images a and B of the same scene captured by neighboring cameras with some parallax (i.e. a captured by sub-camera 1 and a' captured by sub-camera 2) -due to different viewpoints, the object is imaged with some displacement in one image compared to the other image, depending on its distance from the camera. The feature pairs a-a ', b-b' and c-c 'represent the same "corresponding points" in both images a and a'. An algorithm is used to find the corresponding points between the two images. A set of salient points (e.g., corners) is found in both images, and then the algorithm finds a match between the points in both images. Such algorithms are known to those skilled in the art. In step 422, only the Y-coordinate is extracted in order to estimate the scale between the two images. Since the position of the optical element, which is controlled by the AF mechanism, may introduce different scales between the two sub-camera images, it is necessary to determine the appropriate scale for each captured image (i.e. for each focus position). Assuming that the two sub-cameras are placed adjacent to each other along the X-axis, once the corresponding point pairs are found, a single coordinate is extracted from each point in step 422. That is, the algorithm only considers its Y coordinate and not its X coordinate. The inventors have advantageously realized that the X-coordinate may be affected by parallax, while the Y-coordinate is largely unaffected by parallax after the rectification step, and thus the Y-coordinate can be used to estimate the scale more robustly. If two sub-cameras are placed adjacent along the Y-axis, the algorithm only considers its X-coordinate and not its Y-coordinate once the corresponding point pair is found. Continuing with the assumption that the two sub-cameras are adjacent along the X-axis, the Y-coordinate of the corresponding point is used to estimate the scaling factor S between the images in step 424. In one exemplary embodiment, the scale factor estimation is implemented using a least squares method, in which case S is given by:
S=(Y2’*W*Y2)\Y2’*W*Y1
where Y1 is a vector of Y coordinates of points taken from one image, Y2 is a vector of Y coordinates of points taken from another image, and W is a diagonal matrix that holds the absolute value of Y2. One image is then scaled in step 426 using the scaling factor S to match the scale between the two images. In step 426, the coordinates of the points in each image are multiplied by the same scaling factor S. Finally, in step 428, the scaled corresponding pairs of points are used to calculate the offset in the x and y axes between the two images for each axis. In one embodiment, only a subset of the corresponding points located in a particular ROI are used to calculate the offset in x and y. For example, the ROI may be a section that is used to determine focus and that may be selected by a user or camera Software (SW). The estimated offset is applied to one or both of the images. The result of the resizing process in FIG. 4B (and in step 404 of FIG. 4A) is a scaled image 430.
Referring now to fig. 4A, local registration and disparity correction are applied to the scaled image in step 406 in order to estimate a disparity map. The local registration uses the scale and offset parameters found in step 404. Fusion is then performed in step 408 by combining information from both images according to the disparity map in order to enhance resolution in the final image and improve SNR. The fusion process uses the image from the sub-camera 1 as a baseline. The output of which is a fused image 410. Post-processing, such as tone mapping, gamma correction, contrast enhancement, and color correction/enhancement, may then be applied to the fused image.
Auto focus
As mentioned previously with respect to fig. 2, the camera system disclosed herein includes an AF mechanism that controls the focus position of the optical elements. The system shown in fig. 2 includes two such AF mechanisms. Figure 5A schematically illustrates in a cross-sectional isometric view another embodiment of a dual-aperture imaging system, numeral 500, with a single autofocus mechanism. In addition to the conventional image sensor and optical elements, the system 500 only includes the AF mechanism 502 located in the color sub-camera 1. The luminance sub-camera 2 does not have an AF mechanism, but is a fixed focus camera whose focus is fixed to a certain object distance. The focus position is such that the DOF range of the sub-camera 2 is between infinity and tens of centimeters, depending on the focal length and the optical element design. For example, the DOF may be between infinity and 50cm, so that the sub-camera 2 will produce a sharp image for object distances within this range from the camera. In system 500, by changing the focal position of the optical elements, sub-camera 1 can produce an image in which the main subject is in focus for a wide range of object distances, making it appear sharp in the sub-camera 1 image.
Fig. 5B schematically illustrates in a flowchart one embodiment of a method of image fusion using the imaging system with AF 500. Two images 500a and 500b from sub-cameras 1 and 2, respectively, serve as inputs. In step 502, a focus position is selected for the sub-camera 1. A check is performed in step 504 to determine if the distance of the imaged object is within the DOF of sub-camera 2, as is known in the art, by calculating a sharpness metric on the images of sub-cameras 1 and 2. The calculation of the sharpness measure may result in a sharpness difference. If the answer in the check of step 504 is "yes", the object will appear clear in the sub-camera 2 image. In this case, the image fusion described earlier is applied in step 506 to the object images obtained by both sub-cameras in order to obtain a higher output resolution and a better SNR. If the answer to check 504 is "no" (that is, the object is located closer to the camera and outside the DOF range of sub-camera 2), the object will appear blurred (unsharp) in the sub-camera 2 image. In this case, the image from the sub-camera 2 is not used to enhance the resolution, but is used only to improve the SNR of the image from the sub-camera 1. To this end, another algorithm (procedure) similar to the previous fusion algorithm (procedure) is applied in step 508. The image from sub-camera 1 is scaled to the appropriate output size and a de-noising algorithm using information from the sub-camera 2 image is applied. Since in this case high frequencies are lost in the sub-camera 2 image (due to defocus), the algorithm only considers information at low spatial frequencies from the sub-camera 2 image. To determine the object distance, the selected focus position of the AF mechanism of the sub-camera 1 is used (after convergence of the focus process).
Figure 6 schematically illustrates another embodiment of a dual-aperture imaging system, numbered 600, with a single AF mechanism in a cross-sectional isometric view. Similar to system 500, system 600 includes only one AF mechanism 602 in addition to the conventional image sensor and optical elements. However, unlike AF mechanism 502, AF mechanism 602 moves the optical elements of sub-camera 1 together with the optical elements of sub-camera 2. The various optical elements are mounted on a lens holder 604, the lens holder 604 having special threads to secure the two lenses and being moved by the AF mechanism. Since the optical elements of sub-camera 1 and sub-camera 2 have very similar focal lengths, the mechanical movement brings the images from sub-camera 1 and from sub-camera 2 into focus simultaneously. The advantage of this configuration over having only one AF mechanism is that both sub-cameras support the same range of object distances, so the image fusion algorithm can be applied for the entire range. Information from both sub-camera images may be taken into account when the AF mechanism selects the best focus position corresponding to the lens (e.g., to help focus in low light conditions). In low light, the AF sharpness measurement is more noisy due to lower SNR in the image. By using two images instead of one, it is possible to help reduce noise and improve the robustness and accuracy of the AF processing (algorithm).
In one embodiment, some or all of the optical elements of sub-camera 1 and sub-camera 2 are fabricated on the same die using wafer level optical element fabrication techniques or injection molding of glass or plastic materials. In this case, the single AF mechanism moves the optical die on which the optical elements of the two sub-cameras are fabricated, so that the two optical stacks move together.
In another embodiment, a camera is similar to camera 500 and includes a single AF mechanism placed on sub-camera 1 (which has a color CFA). The sub-camera 2 does not have an AF mechanism, but uses fixed focus optics with unique properties that provide extended depth of focus, which is achieved by optical design (e.g., by employing optics with narrower apertures and higher F-numbers). The optical performance of the optical elements of sub-camera 2 is designed to support sharp images for object distances between infinity and a few cm from the camera-in this case, a fusion algorithm can be applied to enhance the output resolution for a wider range of object distances than the single AF embodiment described previously. There is typically a tradeoff between the DOF of the camera and the minimum achievable PSF size over the DOF range. An algorithm may be used to enhance the sharpness of the images captured by the sub-cameras 2 before applying the fusion algorithm to combine the photographs. Such algorithms are known in the art.
As a conclusion, the dual-aperture cameras and methods of use of such cameras disclosed herein have several advantages over single-aperture cameras in terms of camera height, resolution, effective resolution, and SNR. In terms of camera height, in one example, a standard 8 megapixel 1/3 "camera with a 70 degree diagonal FOV may have a module height of 5.7 mm. In contrast, the dual-aperture camera disclosed herein may have a module height of 4.5mm with two 5 megapixel 1/4 "image sensors (one color image sensor and one transparent image sensor) each having a 70 degree diagonal field of view. In another example, a standard 8 megapixel 1/3 "camera with a 76 degree diagonal FOV may have a module height of 5.2 mm. In contrast, the dual-aperture camera disclosed herein may have a module height of 4.1mm with two 5 megapixel 1/4 "image sensors (one color image sensor and one transparent image sensor) each having a 76 degree diagonal FOV.
While the present disclosure has been described in terms of certain embodiments and generally associated methods, alterations and permutations of the described embodiments and methods will be apparent to those skilled in the art. It is to be understood that the disclosure is not to be limited by the specific embodiments described herein, but only by the scope of the appended claims. Furthermore, citation or identification of any reference in this application shall be construed as an admission that such reference is available as prior art to the present application.
Claims (22)
1. A dual-aperture digital camera with autofocus AF for imaging an object or scene, comprising:
a) a first sub-camera comprising a first optical element module and a color image sensor having a first number of pixels, the first sub-camera adapted to provide a color image of an object or scene;
b) a second sub-camera comprising a second optical element module and a transparent image sensor having a second number of pixels, the second sub-camera being adapted to provide a luminance image of the object or scene, wherein the first and second sub-cameras have substantially the same field of view;
c) an AF mechanism mechanically coupled to the at least first optics module and for performing AF operations on the at least first optics module; and
d) a camera controller coupled to the AF mechanism and to the two image sensors, configured to control the AF mechanism, calculate a sharpness difference between the color and luminance images due to the AF operation, and process the color and luminance images into a fused color image using the calculated sharpness difference.
2. The dual-aperture digital camera of claim 1, wherein the color image sensor comprises a non-standard color filter array.
3. The dual-aperture digital camera of claim 1, wherein the camera controller structure is based on calibration data obtained by a calibration step.
4. The dual-aperture digital camera of claim 3, wherein the calibration data is stored in a one-time programmable memory or EEPROM of the dual-aperture digital camera.
5. The dual-aperture digital camera of claim 1, wherein the first number of pixels and the second number of pixels are equal.
6. The dual-aperture digital camera of claim 1, wherein the first number of pixels and the second number of pixels are different.
7. The dual-aperture digital camera of claim 1, wherein the color image sensor and the transparent image sensor have pixels of the same size.
8. The dual-aperture digital camera of claim 1, wherein the camera controller is further configured to find corresponding points in the color and luminance images, estimate scaling factors and use the scaling factors to process the color and luminance images into a fused color image.
9. The dual-aperture digital camera of claim 1, wherein the camera controller is further configured to pre-process the color and luminance images to obtain corresponding corrected color and luminance images, register the corrected color and luminance images to obtain corresponding registered color and luminance images, and fuse the registered color and luminance images into a fused color image.
10. The dual-aperture digital camera of claim 9, wherein epipolar lines in the rectified color and luminance image are more or less parallel to a horizontal or vertical axis of the rectified color and luminance image.
11. The dual-aperture digital camera of claim 8, wherein the camera controller is further configured to pre-process the color and luminance images to obtain corresponding corrected color and luminance images, register the corrected color and luminance images to obtain corresponding registered color and luminance images, and fuse the registered color and luminance images into a fused color image.
12. The dual-aperture digital camera of claim 11, wherein epipolar lines in the rectified color and luminance image are more or less parallel to a horizontal axis of the rectified color and luminance image if the first and second sub-cameras are placed side-by-side along an X-axis or more or less parallel to a vertical axis of the rectified color and luminance image if the first and second sub-cameras are placed side-by-side along a Y-axis.
13. The dual-aperture digital camera of claim 12, wherein the camera controller structure is based on calibration data obtained by a calibration step, wherein the calibration data is saved in a one-time programmable memory or EEPROM of the dual-aperture digital camera.
14. The dual-aperture digital camera of claim 13, wherein the first number of pixels and the second number of pixels are different.
15. The dual-aperture digital camera of claim 1, wherein the first sub-camera comprises an Infrared (IR) filter that blocks IR wavelengths from entering the color image sensor, and wherein the second sub-camera is configured to allow at least some IR wavelengths to enter the transparent image sensor.
16. A dual-aperture digital camera for imaging an object or scene, comprising:
a) a first sub-camera comprising a first optical element module and a color image sensor having a first number of pixels, the first sub-camera adapted to provide a color image of an object or scene;
b) a second sub-camera comprising a second optical element module and a transparent image sensor having a second number of pixels, the second sub-camera adapted to provide a luminance image of the object or scene, wherein the first sub-camera comprises an infrared IR filter that blocks IR wavelengths from entering the color image sensor, and wherein the second sub-camera is configured to allow at least some IR wavelengths to enter the transparent image sensor; and
c) a camera controller coupled to the color image sensor and the transparent image sensor, wherein the camera controller is configured to be based on calibration data obtained by the calibration step, wherein the calibration data is stored in a one-time programmable memory or an EEPROM of the dual aperture digital camera, wherein the camera controller is further configured to pre-process the color and luminance images to obtain corresponding corrected color and luminance images, register the corrected color and luminance images to obtain corresponding registered color and luminance images, and merge data from the registered color and luminance images with data from the color image.
17. The dual-aperture digital camera of claim 16, further comprising an AF mechanism mechanically coupled to and for performing AF operations on at least the first optel module.
18. A dual-aperture digital camera, comprising:
a) a first sub-camera comprising a first optical element module having a corresponding first optical axis, a first color image sensor covered with a color filter array, and an infrared IR filter blocking IR wavelengths from entering the color image sensor, wherein the first sub-camera is arranged to output a first image;
b) a second sub-camera comprising a second optical element module having a corresponding second optical axis and a second image sensor configurable to allow at least some IR wavelengths into the transparent image sensor, wherein the second sub-camera is configured to output a second image; and
c) an image fusion algorithm structure that merges data from the first and second images into a merged color image, wherein data in an out-of-focus region in the second image is not fused with corresponding data in the first image.
19. A method for fusing an image of a first sub-camera and an image of a second sub-camera in a dual-camera, comprising:
a) simultaneously obtaining a color image of an object or scene with the first sub-camera and a luminance image with the second sub-camera, wherein the first sub-camera comprises a first optical element module, wherein the second sub-camera comprises a second optical element module, and wherein the first and second sub-cameras have substantially the same field of view;
b) using an AF mechanism mechanically coupled to the at least first optical element module for performing an AF operation on the at least first optical element module;
c) pre-processing the color and luminance images to obtain corresponding rectified and scaled color and luminance images while taking into account sharpness differences due to the AF operation;
d) performing registration between the rectified and scaled color and luminance images to obtain a registered image; and
d) and fusing the registered images into a focused fusion color image.
20. The method of claim 19, wherein the fusing of the registered images is not performed in the out-of-focus region.
21. The method of claim 19, wherein the pre-processing step to obtain the corresponding rectified and scaled color and luminance images comprises computing a set of respective points in the color and luminance images, extracting a single coordinate from each respective point, and using the single coordinate to estimate a scaling factor S between the color and luminance images.
22. The method of claim 21, further comprising the step of scaling one of the images to match the other image using a scaling factor S to obtain a registered image.
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201361861185P | 2013-08-01 | 2013-08-01 | |
US61/861,185 | 2013-08-01 | ||
CN201480043316.7A CN105917641B (en) | 2013-08-01 | 2014-07-24 | With the slim multiple aperture imaging system focused automatically and its application method |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201480043316.7A Division CN105917641B (en) | 2013-08-01 | 2014-07-24 | With the slim multiple aperture imaging system focused automatically and its application method |
Publications (2)
Publication Number | Publication Date |
---|---|
CN108718376A CN108718376A (en) | 2018-10-30 |
CN108718376B true CN108718376B (en) | 2020-08-14 |
Family
ID=52432504
Family Applications (6)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201810946469.2A Active CN108989648B (en) | 2013-08-01 | 2014-07-24 | Thin multi-aperture imaging system with auto-focus and method of use thereof |
CN201811063380.8A Active CN109246339B (en) | 2013-08-01 | 2014-07-24 | Dual aperture digital camera for imaging an object or scene |
CN201810567323.7A Active CN108718376B (en) | 2013-08-01 | 2014-07-24 | Thin multi-aperture imaging system with auto-focus and method of use thereof |
CN201480043316.7A Active CN105917641B (en) | 2013-08-01 | 2014-07-24 | With the slim multiple aperture imaging system focused automatically and its application method |
CN201810946529.0A Active CN108989649B (en) | 2013-08-01 | 2014-07-24 | Thin multi-aperture imaging system with auto-focus and method of use thereof |
CN201811064283.0A Active CN109120823B (en) | 2013-08-01 | 2014-07-24 | Thin multi-aperture imaging system with auto-focus and method of use thereof |
Family Applications Before (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201810946469.2A Active CN108989648B (en) | 2013-08-01 | 2014-07-24 | Thin multi-aperture imaging system with auto-focus and method of use thereof |
CN201811063380.8A Active CN109246339B (en) | 2013-08-01 | 2014-07-24 | Dual aperture digital camera for imaging an object or scene |
Family Applications After (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201480043316.7A Active CN105917641B (en) | 2013-08-01 | 2014-07-24 | With the slim multiple aperture imaging system focused automatically and its application method |
CN201810946529.0A Active CN108989649B (en) | 2013-08-01 | 2014-07-24 | Thin multi-aperture imaging system with auto-focus and method of use thereof |
CN201811064283.0A Active CN109120823B (en) | 2013-08-01 | 2014-07-24 | Thin multi-aperture imaging system with auto-focus and method of use thereof |
Country Status (5)
Country | Link |
---|---|
US (10) | US9571731B2 (en) |
EP (1) | EP3028443A2 (en) |
CN (6) | CN108989648B (en) |
IL (4) | IL243776B (en) |
WO (1) | WO2015015383A2 (en) |
Families Citing this family (82)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109194849B (en) | 2013-06-13 | 2021-01-15 | 核心光电有限公司 | Double-aperture zooming digital camera |
US9857568B2 (en) | 2013-07-04 | 2018-01-02 | Corephotonics Ltd. | Miniature telephoto lens assembly |
WO2015001440A1 (en) | 2013-07-04 | 2015-01-08 | Corephotonics Ltd. | Miniature telephoto lens assembly |
EP3028443A2 (en) * | 2013-08-01 | 2016-06-08 | Corephotonics Ltd. | Thin multi-aperture imaging system with auto-focus and methods for using same |
US9448382B2 (en) | 2013-11-06 | 2016-09-20 | Corephotonics Ltd. | Electromagnetic actuators for digital cameras |
EP3164987B1 (en) | 2014-07-01 | 2024-01-03 | Apple Inc. | Mobile camera system |
US11381747B2 (en) | 2015-02-13 | 2022-07-05 | Apple Inc. | Dual camera magnet arrangement |
US9781345B1 (en) | 2015-02-13 | 2017-10-03 | Apple Inc. | Dual camera magnet arrangement |
KR102480080B1 (en) * | 2015-04-16 | 2022-12-22 | 코어포토닉스 리미티드 | Auto focus and optical imagestabilization in a compact folded camera |
WO2016195135A1 (en) * | 2015-06-03 | 2016-12-08 | 재단법인 다차원 스마트 아이티 융합시스템 연구단 | Multi-aperture camera system having auto focusing function and/or depth estimation function |
TWI569640B (en) * | 2015-06-23 | 2017-02-01 | 台灣東電化股份有限公司 | Camera module |
CN107533272B (en) * | 2015-06-24 | 2020-09-11 | 核心光电有限公司 | Low-profile triaxial actuator for folded lens camera |
US10523854B2 (en) | 2015-06-25 | 2019-12-31 | Intel Corporation | Array imaging system having discrete camera modules and method for manufacturing the same |
KR102336447B1 (en) * | 2015-07-07 | 2021-12-07 | 삼성전자주식회사 | Image capturing apparatus and method for the same |
EP3598737B1 (en) * | 2015-08-13 | 2020-12-09 | Corephotonics Ltd. | Dual aperture zoom camera with video support and switching / non-switching dynamic control |
DE102015215845B4 (en) * | 2015-08-19 | 2017-06-22 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Multi-aperture imaging device with channel-specific adjustability |
DE102015215844B4 (en) * | 2015-08-19 | 2017-05-18 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | A multi-aperture imaging apparatus, a portable apparatus, and a method of manufacturing a multi-aperture imaging apparatus |
DE102015215836B4 (en) * | 2015-08-19 | 2017-05-18 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Multiaperture imaging device with a reflective facet beam deflection device |
DE102015215837A1 (en) * | 2015-08-19 | 2017-02-23 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Multi-aperture imaging apparatus, method of making same and imaging system |
DE102015215840B4 (en) * | 2015-08-19 | 2017-03-23 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | A multi-aperture imaging apparatus, imaging system, and method of providing a multi-aperture imaging apparatus |
DE102015215841B4 (en) * | 2015-08-19 | 2017-06-01 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Apparatus with a multi-channel imaging device and method of making the same |
US10063783B2 (en) * | 2015-09-30 | 2018-08-28 | Apple Inc. | Mobile zoom using multiple optical image stabilization cameras |
US9774787B2 (en) | 2015-09-30 | 2017-09-26 | Apple Inc. | Mobile zoom using multiple optical image stabilization cameras |
US10264188B2 (en) | 2015-09-30 | 2019-04-16 | Apple Inc. | Mobile zoom using multiple optical image stabilization cameras |
US9769389B2 (en) | 2015-09-30 | 2017-09-19 | Apple Inc. | Mobile zoom using multiple optical image stabilization cameras |
US9769419B2 (en) | 2015-09-30 | 2017-09-19 | Cisco Technology, Inc. | Camera system for video conference endpoints |
US10382698B2 (en) | 2015-09-30 | 2019-08-13 | Apple Inc. | Mobile zoom using multiple optical image stabilization cameras |
US10097747B2 (en) * | 2015-10-21 | 2018-10-09 | Qualcomm Incorporated | Multiple camera autofocus synchronization |
KR102480600B1 (en) | 2015-10-21 | 2022-12-23 | 삼성전자주식회사 | Method for low-light image quality enhancement of image processing devices and method of operating an image processing system for performing the method |
JP6711612B2 (en) * | 2015-12-21 | 2020-06-17 | キヤノン株式会社 | Image processing apparatus, image processing method, and imaging apparatus |
US9781324B2 (en) * | 2016-02-18 | 2017-10-03 | Ningbo Sunny Opotech Co., Ltd. | Array imaging module and molded photosensitive assembly, circuit board assembly and manufacturing methods thereof for electronic device |
US10630876B2 (en) * | 2016-02-18 | 2020-04-21 | Ningbo Sunny Opotech Co., Ltd. | Array imaging module and molded photosensitive assembly, circuit board assembly and manufacturing methods thereof for electronic device |
JP2019519087A (en) * | 2016-03-12 | 2019-07-04 | ニンボー サニー オプテック カンパニー,リミテッド | Array imaging module and molded photosensitive assembly, and method of manufacturing the same for electronic devices |
US10750071B2 (en) * | 2016-03-12 | 2020-08-18 | Ningbo Sunny Opotech Co., Ltd. | Camera module with lens array arrangement, circuit board assembly, and image sensor and manufacturing method thereof |
DE102016204148A1 (en) | 2016-03-14 | 2017-09-14 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Multi-aperture imaging apparatus, imaging system and method for detecting an object area |
CN107205109B (en) * | 2016-03-18 | 2020-10-09 | 聚晶半导体股份有限公司 | Electronic device with multiple camera modules and control method thereof |
US10362205B2 (en) | 2016-04-28 | 2019-07-23 | Qualcomm Incorporated | Performing intensity equalization with respect to mono and color images |
US11536930B2 (en) | 2016-05-24 | 2022-12-27 | Microsoft Licensing Technology, LLC. | Suspended actuator |
KR101785458B1 (en) | 2016-06-07 | 2017-10-16 | 엘지전자 주식회사 | Camera module and mobile terminal having the same |
EP4020958B1 (en) * | 2016-06-19 | 2023-10-25 | Corephotonics Ltd. | Frame synchronization in a dual-aperture camera system |
KR102636272B1 (en) | 2016-07-26 | 2024-02-14 | 삼성전자주식회사 | Image pickup device and electronic system including the same |
EP3504587A4 (en) * | 2016-08-24 | 2020-04-15 | Hutchinson Technology Incorporated | Dual camera assemblies with optical image stabilization |
TWI613477B (en) * | 2016-09-12 | 2018-02-01 | 台睿精工股份有限公司 | Structure of dual-lens with mechanic zero tile angle and adjustment method thereof |
EP3513380B1 (en) * | 2016-10-26 | 2023-12-27 | Huawei Technologies Co., Ltd. | Method and device for depth detection using stereo images |
US9860456B1 (en) * | 2016-11-11 | 2018-01-02 | Motorola Mobility Llc | Bayer-clear image fusion for dual camera |
KR101823272B1 (en) * | 2016-12-01 | 2018-01-29 | 삼성전기주식회사 | Camera module |
CN206339770U (en) * | 2016-12-10 | 2017-07-18 | 瑞声科技(新加坡)有限公司 | Twin-lens module and the electronic equipment using the twin-lens module |
US11143938B2 (en) * | 2017-02-10 | 2021-10-12 | Lg Innotek Co., Ltd. | Lens driving device, camera module and optical instrument |
US10154204B2 (en) * | 2017-03-09 | 2018-12-11 | Nokia Of America Corporation | Video compressive sensing with side information |
WO2018176493A1 (en) * | 2017-04-01 | 2018-10-04 | SZ DJI Technology Co., Ltd. | Low-profile multi-band hyperspectral imaging for machine vision |
DE102017206442B4 (en) * | 2017-04-13 | 2021-01-28 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Device for imaging partial fields of view, multi-aperture imaging device and method for providing the same |
US10567645B2 (en) * | 2017-05-17 | 2020-02-18 | Samsung Electronics Co., Ltd. | Method and apparatus for capturing video data |
CN109040534A (en) * | 2017-06-12 | 2018-12-18 | 杭州海康威视数字技术股份有限公司 | A kind of image processing method and image capture device |
CN107277348B (en) | 2017-06-16 | 2019-08-16 | Oppo广东移动通信有限公司 | Focusing method, device, computer readable storage medium and mobile terminal |
US11218626B2 (en) * | 2017-07-28 | 2022-01-04 | Black Sesame International Holding Limited | Fast focus using dual cameras |
KR102378472B1 (en) | 2017-08-10 | 2022-03-25 | 삼성전자주식회사 | Method for capturing image using camera including driving device capable of rotating mirror and electronic device |
US10462370B2 (en) | 2017-10-03 | 2019-10-29 | Google Llc | Video stabilization |
US11263782B2 (en) * | 2017-10-11 | 2022-03-01 | Qualcomm Incorporated | Image signal processor for processing images |
KR102318013B1 (en) * | 2017-10-13 | 2021-10-27 | 삼성전자 주식회사 | Electronic device composing a plurality of images and method |
CN107765392A (en) * | 2017-11-29 | 2018-03-06 | 瑞声声学科技(苏州)有限公司 | Twin-lens module group drive device |
US10171738B1 (en) | 2018-05-04 | 2019-01-01 | Google Llc | Stabilizing video to reduce camera and face movement |
CN108900772A (en) * | 2018-07-19 | 2018-11-27 | 维沃移动通信有限公司 | A kind of mobile terminal and image capturing method |
US11272112B2 (en) * | 2018-08-08 | 2022-03-08 | Canon Kabushiki Kaisha | Image capturing apparatus |
TWI761575B (en) * | 2018-08-16 | 2022-04-21 | 先進光電科技股份有限公司 | Optical image capturing module、system and manufacturing method thereof |
TWI768105B (en) * | 2018-08-16 | 2022-06-21 | 先進光電科技股份有限公司 | Optical image capturing module, system and manufacturing method thereof |
TWI768102B (en) * | 2018-08-16 | 2022-06-21 | 先進光電科技股份有限公司 | Optical image capturing module, system and manufacturing method thereof |
TWI771472B (en) * | 2018-08-16 | 2022-07-21 | 先進光電科技股份有限公司 | Optical image capturing module、system and manufacturing method thereof |
TWI768106B (en) * | 2018-08-16 | 2022-06-21 | 先進光電科技股份有限公司 | Optical image capturing module、system and manufacturing method thereof |
TWI746881B (en) * | 2018-08-16 | 2021-11-21 | 先進光電科技股份有限公司 | Optical image capturing module、system and manufacturing method thereof |
DE102018222861A1 (en) * | 2018-12-21 | 2020-06-25 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Device with a multi-aperture imaging device for accumulating image information |
KR102648912B1 (en) * | 2019-01-23 | 2024-03-19 | 삼성전자주식회사 | Processor analyzing image data and generating final image data |
KR20190088930A (en) * | 2019-07-09 | 2019-07-29 | 엘지전자 주식회사 | Display Pixel Automatic Inspection System and method |
US11849099B2 (en) * | 2019-09-02 | 2023-12-19 | Trieye Ltd. | Multi-view image fusion by image space equalization and stereo-based rectification from two different cameras |
CN110769151B (en) * | 2019-09-27 | 2021-10-15 | 维沃移动通信有限公司 | Image processing method, image processing apparatus, electronic device, and medium |
KR20210151450A (en) | 2020-06-05 | 2021-12-14 | 에스케이하이닉스 주식회사 | Smart binning circuit, image sensing device and operation method thereof |
US11190689B1 (en) | 2020-07-29 | 2021-11-30 | Google Llc | Multi-camera video stabilization |
US11496660B2 (en) * | 2020-09-04 | 2022-11-08 | Altek Semiconductor Corp. | Dual sensor imaging system and depth map calculation method thereof |
US11418719B2 (en) | 2020-09-04 | 2022-08-16 | Altek Semiconductor Corp. | Dual sensor imaging system and calibration method which includes a color sensor and an infrared ray sensor to perform image alignment and brightness matching |
US11689822B2 (en) | 2020-09-04 | 2023-06-27 | Altek Semiconductor Corp. | Dual sensor imaging system and privacy protection imaging method thereof |
US11496694B2 (en) | 2020-09-04 | 2022-11-08 | Altek Semiconductor Corp. | Dual sensor imaging system and imaging method thereof |
US11568526B2 (en) * | 2020-09-04 | 2023-01-31 | Altek Semiconductor Corp. | Dual sensor imaging system and imaging method thereof |
US11924563B2 (en) * | 2021-12-22 | 2024-03-05 | Qualcomm Incorporated | High dynamic range (HDR) photography with in-sensor zoom |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2010116367A1 (en) * | 2009-04-07 | 2010-10-14 | Nextvision Stabilized Systems Ltd | Continuous electronic zoom for an imaging system with multiple imaging devices having different fixed fov |
CN102037717A (en) * | 2008-05-20 | 2011-04-27 | 派力肯成像公司 | Capturing and processing of images using monolithic camera array with hetergeneous imagers |
CN102511013A (en) * | 2010-07-23 | 2012-06-20 | 索尼公司 | Imaging device, method for controlling same, and program |
CN102982518A (en) * | 2012-11-06 | 2013-03-20 | 扬州万方电子技术有限责任公司 | Fusion method of infrared image and visible light dynamic image and fusion device of infrared image and visible light dynamic image |
TWI399975B (en) * | 2008-02-01 | 2013-06-21 | Omnivision Tech Inc | Fusing of images captured by a multi-aperture imaging system |
CN103229509A (en) * | 2010-02-19 | 2013-07-31 | 双光圈股份有限公司 | Processing multi-perture image data |
Family Cites Families (504)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US3085354A (en) | 1957-01-31 | 1963-04-16 | Westinghouse Electric Corp | Multi-gimbal flight simulator |
US3149327A (en) | 1957-06-26 | 1964-09-15 | Robert W Bogle | Microwave superregenerative pulse radar |
US3238695A (en) | 1961-06-05 | 1966-03-08 | Warrick Equipment Corp | Packaging machine |
US3274552A (en) | 1962-06-25 | 1966-09-20 | Martin Marietta Corp | Adaptive missile control system |
US3115825A (en) | 1962-07-18 | 1963-12-31 | Great West Super Markets Inc | Eradicator attachment for marking stamps |
US3483452A (en) | 1968-09-11 | 1969-12-09 | Hercules Inc | Capacitors with polypropylene film and liquid dielectrics |
US3584513A (en) | 1969-01-06 | 1971-06-15 | Singer General Precision | Self-calibrating system for navigational instruments |
US3941001A (en) | 1973-11-09 | 1976-03-02 | Lear Siegler, Inc. | Gimbal control mechanism |
GB1462795A (en) | 1974-04-02 | 1977-01-26 | Baker Perkins Holdings Ltd | Jaw crushers |
US4199785A (en) | 1979-01-05 | 1980-04-22 | Honeywell Inc. | Electronic zoom system |
JPS59191146A (en) | 1983-04-13 | 1984-10-30 | Hitachi Ltd | Optical scanner |
US5099263A (en) | 1984-11-10 | 1992-03-24 | Minolta Camera Kabushiki Kaisha | Variable focal length camera |
JPH0690350B2 (en) | 1986-12-15 | 1994-11-14 | 富士写真光機株式会社 | camera |
EP0342419B1 (en) | 1988-05-19 | 1992-10-28 | Siemens Aktiengesellschaft | Method for the observation of a scene and apparatus therefor |
DE3927334C1 (en) | 1989-08-18 | 1991-01-10 | Messerschmitt-Boelkow-Blohm Gmbh, 8012 Ottobrunn, De | |
JP2703105B2 (en) | 1989-10-20 | 1998-01-26 | 富士写真フイルム株式会社 | Image stabilization device |
US5032917A (en) | 1990-03-12 | 1991-07-16 | Rca Licensing Corporation | Video signal blending apparatus |
JPH0443773A (en) | 1990-06-11 | 1992-02-13 | Matsushita Electric Ind Co Ltd | Arithmetic circuit |
US5041852A (en) | 1990-10-18 | 1991-08-20 | Fjui Photo Film Co., Ltd. | Camera shake correction system |
JP3261152B2 (en) | 1991-03-13 | 2002-02-25 | シャープ株式会社 | Imaging device having a plurality of optical systems |
US5394520A (en) | 1991-09-26 | 1995-02-28 | Hughes Aircraft Company | Imaging apparatus for providing a composite digital representation of a scene within a field of regard |
US5657402A (en) | 1991-11-01 | 1997-08-12 | Massachusetts Institute Of Technology | Method of creating a high resolution still image using a plurality of images and apparatus for practice of the method |
JP3103166B2 (en) | 1991-11-26 | 2000-10-23 | 富士写真光機株式会社 | Macro lens with a long exit pupil |
US5248971A (en) | 1992-05-19 | 1993-09-28 | Mandl William J | Method and apparatus for multiplexed oversampled analog to digital modulation |
JP3218730B2 (en) | 1992-10-19 | 2001-10-15 | 株式会社ニコン | Focus adjustment device with prediction function |
JPH06177706A (en) | 1992-12-08 | 1994-06-24 | Sony Corp | Signal processing unit |
EP0605045B1 (en) | 1992-12-29 | 1999-03-31 | Laboratoires D'electronique Philips S.A.S. | Image processing method and apparatus for generating one image from adjacent images |
US5682198A (en) | 1993-06-28 | 1997-10-28 | Canon Kabushiki Kaisha | Double eye image pickup apparatus |
US5805140A (en) | 1993-07-16 | 1998-09-08 | Immersion Corporation | High bandwidth force feedback interface using voice coils and flexures |
US6128416A (en) | 1993-09-10 | 2000-10-03 | Olympus Optical Co., Ltd. | Image composing technique for optimally composing a single image from a plurality of digital images |
JP3355787B2 (en) | 1994-05-20 | 2002-12-09 | ソニー株式会社 | Optical axis correction mechanism |
US6714665B1 (en) | 1994-09-02 | 2004-03-30 | Sarnoff Corporation | Fully automated iris recognition system utilizing wide and narrow fields of view |
CA2155719C (en) | 1994-11-22 | 2005-11-01 | Terry Laurence Glatt | Video surveillance system with pilot and slave cameras |
JPH08271976A (en) | 1995-03-29 | 1996-10-18 | Canon Inc | Camera |
JPH0995194A (en) | 1995-09-29 | 1997-04-08 | Aisin Seiki Co Ltd | Detecting device for object in front of vehicle |
US5768443A (en) | 1995-12-19 | 1998-06-16 | Cognex Corporation | Method for coordinating multiple fields of view in multi-camera |
US5982951A (en) | 1996-05-28 | 1999-11-09 | Canon Kabushiki Kaisha | Apparatus and method for combining a plurality of images |
US5926190A (en) | 1996-08-21 | 1999-07-20 | Apple Computer, Inc. | Method and system for simulating motion in a computer graphics application using image registration and view interpolation |
JPH10126796A (en) | 1996-09-12 | 1998-05-15 | Eastman Kodak Co | Digital camera for dynamic and still images using dual mode software processing |
US5975703A (en) | 1996-09-30 | 1999-11-02 | Digital Optics International | Image projection system |
US5960218A (en) | 1997-02-18 | 1999-09-28 | Mobi Corporation | Dual focal length camera |
US5940641A (en) | 1997-07-10 | 1999-08-17 | Eastman Kodak Company | Extending panoramic images |
GB9720911D0 (en) | 1997-10-03 | 1997-12-03 | Britax Rainsfords Pty Ltd | Hall effect sensor system |
US6148120A (en) | 1997-10-30 | 2000-11-14 | Cognex Corporation | Warping of focal images to correct correspondence error |
US6341180B1 (en) | 1997-12-18 | 2002-01-22 | Cellavision Ab | Image content autofocus for microscopy using a noise-insensitive focus filter |
JP3695119B2 (en) | 1998-03-05 | 2005-09-14 | 株式会社日立製作所 | Image synthesizing apparatus and recording medium storing program for realizing image synthesizing method |
US6208765B1 (en) | 1998-06-19 | 2001-03-27 | Sarnoff Corporation | Method and apparatus for improving image resolution |
US7057647B1 (en) * | 2000-06-14 | 2006-06-06 | E-Watch, Inc. | Dual-mode camera system for day/night or variable zoom operation |
GB9823689D0 (en) | 1998-10-30 | 1998-12-23 | Greenagate Limited | Improved methods and apparatus for 3-D imaging |
US6211668B1 (en) | 1998-12-09 | 2001-04-03 | Cts | Magnetic position sensor having opposed tapered magnets |
US6611289B1 (en) | 1999-01-15 | 2003-08-26 | Yanbin Yu | Digital cameras using multiple sensors with multiple lenses |
JP3861855B2 (en) | 1999-01-21 | 2006-12-27 | 日本電気株式会社 | Image input device |
US6738073B2 (en) | 1999-05-12 | 2004-05-18 | Imove, Inc. | Camera system with both a wide angle view and a high resolution view |
US20020063711A1 (en) | 1999-05-12 | 2002-05-30 | Imove Inc. | Camera system with high resolution image inside a wide angle view |
US20020075258A1 (en) | 1999-05-12 | 2002-06-20 | Imove Inc. | Camera system with high resolution image inside a wide angle view |
US6346950B1 (en) | 1999-05-20 | 2002-02-12 | Compaq Computer Corporation | System and method for display images using anamorphic video |
US6222359B1 (en) | 1999-06-18 | 2001-04-24 | Cts Corporation | Non-contacting position sensor using radial bipolar tapered magnets |
US7038716B2 (en) | 1999-07-30 | 2006-05-02 | Pixim, Inc. | Mobile device equipped with digital image sensor |
US7015954B1 (en) | 1999-08-09 | 2006-03-21 | Fuji Xerox Co., Ltd. | Automatic video system using multiple cameras |
US6650368B1 (en) | 1999-10-26 | 2003-11-18 | Hewlett-Packard Development Company, Lp. | Digital camera and method of enhancing zoom effects |
DE19955886A1 (en) | 1999-11-20 | 2001-05-23 | Bosch Gmbh Robert | Solenoid valve with a check valve |
US6643416B1 (en) | 1999-11-30 | 2003-11-04 | Eastman Kodak Company | Method for determining necessary resolution for zoom and crop images |
US6553106B1 (en) | 1999-12-27 | 2003-04-22 | Avaya Technology Corp. | Alphanumeric messaging system |
FI20000556A0 (en) | 2000-03-10 | 2000-03-10 | Vaasa Control Oy | Capacitor mounting and protective arrangement |
KR100456319B1 (en) | 2000-05-19 | 2004-11-10 | 주식회사 하이닉스반도체 | Method for forming gate of semiconductor device by using polishing selectivity difference between polymer and oxide layer |
US20020005902A1 (en) | 2000-06-02 | 2002-01-17 | Yuen Henry C. | Automatic video recording system using wide-and narrow-field cameras |
JP2002010276A (en) | 2000-06-22 | 2002-01-11 | Olympus Optical Co Ltd | Imaging apparatus |
JP4501239B2 (en) | 2000-07-13 | 2010-07-14 | ソニー株式会社 | Camera calibration apparatus and method, and storage medium |
US7002583B2 (en) | 2000-08-03 | 2006-02-21 | Stono Technologies, Llc | Display of images and image transitions |
US6778207B1 (en) | 2000-08-07 | 2004-08-17 | Koninklijke Philips Electronics N.V. | Fast digital pan tilt zoom video |
US7345277B2 (en) * | 2000-08-09 | 2008-03-18 | Evan Zhang | Image intensifier and LWIR fusion/combination system |
JP2002099014A (en) | 2000-09-22 | 2002-04-05 | Nikon Corp | Signal predicting apparatus and camera provided with the same |
JP2002214662A (en) | 2001-01-23 | 2002-07-31 | Olympus Optical Co Ltd | Shake correcting device for optical device |
US6741250B1 (en) | 2001-02-09 | 2004-05-25 | Be Here Corporation | Method and system for generation of multiple viewpoints into a scene viewed by motionless cameras and for presentation of a view path |
GB2372659A (en) | 2001-02-23 | 2002-08-28 | Sharp Kk | A method of rectifying a stereoscopic image |
US20040012698A1 (en) * | 2001-03-05 | 2004-01-22 | Yasuo Suda | Image pickup model and image pickup device |
JP2002277930A (en) | 2001-03-21 | 2002-09-25 | Asahi Optical Co Ltd | Camera equipped with lens barrier |
US7346217B1 (en) | 2001-04-25 | 2008-03-18 | Lockheed Martin Corporation | Digital image enhancement using successive zoom images |
JP2002341220A (en) | 2001-05-14 | 2002-11-27 | Olympus Optical Co Ltd | Optical instrument |
GB0116877D0 (en) | 2001-07-10 | 2001-09-05 | Hewlett Packard Co | Intelligent feature selection and pan zoom control |
US6680748B1 (en) | 2001-09-27 | 2004-01-20 | Pixim, Inc., | Multi-mode camera and method therefor |
US20030093805A1 (en) | 2001-11-15 | 2003-05-15 | Gin J.M. Jack | Dual camera surveillance and control system |
US7339621B2 (en) | 2001-12-13 | 2008-03-04 | Psion Teklogix Systems, Inc. | Imager output signal processing |
JP2003309748A (en) | 2002-02-13 | 2003-10-31 | Fuji Photo Film Co Ltd | Portable telephone set with image sensing unit and method of controlling the same |
JP4198449B2 (en) | 2002-02-22 | 2008-12-17 | 富士フイルム株式会社 | Digital camera |
JP2003298920A (en) | 2002-03-29 | 2003-10-17 | Fuji Photo Film Co Ltd | Digital camera |
JP2003304024A (en) | 2002-04-12 | 2003-10-24 | Nippon Telegr & Teleph Corp <Ntt> | Optical module with built-in drive circuit |
GB2388265B (en) | 2002-04-30 | 2005-10-12 | Hewlett Packard Co | Improvements in and relating to processing of images |
JP4657564B2 (en) | 2002-04-30 | 2011-03-23 | イーストマン コダック カンパニー | Electronic still camera and image processing method |
CA2386560A1 (en) | 2002-05-15 | 2003-11-15 | Idelix Software Inc. | Controlling optical hardware and dynamic data viewing systems with detail-in-context viewing tools |
JP3870124B2 (en) | 2002-06-14 | 2007-01-17 | キヤノン株式会社 | Image processing apparatus and method, computer program, and computer-readable storage medium |
US6839067B2 (en) | 2002-07-26 | 2005-01-04 | Fuji Xerox Co., Ltd. | Capturing and producing shared multi-resolution video |
JP2004260787A (en) | 2002-09-09 | 2004-09-16 | Rohm Co Ltd | Image sensor module |
US20040061788A1 (en) | 2002-09-26 | 2004-04-01 | Logitech Europe S.A. | Multiple mode capture button for a digital camera |
JP4481560B2 (en) | 2002-10-08 | 2010-06-16 | オリンパス株式会社 | Lens barrel |
US7321470B2 (en) | 2002-10-08 | 2008-01-22 | Olympus Corporation | Camera |
GB2394852B (en) | 2002-10-31 | 2006-12-20 | Hewlett Packard Co | Image capture systems using motion detection |
JP2004219569A (en) | 2003-01-10 | 2004-08-05 | Olympus Corp | Electronic image pickup unit |
JP3861815B2 (en) | 2003-01-17 | 2006-12-27 | コニカミノルタフォトイメージング株式会社 | Camera with image stabilization function |
JP4055599B2 (en) | 2003-02-13 | 2008-03-05 | コニカミノルタオプト株式会社 | Imaging lens device and electronic apparatus equipped with the same |
WO2004074853A2 (en) | 2003-02-14 | 2004-09-02 | Bei Sensors And Systems Company, Inc. | Position sensor utilizing a linear hall-effect sensor, having a magnet arrangement for an increased linearity |
AU2003236050A1 (en) | 2003-03-20 | 2004-10-11 | Seijiro Tomita | Panoramic picture creating method and device, and monitor system using the method and device |
EP1626301B1 (en) | 2003-05-15 | 2011-03-30 | Konica Minolta Opto, Inc. | Optical system and imaging device |
US20040240052A1 (en) | 2003-06-02 | 2004-12-02 | Pentax Corporation | Multiple-focal imaging device, and a mobile device having the multiple-focal-length imaging device |
US7596284B2 (en) | 2003-07-16 | 2009-09-29 | Hewlett-Packard Development Company, L.P. | High resolution image reconstruction |
US7619683B2 (en) | 2003-08-29 | 2009-11-17 | Aptina Imaging Corporation | Apparatus including a dual camera module and method of using the same |
JP2005099265A (en) | 2003-09-24 | 2005-04-14 | Fujinon Corp | Imaging apparatus, imaging method, and range finding method |
JP2005122084A (en) | 2003-09-25 | 2005-05-12 | Kyocera Corp | Optical element module |
CN1544990A (en) * | 2003-11-12 | 2004-11-10 | 浙江大学 | Imaging method as Dichronic imaging by four lens |
EP1536633A1 (en) | 2003-11-27 | 2005-06-01 | Sony Corporation | Photographing apparatus and method, supervising system, program and recording medium |
US7746396B2 (en) * | 2003-12-17 | 2010-06-29 | Nokia Corporation | Imaging device and method of creating image file |
KR100557040B1 (en) | 2003-12-30 | 2006-03-03 | 엘지전자 주식회사 | Optical pick-up system |
JP2005208194A (en) | 2004-01-21 | 2005-08-04 | Konica Minolta Photo Imaging Inc | Photographing apparatus |
US7773143B2 (en) * | 2004-04-08 | 2010-08-10 | Tessera North America, Inc. | Thin color camera having sub-pixel resolution |
KR20050090780A (en) | 2004-03-10 | 2005-09-14 | 삼성전자주식회사 | Image photographing apparatus |
US7620265B1 (en) * | 2004-04-12 | 2009-11-17 | Equinox Corporation | Color invariant image fusion of visible and thermal infrared video |
EP1594321A3 (en) * | 2004-05-07 | 2006-01-25 | Dialog Semiconductor GmbH | Extended dynamic range in color imagers |
JP4201140B2 (en) | 2004-05-10 | 2008-12-24 | 株式会社コルグ | Operator |
WO2006040687A2 (en) | 2004-07-19 | 2006-04-20 | Grandeye, Ltd. | Automatically expanding the zoom capability of a wide-angle video camera |
EP1780567B1 (en) | 2004-07-20 | 2011-09-14 | Five Dimension Co., Ltd. | Electronic imaging device |
US7916180B2 (en) | 2004-08-25 | 2011-03-29 | Protarius Filo Ag, L.L.C. | Simultaneous multiple field of view digital cameras |
WO2006026354A2 (en) * | 2004-08-25 | 2006-03-09 | Newport Imaging Corporation | Apparatus for multiple camera devices and method of operating same |
US7564019B2 (en) | 2005-08-25 | 2009-07-21 | Richard Ian Olsen | Large dynamic range cameras |
EP1787463A1 (en) * | 2004-09-09 | 2007-05-23 | Nokia Corporation | Method of creating colour image, imaging device and imaging module |
US7465107B2 (en) | 2004-09-21 | 2008-12-16 | Canon Kabushiki Kaisha | Photographing apparatus and control method therefor |
KR101054344B1 (en) | 2004-11-17 | 2011-08-04 | 삼성전자주식회사 | Thin film transistor array panel and manufacturing method thereof |
US8531562B2 (en) * | 2004-12-03 | 2013-09-10 | Fluke Corporation | Visible light and IR combined image camera with a laser pointer |
EP1669251A1 (en) | 2004-12-07 | 2006-06-14 | IEE INTERNATIONAL ELECTRONICS & ENGINEERING S.A. | Child seat detection system |
US7688364B2 (en) | 2004-12-10 | 2010-03-30 | Ambarella, Inc. | Decimating and cropping based zoom factor for a digital camera |
US20060126737A1 (en) | 2004-12-15 | 2006-06-15 | International Business Machines Corporation | Method, system and program product for a camera to track an object using motion vector data |
KR100636969B1 (en) | 2004-12-30 | 2006-10-19 | 매그나칩 반도체 유한회사 | image sensor with built-in ISP and dual camera system |
JP2006191411A (en) | 2005-01-07 | 2006-07-20 | Canon Inc | Camera control apparatus, image display apparatus, method for controlling camera, method for displaying image, and program |
US7573514B2 (en) | 2005-02-03 | 2009-08-11 | Eastman Kodak Company | Digital imaging system with digital zoom warning |
US7965314B1 (en) * | 2005-02-09 | 2011-06-21 | Flir Systems, Inc. | Foveal camera systems and methods |
US7663662B2 (en) | 2005-02-09 | 2010-02-16 | Flir Systems, Inc. | High and low resolution camera systems and methods |
US7646400B2 (en) | 2005-02-11 | 2010-01-12 | Creative Technology Ltd | Method and apparatus for forming a panoramic image |
US7236306B2 (en) | 2005-02-18 | 2007-06-26 | Eastman Kodak Company | Digital camera using an express zooming mode to provide expedited operation over an extended zoom range |
US20060187322A1 (en) | 2005-02-18 | 2006-08-24 | Janson Wilbert F Jr | Digital camera using multiple fixed focal length lenses and multiple image sensors to provide an extended zoom range |
US7206136B2 (en) | 2005-02-18 | 2007-04-17 | Eastman Kodak Company | Digital camera using multiple lenses and image sensors to provide an extended zoom range |
US7561191B2 (en) | 2005-02-18 | 2009-07-14 | Eastman Kodak Company | Camera phone using multiple lenses and image sensors to provide an extended zoom range |
US7256944B2 (en) | 2005-02-18 | 2007-08-14 | Eastman Kodak Company | Compact image capture assembly using multiple lenses and image sensors to provide an extended zoom range |
JP2006237914A (en) | 2005-02-24 | 2006-09-07 | Kyocera Corp | Mobile terminal device |
JP2006238325A (en) | 2005-02-28 | 2006-09-07 | Canon Inc | Camera system |
KR100658150B1 (en) | 2005-04-08 | 2006-12-15 | 삼성전기주식회사 | Camera module and method of manufacturing the same |
JP3934151B2 (en) | 2005-06-22 | 2007-06-20 | 松下電器産業株式会社 | Image generating apparatus and image generating method |
KR20070005946A (en) | 2005-07-05 | 2007-01-11 | 엘지전자 주식회사 | Position detection apparatus of camera lens in the mobile terminal |
JP2007033879A (en) | 2005-07-27 | 2007-02-08 | Sony Corp | Imaging lens device and imaging apparatus |
US7424218B2 (en) | 2005-07-28 | 2008-09-09 | Microsoft Corporation | Real-time preview for panoramic images |
JP4573724B2 (en) | 2005-08-01 | 2010-11-04 | イーストマン コダック カンパニー | Imaging apparatus having a plurality of optical systems |
JP4573725B2 (en) | 2005-08-01 | 2010-11-04 | イーストマン コダック カンパニー | Imaging apparatus having a plurality of optical systems |
US7964835B2 (en) * | 2005-08-25 | 2011-06-21 | Protarius Filo Ag, L.L.C. | Digital cameras with direct luminance and chrominance detection |
JP4188394B2 (en) | 2005-09-20 | 2008-11-26 | フジノン株式会社 | Surveillance camera device and surveillance camera system |
US7872681B2 (en) | 2005-10-13 | 2011-01-18 | Rjs Technology, Inc. | System and method for a high performance color filter mosaic array |
JP4992720B2 (en) | 2005-11-14 | 2012-08-08 | 株式会社ニコン | Image blur correction apparatus and camera |
JP4788953B2 (en) | 2005-11-16 | 2011-10-05 | ソニー株式会社 | Imaging device and zoom lens |
US8238695B1 (en) | 2005-12-15 | 2012-08-07 | Grandeye, Ltd. | Data reduction techniques for processing wide-angle video |
US7423540B2 (en) | 2005-12-23 | 2008-09-09 | Delphi Technologies, Inc. | Method of detecting vehicle-operator state |
US20070177025A1 (en) | 2006-02-01 | 2007-08-02 | Micron Technology, Inc. | Method and apparatus minimizing die area and module size for a dual-camera mobile device |
US20090219547A1 (en) | 2006-02-06 | 2009-09-03 | Petteri Kauhanen | Method and Device for Position Sensing in an Imaging System |
CN101401023A (en) | 2006-02-06 | 2009-04-01 | 诺基亚公司 | Optical image stabilizer using gimballed prism |
JP4579842B2 (en) | 2006-02-06 | 2010-11-10 | イーストマン コダック カンパニー | Imaging device |
US9182228B2 (en) | 2006-02-13 | 2015-11-10 | Sony Corporation | Multi-lens array system and method |
JP4622882B2 (en) | 2006-02-21 | 2011-02-02 | カシオ計算機株式会社 | Digital camera |
EP1999947B1 (en) * | 2006-03-29 | 2012-08-29 | DigitalOptics Corporation Europe Limited | Image capturing device with improved image quality |
US7708478B2 (en) | 2006-04-13 | 2010-05-04 | Nokia Corporation | Actuator mechanism and a shutter mechanism |
EP2016620A2 (en) * | 2006-04-17 | 2009-01-21 | Omnivision Cdm Optics, Inc. | Arrayed imaging systems and associated methods |
US9274807B2 (en) * | 2006-04-20 | 2016-03-01 | Qualcomm Incorporated | Selective hibernation of activities in an electronic device |
US7773121B1 (en) | 2006-05-03 | 2010-08-10 | The United States Of America As Represented By The Administrator Of The National Aeronautics And Space Administration | High-resolution, continuous field-of-view (FOV), non-rotating imaging system |
EP2016759A1 (en) | 2006-05-05 | 2009-01-21 | Nokia Corporation | Optical image recording device with small height and high resolution |
JP2007306282A (en) | 2006-05-11 | 2007-11-22 | Citizen Electronics Co Ltd | Camera module |
KR100749337B1 (en) | 2006-06-13 | 2007-08-14 | 삼성전자주식회사 | Method for photography using a mobile terminal with plural lenses and apparatus therefor |
JP2008011123A (en) * | 2006-06-28 | 2008-01-17 | Fujitsu Ltd | Communication device performing redundant data communication |
US7737379B2 (en) | 2006-07-19 | 2010-06-15 | Witdouck Calvin J | System and method for sorting larvae cocoons |
US8189100B2 (en) | 2006-07-25 | 2012-05-29 | Qualcomm Incorporated | Mobile device with dual digital camera sensors and methods of using the same |
US7756330B2 (en) | 2006-07-27 | 2010-07-13 | Eastman Kodak Company | Producing an extended dynamic range digital image |
JP4875942B2 (en) * | 2006-07-31 | 2012-02-15 | イーストマン コダック カンパニー | Imaging apparatus having a plurality of optical systems |
US7667762B2 (en) | 2006-08-01 | 2010-02-23 | Lifesize Communications, Inc. | Dual sensor video camera |
US20080030592A1 (en) | 2006-08-01 | 2008-02-07 | Eastman Kodak Company | Producing digital image with different resolution portions |
JP2008076485A (en) | 2006-09-19 | 2008-04-03 | Konica Minolta Opto Inc | Lens barrel and imaging apparatus |
JP2008096584A (en) | 2006-10-10 | 2008-04-24 | Nikon Corp | Camera |
KR101278239B1 (en) | 2006-10-17 | 2013-06-24 | 삼성전자주식회사 | Dual lens optical system and Dual lens camera comprising the same |
US7697053B2 (en) | 2006-11-02 | 2010-04-13 | Eastman Kodak Company | Integrated display having multiple capture devices |
JP4448844B2 (en) | 2006-11-22 | 2010-04-14 | 富士フイルム株式会社 | Compound eye imaging device |
KR100871566B1 (en) | 2006-12-04 | 2008-12-02 | 삼성전자주식회사 | Apparatus and method for preventing shaking of image photographing device |
JP4662071B2 (en) * | 2006-12-27 | 2011-03-30 | 富士フイルム株式会社 | Image playback method |
US7533819B2 (en) | 2007-01-31 | 2009-05-19 | Symbol Technologies, Inc. | Dual camera assembly for an imaging-based bar code reader |
US7978239B2 (en) | 2007-03-01 | 2011-07-12 | Eastman Kodak Company | Digital camera using multiple image sensors to provide improved temporal sampling |
US7676146B2 (en) | 2007-03-09 | 2010-03-09 | Eastman Kodak Company | Camera using multiple lenses and image sensors to provide improved focusing capability |
US7859588B2 (en) | 2007-03-09 | 2010-12-28 | Eastman Kodak Company | Method and apparatus for operating a dual lens camera to augment an image |
US7729602B2 (en) | 2007-03-09 | 2010-06-01 | Eastman Kodak Company | Camera using multiple lenses and image sensors operable in a default imaging mode |
US7683962B2 (en) | 2007-03-09 | 2010-03-23 | Eastman Kodak Company | Camera using multiple lenses and image sensors in a rangefinder configuration to provide a range map |
WO2008123675A1 (en) | 2007-04-06 | 2008-10-16 | Korea Expressway Corporation | Multi-area monitoring system from single cctv having a camera quadratic curved surface mirror structure and it, and unwrapping method for the same |
JP5040412B2 (en) | 2007-04-18 | 2012-10-03 | ソニー株式会社 | Image pickup device package, image pickup device module, lens barrel, and image pickup apparatus |
WO2008129552A1 (en) | 2007-04-19 | 2008-10-30 | Dvp Technologies Ltd. | Imaging system and method for use in monitoring a field of regard |
US7918398B2 (en) | 2007-06-04 | 2011-04-05 | Hand Held Products, Inc. | Indicia reading terminal having multiple setting imaging lens |
US8390729B2 (en) | 2007-09-05 | 2013-03-05 | International Business Machines Corporation | Method and apparatus for providing a video image having multiple focal lengths |
US20090086074A1 (en) | 2007-09-27 | 2009-04-02 | Omnivision Technologies, Inc. | Dual mode camera solution apparatus, system, and method |
US8084969B2 (en) | 2007-10-01 | 2011-12-27 | Allegro Microsystems, Inc. | Hall-effect based linear motor controller |
KR101428042B1 (en) | 2007-10-08 | 2014-08-07 | 엘지이노텍 주식회사 | Vehicle camera control system |
US8752969B1 (en) | 2007-10-15 | 2014-06-17 | Arete Associates | Method of operating a fast scanning mirror |
JP2009109904A (en) | 2007-10-31 | 2009-05-21 | Sony Corp | Lens barrel and imaging apparatus |
US20090122195A1 (en) | 2007-11-09 | 2009-05-14 | Van Baar Jeroen | System and Method for Combining Image Sequences |
US20090128644A1 (en) | 2007-11-15 | 2009-05-21 | Camp Jr William O | System and method for generating a photograph |
US8310587B2 (en) | 2007-12-04 | 2012-11-13 | DigitalOptics Corporation International | Compact camera optics |
KR20090058229A (en) | 2007-12-04 | 2009-06-09 | 삼성전기주식회사 | Dual camera module |
TW200928431A (en) | 2007-12-26 | 2009-07-01 | Delta Electronics Inc | Optical actuator |
US7745779B2 (en) | 2008-02-08 | 2010-06-29 | Aptina Imaging Corporation | Color pixel arrays having common color filters for multiple adjacent pixels for use in CMOS imagers |
US8115825B2 (en) | 2008-02-20 | 2012-02-14 | Apple Inc. | Electronic device with two image sensors |
CN101276415A (en) | 2008-03-03 | 2008-10-01 | 北京航空航天大学 | Apparatus and method for realizing multi-resolutions image acquisition with multi-focusing video camera |
US8222424B2 (en) | 2008-03-24 | 2012-07-17 | Novartis Ag | Arylsulfonamide-based matrix metalloprotease inhibitors |
US20100097444A1 (en) * | 2008-10-16 | 2010-04-22 | Peter Lablans | Camera System for Creating an Image From a Plurality of Images |
US8866920B2 (en) | 2008-05-20 | 2014-10-21 | Pelican Imaging Corporation | Capturing and processing of images using monolithic camera array with heterogeneous imagers |
FI20085510L (en) | 2008-05-28 | 2009-11-29 | Valtion Teknillinen | A zoom-camera arrangement comprising several sub-cameras |
JP5017184B2 (en) | 2008-06-10 | 2012-09-05 | 株式会社日立製作所 | Thermally assisted magnetic recording head |
JP4513906B2 (en) | 2008-06-27 | 2010-07-28 | ソニー株式会社 | Image processing apparatus, image processing method, program, and recording medium |
US8134589B2 (en) | 2008-07-17 | 2012-03-13 | Eastman Kodak Company | Zoom by multiple image capture |
KR101477178B1 (en) | 2008-07-17 | 2014-12-29 | 삼성전자주식회사 | Portable terminal having dual camera and photographing method using the same |
GB2462095A (en) | 2008-07-23 | 2010-01-27 | Snell & Wilcox Ltd | Processing of images to represent a transition in viewpoint |
US8237807B2 (en) | 2008-07-24 | 2012-08-07 | Apple Inc. | Image capturing device with touch screen for adjusting camera settings |
US8786770B2 (en) * | 2008-09-10 | 2014-07-22 | Panasonic Corporation | Camera body and imaging device |
CN101394487B (en) | 2008-10-27 | 2011-09-14 | 华为技术有限公司 | Image synthesizing method and system |
JP5472584B2 (en) * | 2008-11-21 | 2014-04-16 | ソニー株式会社 | Imaging device |
JP5230376B2 (en) | 2008-11-28 | 2013-07-10 | 三星電子株式会社 | Imaging apparatus and imaging method |
CN101493893B (en) * | 2008-12-11 | 2012-01-11 | 中山大学 | Image data fusing method |
JP5265336B2 (en) | 2008-12-25 | 2013-08-14 | 富士フイルム株式会社 | Camera shake correction apparatus and optical apparatus |
WO2010081556A1 (en) * | 2009-01-16 | 2010-07-22 | Iplink Limited | Improving the depth of field in an imaging system |
US20100202068A1 (en) | 2009-02-06 | 2010-08-12 | Panasonic Corporation | Lens barrel structure |
US8749635B2 (en) * | 2009-06-03 | 2014-06-10 | Flir Systems, Inc. | Infrared camera systems and methods for dual sensor applications |
JP2010204341A (en) | 2009-03-03 | 2010-09-16 | Nikon Corp | Camera |
US8602896B2 (en) * | 2009-03-05 | 2013-12-10 | Igt | Methods and regulated gaming machines including game gadgets configured for player interaction using service oriented subscribers and providers |
CN101833157A (en) | 2009-03-13 | 2010-09-15 | 鸿富锦精密工业(深圳)有限公司 | Camera module |
CN101981979B (en) * | 2009-03-17 | 2013-04-17 | 华为技术有限公司 | Downlink power distributing method, apparatus and system |
WO2010108119A2 (en) * | 2009-03-19 | 2010-09-23 | Flextronics Ap, Llc | Dual sensor camera |
JP5121769B2 (en) | 2009-03-30 | 2013-01-16 | 富士フイルム株式会社 | Lens unit |
KR101552481B1 (en) | 2009-04-13 | 2015-09-21 | 삼성전자 주식회사 | Zoom lens module |
WO2010122841A1 (en) | 2009-04-22 | 2010-10-28 | コニカミノルタオプト株式会社 | Mirror-lens barrel, image pickup device and method for manufacturing a mirror-lens barrel |
US8553106B2 (en) | 2009-05-04 | 2013-10-08 | Digitaloptics Corporation | Dual lens digital zoom |
US9843743B2 (en) * | 2009-06-03 | 2017-12-12 | Flir Systems, Inc. | Infant monitoring systems and methods using thermal imaging |
US8253832B2 (en) * | 2009-06-09 | 2012-08-28 | Omnivision Technologies, Inc. | Interpolation for four-channel color filter array |
CN102404510B (en) | 2009-06-16 | 2015-07-01 | 英特尔公司 | Camera applications in handheld device |
US20100321494A1 (en) | 2009-06-18 | 2010-12-23 | Theia Technologies, Llc | Compact dome camera |
WO2011005413A2 (en) | 2009-06-22 | 2011-01-13 | Omnivision Technologies, Inc. | System and method for an image sensor operable in multiple video standards |
WO2011009108A2 (en) | 2009-07-17 | 2011-01-20 | Universal Robotics, Inc. | System and method for automatic calibration of stereo images |
US8947502B2 (en) | 2011-04-06 | 2015-02-03 | Qualcomm Technologies, Inc. | In camera implementation of selecting and stitching frames for panoramic imagery |
JP5846346B2 (en) | 2009-08-21 | 2016-01-20 | ミツミ電機株式会社 | Camera shake correction device |
JP2011055246A (en) | 2009-09-02 | 2011-03-17 | Panasonic Corp | Telescopic imaging apparatus |
CN201514511U (en) | 2009-09-08 | 2010-06-23 | 华晶科技股份有限公司 | Periscopic lens structure |
KR101613928B1 (en) | 2009-09-09 | 2016-04-20 | 엘지전자 주식회사 | Portable terminal |
ES2739036T3 (en) | 2009-09-14 | 2020-01-28 | Viion Systems Inc | Saccadic Dual Resolution Video Analysis Camera |
US8194165B2 (en) * | 2009-09-30 | 2012-06-05 | Truesense Imaging, Inc. | Methods for capturing and reading out images from an image sensor |
KR101617289B1 (en) | 2009-09-30 | 2016-05-02 | 엘지전자 주식회사 | Mobile terminal and operation control method thereof |
JP5513834B2 (en) | 2009-10-13 | 2014-06-04 | 台湾東電化股▲ふん▼有限公司 | Lens drive device |
CA3043204C (en) | 2009-11-19 | 2021-08-31 | Esight Corp. | Apparatus and method for a dynamic "region of interest" in a display system |
KR101081630B1 (en) | 2009-11-20 | 2011-11-09 | 엘지이노텍 주식회사 | Voice coil motor |
WO2011063347A2 (en) | 2009-11-20 | 2011-05-26 | Pelican Imaging Corporation | Capturing and processing of images using monolithic camera array with heterogeneous imagers |
US8400555B1 (en) | 2009-12-01 | 2013-03-19 | Adobe Systems Incorporated | Focused plenoptic camera employing microlenses with different focal lengths |
US20110128288A1 (en) | 2009-12-02 | 2011-06-02 | David Petrou | Region of Interest Selector for Visual Queries |
US10080006B2 (en) | 2009-12-11 | 2018-09-18 | Fotonation Limited | Stereoscopic (3D) panorama creation on handheld device |
JP5310539B2 (en) | 2009-12-28 | 2013-10-09 | 富士通株式会社 | Mail transmission / reception device, mail transmission / reception method, and mail transmission / reception program |
KR20110080590A (en) | 2010-01-06 | 2011-07-13 | 삼성테크윈 주식회사 | Correction module for shaking and camera module comprising the same |
TWI407177B (en) | 2010-01-26 | 2013-09-01 | Hon Hai Prec Ind Co Ltd | Zoom lens |
EP2529333A4 (en) | 2010-01-28 | 2013-10-23 | Pathway Innovations And Technologies Inc | Document imaging system having camera-scanner apparatus and personal computer based processing software |
CN103210641B (en) * | 2010-02-19 | 2017-03-15 | 双光圈国际株式会社 | Process multi-perture image data |
JP5445235B2 (en) | 2010-03-09 | 2014-03-19 | ソニー株式会社 | Image processing apparatus, image processing method, and program |
WO2011112633A1 (en) | 2010-03-09 | 2011-09-15 | Flir Systems, Inc. | Imager with multiple sensor arrays |
JP5079836B2 (en) | 2010-03-24 | 2012-11-21 | 台灣東電化股▲ふん▼有限公司 | Anti-shake structure of lens autofocus module |
JP2011205374A (en) | 2010-03-25 | 2011-10-13 | Fujifilm Corp | Display apparatus |
JP4783465B1 (en) | 2010-03-26 | 2011-09-28 | 富士フイルム株式会社 | Imaging device and display device |
TWI478828B (en) | 2010-03-26 | 2015-04-01 | Hon Hai Prec Ind Co Ltd | Vehicle imaging system and vehicle with same |
US8456518B2 (en) | 2010-03-31 | 2013-06-04 | James Cameron & Vincent Pace | Stereoscopic camera with automatic obstruction removal |
US9001227B2 (en) | 2010-04-05 | 2015-04-07 | Qualcomm Incorporated | Combining data from multiple image sensors |
US8547389B2 (en) | 2010-04-05 | 2013-10-01 | Microsoft Corporation | Capturing image structure detail from a first image and color from a second image |
CN102215373B (en) | 2010-04-07 | 2014-12-24 | 苹果公司 | In conference display adjustments |
US8446484B2 (en) | 2010-04-21 | 2013-05-21 | Nokia Corporation | Image processing architecture with pre-scaler |
US20130300875A1 (en) * | 2010-04-23 | 2013-11-14 | Flir Systems Ab | Correction of image distortion in ir imaging |
US20130250150A1 (en) | 2010-05-03 | 2013-09-26 | Michael R. Malone | Devices and methods for high-resolution image and video capture |
WO2011159401A1 (en) | 2010-05-03 | 2011-12-22 | Invisage Technologies, Inc. | Devices and methods for high-resolution image and video capture |
CN101853500A (en) * | 2010-05-13 | 2010-10-06 | 西北工业大学 | Colored multi-focus image fusing method |
US20110285713A1 (en) | 2010-05-21 | 2011-11-24 | Jerzy Wieslaw Swic | Processing Color Sub-Pixels |
DE102010017057B4 (en) | 2010-05-21 | 2015-03-19 | Jena-Optronik Gmbh | Camera with several fixed focal lengths |
US20130141541A1 (en) * | 2010-06-11 | 2013-06-06 | Hysonic. Co., Ltd. | Compact camera actuator and compact stereo-scopic image photographing device |
CN103154816A (en) | 2010-07-13 | 2013-06-12 | R·S·米尔拉伊 | Variable three-dimensional camera assembly for still photography |
US9137574B2 (en) * | 2010-07-28 | 2015-09-15 | Yahoo! Inc. | Method or system to predict media content preferences |
US8493482B2 (en) | 2010-08-18 | 2013-07-23 | Apple Inc. | Dual image sensor image processing system and method |
US8896655B2 (en) | 2010-08-31 | 2014-11-25 | Cisco Technology, Inc. | System and method for providing depth adaptive video conferencing |
JP5609467B2 (en) | 2010-09-15 | 2014-10-22 | 株式会社リコー | Imaging apparatus and imaging method |
US8780251B2 (en) | 2010-09-20 | 2014-07-15 | Canon Kabushiki Kaisha | Image capture with focus adjustment |
US20120075489A1 (en) | 2010-09-24 | 2012-03-29 | Nishihara H Keith | Zoom camera image blending technique |
US20140192238A1 (en) | 2010-10-24 | 2014-07-10 | Linx Computational Imaging Ltd. | System and Method for Imaging and Image Processing |
US9204026B2 (en) | 2010-11-01 | 2015-12-01 | Lg Electronics Inc. | Mobile terminal and method of controlling an image photographing therein |
JP5809925B2 (en) * | 2010-11-02 | 2015-11-11 | オリンパス株式会社 | Image processing apparatus, image display apparatus and imaging apparatus including the same, image processing method, and image processing program |
JP5719148B2 (en) | 2010-11-10 | 2015-05-13 | キヤノン株式会社 | Imaging apparatus, control method therefor, and program |
KR101731346B1 (en) | 2010-11-12 | 2017-04-28 | 엘지전자 주식회사 | Method for providing display image in multimedia device and thereof |
WO2012075250A1 (en) | 2010-12-01 | 2012-06-07 | Magna Electronics Inc. | System and method of establishing a multi-camera image using pixel remapping |
JP5589823B2 (en) | 2010-12-21 | 2014-09-17 | 株式会社リコー | Stereo camera calibration apparatus and calibration method |
US10200671B2 (en) | 2010-12-27 | 2019-02-05 | 3Dmedia Corporation | Primary and auxiliary image capture devices for image processing and related methods |
US8274552B2 (en) | 2010-12-27 | 2012-09-25 | 3Dmedia Corporation | Primary and auxiliary image capture devices for image processing and related methods |
JP5654867B2 (en) | 2010-12-27 | 2015-01-14 | パナソニックIpマネジメント株式会社 | Video signal processing apparatus and video signal processing method |
JP2012141442A (en) * | 2010-12-28 | 2012-07-26 | Sony Corp | Lens protection device, lens unit, and image pickup apparatus |
US8824823B1 (en) | 2011-01-20 | 2014-09-02 | Verint Americas Inc. | Increased quality of image objects based on depth in scene |
CN102130567A (en) | 2011-01-21 | 2011-07-20 | 清华大学 | Voice coil motor |
US8803990B2 (en) | 2011-01-25 | 2014-08-12 | Aptina Imaging Corporation | Imaging system with multiple sensors for producing high-dynamic-range images |
US8520080B2 (en) | 2011-01-31 | 2013-08-27 | Hand Held Products, Inc. | Apparatus, system, and method of use of imaging assembly on mobile terminal |
JP5814566B2 (en) | 2011-02-28 | 2015-11-17 | オリンパス株式会社 | IMAGING DEVICE, IMAGING METHOD, AND IMAGING DEVICE CONTROL PROGRAM |
WO2012122177A1 (en) | 2011-03-08 | 2012-09-13 | Spectral Instruments Imaging, LLC | Imaging system having primary and auxiliary camera systems |
JP5708097B2 (en) | 2011-03-18 | 2015-04-30 | 株式会社リコー | Imaging apparatus, imaging method, and imaging program |
US9172856B2 (en) | 2011-03-29 | 2015-10-27 | Microsoft Technology Licensing, Llc | Folded imaging path camera |
CN102739949A (en) | 2011-04-01 | 2012-10-17 | 张可伦 | Control method for multi-lens camera and multi-lens device |
EP2523450B1 (en) | 2011-05-10 | 2014-05-14 | HTC Corporation | Handheld electronic device with dual image capturing method and computer program product |
US8553129B2 (en) | 2011-05-10 | 2013-10-08 | Htc Corporation | Handheld electronic device with two lens modules, dual image capturing method applying for the handheld electronic device, and computer program product for load into the handheld electronic device |
JP2012253531A (en) * | 2011-06-02 | 2012-12-20 | Sony Corp | Imaging apparatus, imaging method, and image processing device |
CN102298769A (en) * | 2011-06-11 | 2011-12-28 | 浙江理工大学 | Colored fusion method of night vision low-light image and infrared image based on color transmission |
KR101224790B1 (en) | 2011-06-14 | 2013-01-21 | 삼성전기주식회사 | Image Photographing Device |
CN102959960B (en) * | 2011-06-23 | 2015-04-01 | 松下电器产业株式会社 | Imaging device |
US8605199B2 (en) | 2011-06-28 | 2013-12-10 | Canon Kabushiki Kaisha | Adjustment of imaging properties for an imaging assembly having light-field optics |
WO2013006811A1 (en) | 2011-07-06 | 2013-01-10 | Flextronics Ap, Llc | Camera module with magnetic shielding and method of manufacture |
JP5821356B2 (en) | 2011-07-15 | 2015-11-24 | ミツミ電機株式会社 | Lens drive device |
US9270875B2 (en) | 2011-07-20 | 2016-02-23 | Broadcom Corporation | Dual image capture processing |
JP6103840B2 (en) | 2011-07-28 | 2017-03-29 | キヤノン株式会社 | Correction optical apparatus and imaging apparatus |
US8891185B2 (en) | 2011-08-16 | 2014-11-18 | Flextronics Ap, Llc | Camera module and method for manufacturing same |
US8988564B2 (en) | 2011-09-09 | 2015-03-24 | Apple Inc. | Digital camera with light splitter |
EP2592823A3 (en) | 2011-10-12 | 2013-06-19 | Canon Kabushiki Kaisha | Image-capturing device |
US8947627B2 (en) | 2011-10-14 | 2015-02-03 | Apple Inc. | Electronic devices having displays with openings |
US10001622B2 (en) | 2011-10-25 | 2018-06-19 | Sanford Burnham Medical Research Institute | Multifunction autofocus system and method for automated microscopy |
JP5809936B2 (en) | 2011-11-08 | 2015-11-11 | オリンパス株式会社 | Imaging device |
JP5884421B2 (en) | 2011-11-14 | 2016-03-15 | ソニー株式会社 | Image processing apparatus, image processing apparatus control method, and program |
JP5741395B2 (en) | 2011-11-16 | 2015-07-01 | コニカミノルタ株式会社 | Imaging device |
WO2013080552A1 (en) * | 2011-11-30 | 2013-06-06 | パナソニック株式会社 | Imaging device and imaging system |
JP2013120262A (en) | 2011-12-07 | 2013-06-17 | Panasonic Corp | Imaging apparatus |
AU2011253982B9 (en) | 2011-12-12 | 2015-07-16 | Canon Kabushiki Kaisha | Method, system and apparatus for determining a subject and a distractor in an image |
TWI537670B (en) | 2011-12-13 | 2016-06-11 | 鴻海精密工業股份有限公司 | Dual lens camera |
US8970655B2 (en) | 2011-12-16 | 2015-03-03 | Polycom, Inc. | Reflective and refractive solutions to providing direct eye contact videoconferencing |
KR101300353B1 (en) | 2011-12-22 | 2013-08-28 | 삼성전기주식회사 | Hand vibration correction device |
US8619148B1 (en) | 2012-01-04 | 2013-12-31 | Audience, Inc. | Image correction after combining images from multiple cameras |
CN104054020B (en) | 2012-01-12 | 2017-03-22 | 核心光电有限公司 | Electromagnetic Actuators For Digital Cameras |
JP2013143753A (en) | 2012-01-12 | 2013-07-22 | Olympus Corp | Imaging apparatus |
KR101993222B1 (en) | 2012-01-19 | 2019-06-26 | 엘지전자 주식회사 | Display Device |
KR20130090225A (en) | 2012-02-03 | 2013-08-13 | 삼성전자주식회사 | Method of changing an operation mode of a camera image sensor |
GB2499200B (en) | 2012-02-07 | 2014-12-17 | Canon Kk | Method and device for transitioning between an image of a first video sequence and an image for a second video sequence |
JP2013183353A (en) * | 2012-03-02 | 2013-09-12 | Toshiba Corp | Image processor |
US8866943B2 (en) | 2012-03-09 | 2014-10-21 | Apple Inc. | Video camera providing a composite video sequence |
KR20130104764A (en) | 2012-03-15 | 2013-09-25 | 엘지전자 주식회사 | Mobile terminal |
JP2013205550A (en) | 2012-03-28 | 2013-10-07 | Olympus Corp | Position detection device and position control device |
US20130258044A1 (en) * | 2012-03-30 | 2013-10-03 | Zetta Research And Development Llc - Forc Series | Multi-lens camera |
US9029759B2 (en) | 2012-04-12 | 2015-05-12 | Nan Chang O-Film Optoelectronics Technology Ltd | Compact camera modules with features for reducing Z-height and facilitating lens alignment and methods for manufacturing the same |
JP2013238848A (en) | 2012-04-20 | 2013-11-28 | Hoya Corp | Imaging apparatus |
WO2013163579A2 (en) | 2012-04-27 | 2013-10-31 | Adobe Systems Incorporated | Automatic adjustment of images |
IL219639A (en) | 2012-05-08 | 2016-04-21 | Israel Aerospace Ind Ltd | Remote tracking of objects |
CN102722321A (en) | 2012-05-22 | 2012-10-10 | 中兴通讯股份有限公司 | Method and device for switching between double cameras |
US8953084B2 (en) | 2012-05-30 | 2015-02-10 | Digimarc Corporation | Plural focal-plane imaging |
US20130321675A1 (en) * | 2012-05-31 | 2013-12-05 | Apple Inc. | Raw scaler with chromatic aberration correction |
WO2013182873A1 (en) | 2012-06-08 | 2013-12-12 | Nokia Corporation | A multi-frame image calibrator |
EP2860963B1 (en) | 2012-06-11 | 2019-05-22 | Sony Interactive Entertainment Inc. | Image generation device, and image generation method |
US8941948B2 (en) | 2012-06-18 | 2015-01-27 | HGST Netherlands B.V. | Perpendicular recording head with leading bump in the main pole having narrow leading gap (LG) |
KR101991719B1 (en) | 2012-06-29 | 2019-06-21 | 엘지이노텍 주식회사 | Camera Module |
DE102012211383A1 (en) | 2012-06-29 | 2014-01-02 | Continental Automotive Gmbh | Magnetic field generator and sensor device for use in determining a rotation angle |
US9134503B2 (en) | 2012-07-06 | 2015-09-15 | Apple Inc. | VCM OIS actuator module |
US9733717B2 (en) | 2012-07-12 | 2017-08-15 | Dual Aperture International Co. Ltd. | Gesture-based user interface |
US9225903B2 (en) | 2012-07-12 | 2015-12-29 | Sony Corporation | Image blur correction apparatus, method of correcting image blur, and imaging apparatus |
KR102051501B1 (en) | 2012-07-26 | 2019-12-03 | 엘지이노텍 주식회사 | Camera module |
US9007520B2 (en) | 2012-08-10 | 2015-04-14 | Nanchang O-Film Optoelectronics Technology Ltd | Camera module with EMI shield |
US9398264B2 (en) | 2012-10-19 | 2016-07-19 | Qualcomm Incorporated | Multi-camera system using folded optics |
CN104937920A (en) | 2012-10-31 | 2015-09-23 | 因维萨热技术公司 | Expanded-field-of-view image and video capture |
EP2917783A4 (en) | 2012-11-08 | 2016-07-13 | Dynaoptics Pte Ltd | Miniature optical zoom lens |
WO2014076959A1 (en) | 2012-11-16 | 2014-05-22 | パナソニック株式会社 | Camera drive device |
CN113472989A (en) | 2012-11-28 | 2021-10-01 | 核心光电有限公司 | Multi-aperture imaging system and method for acquiring images by multi-aperture imaging system |
KR101960493B1 (en) | 2012-12-12 | 2019-07-15 | 삼성전자주식회사 | Optical adjusting apparatus |
CN103024272A (en) | 2012-12-14 | 2013-04-03 | 广东欧珀移动通信有限公司 | Double camera control device, method and system of mobile terminal and mobile terminal |
US9282228B2 (en) | 2013-01-05 | 2016-03-08 | The Lightco Inc. | Camera methods and apparatus using optical chain modules which alter the direction of received light |
US20140313316A1 (en) | 2013-01-30 | 2014-10-23 | SeeScan, Inc. | Adjustable variable resolution inspection systems and methods using multiple image sensors |
US20140218587A1 (en) | 2013-02-07 | 2014-08-07 | Motorola Mobility Llc | Double sided camera module |
US20190215440A1 (en) * | 2018-01-10 | 2019-07-11 | Duelight Llc | Systems and methods for tracking a region using an image sensor |
US9293500B2 (en) * | 2013-03-01 | 2016-03-22 | Apple Inc. | Exposure control for image sensors |
US9413930B2 (en) | 2013-03-14 | 2016-08-09 | Joergen Geerds | Camera system |
WO2014145166A2 (en) | 2013-03-15 | 2014-09-18 | Eyecam, LLC | Autonomous computing and telecommunications head-up displays glasses |
JP6214206B2 (en) | 2013-05-13 | 2017-10-18 | キヤノン株式会社 | Imaging apparatus, control method, and program |
JP6100089B2 (en) | 2013-05-17 | 2017-03-22 | キヤノン株式会社 | Image processing apparatus, image processing method, and program |
DE102013209829B4 (en) | 2013-05-27 | 2016-04-28 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Optical structure with webs disposed thereon and method of making the same |
CN203406908U (en) | 2013-06-03 | 2014-01-22 | 王傲立 | Rotating cameras for mobile phone |
KR102166262B1 (en) | 2013-06-10 | 2020-10-15 | 삼성전자주식회사 | Camera lens assembly |
CN109194849B (en) | 2013-06-13 | 2021-01-15 | 核心光电有限公司 | Double-aperture zooming digital camera |
JP6227294B2 (en) | 2013-06-20 | 2017-11-08 | 惠州市大亜湾永昶電子工業有限公司 | Lens drive device with camera shake suppression function |
US9432575B2 (en) | 2013-06-28 | 2016-08-30 | Canon Kabushiki Kaisha | Image processing apparatus |
TWI546570B (en) | 2013-07-01 | 2016-08-21 | 台灣東電化股份有限公司 | Optical anti-shake apparatus with switchable light path |
WO2015001440A1 (en) | 2013-07-04 | 2015-01-08 | Corephotonics Ltd. | Miniature telephoto lens assembly |
US9137447B2 (en) | 2013-07-31 | 2015-09-15 | Panasonic Intellectual Property Management Co., Ltd. | Imaging apparatus that generates an image including an emphasized in-focus part of a captured image |
EP3028443A2 (en) | 2013-08-01 | 2016-06-08 | Corephotonics Ltd. | Thin multi-aperture imaging system with auto-focus and methods for using same |
US9285566B2 (en) | 2013-08-08 | 2016-03-15 | Apple Inc. | Mirror tilt actuation |
US9494769B2 (en) | 2013-09-12 | 2016-11-15 | Hong Kong Applied Science And Technology Research Institute Co. Ltd. | Multi-lens imaging module and actuator with auto-focus adjustment |
US20150086127A1 (en) | 2013-09-20 | 2015-03-26 | Samsung Electronics Co., Ltd | Method and image capturing device for generating artificially defocused blurred image |
CN105579902B (en) | 2013-09-23 | 2019-06-28 | Lg伊诺特有限公司 | A method of manufacture camera model |
US9615012B2 (en) | 2013-09-30 | 2017-04-04 | Google Inc. | Using a second camera to adjust settings of first camera |
CN104581136B (en) | 2013-10-14 | 2017-05-31 | 钰立微电子股份有限公司 | The calibration method of image calibration system and stereo camera |
US9736365B2 (en) | 2013-10-26 | 2017-08-15 | Light Labs Inc. | Zoom related methods and apparatus |
KR101528626B1 (en) | 2013-11-04 | 2015-06-17 | 서경진 | the improved model roll bail standing exector system for round baler |
US9344626B2 (en) | 2013-11-18 | 2016-05-17 | Apple Inc. | Modeless video and still frame capture using interleaved frames of video and still resolutions |
US9509979B2 (en) | 2013-11-26 | 2016-11-29 | Mobileye Vision Technologies Ltd. | Stereo auto-calibration from structure-from-motion |
US8730299B1 (en) * | 2013-11-27 | 2014-05-20 | Dmitry Kozko | Surround image mode for multi-lens mobile devices |
CN104680501B (en) | 2013-12-03 | 2018-12-07 | 华为技术有限公司 | The method and device of image mosaic |
US9215377B2 (en) | 2013-12-04 | 2015-12-15 | Nokia Technologies Oy | Digital zoom with sensor mode change |
KR101916355B1 (en) | 2013-12-06 | 2018-11-07 | 후아웨이 디바이스 (둥관) 컴퍼니 리미티드 | Photographing method of dual-lens device, and dual-lens device |
WO2015081562A1 (en) | 2013-12-06 | 2015-06-11 | 华为终端有限公司 | Terminal, image processing method, and image acquisition method |
KR20160090373A (en) | 2013-12-06 | 2016-07-29 | 후아웨이 디바이스 컴퍼니 리미티드 | Photographing method for dual-camera device and dual-camera device |
JP6263623B2 (en) | 2013-12-06 | 2018-01-17 | 華為終端(東莞)有限公司 | Image generation method and dual lens apparatus |
US9538096B2 (en) | 2014-01-27 | 2017-01-03 | Raytheon Company | Imaging system and methods with variable lateral magnification |
KR102128468B1 (en) | 2014-02-19 | 2020-06-30 | 삼성전자주식회사 | Image Processing Device and Method including a plurality of image signal processors |
US20160018720A1 (en) | 2014-02-19 | 2016-01-21 | Gil BACHAR | Magnetic shielding between voice coil motors in a dual-aperture camera |
DE102014203189A1 (en) | 2014-02-21 | 2015-08-27 | Carl Zeiss Smt Gmbh | Mirror array |
TW201533514A (en) | 2014-02-27 | 2015-09-01 | Tdk Taiwan Corp | Reflector structure and photographic device |
US9316810B2 (en) | 2014-03-07 | 2016-04-19 | Apple Inc. | Folded telephoto camera lens system |
US9557627B2 (en) | 2014-03-07 | 2017-01-31 | Apple Inc. | Folded camera lens systems |
CN103841404A (en) | 2014-03-18 | 2014-06-04 | 江西省一元数码科技有限公司 | Novel three-dimensional image shooting module |
US20150271471A1 (en) | 2014-03-19 | 2015-09-24 | Htc Corporation | Blocking detection method for camera and electronic apparatus with cameras |
KR102214193B1 (en) | 2014-03-25 | 2021-02-09 | 삼성전자 주식회사 | Depth camera device, 3d image display system having the same and control methods thereof |
US9383550B2 (en) | 2014-04-04 | 2016-07-05 | Qualcomm Incorporated | Auto-focus in low-profile folded optics multi-camera system |
US9618770B2 (en) | 2014-04-11 | 2017-04-11 | Samsung Electro-Mechanics Co., Ltd. | Camera module with function of auto-focus and image stabilize |
KR101771778B1 (en) | 2014-04-11 | 2017-08-25 | 삼성전기주식회사 | Camera module |
CN105024516B (en) | 2014-04-30 | 2017-12-01 | 光宝电子(广州)有限公司 | Voice coil motor array module |
US10257450B2 (en) | 2014-05-15 | 2019-04-09 | Huawei Technologies Co., Ltd. | Multi-frame noise reduction method, and terminal |
US20150334309A1 (en) | 2014-05-16 | 2015-11-19 | Htc Corporation | Handheld electronic apparatus, image capturing apparatus and image capturing method thereof |
US9360671B1 (en) | 2014-06-09 | 2016-06-07 | Google Inc. | Systems and methods for image zoom |
KR102157675B1 (en) | 2014-07-25 | 2020-09-18 | 삼성전자주식회사 | Image photographing apparatus and methods for photographing image thereof |
US9392188B2 (en) | 2014-08-10 | 2016-07-12 | Corephotonics Ltd. | Zoom dual-aperture camera with folded lens |
TW201632949A (en) | 2014-08-29 | 2016-09-16 | 伊奧克里公司 | Image diversion to capture images on a portable electronic device |
JP2016057468A (en) | 2014-09-10 | 2016-04-21 | Hoya株式会社 | Bending imaging device |
GB201416870D0 (en) | 2014-09-24 | 2014-11-05 | Rota Eng Ltd | Magnetic Field Generator And Position Sensing Assembly |
CN105659580B (en) | 2014-09-30 | 2018-09-07 | 华为技术有限公司 | A kind of Atomatic focusing method, device and electronic equipment |
WO2016061738A1 (en) | 2014-10-20 | 2016-04-28 | Schott Glass Technologies (Suzhou) Co. Ltd. | Optical arrangement for a camera module, camera module with optical arrangement and method of manufacturing the optical arrangement |
WO2016081567A1 (en) | 2014-11-19 | 2016-05-26 | Orlo James Fiske | Thin optical system and camera |
KR102287013B1 (en) | 2014-11-25 | 2021-08-06 | 삼성디스플레이 주식회사 | Thin film transistor, organic light emitting diode display including the same and manufacuring method thereof |
JP6622503B2 (en) | 2014-11-25 | 2019-12-18 | 日本放送協会 | Camera model parameter estimation apparatus and program thereof |
JP6483418B2 (en) | 2014-11-27 | 2019-03-13 | エイブリック株式会社 | Hall sensor and compensation method of offset due to temperature of hall sensor |
US10634867B2 (en) | 2014-11-28 | 2020-04-28 | Samsung Electro-Mechanics Co., Ltd. | Camera module |
US10976182B2 (en) | 2014-12-22 | 2021-04-13 | Nidec Corporation | Position estimation method and position control device |
US9286680B1 (en) | 2014-12-23 | 2016-03-15 | Futurewei Technologies, Inc. | Computational multi-camera adjustment for smooth view switching and zooming |
US11019330B2 (en) | 2015-01-19 | 2021-05-25 | Aquifi, Inc. | Multiple camera system with auto recalibration |
US9800798B2 (en) | 2015-02-13 | 2017-10-24 | Qualcomm Incorporated | Systems and methods for power optimization for imaging devices with dual cameras |
US9798135B2 (en) | 2015-02-16 | 2017-10-24 | Apple Inc. | Hybrid MEMS scanning module |
JP6289399B2 (en) | 2015-02-23 | 2018-03-07 | 本田技研工業株式会社 | Position detection device |
KR101914894B1 (en) | 2015-04-02 | 2018-11-02 | 코어포토닉스 리미티드 | Dual voice coil motor structure of dual optical module camera |
US9591237B2 (en) | 2015-04-10 | 2017-03-07 | Qualcomm Incorporated | Automated generation of panning shots |
KR102480080B1 (en) | 2015-04-16 | 2022-12-22 | 코어포토닉스 리미티드 | Auto focus and optical imagestabilization in a compact folded camera |
US9485432B1 (en) | 2015-04-29 | 2016-11-01 | Uurmi Systems Private Limited | Methods, systems and apparatuses for dual-camera based zooming |
US20160353012A1 (en) | 2015-05-25 | 2016-12-01 | Htc Corporation | Zooming control method for camera and electronic apparatus with camera |
CN105847662A (en) | 2015-06-19 | 2016-08-10 | 维沃移动通信有限公司 | Moving object shooting method based on mobile terminal, and mobile terminal |
US10291842B2 (en) | 2015-06-23 | 2019-05-14 | Samsung Electronics Co., Ltd. | Digital photographing apparatus and method of operating the same |
CN107533272B (en) | 2015-06-24 | 2020-09-11 | 核心光电有限公司 | Low-profile triaxial actuator for folded lens camera |
CN105827903A (en) | 2015-06-26 | 2016-08-03 | 维沃移动通信有限公司 | Camera module and mobile terminal |
US9863789B2 (en) | 2015-06-30 | 2018-01-09 | Ford Global Technologies, Llc | Rotating camera systems and methods |
CN106709899B (en) | 2015-07-15 | 2020-06-02 | 华为终端有限公司 | Method, device and equipment for calculating relative positions of two cameras |
EP3598737B1 (en) | 2015-08-13 | 2020-12-09 | Corephotonics Ltd. | Dual aperture zoom camera with video support and switching / non-switching dynamic control |
EP3207301A4 (en) | 2015-08-14 | 2018-05-09 | SZ DJI Osmo Technology Co., Ltd. | Gimbal having parallel stability mechanism |
US20170070731A1 (en) | 2015-09-04 | 2017-03-09 | Apple Inc. | Single And Multi-Camera Calibration |
KR101993077B1 (en) | 2015-09-06 | 2019-06-25 | 코어포토닉스 리미티드 | Automatic focus and optical image stabilization by roll compensation of compact folding camera |
JP6593629B2 (en) | 2015-09-09 | 2019-10-23 | ソニー株式会社 | Image processing apparatus, solid-state imaging device, and electronic device |
US10382698B2 (en) | 2015-09-30 | 2019-08-13 | Apple Inc. | Mobile zoom using multiple optical image stabilization cameras |
CN108351222B (en) | 2015-10-28 | 2020-10-30 | 阿尔卑斯阿尔派株式会社 | Position detecting device |
KR101858694B1 (en) | 2015-11-03 | 2018-06-27 | 엘지전자 주식회사 | Vehicle and control method for the same |
KR20170075442A (en) | 2015-12-23 | 2017-07-03 | 삼성전자주식회사 | Photographing apparatus module, user terminal comprising the photographing apparatus and method of operating the photographing apparatus module |
EP4254926A3 (en) | 2015-12-29 | 2024-01-31 | Corephotonics Ltd. | Dual-aperture zoom digital camera with automatic adjustable tele field of view |
CN205301703U (en) | 2016-01-19 | 2016-06-08 | 西安励德微系统科技有限公司 | Laser light curtain projection scanning device |
JP6508532B2 (en) | 2016-02-17 | 2019-05-08 | 新シコー科技株式会社 | Lens drive device, camera device and electronic device |
US11016268B2 (en) | 2016-02-19 | 2021-05-25 | Almalence Inc. | Collapsible imaging systems having lens arrays |
US9843736B2 (en) | 2016-02-26 | 2017-12-12 | Essential Products, Inc. | Image capture with a camera integrated display |
KR20170105236A (en) | 2016-03-09 | 2017-09-19 | 엘지전자 주식회사 | Image stabilization device |
KR20170113066A (en) | 2016-03-24 | 2017-10-12 | 삼성전자주식회사 | Electronic device with display and method for displaying image thereof |
KR20170112491A (en) | 2016-03-31 | 2017-10-12 | 엘지전자 주식회사 | Mobile terminal and method for controlling the same |
EP3518520B1 (en) | 2016-05-30 | 2020-08-26 | Corephotonics Ltd. | Rotational ball-guided voice coil motor |
KR102390572B1 (en) | 2016-07-07 | 2022-04-25 | 코어포토닉스 리미티드 | Linear ball guided voice coil motor for folded optic |
CN111580238B (en) | 2016-07-12 | 2022-07-12 | 台湾东电化股份有限公司 | Lens driving module |
US10303042B2 (en) | 2016-07-12 | 2019-05-28 | Tdk Taiwan Corp. | Lens driving module |
TWM533229U (en) | 2016-08-26 | 2016-12-01 | Largan Precision Co Ltd | Optical path folding element, imaging lens module and electronic device |
AU2017343447B2 (en) | 2016-09-19 | 2020-09-10 | Tau Technologies, LLC | Multi-camera imaging systems |
US10516773B2 (en) | 2016-10-13 | 2019-12-24 | Samsung Electro-Mechanics Co., Ltd. | Camera module and portable electronic device including the same |
KR102609464B1 (en) | 2016-10-18 | 2023-12-05 | 삼성전자주식회사 | The Electronic Device Shooting Image |
US9860456B1 (en) * | 2016-11-11 | 2018-01-02 | Motorola Mobility Llc | Bayer-clear image fusion for dual camera |
CN106603765B (en) | 2016-12-20 | 2020-03-17 | Oppo广东移动通信有限公司 | Bracket component and mobile terminal |
EP4246993A3 (en) | 2016-12-28 | 2024-03-06 | Corephotonics Ltd. | Folded camera structure with an extended light-folding-element scanning range |
CN106534655B (en) | 2017-01-11 | 2019-04-16 | Oppo广东移动通信有限公司 | Camera module and mobile terminal |
US10884321B2 (en) | 2017-01-12 | 2021-01-05 | Corephotonics Ltd. | Compact folded camera |
KR102140582B1 (en) | 2017-04-28 | 2020-08-03 | 자화전자(주) | Apparatus for driving optical-reflector with multi-axial structure |
US10334149B2 (en) | 2017-02-23 | 2019-06-25 | Qualcomm Incorporated | Adjustment for cameras for low power mode operation |
KR102530535B1 (en) | 2017-03-15 | 2023-05-08 | 코어포토닉스 리미티드 | Cameras with panoramic scanning range |
KR102426728B1 (en) | 2017-04-10 | 2022-07-29 | 삼성전자주식회사 | Method and electronic device for focus control |
JP6967715B2 (en) | 2017-04-18 | 2021-11-17 | パナソニックIpマネジメント株式会社 | Camera calibration method, camera calibration program and camera calibration device |
KR102390184B1 (en) | 2017-04-26 | 2022-04-25 | 삼성전자주식회사 | Electronic apparatus and method for displaying image thereof |
WO2018217951A1 (en) | 2017-05-24 | 2018-11-29 | Camplex, Inc. | Surgical visualization systems and displays |
CN108476289B (en) | 2017-07-31 | 2021-02-02 | 深圳市大疆创新科技有限公司 | Video processing method, device, aircraft and system |
JP7103361B2 (en) | 2017-09-05 | 2022-07-20 | ソニーグループ株式会社 | Imaging device |
JP7009142B2 (en) | 2017-09-28 | 2022-01-25 | キヤノン株式会社 | Image pickup device and image processing method |
US20190100156A1 (en) | 2017-09-29 | 2019-04-04 | GM Global Technology Operations LLC | System and method for controlling a display |
CN107682489B (en) | 2017-11-20 | 2019-11-19 | 珠海市魅族科技有限公司 | A kind of display panel control method of mobile terminal and mobile terminal |
CN113075776B (en) | 2017-11-23 | 2023-08-29 | 核心光电有限公司 | mobile electronic device |
US10600157B2 (en) | 2018-01-05 | 2020-03-24 | Qualcomm Incorporated | Motion blur simulation |
JP2019126179A (en) | 2018-01-17 | 2019-07-25 | オリンパス株式会社 | Driving device |
CN209514186U (en) | 2018-01-25 | 2019-10-18 | 台湾东电化股份有限公司 | Optical element driving mechanism |
JP7102199B2 (en) | 2018-04-11 | 2022-07-19 | キヤノン株式会社 | Drive device, image blur correction device and image pickup device |
CN114153107B (en) | 2018-04-23 | 2024-07-02 | 核心光电有限公司 | Camera and actuator |
KR20200005332A (en) | 2018-07-06 | 2020-01-15 | 삼성전자주식회사 | Calibration device and method of operation thereof |
CN110913122B (en) | 2018-09-18 | 2021-08-10 | 北京小米移动软件有限公司 | Multi-camera zooming method, device, equipment and storage medium |
US20200118287A1 (en) | 2018-10-16 | 2020-04-16 | Augentix Inc. | Method of Assembly Calibration for Multi-Camera system and Related Device |
US11055866B2 (en) | 2018-10-29 | 2021-07-06 | Samsung Electronics Co., Ltd | System and method for disparity estimation using cameras with different fields of view |
CN109729266A (en) | 2018-12-25 | 2019-05-07 | 努比亚技术有限公司 | A kind of image capturing method, terminal and computer readable storage medium |
DE102019128781A1 (en) * | 2019-10-24 | 2021-04-29 | Leica Camera Aktiengesellschaft | Method for generating an output signal of a PDAF pixel |
-
2014
- 2014-07-24 EP EP14831759.7A patent/EP3028443A2/en not_active Withdrawn
- 2014-07-24 US US14/906,116 patent/US9571731B2/en active Active
- 2014-07-24 CN CN201810946469.2A patent/CN108989648B/en active Active
- 2014-07-24 CN CN201811063380.8A patent/CN109246339B/en active Active
- 2014-07-24 CN CN201810567323.7A patent/CN108718376B/en active Active
- 2014-07-24 WO PCT/IB2014/063393 patent/WO2015015383A2/en active Application Filing
- 2014-07-24 CN CN201480043316.7A patent/CN105917641B/en active Active
- 2014-07-24 CN CN201810946529.0A patent/CN108989649B/en active Active
- 2014-07-24 CN CN201811064283.0A patent/CN109120823B/en active Active
-
2016
- 2016-01-25 IL IL243776A patent/IL243776B/en active IP Right Grant
-
2017
- 2017-01-17 US US15/407,271 patent/US9998653B2/en active Active
-
2018
- 2018-05-17 US US15/982,401 patent/US10250797B2/en active Active
- 2018-05-17 US US15/982,446 patent/US10084953B1/en active Active
- 2018-06-09 IL IL259908A patent/IL259908B/en active IP Right Grant
-
2019
- 2019-01-17 US US16/249,937 patent/US10469735B2/en active Active
- 2019-03-28 US US16/368,173 patent/US10694094B2/en active Active
-
2020
- 2020-05-13 US US15/930,487 patent/US11470235B2/en active Active
- 2020-08-07 IL IL276581A patent/IL276581B/en unknown
-
2022
- 2022-03-10 IL IL291274A patent/IL291274B2/en unknown
- 2022-09-30 US US17/957,206 patent/US11716535B2/en active Active
-
2023
- 2023-06-13 US US18/333,575 patent/US11856291B2/en active Active
- 2023-11-09 US US18/505,263 patent/US11991444B2/en active Active
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
TWI399975B (en) * | 2008-02-01 | 2013-06-21 | Omnivision Tech Inc | Fusing of images captured by a multi-aperture imaging system |
CN102037717A (en) * | 2008-05-20 | 2011-04-27 | 派力肯成像公司 | Capturing and processing of images using monolithic camera array with hetergeneous imagers |
WO2010116367A1 (en) * | 2009-04-07 | 2010-10-14 | Nextvision Stabilized Systems Ltd | Continuous electronic zoom for an imaging system with multiple imaging devices having different fixed fov |
CN103229509A (en) * | 2010-02-19 | 2013-07-31 | 双光圈股份有限公司 | Processing multi-perture image data |
CN102511013A (en) * | 2010-07-23 | 2012-06-20 | 索尼公司 | Imaging device, method for controlling same, and program |
CN102982518A (en) * | 2012-11-06 | 2013-03-20 | 扬州万方电子技术有限责任公司 | Fusion method of infrared image and visible light dynamic image and fusion device of infrared image and visible light dynamic image |
Also Published As
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN108718376B (en) | Thin multi-aperture imaging system with auto-focus and method of use thereof | |
CN108141571B (en) | Maskless phase detection autofocus | |
JP5901246B2 (en) | Imaging device | |
JP5606208B2 (en) | Focus detection apparatus and imaging apparatus | |
JP2016038414A (en) | Focus detection device, control method thereof, and imaging apparatus | |
US20240214668A1 (en) | Image processing device, image processing method, imaging device, and recording medium | |
JP2015194736A (en) | Imaging device and method for controlling the same | |
US20220392092A1 (en) | Image processing apparatus, image processing method, and storage medium | |
JP2017102240A (en) | Image processing device and image processing method, imaging device, program |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |