WO2019174758A1 - Plenoptic camera for mobile devices - Google Patents
Plenoptic camera for mobile devices Download PDFInfo
- Publication number
- WO2019174758A1 WO2019174758A1 PCT/EP2018/065883 EP2018065883W WO2019174758A1 WO 2019174758 A1 WO2019174758 A1 WO 2019174758A1 EP 2018065883 W EP2018065883 W EP 2018065883W WO 2019174758 A1 WO2019174758 A1 WO 2019174758A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- plenoptic camera
- lens
- camera
- image sensor
- plenoptic
- Prior art date
Links
- 230000003287 optical effect Effects 0.000 claims abstract description 83
- 239000011521 glass Substances 0.000 claims description 3
- 238000003384 imaging method Methods 0.000 description 6
- 238000005516 engineering process Methods 0.000 description 4
- 210000003692 ilium Anatomy 0.000 description 4
- 238000000034 method Methods 0.000 description 4
- XUIMIQQOPSSXEZ-UHFFFAOYSA-N Silicon Chemical compound [Si] XUIMIQQOPSSXEZ-UHFFFAOYSA-N 0.000 description 3
- 238000013459 approach Methods 0.000 description 3
- 238000004519 manufacturing process Methods 0.000 description 3
- 229910052710 silicon Inorganic materials 0.000 description 3
- 239000010703 silicon Substances 0.000 description 3
- 238000003491 array Methods 0.000 description 2
- 230000010354 integration Effects 0.000 description 2
- 239000011159 matrix material Substances 0.000 description 2
- 238000013139 quantization Methods 0.000 description 2
- 238000005452 bending Methods 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- VJYFKVYYMZPMAB-UHFFFAOYSA-N ethoprophos Chemical compound CCCSP(=O)(OCC)SCCC VJYFKVYYMZPMAB-UHFFFAOYSA-N 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 238000004806 packaging method and process Methods 0.000 description 1
- 238000003909 pattern recognition Methods 0.000 description 1
- 230000008685 targeting Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B13/00—Optical objectives specially designed for the purposes specified below
- G02B13/001—Miniaturised objectives for electronic devices, e.g. portable telephones, webcams, PDAs, small digital cameras
- G02B13/0055—Miniaturised objectives for electronic devices, e.g. portable telephones, webcams, PDAs, small digital cameras employing a special optical element
- G02B13/0065—Miniaturised objectives for electronic devices, e.g. portable telephones, webcams, PDAs, small digital cameras employing a special optical element having a beam-folding prism or mirror
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B13/00—Optical objectives specially designed for the purposes specified below
- G02B13/001—Miniaturised objectives for electronic devices, e.g. portable telephones, webcams, PDAs, small digital cameras
- G02B13/0055—Miniaturised objectives for electronic devices, e.g. portable telephones, webcams, PDAs, small digital cameras employing a special optical element
- G02B13/0075—Miniaturised objectives for electronic devices, e.g. portable telephones, webcams, PDAs, small digital cameras employing a special optical element having an element with variable optical properties
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/0075—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for altering, e.g. increasing, the depth of field or depth of focus
-
- H—ELECTRICITY
- H01—ELECTRIC ELEMENTS
- H01L—SEMICONDUCTOR DEVICES NOT COVERED BY CLASS H10
- H01L27/00—Devices consisting of a plurality of semiconductor or other solid-state components formed in or on a common substrate
- H01L27/14—Devices consisting of a plurality of semiconductor or other solid-state components formed in or on a common substrate including semiconductor components sensitive to infrared radiation, light, electromagnetic radiation of shorter wavelength or corpuscular radiation and specially adapted either for the conversion of the energy of such radiation into electrical energy or for the control of electrical energy by such radiation
- H01L27/144—Devices controlled by radiation
- H01L27/146—Imager structures
- H01L27/14601—Structural or functional details thereof
- H01L27/14625—Optical elements or arrangements associated with the device
-
- H—ELECTRICITY
- H01—ELECTRIC ELEMENTS
- H01L—SEMICONDUCTOR DEVICES NOT COVERED BY CLASS H10
- H01L27/00—Devices consisting of a plurality of semiconductor or other solid-state components formed in or on a common substrate
- H01L27/14—Devices consisting of a plurality of semiconductor or other solid-state components formed in or on a common substrate including semiconductor components sensitive to infrared radiation, light, electromagnetic radiation of shorter wavelength or corpuscular radiation and specially adapted either for the conversion of the energy of such radiation into electrical energy or for the control of electrical energy by such radiation
- H01L27/144—Devices controlled by radiation
- H01L27/146—Imager structures
- H01L27/14601—Structural or functional details thereof
- H01L27/14625—Optical elements or arrangements associated with the device
- H01L27/14627—Microlenses
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/204—Image signal generators using stereoscopic image cameras
- H04N13/207—Image signal generators using stereoscopic image cameras using a single 2D image sensor
- H04N13/236—Image signal generators using stereoscopic image cameras using a single 2D image sensor using varifocal lenses or mirrors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/204—Image signal generators using stereoscopic image cameras
- H04N13/239—Image signal generators using stereoscopic image cameras using two 2D image sensors having a relative position equal to or related to the interocular distance
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/204—Image signal generators using stereoscopic image cameras
- H04N13/243—Image signal generators using stereoscopic image cameras using three or more 2D image sensors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/67—Focus control based on electronic image sensor signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/95—Computational photography systems, e.g. light-field imaging systems
- H04N23/957—Light-field or plenoptic cameras or camera modules
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N2013/0074—Stereoscopic image analysis
- H04N2013/0081—Depth or disparity estimation from stereoscopic image signals
Definitions
- the present invention is comprised in the field of microlens arrays, optical systems incorporating microlens arrays, light field images, light field cameras and plenoptic cameras.
- Plenoptic cameras are imaging devices capable of capturing not only spatial information but also angular information of a scene. This captured information is known as light-field which can be represented as a four-dimensional tuple LF(px, pyJxJy), where px and py select the direction of arrival of the rays to the sensor and lx, ly are the spatial position of these rays.
- a plenoptic camera is typically formed by a microlens array placed in front of a sensor.
- plenoptic cameras can be considered a multi-view system.
- Another system that can capture a light-field can be formed by an array of several cameras. Accordingly, information about the depths of the different objects (i.e., the distance between the object itself and the camera) of the scene is captured implicitly in the light-field.
- This capability of plenoptic cameras entails a wide number of applications concerning the depth map generation and 3D imaging.
- Lytro introduced the first single-assembly plenoptic camera commercially available in the international market, and three years later, the Lytro Ilium camera. Since this, no other light-field cameras have been launched to the consumer electronics market.
- the Lytro first plenoptic camera had a mechanical size along the optical axis of 12 cm, and the Lytro Ilium camera had an objective lens (like the DSLR cameras) of more than 12 cm, and a total size of about 20 cm.
- Lytro moved to a very different market: the cinema market, producing extremely large cameras in which the length of the optical system can be dozens of centimetres, with sensors of 755 megapixels and extremely heavy solutions. These cameras are not hand-held cameras but professional movie maker cameras to be held by tripods or heavy mechanical structures.
- Patent US 9,647, 150-B2 discloses a method of manufacturing miniaturized plenoptic sensors.
- the smallest plenoptic camera launched to the consumer electronic market is the 12 cm Lytro camera.
- Performance on plenoptic cameras depends on key optic design factors such as focal length and f-number, where a large focal length or a small f number can improve drastically the performance of the camera.
- small f numbers are easy to find in smartphone lenses
- large focal lengths are very hard to design and manufacture fulfilling the smartphone market design rules due to the very small thicknesses of the modules that impose difficult constraints at the MTTL (Mechanical Total Track Length) of the cameras.
- Plenoptic camera A device capable of capturing not only the spatial position but also the direction of arrival of the incident light rays.
- Multiview system System capable of capturing a scene from several points of view.
- a plenoptic camera can be considered a multiview system.
- Stereo and multi-stereo cameras are also considered multiview systems.
- Light field four-dimensional structure LF(px, py, lx, ly) that contains the information from the light captured by the pixels (px, py) below the microlenses (lx, ly ) in a plenoptic camera.
- Depth distance between the plane of an object point of a scene and the main plane of the camera, both planes are perpendicular to the optical axis.
- Plenoptic view two-dimensional image formed by taking a subset of the light field structure by choosing a certain value (px, py), always the same (px, py) for every one of the microlenses (lx, ly).
- Microlens array MLA: array of small lenses (microlenses).
- Disparity Distance between two (or more) projections of an object point into a camera.
- Baseline Difference between the position of two (or more) cameras in a stereo (or multi-stereo) configuration.
- Folded optics optical system in which the optical path is bent through reflective elements such as prisms or mirrors, in a way that the system thickness is changed to reach a certain thickness specification.
- OTTL Optical Total Track Length
- MTTL Mechanism Total Track Length
- Prism or mirror refers to the optical component used to reflect the light at a certain angle, bending the optical path of the light.
- a new concept of plenoptic camera is herewith presented, wherein a prism or mirror or other reflective element is used to fold the optical path of the lens, allowing to design lenses with large focal lengths without increasing the thickness of the lens.
- a first aspect of the present invention refers to a plenoptic camera for mobile devices comprising a main lens, a microlens array, an image sensor, and a first reflective element (preferably a prism or a mirror) configured to reflect the light rays captured by the plenoptic camera before arriving at the image sensor, so as to fold the optical path of the light captured by the camera before impinging the image sensor.
- a first reflective element preferably a prism or a mirror
- the first reflective element is arranged to receive the captured light rays before arriving at the main lens. In another embodiment, the first reflective element is arranged to receive the light rays already focused by the main lens.
- the optical axis of the main lens is preferably parallel to the surface of the image sensor (in this way, the optical path is folded 90 degrees or any other arbitrary angle).
- the plenoptic camera comprises one or more further reflective elements (preferably prisms or mirrors) configured to reflect the light rays reflected by the first reflective element before arriving at the image sensor.
- the further reflective elements are therefore intercalated between the first reflective element and the image sensor, so as to further fold the optical path and help reducing the physical dimensions of the plenoptic camera in a determined axis.
- the main lens may comprise a plurality of lens elements.
- the main lens may comprise a first set and a second set of lens elements, each set comprising one or more concentric lens elements.
- the physical arrangement of both sets of lens elements may be such that the optical axis of the first set of lens elements is perpendicular to the optical axis of the second set of lens elements and parallel to the image sensor.
- the first reflective element is arranged between the first and the second set of lens elements.
- the first reflective element is arranged to receive the captured light rays before arriving at the main lens
- the plenoptic camera comprises a second reflective element arranged between the first set and the second set of lens elements, wherein the second reflective element is configured to reflect the light rays reflected by the first reflective element and already focused by the first set of lens elements, before arriving at the image sensor.
- a camera module for mobile devices that comprises the plenoptic camera previously described.
- This camera module can be, for instance, a separate part directly integrated into a smartphone (e.g. inserted in the smartphone or attached to the back case of the smartphone) by coupling means and electrical contacts.
- the components of the plenoptic camera are arranged such that the thickness of the camera module is lower than 10 mm.
- a further aspect of the present invention refers to a mobile device, preferably a smartphone, comprising the plenoptic camera or the camera module previously described.
- the image sensor of the plenoptic camera may be arranged such that the perpendicular line of the image sensor is parallel to the back side of the mobile device. This way, the light path of the light rays captured by the camera is folded by the first reflective element (and, optionally, further reflective elements), which allows reducing the thickness of the mobile device.
- the components of the plenoptic camera are preferably arranged such that the thickness of the mobile device is lower than 10 mm.
- Figure 1 A represents a schematic side view of a plenoptic camera system with an image sensor, a microlens array and a field lens, according to the prior art.
- Figure 1 B depicts, in a front view, the microimages produced by the microlenses over the image sensor.
- Figure 1 C shows the pixels forming one microimage of the image sensor.
- Figure 2 illustrates the disparity between two projections of the same object point through two cameras separated from each other a baseline b.
- Figure 3 shows the error in depth computations versus real distance of objects in the object world for different focal lengths in a plenoptic camera.
- Figure 4 shows a typical camera module for smartphones.
- Figure 5A depicts a plenoptic camera according to the prior art, with a pure plenoptic (unfolded) configuration.
- Figures 5B and 5C show a plenoptic camera according to two different embodiments of the present invention, with folded optics configuration.
- Figures 6A-6D show four different plenoptic camera embodiments according to the present invention.
- Figure 7 shows a schematic example of a plenoptic camera according to the present invention installed within a smartphone.
- Figures 8A-8D show another four embodiments of plenoptic camera devices with folded optics configurations.
- Figure 9 shows an image sensor with its fitting image circle.
- Figure 10A shows a 3D view of a plenoptic camera with folded optics configuration.
- Figure 10B shows a 3D view of a plenoptic camera with folded optics configuration where the lenses have been cut to reduce the thickness of the device in the Z axis.
- a plenoptic camera is equivalent to capturing the scene from several points of view (the so-called plenoptic views that act like several cameras distributed about the equivalent aperture of the plenoptic camera).
- a plenoptic camera 100 is made by placing a microlens array 104 between the main lens 102 and the image sensor 108.
- Each of the microlenses 106 (Jx, ly) is forming a small image, known as microimage (1 10a, 1 10b), of the main aperture onto the image sensor 108 (see Figures 1 B and 1C), such that each pixel (px, py) of any microimage (1 10a, 1 10b) is capturing light rays 101 coming from a different part of the main aperture, every one of the microimages below any microlens is an image of the main lens aperture, and every pixel in position pxl, pyl to pxn, pyn in every microlens 106 integrates light coming from a given part of the aperture ( ach, agh ) irrelevant of the position of the microlens.
- the coordinates (px, py) of a pixel within a microimage determine the direction of arrival of the captured rays to a given microlens and (lx, ly) determine the two-dimensional spatial position. All this information is known as light field and can be represented by a four-dimensional matrix LF(px, py, lx, ly) or five- dimensional matrix LF(px, py, lx, ly, c) if the colour information (c) is considered.
- a plenoptic camera behaves like a multi- stereo camera (since both are multi-view systems) with a reduced baseline between views. That is, multi-stereo systems can also record the light-field.
- the behaviour of multi-stereo and stereo cameras has been widely studied.
- Articles like“Quantization Error in Stereo Imaging” [Rodriguez, J. J., & Aggarwal, J. K. Quantization error in stereo imaging. In Computer Vision and Pattern Recognition, 1988. Proceedings CVPR'88., Computer Society Conference on (pp. 153-158). IEEE] show how long focal lengths improve the depth error estimation in relatively long distances on multi-view systems.
- the disparity d represents the difference in position of two projections (or more projections in the case of a multi-stereo systems) of the same point in the object world, in the two (or more) cameras of a stereo (multi-stereo) system, as an example Figure 2 shows two cameras separated from each other a baseline b, and how when the light from point P in the object world crosses the two equivalent lenses d and c2 from the two cameras and reaches the sensors s1 and s2 from the two cameras at two different positions of the sensors, the disparity d is the distance between the two images pi and p2 of the same point P in the two sensors s1 and s2. From previous equation, the depth estimation error can be calculated as:
- a plenoptic camera follows the same equation for the error produced in depth computations.
- the baseline corresponds to the aperture size of the optical system (D).
- the depth error Az produced in a plenoptic camera can be reduced by increasing the focal length f of the optical system while maintaining the f-number, by reducing the f- number while keeping the focal length f (that is, increasing D), or by reducing the f- number at the same time that the focal length f is increased.
- Mobile phone lenses commonly are designed with small f numbers and small focal lengths (due to the restrictive thickness requirements of the mobile phone industry). Departing from an off- the-shelf design of a lens for a smartphone, which has a small f number and a small focal length, Figure 3 shows how the depth estimation error is reduced quadratically with the increase of the focal length when the f number is kept.
- increasing the focal length generally means increasing the OTTL (optical total track length) of an optical system. Even if it depends on the particular optical design, the relation between focal length and OTTL approximately follows the expression 1.1 ⁇
- FIG. 4 shows a schematic of a typical camera module 400 for mobile devices, such as smartphones, with the aim of being illustrative but never limiting. The important dimensions have been highlighted (Sx x Sy x Sz).
- the typical dimensions of camera modules used in the mobile phone industry are the following: 4 mm ⁇ Sz ⁇ 6.5 mm; 8 mm ⁇ Sy ⁇ 10 mm; 8 mm ⁇ Sz ⁇ 10 mm, where Sx, Sy and Sz correspond to the width, the height and the thickness of the camera module 400, respectively (according to axes X, Y and Z of Figure 7).
- the most critical dimension is Sz, which coincides with the MTz (Mechanical Track in z).
- This size Sz of the camera module 400 has to be smaller than the thickness Tz of the mobile device, as shown in Figure 7, and mobile phone manufacturers tend to move to smaller thicknesses with each new phone generation. This means the cameras need to follow these trends if the aim is fitting them into the mobile device. Camera modules with thicknesses Sz higher than 10 mm would be severely rejected by the market, aiming to cameras with Sz approaching 5 and 4 mm.
- miniaturized plenoptic cameras (as the ones disclosed in patent document US9647150B2), even if never launched commercially by anybody else with a form factor similar to Figure 4, can have very improved performance if the focal length f is increased to values that are not commonly seen in conventional imaging lenses in the mini-camera industry.
- increasing the focal length of a specific plenoptical system without violating the smartphone market design rules turns out imperative to improve the depth error precision and push the plenoptic mini-camera to the top-level of depth/3D cameras for portable devices.
- a first approach to increase the focal length f is to scale all components of the optical system, increasing all the dimensions while keeping the f-number. This implies changing the main lenses, changing the microlenses and the sensor itself, so that, the OTTL and MTTL are also forced to increase dimensions, for sure exceeding the smartphone market requirements in terms of small thicknesses (Sz).
- a second approach to increase the focal length f could be scaling the main lens but keeping the sensor and microlenses size.
- the focal length f of the plenoptic camera would increase, but, as the microlenses and sensor are kept the same size, the FOV (field of view) would be reduced due to the fact that the sensor is not capturing anymore the whole FOV of the optical system, but only a subset.
- the OTTL and MTTL would be also increased leading to an increase in length of the main lens and making more difficult its use in mobile phone applications.
- a prism or mirror is used to fold the optical path of the light, increasing the OTTL without increasing the thickness Sz of the camera module 400. Therefore, a novel plenoptic device with folded optic configurations is herewith presented.
- Figures 5A-5C show several embodiments of a plenoptic camera, showing the benefits of folded devices in terms of thickness.
- the main lens 102 is formed by a single lens element, or a pair or group of cemented lens elements.
- the term OT refers to optical track length
- MT refers to mechanical track length.
- the mechanical track length in the Z axis (MTz) depicted in Figure 7 is the critical dimension to consider when fitting the camera into a mobile phone since it corresponds to the thickness Tz of the device (or in other words, making thickness Sz as small as possible in the camera module 400 of Figure 4).
- the three embodiments of Figures 5A- 5C have the same optical performance in terms of focal length f and f-number, but different MTz.
- FIG. 5A depicts a typical plenoptic camera 500a according to the prior art.
- the configuration of this plenoptic camera 500a is designed with a small f-number and a large focal length fwith the purpose of obtaining a good depth error precision.
- the optical axis 502 of the main lens 102 is perpendicular to the image sensor 108, crossing the center of the image sensor 108 (i.e. the normal line 504 of the image sensor 108 at its central point is coincident with the optical axis 502).
- FIG. 5B shows a plenoptic camera 500b according to an embodiment of the present invention.
- the plenoptic camera 500b depicted in Figure 5B uses folded optics that reduces the MTz while keeping the same focal length (the OTTL and f-number remain the same as in Figure 5A).
- the optical axis 502 of the main lens 502 is parallel to the image sensor 108 (i.e. the optical axis 502 and the normal line 504 of the image sensor are perpendicular).
- the MTz thickness of the camera module has been reduced enough to fit within the low thickness requirements of mini-camera specs while retaining the benefits of large focal lengths for plenoptic camera systems.
- the plenoptic cameras 500a and 500b in Figures 5A and 5B offer the same optical performance and the same f number, however, the thickness of the plenoptic camera 500a in Figure 5A is larger than the thickness of the plenoptic camera 500b in Figure 5B (MTz a > MTz b ) or, if implemented in a module like in Figure 4, the thickness Sz would be smaller for the embodiment shown in Figure 5B.
- FIG. 5C represents a plenoptic camera 500c according to another embodiment of the present invention.
- This plenoptic camera 500c has a configuration where two reflective elements, a first reflective element 510 and a second reflective element 512, have been introduced to bend the optical path.
- the second reflective element 512 (such as a prism or a mirror) reflects the light rays which have been already reflected by the first reflective element 510.
- Additional reflective elements e.g. a third reflective element, a fourth reflective element, etc. may be used to further reflect the light rays reflected by the previous reflective elements positioned along the optical path.
- the optical axis 502 of the main lens 102 and the normal line of the image sensor 108 at its central point are parallel but not coincident (i.e. they are positioned at different heights), since the optical path has been folded twice along the way.
- Figures 6A-6D show several embodiments of plenoptic camera devices (600a, 600b, 600c, 600d) with folded optics configuration, with the aim of being illustrative, but never limiting, where the main lens 102 is composed by a plurality of non-cemented lens elements or lens groups.
- the plenoptic camera devices shown in this figure are formed by an image sensor 108, a microlens array 104, an infrared filter 612 (an optional element that may not be present), and a main lens 102 composed by four or five lens elements, but it could be composed by fewer or more lens elements.
- Each configuration shows a different MTz, the mechanical track length in the Z axis corresponding to the thickness Tz of the mobile device, as depicted in Figure 7.
- Each figure represents the axes X, Y and Z corresponding to those shown in Figure 7, according to the installation of the plenoptic camera in the mobile device (in Figures 6A- 6C the image sensor 108 extends along the Z axis, whereas in the embodiment of Figure 6D the image sensor 108 extends along the X axis).
- a first reflective element 510 preferably a prism or mirror
- MTz ⁇ OTTL MTz ⁇ MTTL (considering the original non- folded configuration to compute the MTTL).
- the first reflective element 510 such as a prism or mirror placed at 45 degrees with respect to the optical axis, reflects the light rays 601 a captured by the plenoptic camera 600a just before crossing any optical surface, i.e. before reaching any of the lens elements (620, 622, 624, 626, 628) of the main lens 102.
- the light rays 601 b reflected from the first reflective element 510 (and forming a certain angle with respect to the captured light rays 601 a) reach the main lens 102.
- MTz a ⁇ OTTLa what in practical terms means that the thickness Sz of the camera module 400 ( Figure 4) is smaller and easier to fit within the stringent requirements of a mobile phone.
- the main lens 102 comprises a first set (630, 632) and a second set (634, 636) of lens elements.
- the plenoptic camera 600b of Figure 6B bends the captured light rays 601 a after they cross the first set of lens elements (the two first lenses 630 and 632) of the main lens 102 (in this case an achromatic doublet) with the help of a first reflective element 510, a prism or mirror, placed at 45 degrees with respect to the optical axes of both sets of lens elements.
- the MTz b MTz a
- the third configuration shows a main lens 102 formed by five lens elements divided into a first set (640, 642, 644) and a second set (646, 648) of lens elements.
- the captured light rays 601 a are reflected after crossing the first set of lens elements (the first three lens elements 640, 642, 644), obtaining the reflected light rays 601 b impinging on the second set (646, 648) of lens elements and the image sensor 108.
- MTz c ⁇ OTTL OTz c + OTx c.
- the sensor extends along the x dimension, and therefore its die dimension is not limiting the MTz.
- the main lens 102 is formed by four lens elements divided into a first set (650, 652) and a second set (654, 656) of lens elements.
- the first reflective element 510 is arranged to receive the captured light rays 601 a before it reaches the main lens 102, to obtain reflected light rays 601 b.
- the second reflective element 512 is arranged between both sets of lens elements, and reflects the reflected light rays 601 b to obtain further reflected light rays 601 c that impinge on the second set (654, 656) of lens elements and the image sensor 108.
- folded optics allows reducing thickness (MTz, or Sz in Figure 4 and Tz in Figure 7) of cameras with large focal lengths that commonly would lead to big Sz dimensions (high focal lengths can be fitted into really thin modules with low MTz or Sz, as shown in Figure 6D, for example).
- the thickness of the camera is drastically reduced with respect to its original thickness (the MTTL in the equivalent unfolded configuration), allowing to fit large cameras into portable devices that, if it was not for the use of the folded optics technology, would never be able to accomplish the specs of smartphone industry in terms of thickness.
- the plenoptic camera with reduced thickness proposed by the present invention is suitable to be installed on any mobile device with strict thickness constraints, such as a tablet, PDA or a smartphone.
- Figure 7 shows an example of a plenoptic camera fitted into a smartphone 700 having a similar configuration as those depicted in embodiments of Figures 6B and 6C.
- the plenoptic camera is preferably installed at the rear part or back side 710 of the smartphone 700, capturing images from behind the screen.
- the plenoptic camera may be installed at the front side of the smartphone 700, next to the screen, to capture frontal images.
- the smartphone 700 has the following dimensions in the axes X, Y and Z represented in Figure 7: a width Tx, a length Ty, and a thickness Tz, respectively.
- a width Tx a width
- Ty a length
- Tz a thickness
- the main lens 102 of the plenoptic camera is formed by five lens elements (730, 732, 734, 736, 738), and a first reflective element 510 (a prism or mirror) reflects the light after it passes through a first set of lens elements (the first two lens elements 730 and 732) of the main lens 102, just like in the embodiment of Figure 6B.
- the three other lens elements (734, 736, 738), forming the second set of lens elements, microlens array 104 and image sensor 108 are distributed along the X axis, not contributing to the thickness MTz of the camera (the critical size Sz in Figure 4). These elements could instead be distributed along the Y axis, or in any arrangement such that the normal line 504 of the image sensor 108 and the optical axis of the second set of lens elements are parallel to the X-Y plane.
- this new proposed folded optics technique allows to have at the same time a superior plenoptic performance (with long focal lengths and small f number) and a small MTz (or thickness Sz of the camera module 400), being ideal for their integration in portable devices such as smartphones, tablets, laptops, etc.
- Figures 8A-8D show four more embodiments of plenoptic camera devices (800a, 800b, 800c, 800d) with folded optics configurations where full folded plenoptic designs (including the first reflective element 510) have been further described with the aim of being illustrative but never limiting.
- a first prismatic lens 802 is used as the first reflective element 510 (and, optionally, a further (second, third%) prismatic lens 812 is used as the second (third, fourth%) reflective element 512).
- the prismatic lens 802 (and, optionally, any further second, third, etc. prismatic lens/es 812 used) is basically a three- surfaces optical element in which the mid surface is reflective (e.g.
- the prismatic lens 802/812 is an optical element that integrates a lens element of the main lens (formed with the two refractive surfaces 804a/814a and 804c/814c) together with the reflective element 510/512 (formed by the reflective surface 804b/814b) that folds the light path.
- Light rays crossing the first surface 804a/814a of the prismatic lens 802/812 have a different optical axis (typically perpendicular) than the rays crossing the third surface 804c/814c due to the reflection produced in the second surface 804b/814b of the prismatic lens 802/812.
- the two refractive surfaces (804a/814a, 804c/814c) can have convex, concave or aspheric shapes, and the reflective surface might be planar or convex/concave, spherical or aspheric.
- prismatic lenses allows to fold the light path achieving long optical total track lengths OTTLs (and hence long effective focal length, EFFLs) within small thicknesses. Also, the integration of the prismatic lens 802/812 together with the other lens elements of the optical system is easier than using, for instance, a single mirror, where alignment tasks are for sure more difficult.
- the fact of having a prismatic lens 802/812 with its two well defined refractive surfaces (804a/814a, 804c/814c) and thus its well defined optical axes eases the alignment processes.
- Figure 8A shows a main lens containing five lens elements (802, 822, 824, 826, 828), an optional infrared filter 612, a microlens array 104 and an image sensor 108.
- the first lens element is a prismatic lens 802 that integrates within a single entity a convex lens (first 804a and third 804c surfaces) and the first reflective element 510 (second surface 804b).
- the first surface 804a has a convex shape (but it could be also concave or flat)
- the second surface 804b is a flat surface (but it could be any other non-flat surface) at 45-degrees (but might be other angles) as referred to the optical axis and this flat surface reflects the light towards the third surface 804c, a second convex surface (but it could be concave or flat).
- the first convex surface 804a of the prismatic lens 802 refracts the light rays 801 a captured by the plenoptic camera 800a, next these rays are reflected by the first reflective element 510 (flat surface 804b) of the of the prismatic lens 802 a total of 90 degrees along the optical axis (but it could be different if the first reflective element 510 is not tilted 45 degrees with respect to the optical axis).
- the first optical axis extends along the Z axis and, after the reflective element 510, light follows a second optical axis (X axis), which is perpendicular to the first one, arriving at the third surface 804c of the prismatic lens 802. Light then crosses the other lens elements (822, 824, 826, 828), arriving at the microlens array 104, and finally to the image sensor 108.
- the embodiment of Figure 8A has an optical total track length OTTLa (OTzai + OTxa-i) of 1 1 .2 mm (but it could be longer or shorter); however, the use of the prismatic lens 802 to fold the light path allows extending most of the OTTL of the camera along the X axis, leading to a thickness of MTz a of around 5.1 mm (but it could be even shorter, or longer), making this lens with a very large OTTL suitable to be integrated into a mobile phone thanks to its reduced thickness. In this case the thickness (Z axis) is limited by the sensor size.
- the lens example of Figure 8A should not be interpreted as a limiting choice, but only as an illustrative example of how a folded design can achieve large focal length and great depth performance with a small thickness.
- the main lens 102 of the camera may have more or less lens elements in order to improve the optical performance (in this example five lens elements, but it could be fewer or more lenses), the non-reflective surfaces of the prismatic lens 802 may be formed by convex surfaces, planar surfaces, concave surfaces or any aspheric surface the designer might consider appropriate.
- the reflective element 510 (which in this case is a flat surface tilted 45-degrees with respect to the optical axis) might be a convex or a concave reflective surface (or a flat surface tilted any other angle versus the optical axis).
- the prismatic lens 802 may be located as a first lens element, or as a subsequent lens element, after one or more lens elements (e.g. as a second lens element).
- Figure 8B shows an embodiment where two prismatic lenses (a first prismatic lens 802 and a second prismatic lens 812) have been used to fold the light path twice.
- the size of the image sensor 108 will not be liming the thickness of the lens as the image sensor 108 extends along the X and Y dimensions (is not anymore a limiting factor in the Z dimension: the sensor rectangle is extended along X-Y dimensions of Figure 7 and we do not impose anymore that the sensor rectangular-die has to be smaller than Tz in Figure 7, as is imposed by the embodiment in Figure 8A).
- the main lens 102 is also formed by five elements (802, 832, 834, 836, 812), an optional infrared filter 612, the microlens array 104 and the image sensor 108.
- the first four lens elements (802, 832, 834, 836) are similar to the embodiment described in Figure 8A.
- the fifth lens element is a second prismatic lens 812 with two refractive surfaces (first 814a and third 814c surfaces) having aspheric shapes, and a second reflective surface (in the example, a 45- degree flat surface) that acts as a second reflective element 512.
- the optical total track length OTTL of the lens (OTzbi + OTxbi + OTzb 2 ) is about 12.9 mm (but it could be longer or shorter).
- the use of folded optics allows to have a thickness MTz b of only a few millimeters (around 5.0 mm in the embodiment).
- the use of a second reflective element 512 allows to further increase the effective focal length EFFL (up to 13.2 mm in the example versus 9.3 mm in the embodiment from Figure 8A), improving drastically the depth sensing performance of the plenoptic camera.
- the lens may be formed by less or more elements than the five elements in the example, and by less or more than two reflective elements (510, 512), that may be either prisms or mirrors, or a combination of prisms and mirrors.
- the reflective element (510) and any other further reflective element (512) can reflect the incoming light rays with a 90 degrees angle or with any other arbitrary angle.
- the reflective elements can be arranged (i.e. tilted) so that the angle of incidence (and therefore the correspondent angle of reflection) of the incident light rays can be any angle comprised within the range (0-90), and preferably within the range [22.5-67.5]. In some embodiments, the angle of reflection is preferably 45°, thereby obtaining an optical path which is folded 90 degrees.
- Figure 8C shows an embodiment where two prismatic lenses (802, 812) have been integrated into a four-element lens, such that two lens elements of all the lens elements (802, 842, 812, 844) of the main lens 102 are prismatic lenses (802,812).
- the camera 800c comprises an optional infrared filter 612, a microlens array 104 and an image sensor 108.
- the first prismatic lens 802 is similar to that in Figure 8A.
- the second prismatic lens 812 is formed by a concave-planar lens as first 814a and the third 814c surfaces, and the reflective second surface 814b is a 45 degrees versus the optical axis flat surface.
- the second prismatic lens 812 is located between two regular aspheric lenses (842, 844).
- the main lens has an optical total track length OTTL (OTzci + OTxci + OTzc 2 ) of 12.0 mm with an effective focal length EFFL of 10.4 mm, and the thickness MTz c is 5.7 mm.
- the thickness MTz is limited by the size of the prismatic lenses (802, 812) and the thickness of the last regular lens element 844. If the priority is to reduce as much as possible the thickness MTz, the use of prismatic lens as first and/or last lens elements is clearly the best solution.
- Figure 8D shows another embodiment of plenoptic camera with folded optics configuration, where two prismatic lenses (802, 812) have been used in a main lens 102 composed of five lens elements (802, 852, 854, 856, 812).
- the first prismatic lens 802 is similar to that in Figure 8A; however, a small concavity has been introduced in the reflective element 510 (so small that cannot be appreciated in the schematic of Figure 8D).
- the second prismatic lens 812 integrates an aspheric lens and a concave reflective surface 814b (instead of flat as in embodiments 8A to 8C).
- the inclusion of non-planar reflective surfaces (804b, 814b) complicates the design but has manufacturing advantages.
- the main lens has an optical total track length OTTL (OTZdi + OTXdi + OTZd 2 ) of 14 mm, with an effective focal length EFFL of 12.4 mm.
- the thickness MTz d of the lens in this embodiment is 6.2 mm.
- prismatic lenses (802, 812) allows to have large optical total track length OTTLs with small thicknesses MTz s .
- the thickness MTz is below 6.5 mm, and therefore it can be integrated in a modern mobile phone, where thickness as a usual practice never exceeds 7.5 mm for rear cameras and 5 mm for front cameras.
- prismatic lens technique or any other folded optics technique as previously described to reduce the thickness MTz of the device, other strategies might also be used to reduce the thickness of the device.
- lenses commonly have rotational symmetry, whereas image sensors 108 are not circular (they are rectangular).
- the lens has to be optimized to exhibit good optical performance along the whole diagonal of the image sensor 108 to ensure a good performance along the whole sensor, but part of the optimized field is wasted, due to the shape of the image sensor 108 (the light photons that hit inside the dotted circle in Figure 9 but not within the rectangle of the active area of the sensor is not used, photons are not converted to electrons).
- Figure 9 shows an image sensor 108 with side sizes ISz x ISx and its correspondent image circle.
- the diameter of the image circle is fixed by the diagonal of the active area of the sensor; however, since the sensor is rectangular a non-negligible part of the optimized field is wasted, and so, a non-negligible part of the area of the lenses is not being used for useful light hitting the active area of the sensor.
- Figure 10A shows a plenoptic camera 1000a where as in any normal camera the rotational symmetry of the lenses produces an image circle hitting the microlens array (104) and finally hitting the image sensor (108) that in Figure 10A is like the circle in Figure 9, but in fact the image sensor 108 and the microlens array 104 are rectangles as in Figure 9 and 10B, and the light hitting inside the circle but outside the rectangle of the image sensor 108 does not have any useful role.
- Figure 10A shows a folded-plenoptic camera with five lens elements (1002, 1004, 1006, 1008, 1010), in which four different rays are depicted reaching the four corners of the image sensor 108, limiting the field of view (FOV) of the plenoptic camera 1000a (the light at the very center of the FOV reaching the center of the image sensor 108 is also depicted in Figure 10A).
- FOV field of view
- plenoptic cameras 1000a and 1000b are functionally identical, but in camera 1000a the MTTL (the thickness MTz a ) is fixed by the outside circle of lenses 1008 and 1010 (or by the outside circle of Figure 9), while in camera 1000b the MTTL (thickness MT ⁇ b ) is fixed by the lens 1012 (exactly the same as lens 1002 in camera 1000a, larger in the z-dimension than the truncated lenses 1018 and 1020).
- the refractive surfaces (804a, 804c; 814a, 814c) of the prismatic lens can be concave, convex, planar, aspheric or any combination thereof.
- the reflective surface (804b; 814b) can be planar or convex/concave, and they can be at any tilting degree (not necessarily 45 degrees vs the optical axis as shown in most figures).
- Prismatic lenses can be located as the first lens element of the main lens, as the last lens element of the main lens or between regular element lenses of the main lens, depending on the particular needs of the design.
- the number of prismatic lenses can also be variable (one, two or more prismatic lenses may be used). And, furthermore, the lenses may be cut to reduce thickness.
- the active photosensitive area is not perfectly centered within the silicon die area, and for example in plenoptic camera 1000b it might be convenient to move the silicon sensor 108 a bit towards the right or towards the left, we could do that by building the reflective surface in lens 1012 at angles slightly higher or lower than 45 degrees vs the optical axis of the first surface of lens 1012 (obviously in this case the sensor would not be perfectly parallel or perpendicular to the outside frame of the mobile phone, but we would fix a miniaturization problem).
Abstract
Description
Claims
Priority Applications (8)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020207028043A KR102633636B1 (en) | 2018-03-15 | 2018-06-14 | Plenoptic cameras for mobile devices |
CN201880092632.1A CN112005150B (en) | 2018-03-15 | 2018-06-14 | Plenoptic camera for mobile device |
US16/980,590 US11456326B2 (en) | 2018-03-15 | 2018-06-14 | Plenoptic camera for mobile devices |
ES202090040A ES2854573A1 (en) | 2018-03-15 | 2018-06-14 | Plenoptic camera for mobile devices |
JP2020549009A JP2021529334A (en) | 2018-03-15 | 2018-06-14 | Prenoptic camera for mobile devices |
GB2014312.9A GB2585782B (en) | 2018-03-15 | 2018-06-14 | Plenoptic camera for mobile devices |
DE112018007283.5T DE112018007283T5 (en) | 2018-03-15 | 2018-06-14 | Plenoptic camera for mobile devices |
JP2022199686A JP2023030021A (en) | 2018-03-15 | 2022-12-14 | Plenoptic camera for mobile devices |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
ESP201800082 | 2018-03-15 | ||
ES201800082 | 2018-03-15 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2019174758A1 true WO2019174758A1 (en) | 2019-09-19 |
Family
ID=62063005
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/EP2018/059644 WO2019174756A1 (en) | 2018-03-15 | 2018-04-16 | Plenoptic camera for mobile devices |
PCT/EP2018/065883 WO2019174758A1 (en) | 2018-03-15 | 2018-06-14 | Plenoptic camera for mobile devices |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/EP2018/059644 WO2019174756A1 (en) | 2018-03-15 | 2018-04-16 | Plenoptic camera for mobile devices |
Country Status (8)
Country | Link |
---|---|
US (1) | US11456326B2 (en) |
JP (2) | JP2021529334A (en) |
KR (1) | KR102633636B1 (en) |
CN (1) | CN112005150B (en) |
DE (1) | DE112018007283T5 (en) |
ES (1) | ES2854573A1 (en) |
GB (1) | GB2585782B (en) |
WO (2) | WO2019174756A1 (en) |
Families Citing this family (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE102018222865A1 (en) * | 2018-12-21 | 2020-06-25 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Device with a multi-aperture imaging device for generating a depth map |
TWI730637B (en) * | 2020-02-24 | 2021-06-11 | 大陽科技股份有限公司 | Camera module and electronic device |
EP3875656A1 (en) | 2020-03-04 | 2021-09-08 | LG Electronics Inc. | Laundry treating apparatus |
US11683573B2 (en) | 2020-09-02 | 2023-06-20 | Samsung Electronics Co., Ltd. | Folded optic for multicamera device and multicamera device including the same |
KR20230040230A (en) * | 2021-09-15 | 2023-03-22 | 삼성전자주식회사 | Electronic device comprising camera module for obtaining depth information |
WO2023229150A1 (en) * | 2022-05-27 | 2023-11-30 | 삼성전자 주식회사 | Lens assembly and electronic device comprising same |
WO2024063547A1 (en) * | 2022-09-20 | 2024-03-28 | 삼성전자 주식회사 | Camera module and electronic device comprising same |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20070077057A1 (en) * | 2005-09-30 | 2007-04-05 | Hon Hai Precision Industry Co., Ltd. | Digital camera module and lens used therein |
US20090296238A1 (en) * | 2008-05-29 | 2009-12-03 | Tamron Co., Ltd. | Lens Apparatus and Image Pickup Apparatus Using the Same |
US20130321668A1 (en) * | 2012-05-30 | 2013-12-05 | Ajith Kamath | Plural Focal-Plane Imaging |
US9647150B2 (en) | 2013-05-21 | 2017-05-09 | Jorge Vicente Blasco Claret | Monolithic integration of plenoptic lenses on photosensor substrates |
Family Cites Families (17)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH1098639A (en) * | 1996-09-25 | 1998-04-14 | Matsushita Electric Ind Co Ltd | Digital still camera |
JP2006154702A (en) * | 2004-10-29 | 2006-06-15 | Konica Minolta Opto Inc | Variable power optical system, imaging lens device and digital apparatus |
US7620309B2 (en) * | 2006-04-04 | 2009-11-17 | Adobe Systems, Incorporated | Plenoptic camera |
US8290358B1 (en) * | 2007-06-25 | 2012-10-16 | Adobe Systems Incorporated | Methods and apparatus for light-field imaging |
KR101506479B1 (en) * | 2007-09-12 | 2015-03-30 | 삼성전자주식회사 | System and method for compensating ligth pathway by driving curved prism composed of refraction facet |
EP2133726B1 (en) * | 2008-06-10 | 2011-06-01 | Thomson Licensing | Multi-image capture system with improved depth image resolution |
KR101661325B1 (en) * | 2009-02-04 | 2016-09-29 | 삼성전자주식회사 | Zoom lens system and photographic device capable of image stabilizing |
CN101620361A (en) * | 2009-08-12 | 2010-01-06 | 绵阳固创科技有限责任公司 | Nuclear radiation resisting and reinforcing method of visual system |
US8358366B1 (en) * | 2010-05-28 | 2013-01-22 | Adobe Systems Incorporate | Methods and apparatus for high-speed digital imaging |
JP5591851B2 (en) * | 2012-03-15 | 2014-09-17 | 株式会社東芝 | Solid-state imaging device and portable information terminal |
US9089291B2 (en) * | 2013-03-15 | 2015-07-28 | Amo Wavefront Sciences, Llc | System and method for ocular aberrometry and topography using plenoptic imaging |
KR102106540B1 (en) * | 2013-12-12 | 2020-05-04 | 삼성전자주식회사 | Catadioptric light-field lens and image pickup apparatus including the same |
CN103955049A (en) * | 2014-05-21 | 2014-07-30 | 中山联合光电科技有限公司 | Optical fixed-focal-length system |
CN204229030U (en) * | 2014-12-15 | 2015-03-25 | 洪金龙 | Short distance adjustable focus camera lens and there is the portable electric appts of this camera lens |
JP2017134306A (en) * | 2016-01-29 | 2017-08-03 | Hoya株式会社 | Imaging apparatus |
JP6832735B2 (en) * | 2016-08-18 | 2021-02-24 | オリンパス株式会社 | microscope |
CN107991838B (en) * | 2017-11-06 | 2020-10-23 | 万维科研有限公司 | Self-adaptive three-dimensional imaging system |
-
2018
- 2018-04-16 WO PCT/EP2018/059644 patent/WO2019174756A1/en active Application Filing
- 2018-06-14 JP JP2020549009A patent/JP2021529334A/en active Pending
- 2018-06-14 KR KR1020207028043A patent/KR102633636B1/en active IP Right Grant
- 2018-06-14 ES ES202090040A patent/ES2854573A1/en active Pending
- 2018-06-14 WO PCT/EP2018/065883 patent/WO2019174758A1/en active Application Filing
- 2018-06-14 DE DE112018007283.5T patent/DE112018007283T5/en active Pending
- 2018-06-14 GB GB2014312.9A patent/GB2585782B/en active Active
- 2018-06-14 CN CN201880092632.1A patent/CN112005150B/en active Active
- 2018-06-14 US US16/980,590 patent/US11456326B2/en active Active
-
2022
- 2022-12-14 JP JP2022199686A patent/JP2023030021A/en active Pending
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20070077057A1 (en) * | 2005-09-30 | 2007-04-05 | Hon Hai Precision Industry Co., Ltd. | Digital camera module and lens used therein |
US20090296238A1 (en) * | 2008-05-29 | 2009-12-03 | Tamron Co., Ltd. | Lens Apparatus and Image Pickup Apparatus Using the Same |
US20130321668A1 (en) * | 2012-05-30 | 2013-12-05 | Ajith Kamath | Plural Focal-Plane Imaging |
US9647150B2 (en) | 2013-05-21 | 2017-05-09 | Jorge Vicente Blasco Claret | Monolithic integration of plenoptic lenses on photosensor substrates |
Non-Patent Citations (1)
Title |
---|
RODRIGUEZ, J. J.; AGGARWAL, J. K.: "Computer Vision and Pattern Recognition, 1988. Proceedings CVPR'88., Computer Society Conference on", 1988, IEEE, article "Quantization error in stereo imaging", pages: 153 - 158 |
Also Published As
Publication number | Publication date |
---|---|
GB2585782B (en) | 2022-11-09 |
KR20200131836A (en) | 2020-11-24 |
US11456326B2 (en) | 2022-09-27 |
KR102633636B1 (en) | 2024-02-06 |
JP2023030021A (en) | 2023-03-07 |
US20210366968A1 (en) | 2021-11-25 |
DE112018007283T5 (en) | 2020-12-31 |
JP2021529334A (en) | 2021-10-28 |
WO2019174756A1 (en) | 2019-09-19 |
GB2585782A (en) | 2021-01-20 |
CN112005150B (en) | 2023-07-18 |
CN112005150A (en) | 2020-11-27 |
GB202014312D0 (en) | 2020-10-28 |
ES2854573A1 (en) | 2021-09-21 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11456326B2 (en) | Plenoptic camera for mobile devices | |
TWI660631B (en) | Zoom dual-aperture camera with folded lens | |
US20220357645A1 (en) | Opto-mechanics of panoramic capture devices with abutting cameras | |
US8238738B2 (en) | Plenoptic camera | |
CN107991838B (en) | Self-adaptive three-dimensional imaging system | |
JP2002171537A (en) | Compound image pickup system, image pickup device and electronic device | |
KR20180037957A (en) | Methods and apparatus having a two-surface microlens array for low f-number planar optical cameras | |
CN107948470B (en) | Camera module and mobile device | |
CN108174068A (en) | Optical field imaging module | |
CN207691912U (en) | The optical field imaging module of small size | |
US20240103345A1 (en) | Image capturing unit, camera module and electronic device | |
US20230152672A1 (en) | Mounting systems for multi-camera imagers | |
JP2002191060A (en) | Three-dimensional imaging unit | |
WO2006009088A1 (en) | Imaging apparatus | |
US20120147247A1 (en) | Optical system and imaging apparatus including the same | |
US11513324B2 (en) | Camera module | |
Sahin et al. | Light L16 computational camera | |
TWI782787B (en) | Camera module, electronic device and vehicle device | |
ES1299472U (en) | PLENOPTIC CAMERA FOR MOBILE DEVICES (Machine-translation by Google Translate, not legally binding) | |
KR20220078108A (en) | Lens assembly and electronic device including the same | |
KR20220053361A (en) | Imaging device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 18733209 Country of ref document: EP Kind code of ref document: A1 |
|
DPE1 | Request for preliminary examination filed after expiration of 19th month from priority date (pct application filed from 20040101) | ||
ENP | Entry into the national phase |
Ref document number: 202014312 Country of ref document: GB Kind code of ref document: A Free format text: PCT FILING DATE = 20180614 |
|
ENP | Entry into the national phase |
Ref document number: 2020549009 Country of ref document: JP Kind code of ref document: A |
|
ENP | Entry into the national phase |
Ref document number: 20207028043 Country of ref document: KR Kind code of ref document: A |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 18733209 Country of ref document: EP Kind code of ref document: A1 |