US20180109774A1 - Folded parallel-light-channel based stereo imaging system with disparity and convergence angle control - Google Patents
Folded parallel-light-channel based stereo imaging system with disparity and convergence angle control Download PDFInfo
- Publication number
- US20180109774A1 US20180109774A1 US15/591,695 US201715591695A US2018109774A1 US 20180109774 A1 US20180109774 A1 US 20180109774A1 US 201715591695 A US201715591695 A US 201715591695A US 2018109774 A1 US2018109774 A1 US 2018109774A1
- Authority
- US
- United States
- Prior art keywords
- imaging system
- stereo imaging
- fplc
- units
- lens unit
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/128—Adjusting depth or disparity
-
- H04N13/0022—
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B13/00—Optical objectives specially designed for the purposes specified below
- G02B13/001—Miniaturised objectives for electronic devices, e.g. portable telephones, webcams, PDAs, small digital cameras
- G02B13/0015—Miniaturised objectives for electronic devices, e.g. portable telephones, webcams, PDAs, small digital cameras characterised by the lens design
- G02B13/002—Miniaturised objectives for electronic devices, e.g. portable telephones, webcams, PDAs, small digital cameras characterised by the lens design having at least one aspherical surface
- G02B13/004—Miniaturised objectives for electronic devices, e.g. portable telephones, webcams, PDAs, small digital cameras characterised by the lens design having at least one aspherical surface having four lenses
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B13/00—Optical objectives specially designed for the purposes specified below
- G02B13/001—Miniaturised objectives for electronic devices, e.g. portable telephones, webcams, PDAs, small digital cameras
- G02B13/0055—Miniaturised objectives for electronic devices, e.g. portable telephones, webcams, PDAs, small digital cameras employing a special optical element
- G02B13/0065—Miniaturised objectives for electronic devices, e.g. portable telephones, webcams, PDAs, small digital cameras employing a special optical element having a beam-folding prism or mirror
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B13/00—Optical objectives specially designed for the purposes specified below
- G02B13/001—Miniaturised objectives for electronic devices, e.g. portable telephones, webcams, PDAs, small digital cameras
- G02B13/0055—Miniaturised objectives for electronic devices, e.g. portable telephones, webcams, PDAs, small digital cameras employing a special optical element
- G02B13/0065—Miniaturised objectives for electronic devices, e.g. portable telephones, webcams, PDAs, small digital cameras employing a special optical element having a beam-folding prism or mirror
- G02B13/007—Miniaturised objectives for electronic devices, e.g. portable telephones, webcams, PDAs, small digital cameras employing a special optical element having a beam-folding prism or mirror the beam folding prism having at least one curved surface
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B13/00—Optical objectives specially designed for the purposes specified below
- G02B13/001—Miniaturised objectives for electronic devices, e.g. portable telephones, webcams, PDAs, small digital cameras
- G02B13/0055—Miniaturised objectives for electronic devices, e.g. portable telephones, webcams, PDAs, small digital cameras employing a special optical element
- G02B13/0075—Miniaturised objectives for electronic devices, e.g. portable telephones, webcams, PDAs, small digital cameras employing a special optical element having an element with variable optical properties
-
- G02B27/2214—
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B30/00—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images
- G02B30/20—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes
- G02B30/26—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes of the autostereoscopic type
- G02B30/27—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes of the autostereoscopic type involving lenticular arrays
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B7/00—Mountings, adjusting means, or light-tight connections, for optical elements
- G02B7/003—Alignment of optical elements
- G02B7/005—Motorised alignment
-
- H04N13/0228—
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/204—Image signal generators using stereoscopic image cameras
- H04N13/207—Image signal generators using stereoscopic image cameras using a single 2D image sensor
- H04N13/229—Image signal generators using stereoscopic image cameras using a single 2D image sensor using lenticular lenses, e.g. arrangements of cylindrical lenses
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/204—Image signal generators using stereoscopic image cameras
- H04N13/239—Image signal generators using stereoscopic image cameras using two 2D image sensors having a relative position equal to or related to the interocular distance
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N2213/00—Details of stereoscopic systems
- H04N2213/001—Constructional or mechanical details
Definitions
- the present disclosure relates to stereo imaging. More specifically, this disclosure pertains to a compact folded-parallel-light-channel (FPLC) stereo imaging system synchronously generating a left view and a right view of a scene, and also providing both disparity and convergence angle control.
- FPLC folded-parallel-light-channel
- the disclosed stereo imaging system finds utility in a variety of devices including compact mobile devices such as cell phones and smartphones.
- a critical point in designing an embedded imaging system for a handheld or other mobile device such as a smartphone is to ensure the height (thickness) of the imaging system is smaller than (or, at least, close to) the thickness of the cell phone.
- the image sensor of a cell phone imaging system is of a fixed dimension (4.80 ⁇ 3.60 mm). To ensure images of the same size as the image sensor are produced, one cannot unlimitedly reduce the sizes of the lenses used in a cell phone imaging system.
- a telephoto camera usually cannot be used for a mobile device such as a smartphone since such a camera when equipped with camera comprising a plurality of lenses disposed to refract light to form an image at a cell phone camera image sensor (CPCIS), would require at least 14 mm for its height (see FIG. 1 for an example) while the thickness of a typical smartphone is between 7 and 9 mm only.
- FIG. 2 To allow a telephoto camera equipped with a CPCIS to be embedded in a smartphone, prior art devices are known (see FIG. 2 ) wherein the telephoto camera is “folded” by inserting a light-folding mirror in the lens system so that the optical axis (see dotted line) is redirected from vertical to horizontal once it reaches the folding mirror.
- the image sensor is installed on an orientation defining a plane oriented vertically to a plane defined by the ground, instead of parallel to a plane defined by the ground.
- a stereo imaging system could be provided by arranging two identical imaging systems such as those shown in FIG. 2 symmetrically as shown in FIG. 3 .
- Such a hypothetical stereo imaging system could be embedded in a mobile device such as a smartphone completely.
- the only way to provide disparity (interocular distance) control for such a stereo imaging system would be to configure each of the left and right imaging systems to translate laterally in their entirety relative to one another. This is illustrated in FIG. 3 .
- Such an arrangement, while hypothetically configurable, would require additional packaging space potentially not available in small mobile devices such as smartphones.
- the following disclosure describes a folded-parallel-light-channel stereo imaging system for a mobile device configured to allow disparity and convergence angle control without requiring motion of each entire unit relative to one another.
- a stereo imaging system having convergence angle and disparity control comprising a pair of pivoting folded-parallel-light-channel (FPLC) units arranged to provide a virtual left side view and a virtual right side view of a scene.
- Each FPLC unit comprises a fixed lens unit adapted to focus reflected light comprising an image of a scene to an image sensor, and a laterally translatable light-redirecting unit comprising a reflector adapted to define a parallel image reflection path to the fixed lens unit via a collimated light beam comprising substantially parallel light beams.
- the stereo imaging system further includes a disparity-adjusting mechanism adapted to alter a distance between the pair of pivoting FPLC units and a convergence-angle-adjusting mechanism adapted to pivot the pivoting FPLC units.
- the disparity-adjusting mechanism comprises a first actuator operatively connected to a cam assembly.
- the convergence-angle-adjusting mechanism comprises a second actuator adapted to pivot a pair of pivoting housings each respectively carrying a one of the pair of FPLC units.
- the reflector defines a planar reflective surface.
- a concave lens may be disposed between the reflector and an image inlet of each of the pair of FPLC units. This concave lens defines a lens field of view that is the same as a field of view of the fixed lens unit.
- the reflector defines an arcuate reflective surface. The arcuate reflective surface may be configured to define a reflector field of view that is the same as a field of view of the fixed lens unit.
- the fixed lens unit defines a wide-angle lens unit.
- the fixed lens unit defines a telephoto lens unit.
- a stereo imaging system having convergence angle and disparity control comprising a pair of pivoting folded-parallel-light-channel (FPLC) units arranged to provide a virtual left side view and a virtual right side view of a scene.
- Each FPLC unit comprises a fixed lens unit adapted to focus reflected light comprising an image of a scene to an image sensor and a laterally translatable light-redirecting unit comprising a planar reflector adapted to define a parallel image reflection path to the fixed lens unit via a collimated light beam comprising substantially parallel light beams.
- the disclosed system further includes a disparity-adjusting mechanism adapted to alter a distance between the pair of pivoting FPLC units and a convergence-angle-adjusting mechanism adapted to pivot the pivoting FPLC units.
- the disparity-adjusting mechanism and the convergence-angle-adjusting mechanism may be as described above.
- a stereo imaging system having convergence angle and disparity control comprising a pair of pivoting folded-parallel-light-channel (FPLC) units arranged to provide a virtual left side view and a virtual right side view of a scene.
- Each FPLC unit comprises a fixed lens unit adapted to focus reflected light comprising an image of a scene to an image sensor and a laterally translatable light-redirecting unit comprising an arcuate reflector adapted to define a parallel image reflection path to the fixed lens unit via a collimated light beam comprising substantially parallel light beams.
- the disclosed system further includes a disparity-adjusting mechanism adapted to alter a distance between the pair of pivoting FPLC units and a convergence-angle-adjusting mechanism adapted to pivot the pivoting FPLC units.
- the disparity-adjusting mechanism and the convergence-angle-adjusting mechanism may be as described above.
- FIG. 1 depicts a prior art imager for a mobile device such as a cellphone or smartphone;
- FIG. 2 depicts a prior art folded light-path imager for a mobile device such as a cellphone or smartphone;
- FIG. 3 illustrates a hypothetical stereo imager derived from the imager of FIG. 2 ;
- FIG. 4 schematically illustrates a stereo imaging system according to the present disclosure
- FIG. 5 shows in isolation a folded-parallel-light-channel-based camera unit for use in the stereo imaging system of FIG. 4 ;
- FIG. 6 shows operation of a convergence angle adjusting mechanism for the stereo imaging system of FIG. 4 ;
- FIG. 7 shows in isolation a folded-parallel-light-channel-based camera unit for use in the stereo imaging system of FIG. 4 , comprising a folding unit having a curved reflective surface and a multiple-lens block unit comprising three lenses;
- FIG. 8 shows a curved reflector for use in the camera unit of FIG. 7 ;
- FIG. 9 shows in isolation a folded-parallel-light-channel-based camera unit for use in the stereo imaging system of FIG. 4 , comprising a folding unit having a curved reflective surface and a multiple-lens block unit comprising five lenses;
- FIG. 10 shows in isolation a folded-parallel-light-channel-based camera unit for use in the stereo imaging system of FIG. 4 , comprising a folding unit having a planar reflective surface and a multiple-lens block unit comprising three lenses;
- FIG. 11 shows in isolation a folded-parallel-light-channel-based camera unit for use in the stereo imaging system of FIG. 4 , comprising a folding unit having a planar reflective surface and a multiple-lens block unit comprising five lenses; and
- FIG. 12 illustrates a disparity adjusting mechanism for the stereo imaging system of FIG. 4 .
- the present disclosure is directed to a stereo imaging system 100 for a mobile device that not only has a lesser thickness dimension, but is also provided with the capacity of disparity and convergence angle control.
- the stereo imaging system 100 includes two substantially identical FPLC based camera units 102 a , 102 b disposed symmetrically to synchronously generate a left view and a right view of a scene viewed by the stereo imaging system.
- Each FPLC-based camera unit 102 a , 102 b is contained in a separate pivotable housing 103 a , 103 b .
- the FPLC-based camera units 102 a , 102 b each include a light-folding unit 104 a , 104 b to fold a light path (see dotted lines) entering the FPLC-based camera, and a multiple-lens block unit 106 a , 106 b to form images.
- Light rays entering the light-folding unit 104 a , 104 b of the FPLC-based camera 102 a , 102 b on a first light path are redirected by a folding element 108 a , 108 b (not shown in this view) on to a second light path as a collimated light beam comprising parallelly-oriented light rays (see solid lines).
- the folding element 108 a , 108 b may include a flat reflective surface or a curved reflective surface.
- the parallelly-oriented light rays of the collimated light beam are then refracted by lenses (not shown in this view) of the multiple-lens block unit 106 a , 106 b in the second light path to form an image at an image sensor 110 a , 110 b .
- each FPLC based camera 102 a , 102 b may be configured to provide a telephoto lens system embodiment or a wide-angle lens system embodiment.
- Each embodiment satisfies the requirement of parallelly-oriented light ray transmission between the light-folding unit 104 a , 104 b and the multiple-lens block unit 106 a , 106 b.
- each FPLC-based camera unit 102 a , 102 b by its configuration respectively defines a virtual camera 112 a , 112 b (only virtual camera 112 a is shown in the drawing figure) which represents, respectively, a left or a right view of the scene as transmitted to each image sensor 110 a , 110 b.
- disparity of the left view and the right view of the stereo imaging system 100 can be adjusted by adjusting a distance between the light-folding units 104 a , 104 b of the two FPLC based camera units 102 a , 102 b .
- a convergence angle of the left view and the right view of the stereo imaging system 100 can be adjusted by adjusting an angle between the left FPLC based camera unit 102 a and the right FPLC based camera unit 102 b .
- FIGS. 7, 8, and 9 illustrate implementation of FPLC-based camera units 102 a , 102 b comprising folding element 108 a , 108 b having curved reflective surfaces.
- the multiple-lens block unit 106 a comprises three lenses 114 a , 114 b , 114 c .
- the multiple-lens block unit 106 a comprises five lenses 114 a , 114 b , 114 c , 114 d , and 114 e .
- the curved folding elements 108 a , 108 b are provided having a curvature whereby a field of view of the curved folding elements 108 a , 108 b is the same as that of a field of view of the multiple-lens block units 106 a , 106 b .
- the field of view of the curved folding elements 108 a , 108 b defines the field of view of the FPLC-based camera units 102 a , 102 b.
- FIGS. 10 and 11 illustrate implementation of FPLC-based camera units 102 a , 102 b comprising folding elements 108 a , 108 b having planar reflective surfaces.
- FIG. 10 shows an FPLC-based camera unit 102 a having a multiple-lens block unit 106 a comprising three lenses 114 a , 114 b , 114 c
- FIG. 11 shows an FPLC-based camera unit 102 a having a multiple-lens block unit 106 a comprising five lenses 114 a , 114 b , 114 c , 114 d , and 114 e .
- concave lenses 116 a , 116 b are provided as part of the light-folding units 104 a , 104 b , disposed in the light path entering the FPLC-based camera units.
- the concave lenses 116 a , 116 b are provided having a curvature whereby a field of view of the concave lenses 116 a , 116 b is the same as that of a field of view of the multiple-lens block units 106 a , 106 b .
- the field of view of the concave lenses 116 a , 116 b defines the field of view of the FPLC-based camera units 102 a , 102 b.
- the multiple-lens block units 106 a , 106 b are able to provide an image of a scene that is the same size as that of the image sensors 110 a , 110 b .
- the fields of view of the light folding units 104 a , 104 b are independent of the spacing or distance of the light folding units from the multiple lens block units 106 a , 106 b .
- FIGS. 7 and 10 illustrate wide-angle multiple lens block units 106 a , 106 b paired respectively with curved and planar light-folding units 104 a , 104 b .
- FIGS. 9 and 11 illustrate telephoto multiple-lens block units 106 a , 106 b paired respectively with curved and planar light-folding units 104 a , 104 b .
- the field of view of the light-folding units 104 a , 104 b is the same as that of the field of view of the multiple-lens block units 106 a , 106 b .
- the described stereo imaging system 100 is not limited to wide-angle and telephoto lens systems, but instead may be configured with any suitable lens system wherein the light-folding units 104 a , 104 b can be configured with a same field of view as the multiple-lens block units 106 a , 106 b such that the multiple-lens block units can produce an image of a scene that is the same size as the image sensors 110 a , 110 b comprised in the stereo imaging system.
- the light-folding units 104 a , 104 b define virtual cameras 112 a , 112 b , described respectively in reference to an orientation of the stereo imaging system 100 as the left and right virtual camera 112 a , 112 b .
- the distance D (see FIG. 4 and FIG. 6 ) between the left and right virtual camera 112 a , 112 b is variously called the interocular distance, virtual camera distance, virtual camera disparity, or simply disparity. It is this distance D that determines the disparity between a left view and a right view of a scene.
- each virtual camera 112 a , 112 b has a line of sight, referred to as the optical axis O (see FIGS. 5, 7, and 9-11 ).
- the angle between the optical axes of the virtual cameras 112 a , 112 b is called the convergence angle A (see FIG. 6 ).
- the described stereo imaging system 100 of the present disclosure provides for adjustment of both the interocular distance/disparity and convergence angle.
- each FPLC-based camera unit 102 a , 102 b housing 103 a , 103 b is pivotally (see FIG. 6 , arrows B) attached to a stereo imaging system housing 118 .
- the FPLC-based camera units 102 a , 102 b are respectively pivotally attached to the stereo imaging system housing 118 by a rotating shaft 120 a , 120 b .
- a convergence-angle-adjusting mechanism 122 is provided, in the depicted embodiment comprising a biasing actuator 124 and at least two biasing members 126 .
- Rotating the biasing actuator 124 in a first direction will urge each camera unit housing 103 a , 103 b to rotate about an axis defined by the rotating shafts 120 a , 120 b , thus altering an angle between the FPLC-based camera unit 102 a , 102 b optical axes O and so altering a convergence angle of the stereo imaging system 100 .
- Rotating the biasing actuator 124 in a second, opposed direction will return the camera unit housings to their original orientations, assisted by the biasing actions of the biasing members 126 . In turn, the biasing action of the biasing members 126 ensures stability of the adjusting process.
- a disparity adjusting mechanism 128 is also provided.
- the disparity adjusting mechanism 128 comprises an arrangement of guide rods 130 to which each light folding unit 104 a , 104 b is slidingly attached.
- a cam array 132 is provided, disposed between each light folding unit 104 a , 104 b and under control of a disparity adjusting actuator 134 .
- the cam array 132 comprises a pair of elliptical cams 136 a , 136 b disposed whereby actuating the disparity adjusting actuator 134 causes the cams 136 a , 136 b to rotate in opposed directions (see arrows).
- this will bias the light folding units 104 a , 104 b , translating them laterally to increase a distance therebetween.
- a plurality of biasing members 138 are disposed to bias the light folding units 104 a , 104 b towards one another in an opposite direction to the biasing force imposed by the cam array 132 .
- the biasing members 138 provide stability to the disparity adjusting process.
- the present disclosure provides a stereo imaging system 100 wherein a width/height dimension of the system is minimized, and so the described stereo imaging system is readily adapted to small mobile devices such as smartphones.
- the described light folding units 104 a , 104 b reflect light/images to the multiple lens block units 106 a , 106 b as a collimated light beam comprising parallel light rays, the field of view of the light folding units 104 a , 104 b is independent of any distance between the light folding units and the multiple-lens block units.
- disparity control is possible for the stereo imaging system 100 without requiring movement of the multiple lens block units 106 a , 106 b and/or the image sensors 110 a , 110 b .
- This further contributes to the compact design of the described stereo imaging system 100 .
- convergence angle control is made possible, i.e., adjusting an angle between optical axes of the virtual cameras 112 a , 112 b defined by the system.
- the images captured by image sensors 110 a , 110 b representing respectively a left and a right view of a scene can then be processed to provide stereoscopic images and/or image-plus-depth images, i.e. three-dimensional images.
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Stereoscopic And Panoramic Photography (AREA)
- Studio Devices (AREA)
Abstract
A stereo imaging system having convergence angle and disparity control includes a pair of pivoting folded-parallel-light-channel (FPLC) units arranged to provide a virtual left side view and a virtual right side view of a scene. Each FPLC unit includes a fixed lens unit adapted to focus reflected light comprising an image of a scene to an image sensor and a laterally translatable light-redirecting unit comprising a reflector adapted to define a parallel image reflection path to the fixed lens unit via a collimated light beam comprising substantially parallel light beams. The stereo imaging system further includes a disparity-adjusting mechanism adapted to alter a distance between the pair of pivoting FPLC units and a convergence-angle-adjusting mechanism adapted to pivot the pivoting FPLC units.
Description
- This utility patent application claims the benefit of priority in U.S. Provisional Patent Application Ser. No. 62/407,754 filed on Oct. 13, 2016, the entirety of the disclosure of which is incorporated herein by reference.
- The present disclosure relates to stereo imaging. More specifically, this disclosure pertains to a compact folded-parallel-light-channel (FPLC) stereo imaging system synchronously generating a left view and a right view of a scene, and also providing both disparity and convergence angle control. The disclosed stereo imaging system finds utility in a variety of devices including compact mobile devices such as cell phones and smartphones.
- A critical point in designing an embedded imaging system for a handheld or other mobile device such as a smartphone is to ensure the height (thickness) of the imaging system is smaller than (or, at least, close to) the thickness of the cell phone. The image sensor of a cell phone imaging system is of a fixed dimension (4.80×3.60 mm). To ensure images of the same size as the image sensor are produced, one cannot unlimitedly reduce the sizes of the lenses used in a cell phone imaging system. Hence, a telephoto camera usually cannot be used for a mobile device such as a smartphone since such a camera when equipped with camera comprising a plurality of lenses disposed to refract light to form an image at a cell phone camera image sensor (CPCIS), would require at least 14 mm for its height (see
FIG. 1 for an example) while the thickness of a typical smartphone is between 7 and 9 mm only. - To allow a telephoto camera equipped with a CPCIS to be embedded in a smartphone, prior art devices are known (see
FIG. 2 ) wherein the telephoto camera is “folded” by inserting a light-folding mirror in the lens system so that the optical axis (see dotted line) is redirected from vertical to horizontal once it reaches the folding mirror. The image sensor is installed on an orientation defining a plane oriented vertically to a plane defined by the ground, instead of parallel to a plane defined by the ground. By folding a telephoto camera equipped with a CPCIS in this manner, the height of the camera can be made as small as 7 mm and consequently can be embedded into a smart cell phone. As examples, see U.S. Pat. No. 9,316,810 to Mercado and U.S. Pat. No. 9,172,856 to Bohn et al., the entire disclosures of each of which are incorporated herein by reference. - In theory, a stereo imaging system could be provided by arranging two identical imaging systems such as those shown in
FIG. 2 symmetrically as shown inFIG. 3 . Such a hypothetical stereo imaging system could be embedded in a mobile device such as a smartphone completely. However, the only way to provide disparity (interocular distance) control for such a stereo imaging system would be to configure each of the left and right imaging systems to translate laterally in their entirety relative to one another. This is illustrated inFIG. 3 . Such an arrangement, while hypothetically configurable, would require additional packaging space potentially not available in small mobile devices such as smartphones. - Accordingly, a need in the art is identified for improvements to imaging systems for small mobile devices, providing stereo imaging systems including such convergence and disparity control. The following disclosure describes a folded-parallel-light-channel stereo imaging system for a mobile device configured to allow disparity and convergence angle control without requiring motion of each entire unit relative to one another.
- To solve the foregoing problems and address the identified need in the art, in one aspect of the present disclosure a stereo imaging system having convergence angle and disparity control is provided, comprising a pair of pivoting folded-parallel-light-channel (FPLC) units arranged to provide a virtual left side view and a virtual right side view of a scene. Each FPLC unit comprises a fixed lens unit adapted to focus reflected light comprising an image of a scene to an image sensor, and a laterally translatable light-redirecting unit comprising a reflector adapted to define a parallel image reflection path to the fixed lens unit via a collimated light beam comprising substantially parallel light beams. The stereo imaging system further includes a disparity-adjusting mechanism adapted to alter a distance between the pair of pivoting FPLC units and a convergence-angle-adjusting mechanism adapted to pivot the pivoting FPLC units.
- In embodiments, the disparity-adjusting mechanism comprises a first actuator operatively connected to a cam assembly. In embodiments, the convergence-angle-adjusting mechanism comprises a second actuator adapted to pivot a pair of pivoting housings each respectively carrying a one of the pair of FPLC units.
- In embodiments, the reflector defines a planar reflective surface. A concave lens may be disposed between the reflector and an image inlet of each of the pair of FPLC units. This concave lens defines a lens field of view that is the same as a field of view of the fixed lens unit. In alternative embodiments, the reflector defines an arcuate reflective surface. The arcuate reflective surface may be configured to define a reflector field of view that is the same as a field of view of the fixed lens unit. In embodiments, the fixed lens unit defines a wide-angle lens unit. In alternative embodiments, the fixed lens unit defines a telephoto lens unit.
- In another aspect, a stereo imaging system having convergence angle and disparity control is provided, comprising a pair of pivoting folded-parallel-light-channel (FPLC) units arranged to provide a virtual left side view and a virtual right side view of a scene. Each FPLC unit comprises a fixed lens unit adapted to focus reflected light comprising an image of a scene to an image sensor and a laterally translatable light-redirecting unit comprising a planar reflector adapted to define a parallel image reflection path to the fixed lens unit via a collimated light beam comprising substantially parallel light beams. The disclosed system further includes a disparity-adjusting mechanism adapted to alter a distance between the pair of pivoting FPLC units and a convergence-angle-adjusting mechanism adapted to pivot the pivoting FPLC units. The disparity-adjusting mechanism and the convergence-angle-adjusting mechanism may be as described above.
- In yet another aspect, a stereo imaging system having convergence angle and disparity control is provided, comprising a pair of pivoting folded-parallel-light-channel (FPLC) units arranged to provide a virtual left side view and a virtual right side view of a scene. Each FPLC unit comprises a fixed lens unit adapted to focus reflected light comprising an image of a scene to an image sensor and a laterally translatable light-redirecting unit comprising an arcuate reflector adapted to define a parallel image reflection path to the fixed lens unit via a collimated light beam comprising substantially parallel light beams. The disclosed system further includes a disparity-adjusting mechanism adapted to alter a distance between the pair of pivoting FPLC units and a convergence-angle-adjusting mechanism adapted to pivot the pivoting FPLC units. The disparity-adjusting mechanism and the convergence-angle-adjusting mechanism may be as described above.
- These and other embodiments, aspects, advantages, and features of the present invention will be set forth in the description which follows, and in part will become apparent to those of ordinary skill in the art by reference to the following description of the invention and referenced drawings or by practice of the invention. The aspects, advantages, and features of the invention are realized and attained by means of the instrumentalities, procedures, and combinations particularly pointed out in the appended claims. Unless otherwise indicated, any patent and/or non-patent citations discussed herein are specifically incorporated by reference in their entirety into the present disclosure.
-
FIG. 1 depicts a prior art imager for a mobile device such as a cellphone or smartphone; -
FIG. 2 depicts a prior art folded light-path imager for a mobile device such as a cellphone or smartphone; -
FIG. 3 illustrates a hypothetical stereo imager derived from the imager ofFIG. 2 ; -
FIG. 4 schematically illustrates a stereo imaging system according to the present disclosure; -
FIG. 5 shows in isolation a folded-parallel-light-channel-based camera unit for use in the stereo imaging system ofFIG. 4 ; -
FIG. 6 shows operation of a convergence angle adjusting mechanism for the stereo imaging system ofFIG. 4 ; -
FIG. 7 shows in isolation a folded-parallel-light-channel-based camera unit for use in the stereo imaging system ofFIG. 4 , comprising a folding unit having a curved reflective surface and a multiple-lens block unit comprising three lenses; -
FIG. 8 shows a curved reflector for use in the camera unit ofFIG. 7 ; -
FIG. 9 shows in isolation a folded-parallel-light-channel-based camera unit for use in the stereo imaging system ofFIG. 4 , comprising a folding unit having a curved reflective surface and a multiple-lens block unit comprising five lenses; -
FIG. 10 shows in isolation a folded-parallel-light-channel-based camera unit for use in the stereo imaging system ofFIG. 4 , comprising a folding unit having a planar reflective surface and a multiple-lens block unit comprising three lenses; -
FIG. 11 shows in isolation a folded-parallel-light-channel-based camera unit for use in the stereo imaging system ofFIG. 4 , comprising a folding unit having a planar reflective surface and a multiple-lens block unit comprising five lenses; and -
FIG. 12 illustrates a disparity adjusting mechanism for the stereo imaging system ofFIG. 4 . - In the following detailed description of the illustrated embodiments, reference is made to the accompanying drawings that form a part hereof, and in which is shown by way of illustration, specific embodiments in which the invention may be practiced. These embodiments are described in sufficient detail to enable those skilled in the art to practice the invention. Also, it is to be understood that other embodiments may be utilized and that process, reagent, materials, software, and/or other changes may be made without departing from the scope of the present invention.
- The present disclosure is directed to a
stereo imaging system 100 for a mobile device that not only has a lesser thickness dimension, but is also provided with the capacity of disparity and convergence angle control. With reference toFIGS. 4 and 5 , thestereo imaging system 100 includes two substantially identical FPLC basedcamera units camera unit pivotable housing camera units folding unit lens block unit folding unit camera folding element 108 a, 108 b (not shown in this view) on to a second light path as a collimated light beam comprising parallelly-oriented light rays (see solid lines). Thefolding element 108 a, 108 b may include a flat reflective surface or a curved reflective surface. The parallelly-oriented light rays of the collimated light beam are then refracted by lenses (not shown in this view) of the multiple-lens block unit image sensor camera folding unit lens block unit - As shown representatively in
FIG. 5 , each FPLC-basedcamera unit virtual camera virtual camera 112 a is shown in the drawing figure) which represents, respectively, a left or a right view of the scene as transmitted to eachimage sensor - In either embodiment, disparity of the left view and the right view of the
stereo imaging system 100 can be adjusted by adjusting a distance between the light-foldingunits camera units stereo imaging system 100 can be adjusted by adjusting an angle between the left FPLC basedcamera unit 102 a and the right FPLC basedcamera unit 102 b. Mechanisms for effecting these adjustments will be described below. -
FIGS. 7, 8, and 9 illustrate implementation of FPLC-basedcamera units folding element 108 a, 108 b having curved reflective surfaces. In the embodiment depicted inFIG. 7 , the multiple-lens block unit 106 a comprises threelenses FIG. 9 , the multiple-lens block unit 106 a comprises fivelenses folding elements 108 a, 108 b are provided having a curvature whereby a field of view of the curvedfolding elements 108 a, 108 b is the same as that of a field of view of the multiple-lens block units folding elements 108 a, 108 b defines the field of view of the FPLC-basedcamera units -
FIGS. 10 and 11 illustrate implementation of FPLC-basedcamera units folding elements 108 a, 108 b having planar reflective surfaces.FIG. 10 shows an FPLC-basedcamera unit 102 a having a multiple-lens block unit 106 a comprising threelenses FIG. 11 shows an FPLC-basedcamera unit 102 a having a multiple-lens block unit 106 a comprising fivelenses concave lenses 116 a, 116 b (onlylens 116 a shown in the drawings) are provided as part of the light-foldingunits concave lenses 116 a, 116 b are provided having a curvature whereby a field of view of theconcave lenses 116 a, 116 b is the same as that of a field of view of the multiple-lens block units concave lenses 116 a, 116 b defines the field of view of the FPLC-basedcamera units - As will be appreciated, by ensuring that the field of view of the
light folding units lens block units lens block units image sensors folding elements 108 a, 108 b to the multiple-lens block units light folding units lens block units lens block units image sensors -
FIGS. 7 and 10 illustrate wide-angle multiplelens block units units FIGS. 9 and 11 illustrate telephoto multiple-lens block units units units lens block units stereo imaging system 100 is not limited to wide-angle and telephoto lens systems, but instead may be configured with any suitable lens system wherein the light-foldingunits lens block units image sensors - As described above in the discussion of
FIGS. 4 and 5 , the light-foldingunits virtual cameras stereo imaging system 100 as the left and rightvirtual camera FIG. 4 andFIG. 6 ) between the left and rightvirtual camera virtual camera FIGS. 5, 7, and 9-11 ). The angle between the optical axes of thevirtual cameras FIG. 6 ). Advantageously, the describedstereo imaging system 100 of the present disclosure provides for adjustment of both the interocular distance/disparity and convergence angle. - With regard to adjustment of convergence angle, referring back to
FIG. 4 and toFIG. 6 , each FPLC-basedcamera unit b housing FIG. 6 , arrows B) attached to a stereoimaging system housing 118. In the depicted embodiment, the FPLC-basedcamera units imaging system housing 118 by arotating shaft mechanism 122 is provided, in the depicted embodiment comprising a biasingactuator 124 and at least two biasingmembers 126. Rotating the biasingactuator 124 in a first direction will urge eachcamera unit housing shafts camera unit stereo imaging system 100. Rotating the biasingactuator 124 in a second, opposed direction will return the camera unit housings to their original orientations, assisted by the biasing actions of the biasingmembers 126. In turn, the biasing action of the biasingmembers 126 ensures stability of the adjusting process. - With reference to
FIGS. 4 and 12 , adisparity adjusting mechanism 128 is also provided. In the depicting embodiment, thedisparity adjusting mechanism 128 comprises an arrangement ofguide rods 130 to which eachlight folding unit cam array 132 is provided, disposed between eachlight folding unit disparity adjusting actuator 134. In the depicted embodiment, thecam array 132 comprises a pair ofelliptical cams disparity adjusting actuator 134 causes thecams light folding units members 138, in the depicted embodiment being springs concentrically around eachguide rod 130, are disposed to bias thelight folding units cam array 132. Thus, by thisdisparity adjusting mechanism 128 thelight folding units stereo imaging system 100. Likewise, the biasingmembers 138 provide stability to the disparity adjusting process. - Summarizing, the present disclosure provides a
stereo imaging system 100 wherein a width/height dimension of the system is minimized, and so the described stereo imaging system is readily adapted to small mobile devices such as smartphones. In turn, because the described lightfolding units lens block units light folding units stereo imaging system 100 without requiring movement of the multiplelens block units image sensors stereo imaging system 100. Still more, by the described mechanisms convergence angle control is made possible, i.e., adjusting an angle between optical axes of thevirtual cameras image sensors - One of ordinary skill in the art will recognize that additional embodiments of the invention are also possible without departing from the teachings herein. Thus, the foregoing description is presented for purposes of illustration and description of the various aspects of the invention, and one of ordinary skill in the art will recognize that additional embodiments of the invention are possible without departing from the teachings herein. This detailed description, and particularly the specific details of the exemplary embodiments, is given primarily for clarity of understanding, and no unnecessary limitations are to be imported, for modifications will become obvious to those skilled in the art upon reading this disclosure and may be made without departing from the spirit or scope of the invention. Relatively apparent modifications, of course, include combining the various features of one or more figures with the features of one or more of other figures. All such modifications and variations are within the scope of the invention as determined by the appended claims when interpreted in accordance with the breadth to which they are fairly, legally and equitably entitled.
Claims (23)
1. A stereo imaging system having convergence angle and disparity control, comprising:
a pair of pivoting folded-parallel-light-channel (FPLC) units arranged to provide a virtual left side view and a virtual right side view of a scene, each FPLC unit comprising:
a) a fixed lens unit adapted to focus reflected light comprising an image of a scene to an image sensor, and
b) a laterally translatable light-redirecting unit comprising a reflector adapted to define a parallel image reflection path to the fixed lens unit via a collimated light beam comprising substantially parallel light beams;
a disparity-adjusting mechanism adapted to alter a distance between the laterally translatable light-redirecting units of the pair of pivoting FPLC units; and
a convergence-angle-adjusting mechanism adapted to pivot the pivoting FPLC units.
2. The stereo imaging system according to claim 1 , wherein the disparity-adjusting mechanism comprises a first actuator operatively connected to a cam assembly.
3. The stereo imaging system according to claim 2 , wherein the convergence-angle-adjusting mechanism comprises a second actuator adapted to pivot a pair of pivoting housings each respectively carrying a one of the pair of FPLC units.
4. The stereo imaging system according to claim 1 , wherein the reflector defines a planar reflective surface.
5. The stereo imaging system according to claim 4 , further including a concave lens disposed between the reflector and an image inlet of each of the pair of FPLC units.
6. The stereo imaging system according to claim 5 , wherein the concave lens defines a lens field of view that is the same as a field of view of the fixed lens unit.
7. The stereo imaging system according to claim 1 , wherein the reflector defines an arcuate reflective surface.
8. The stereo imaging system according to claim 7 , wherein the arcuate reflective surface is configured to define a reflector field of view that is the same as a field of view of the fixed lens unit.
9. The stereo imaging system according to claim 1 , wherein the fixed lens unit defines a wide-angle lens unit.
10. The stereo imaging system according to claim 1 , wherein the fixed lens unit defines a telephoto lens unit.
11. A stereo imaging system having convergence angle and disparity control, comprising:
a pair of pivoting folded-parallel-light-channel (FPLC) units arranged to provide a virtual left side view and a virtual right side view of a scene, each FPLC unit comprising:
a) a fixed lens unit adapted to focus reflected light comprising an image of a scene to an image sensor, and
b) a laterally translatable light-redirecting unit comprising a planar reflector adapted to define a parallel image reflection path to the fixed lens unit via a collimated light beam comprising substantially parallel light beams;
a disparity-adjusting mechanism adapted to alter a distance between the laterally translatable light-redirecting units of the pair of pivoting FPLC units; and
a convergence-angle-adjusting mechanism adapted to pivot the pivoting FPLC units.
12. The stereo imaging system according to claim 11 , wherein the disparity-adjusting mechanism comprises a first actuator operatively connected to a cam assembly.
13. The stereo imaging system according to claim 12 , wherein the convergence-angle-adjusting mechanism comprises a second actuator adapted to pivot a pair of pivoting housings each respectively carrying a one of the pair of FPLC units.
14. The stereo imaging system according to claim 11 , further including a concave lens disposed between the planar reflector and an image inlet of each of the pair of FPLC units.
15. The stereo imaging system according to claim 14 , wherein the concave lens defines a lens field of view that is the same as a field of view of the fixed lens unit.
16. The stereo imaging system according to claim 11 , wherein the fixed lens unit defines a wide-angle lens unit.
17. The stereo imaging system according to claim 11 , wherein the fixed lens unit defines a telephoto lens unit.
18. A stereo imaging system having convergence angle and disparity control, comprising:
a pair of pivoting folded-parallel-light-channel (FPLC) units arranged to provide a virtual left side view and a virtual right side view of a scene, each FPLC unit comprising:
a) a fixed lens unit adapted to focus reflected light comprising an image of a scene to an image sensor, and
b) a laterally translatable light-redirecting unit comprising an arcuate reflector adapted to define a parallel image reflection path to the fixed lens unit via a collimated light beam comprising substantially parallel light beams;
a disparity-adjusting mechanism adapted to alter a distance between the laterally translatable light-redirecting units of the pair of pivoting FPLC units; and
a convergence-angle-adjusting mechanism adapted to pivot the pivoting FPLC units.
19. The stereo imaging system according to claim 18 , wherein the disparity-adjusting mechanism comprises a first actuator operatively connected to a cam assembly.
20. The stereo imaging system according to claim 19 , wherein the convergence-angle-adjusting mechanism comprises a second actuator adapted to pivot a pair of pivoting housings each respectively carrying a one of the pair of FPLC units.
21. The stereo imaging system according to claim 18 , wherein the arcuate reflective surface is configured to define a reflector field of view that is the same as a field of view of the fixed lens unit.
22. The stereo imaging system according to claim 18 , wherein the fixed lens unit defines a wide-angle lens unit.
23. The stereo imaging system according to claim 18 , wherein the fixed lens unit defines a telephoto lens unit.
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US15/591,695 US20180109774A1 (en) | 2016-10-13 | 2017-05-10 | Folded parallel-light-channel based stereo imaging system with disparity and convergence angle control |
US16/551,080 US11297297B2 (en) | 2016-10-13 | 2019-08-26 | Folded parallel-light-channel based stereo imaging system with disparity and convergence angle control |
US17/558,859 US20220116575A1 (en) | 2016-10-13 | 2021-12-22 | Folded parallel-light-channel based stereo imaging system |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201662407754P | 2016-10-13 | 2016-10-13 | |
US15/591,695 US20180109774A1 (en) | 2016-10-13 | 2017-05-10 | Folded parallel-light-channel based stereo imaging system with disparity and convergence angle control |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/551,080 Continuation US11297297B2 (en) | 2016-10-13 | 2019-08-26 | Folded parallel-light-channel based stereo imaging system with disparity and convergence angle control |
Publications (1)
Publication Number | Publication Date |
---|---|
US20180109774A1 true US20180109774A1 (en) | 2018-04-19 |
Family
ID=61904889
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/591,695 Abandoned US20180109774A1 (en) | 2016-10-13 | 2017-05-10 | Folded parallel-light-channel based stereo imaging system with disparity and convergence angle control |
US16/551,080 Active 2037-10-14 US11297297B2 (en) | 2016-10-13 | 2019-08-26 | Folded parallel-light-channel based stereo imaging system with disparity and convergence angle control |
Family Applications After (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/551,080 Active 2037-10-14 US11297297B2 (en) | 2016-10-13 | 2019-08-26 | Folded parallel-light-channel based stereo imaging system with disparity and convergence angle control |
Country Status (1)
Country | Link |
---|---|
US (2) | US20180109774A1 (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11336830B2 (en) * | 2019-01-03 | 2022-05-17 | Corephotonics Ltd. | Multi-aperture cameras with at least one two state zoom camera |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR101995344B1 (en) * | 2019-01-22 | 2019-07-02 | 김흥수 | A dual depth camera module without blind spot |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20130250410A1 (en) * | 2012-03-22 | 2013-09-26 | Fuhua Cheng | Two-parallel-channel reflector with focal length and disparity control |
US20140021352A1 (en) * | 2012-07-23 | 2014-01-23 | John Franzini | Corrolated control for close focus stereoscopic viewing |
US20140132707A1 (en) * | 2011-09-05 | 2014-05-15 | Mitsubishi Electric Corporation | Image processing apparatus and image processing method |
US8870379B2 (en) * | 2010-11-29 | 2014-10-28 | Hae-Yong Choi | 3D image convertible projection optical system |
US9316810B2 (en) * | 2014-03-07 | 2016-04-19 | Apple Inc. | Folded telephoto camera lens system |
Family Cites Families (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2012117617A1 (en) * | 2011-03-02 | 2012-09-07 | 富士フイルム株式会社 | 3d imaging device |
-
2017
- 2017-05-10 US US15/591,695 patent/US20180109774A1/en not_active Abandoned
-
2019
- 2019-08-26 US US16/551,080 patent/US11297297B2/en active Active
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8870379B2 (en) * | 2010-11-29 | 2014-10-28 | Hae-Yong Choi | 3D image convertible projection optical system |
US20140132707A1 (en) * | 2011-09-05 | 2014-05-15 | Mitsubishi Electric Corporation | Image processing apparatus and image processing method |
US20130250410A1 (en) * | 2012-03-22 | 2013-09-26 | Fuhua Cheng | Two-parallel-channel reflector with focal length and disparity control |
US20140021352A1 (en) * | 2012-07-23 | 2014-01-23 | John Franzini | Corrolated control for close focus stereoscopic viewing |
US9316810B2 (en) * | 2014-03-07 | 2016-04-19 | Apple Inc. | Folded telephoto camera lens system |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11336830B2 (en) * | 2019-01-03 | 2022-05-17 | Corephotonics Ltd. | Multi-aperture cameras with at least one two state zoom camera |
Also Published As
Publication number | Publication date |
---|---|
US11297297B2 (en) | 2022-04-05 |
US20200059636A1 (en) | 2020-02-20 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
KR102291622B1 (en) | Compact eye proximity display optics for augmented reality | |
US10044919B2 (en) | Structures and methods for capturing images by a portable electronic device | |
EP3623857B1 (en) | An optical system for an image acquisition device | |
US20130027522A1 (en) | Stereoscopic imaging apparatus | |
US11297297B2 (en) | Folded parallel-light-channel based stereo imaging system with disparity and convergence angle control | |
US9807366B2 (en) | Two-channel reflector based single-lens 2D/3D camera with disparity and convergence angle control | |
BR112016029714B1 (en) | Multi-camera system using folded optics free from tilt and parallax artifacts | |
US9019603B2 (en) | Two-parallel-channel reflector with focal length and disparity control | |
JP2005241791A (en) | Stereo imaging device | |
CN111033344A (en) | Module with multiple cameras for integration in a mobile device | |
US8639109B2 (en) | Stereoscopic imaging apparatus | |
US10795113B2 (en) | Device and apparatus for imaging | |
JP5379154B2 (en) | Dual focal length lens system | |
JP2023027182A (en) | Lens device and imaging apparatus | |
CN107390348B (en) | Optical imaging device and camera | |
US10602122B2 (en) | Monocular stereoscopic camera | |
US20220116575A1 (en) | Folded parallel-light-channel based stereo imaging system | |
KR101608404B1 (en) | Single lens Microscope for three dimensional image | |
JP4627040B2 (en) | Zoom mechanism | |
US20210286157A1 (en) | A Detachable Optical Structure for Displacing the Optical Axis of a Camera Device | |
JP2000023199A (en) | Compound eye image pickup device | |
KR101789317B1 (en) | A Multiscale imaging system | |
JP5390865B2 (en) | Stereo imaging device | |
CN116366974A (en) | Stereoscopic imaging system based on folding parallel light channel | |
KR101969765B1 (en) | Apparatus and method for recognizing iris using one image sensor |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: AMCHAEL VISUAL TECHNOLOGY CORPORATION, TAIWAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:CHENG, KAI MICHAEL;REEL/FRAME:042326/0439 Effective date: 20170508 |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |