WO2014124262A2 - Method and apparatus for stereoscopic imaging - Google Patents

Method and apparatus for stereoscopic imaging Download PDF

Info

Publication number
WO2014124262A2
WO2014124262A2 PCT/US2014/015306 US2014015306W WO2014124262A2 WO 2014124262 A2 WO2014124262 A2 WO 2014124262A2 US 2014015306 W US2014015306 W US 2014015306W WO 2014124262 A2 WO2014124262 A2 WO 2014124262A2
Authority
WO
WIPO (PCT)
Prior art keywords
eye
image
polarized
polarization
color
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/US2014/015306
Other languages
French (fr)
Other versions
WO2014124262A3 (en
WO2014124262A9 (en
Inventor
Matthew J. Lang
Taishi Zhang
Victor Horodincu
Siew Kit HOI
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
National University of Singapore
Massachusetts Institute of Technology
Original Assignee
National University of Singapore
Massachusetts Institute of Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by National University of Singapore, Massachusetts Institute of Technology filed Critical National University of Singapore
Publication of WO2014124262A2 publication Critical patent/WO2014124262A2/en
Publication of WO2014124262A3 publication Critical patent/WO2014124262A3/en
Publication of WO2014124262A9 publication Critical patent/WO2014124262A9/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/28Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 for polarising
    • G02B27/283Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 for polarising used for beam splitting or combining
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B01PHYSICAL OR CHEMICAL PROCESSES OR APPARATUS IN GENERAL
    • B01JCHEMICAL OR PHYSICAL PROCESSES, e.g. CATALYSIS OR COLLOID CHEMISTRY; THEIR RELEVANT APPARATUS
    • B01J21/00Catalysts comprising the elements, oxides, or hydroxides of magnesium, boron, aluminium, carbon, silicon, titanium, zirconium, or hafnium
    • B01J21/02Boron or aluminium; Oxides or hydroxides thereof
    • B01J21/04Alumina
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B01PHYSICAL OR CHEMICAL PROCESSES OR APPARATUS IN GENERAL
    • B01JCHEMICAL OR PHYSICAL PROCESSES, e.g. CATALYSIS OR COLLOID CHEMISTRY; THEIR RELEVANT APPARATUS
    • B01J23/00Catalysts comprising metals or metal oxides or hydroxides, not provided for in group B01J21/00
    • B01J23/38Catalysts comprising metals or metal oxides or hydroxides, not provided for in group B01J21/00 of noble metals
    • B01J23/48Silver or gold
    • B01J23/50Silver
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B01PHYSICAL OR CHEMICAL PROCESSES OR APPARATUS IN GENERAL
    • B01JCHEMICAL OR PHYSICAL PROCESSES, e.g. CATALYSIS OR COLLOID CHEMISTRY; THEIR RELEVANT APPARATUS
    • B01J23/00Catalysts comprising metals or metal oxides or hydroxides, not provided for in group B01J21/00
    • B01J23/38Catalysts comprising metals or metal oxides or hydroxides, not provided for in group B01J21/00 of noble metals
    • B01J23/54Catalysts comprising metals or metal oxides or hydroxides, not provided for in group B01J21/00 of noble metals combined with metals, oxides or hydroxides provided for in groups B01J23/02 - B01J23/36
    • B01J23/66Silver or gold
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03BAPPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B35/00Stereoscopic photography
    • G03B35/02Stereoscopic photography by sequential recording
    • G03B35/04Stereoscopic photography by sequential recording with movement of beam-selecting members in a system defining two or more viewpoints
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03BAPPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B35/00Stereoscopic photography
    • G03B35/08Stereoscopic photography by simultaneous recording
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03BAPPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B35/00Stereoscopic photography
    • G03B35/18Stereoscopic photography by simultaneous viewing
    • G03B35/24Stereoscopic photography by simultaneous viewing using apertured or refractive resolving means on screens or between screen and eye
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03BAPPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B35/00Stereoscopic photography
    • G03B35/18Stereoscopic photography by simultaneous viewing
    • G03B35/26Stereoscopic photography by simultaneous viewing using polarised or coloured light separating different viewpoint images
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20Image signal generators
    • H04N13/204Image signal generators using stereoscopic image cameras
    • H04N13/207Image signal generators using stereoscopic image cameras using a single two-dimensional [2D] image sensor
    • H04N13/218Image signal generators using stereoscopic image cameras using a single two-dimensional [2D] image sensor using spatial multiplexing

Definitions

  • 3D imaging encodes more object position information, particularly depth.
  • 3D imaging requires either two integrated and matched cameras for simultaneous 3D imaging, or repositioning of a single camera for sequential 3D image capture.
  • One method is a dedicated 3D camera with dual lens and dual image sensors. Despite the possibly higher cost, the versatility of this method is low.
  • Another current method for 3D imaging is to acquire two "sequential" images with the same camera, each image acquired at a slightly different perspective. The images are later combined into a 3D format through post-processing. Due to the minimal requirements on camera type and model, this method is particularly popular among smartphone users.
  • the intrinsic drawback of this method is that it only works with still subjects. Video is not possible, as the method does not work for moving subjects where the position changes drastically between the two independent shots.
  • the present invention is a stereoscopic image acquisition device.
  • the device comprises: an objective lens element configured to relay a combined beam, the combined beam including a left-eye- image polarized beam, corresponding to a left-eye image, and a right-eye-image polarized beam, corresponding to the right-eye image; at least one beam-splitting element, each beam-splitting element configured to separate its respective beamsplitter input beam into its respective first and second polarized output beams; and a plurality of image sensors, each image sensors configured to detect its respective image sensor input beam and to capture its respective image.
  • the left-eye-image polarized beam and each of the first polarized output beams have a first polarization
  • the right-eye-image polarized beam and each of the second polarized output beam have a second polarization, different from the first polarization
  • the present invention is a system for acquiring a stereoscopic image.
  • the system comprises: (1) an attachment configured to acquire a stereoscopic image, and a device described above.
  • the attachment comprises a left-eye attachment channel; a right-eye attachment channel; and a beam combiner.
  • the left-eye attachment channel configured to relay a left- eye attachment beam to the beam combiner
  • the right-eye attachment channel configured to relay the right-eye attachment beam to the beam combiner
  • the beam combiner configured to combine the left-eye attachment beam with the right-eye attachment beam and to form a combined beam
  • the left-eye attachment channel including a first polarizer element configured to transform the left-eye attachment beam into a first polarized attachment beam having a first polarization
  • the right- eye attachment channel including a second polarizer element configured to transform the right-eye attachment beam into a second polarized attachment beam having a second polarization, the first polarization being different from the second polarization.
  • the present invention is a stereoscopic image acquisition device.
  • the device comprises; means for relaying a combined beam, the combined beam including a left-eye-image polarized beam, corresponding to a left- eye image, and a right-eye-image polarized beam, corresponding to the right-eye image; means for separating the combined beam into first and second polarized output beams; means for detecting the first polarized output beam and for capturing the left-eye image, and means for detecting the second polarized output beam and for capture the right-eye image.
  • the left-eye-image polarized beam and the first polarized output beam have a first polarization
  • the right-eye-image polarized beam and the second polarized output beam have a second polarization, different from the first polarization.
  • the present invention is a stereoscopic image acquisition device.
  • the device comprises: means for relaying a combined beam, the combined beam including a left-eye-image polarized beam, corresponding to a left-eye image, and a right-eye-image polarized beam, corresponding to the right-eye image; means for separating the combined beam into first and second polarized output beams, wherein the left-eye-image polarized beam and the first polarized output beam have a first polarization, and the right-eye-image polarized beam and the second polarized output beam have a second polarization, different from the first polarization; means for spatially separating color component rays of the first and the second polarized output beams into first and second pluralities of polarized color components output beams, respectively; means for detecting the first plurality of polarized color components output beams and for capturing a plurality of left-eye color component images; and means for detecting the second plurality of polarized color components output
  • the present invention is A stereoscopic image acquisition device.
  • the device comprises: means for relaying a combined beam, the combined beam including a left-eye-image polarized beam, corresponding to a left-eye image, and a right-eye-image polarized beam, corresponding to the right-eye image; means for spatially separating color component rays of the combined beam into a plurality of color components output beams; means for separating the plurality of color component output beams into respective first and second pluralities of polarized color component output beams, wherein the left-eye-image polarized beam and the first plurality of polarized color component output beams have a first polarization, and the right-eye-image polarized beam and the second plurality of polarized color component output beams have a second polarization, different from the first polarization; means for detecting the first plurality of polarized color components output beams and for capturing a plurality of left-eye color component images; and means for detecting the
  • the present invention is a method for acquiring a stereoscopic image.
  • the method comprises: relaying a combined beam through an objective lens element, the combined beam including a left-eye-image polarized beam, corresponding to a left-eye image, and a right-eye-image polarized beam, corresponding to the right-eye image; separating at least one beam-splitter input beam into its respective first and second polarized output beams; and detecting a plurality of image sensor input beams and capturing a respective plurality of images.
  • the left-eye-image polarized beam and the first polarized output beam each has a first polarization
  • the right-eye-image polarized beam and the second polarized output beam each has a second polarization, different from the first polarization.
  • the present invention is a method of acquiring a stereoscopic image.
  • the method comprises: passing a left-eye beam through a first polarizing filter configured to transform the left-eye beam into a left- eye image polarized beam having a first polarization; passing a right-eye beam through a second polarizing filter configured to transform the right-eye beam into a right-eye image polarized beam having a second polarization, the first polarization being different from the second polarization, combining the left-eye image polarized beam and the right-eye image polarized beam to form a combined beam; relaying the combined beam through an objective lens element; separating the combined beam into the first and the second polarized output beams; relaying the first polarized output beam to a first image sensor and capturing the left-eye image; and relaying the second polarized output beam to a second image sensor and capturing the right-eye image.
  • the present invention is
  • a method of acquiring a stereoscopic image comprises: passing a left-eye beam through a first polarizing filter configured to transform the left-eye beam into a left-eye image polarized beam having a first polarization;
  • a second polarizing filter configured to transform the right-eye beam into a right-eye image polarized beam having a second polarization, the first polarization being different from the second polarization, combining the left-eye image polarized beam and the right-eye image polarized beam to form a combined beam; relaying the combined beam through an objective lens element; separating the combined beam into the first and the second polarized output beams, spatially separating color component rays of the first and the second polarized output beams into first and second pluralities of polarized color components output beams, respectively; relaying the first plurality of polarized color components output beams to a first plurality of image sensors and capturing a plurality of left-eye color component images, and relaying the second plurality of polarized color components output beams to a second plurality of image sensors and capturing a plurality of right-eye color component images.
  • the present invention is a method of acquiring a stereoscopic image.
  • the method comprises passing a left-eye beam through a first polarizing filter configured to transform the left-eye beam into a left- eye image polarized beam having a first polarization; passing a right-eye beam through a second polarizing filter configured to transform the right-eye beam into a right-eye image polarized beam having a second polarization, the first polarization being different from the second polarization, combining the left-eye image polarized beam and the right-eye image polarized beam to form a combined beam; relaying the combined beam through an objective lens element; spatially separating color component rays of the combined beam into a plurality of the color components output beams; separating the plurality of the color components output beams into respective first and second pluralities of polarized color component output beams; relaying the first plurality of polarized color component output beams to a first plurality of image sensors and capturing a plurality of left
  • Figure 1 is a schematic diagram showing how a Bayer- filter equipped digital camera captures color images.
  • Figure 2 is a schematic diagram of an example embodiment of the present invention.
  • Figure 3 A is a sample combined red/blue image taken by iPhone using an example attachment of the present invention.
  • Figures 3B and 3C are single color images that resulted in the anaglyph 3D image shown in Figure 3A.
  • the images in Figures 3B and 3C were taken from the left-eye and the right-eye perspective, respectively.
  • Figure 4A is a schematic diagram of an example embodiment of an attachment of the present invention.
  • Figure 4B is a photograph of an example embodiment of an attachment of the present invention shown in Figure 4A.
  • Figure 5 is a schematic diagram of an example embodiment of the present invention.
  • Figure 6 is a schematic diagram of an example embodiment of the present invention.
  • Figure 7 is a ray-tracing diagram illustrating the optical train of an example attachment of the present invention.
  • Figure 8 is a sample image taken by a single shutter camera using the example attachment shown in Figures 6.
  • Figure 9 is a schematic diagram of an embodiment of the present invention that relies on a polarization mosaic array.
  • Figures 10A, 10B, and IOC are collectively a schematic diagram illustrating the principle of operation of a polarization mosaic array.
  • Figure 1 1 is a schematic diagram of an embodiment of the present invention that relies on a polarization mosaic array.
  • Figure 12A is a schematic diagram of an embodiment of the present invention.
  • Figures 12B and 12C are schematic diagrams of two synchronization schemes that can be implemented in the device shown in Figure 12 A.
  • Figure 13 is a schematic diagram of an embodiment of the present invention.
  • Figure 14 is a schematic diagram of an embodiment of the present invention.
  • Figure 15 is a schematic diagram of an embodiment of the present invention.
  • Figure 16 is a schematic diagram of an embodiment of the present invention.
  • Figure 17 is a schematic diagram of an embodiment of the present invention.
  • Figure 18 is a schematic diagram of an embodiment of the present invention.
  • Figure 19 is a schematic diagram of an embodiment of the present invention.
  • An example embodiment of the present invention is a device that utilizes color filters or polarization filters to generate two separate beams carrying two separate images of the same object taken from different perspectives.
  • the two perspectives correspond to the human left and right eye perspectives.
  • the two separate beams are directed into a single camera objective (a single shutter camera), resulting in a single image with 3D information encoded in the color or polarization.
  • a significant advantage of such a design is that the same lens is used for each eye perspective, thus permitting to capture a stereoscopic image with a single-shutter image acquisition device.
  • Another advantage is that the images are captured simultaneously and work for both static and moving subjects, allowing 3D video capture.
  • the device can be an attachment to a conventional, i.e. single shutter image capturing device.
  • the device of the present invention can further include a means for securing the attachment to an image acquisition device.
  • a means for securing the attachment include a clip, a screw and a bolt, a pin, or any other mechanical device suitable for securing two items together.
  • a metallic platform that is affixed around the lens, such as a washer affixed to the image acquisition device by a magnet.
  • a "dovetail" attachment arrangement whereby the attachment can be slid in place.
  • Another example of such means is a conventional threaded camera mount and a number of components that link this camera base to the attachment such that the attachment can be positioned in front of the objective lens of the camera.
  • such means for securing permit rotation of the attachment relative to the image acquisition device. Such rotation can allow taking the stereoscopic images in either the "portrait” or a "landscape"
  • the attachment described herein includes a mechanism that permits tilting the left and right eye angles so that they are parallel or crossed at an arbitrary or fixed position. This is important for the perspective in capturing the stereoscopic view.
  • the attachment described herein includes a mechanism that permits moving the left-eye channel relative to the right-eye channel by an arbitrary distance.
  • the left-eye channel and right-eye channel can be separated by about 6 cm.
  • the channels can be moved apart beyond 6 cm, or moved closer than 6 cm to each other. Such movement can be accomplished by any mechanism known to a person of ordinary skill in the art, such as a threaded component.
  • another example embodiment of the present invention is a device that includes a single shutter image acquisition device. The device further includes means for generating two separate beams carrying two separate images of the same object taken from different perspectives. In one example embodiment, each of the two images is captured in a corresponding frame by the image acquisition device.
  • both images are captured within a single frame of the image acquisition device.
  • means for generating two separate beams can include two additional shutters, movable mirrors that control which beam reaches the objective lens, two polarization filters in combination with a polarization control elements, such as a liquid crystal element or Pockels cells.
  • such a single-shuter image acquisition device useful for practicing the present invention can include a photodetector (CCD or CMOS) that employs a polarization mosaic array described, for example, in U.S. Patent No. 7,420,542, incorporated herein by reference in its entirety.
  • CMOS complementary metal-oxide-semiconductor
  • FIG 1 is a schematic diagram of a conventional digital camera 100.
  • Most digital cameras employ a Bayer filter, a standard color mask 102, usually stacked on a CCD/CMOS sensor 104.
  • the sensor 104 of the digital camera 100 is a matrix of pixels, which can be considered as an array or matrix of wells for photons. After exposure, the number of photons falling into each well is counted and converted into a grayscale image. Without the color mask 102, the sensor 104 is actually a black-and-white device with no ability to distinguish colors by itself.
  • a color filter array 102 is placed right before the sensor 104 to allow penetration of only a particular color.
  • the most widely used color filter array is the Bayer filter, which passes red (R), blue (B) and green (G) alternately.
  • R red
  • B blue
  • G green
  • each pixel of the sensor 104 can only receive photons of one of these RBG primary colors.
  • the true color image 106 is reconstructed from three single color images 105a, 105b, and 105c in a process called demosaicing. Demosaicing methods are well-known to a person of ordinary skill in the art.
  • An example embodiment of the present invention is a device for acquiring a stereoscopic image that can be an attachment to a single-shutter image acquisition device.
  • the attachment comprises a left-eye channel, a right-eye channel, and a beam combiner.
  • the left-eye channel is configured to relay a left-eye beam to the beam combiner
  • the right-eye channel is configured to relay the right- eye beam to the beam combiner.
  • the beam combiner configured to combine the left-eye beam with the right-eye beam and to form a single combined beam.
  • Such an embodiment is a device 200 illustrated in Figure 2.
  • the device 200 includes a left-eye channel color filter Fl (204) and a left-eye channel mirror Ml (208), and a right-eye channel color filter F2 (206) and a right-eye channel mirror M2 (210).
  • a beam combiner of the device 200 comprises a mirror M3 (212) and a dichroic filter D2 (214).
  • color filters 204 and 206 are not included.
  • color filters 204 and 206 can be anaglyphically colored.
  • a person of ordinary skill in the art of stereoscopic image acquisition will appreciate that numerous anaglyphic color schemes exist. The colors shown throughout the instant disclosure are chosen as “red” and “blue” for illustrative purposes only.
  • anaglyph refers to the stereoscopic effect achieved by means of encoding each eye's image using filters of different (usually chromatically opposite) colors. Anaglyph images contain two differently filtered colored images, one for each eye. When viewed through the "color coded"
  • anaglyph glasses each of the two images reaches one eye, revealing an integrated stereoscopic image.
  • the visual cortex of the brain fuses this into perception of a three dimensional scene or composition.
  • two broadband mirrors Ml (208) and M2 (210) are mounted at approximately 45° with respect to the optical axis of the respective filters 204 and 208 to reflect light onto mirror M3 (212) and dichroic filter D2 (214), which can be a mirror.
  • dichroic filter D2 (214) can operate by transmitting red light and reflecting the shorter wavelength - blue - light.
  • Mirror M3 (212) and dichroic filter D2 (214) in combination operate as a beam combiner. As a result, the left-eye beam 216 and the right-eye beam 218 are combined into a single combined beam 220.
  • Figure 2 depicts a single-shutter image acquisition device 250 as being separate from the device 200. It is understood that in certain embodiments, the image acquisition device 250 may be an integral part of the device 200.
  • the single combined beam 220 is then directed through a Bayer's mask 222 onto a detector 224.
  • a standard color camera sensor can be used to obtain a 3D image.
  • the image captured by a camera in the example embodiment of Figure 2 includes a red- and blue-light images. These images are spatially separated on the detector 224. Each image contains information from a different perspective.
  • the stereoscopic image can be viewed on a conventional display by wearing red- blue glasses.
  • image-processing software can be used to reconstruct the 3D image and to display it on a 3D display that does not require the viewer to wear a device for viewing the stereoscopic image, such as goggles, a lenticular array, or a parallax array.
  • Figures 3 A through 3C illustrate the use of a device exemplified in Figures 4A and 4B and operating according to the principle explained above with respect to Figure 2.
  • the combined red/blue image in Figure 3A was taken by iPhone®.
  • the two single images in Figures 3B and 3C show different perspectives.
  • the 3D effect in Figure 3A can be seen with blue-red glasses.
  • Figure 7 is a ray- tracing diagram illustrating the optical train of the device shown in Figures 2, 4 A, and 4B.
  • Figure 8 is a sample image taken by a single shutter camera using the example attachment shown in Figures 2, 4A and 4B.
  • Device 100 shown in Figure 2 and in Figures 4A and 4B can be used as an attachment to a smartphone or a digital single-shutter camera.
  • a further example embodiment of the present invention is device 500, shown in Figure 5.
  • the device 500 employs a color compensation scheme to convey the colors in the stereoscopic image more accurately.
  • the device 500 further includes a compensating color filter 530.
  • the compensating color filter 530 can be selected to pass the light in the spectral regions disposed in between the colors passed by the left-eye channel and the right-eye channel, such as a green color where left is red and right is blue.
  • the mirror M3 (212) of the device 200 is replaced with a second dichroic filter Dl (532) that transmits the compensating beam 534 but reflects the colored beam 536.
  • Figure 5 depicts a single-shutter image acquisition device 550 as being separate from the device 500. It is understood that in certain embodiments, the image acquisition device 550 may be an integral part of the device 500.
  • Image post-processing using methods well-known to one of ordinary skill in the art, can be performed either by the image acquisition device 550 or by a special or general purpose computer to render a color-compensated 3D image acquired using the device 500.
  • a further example embodiment of the present invention is the device 600 illustrated in Figure 6.
  • the device 600 does not include anaglyphic color filters disposed in its left-eye channel 602 and right-eye channel 603. Instead, the device 600 includes at least one color separation element configured to spatially separate color component rays of the left-eye beam 602 and of the right-eye beam 604.
  • color separation element means “an optical filter capable of separating a "white light” into its component colors, such as a "rainbow” filter. Additional examples include dichroic and trichroic prisms and the like.
  • color component ray means a ray having a maximum intensity at one specific value of wavelength.
  • the white-color left-eye beam 604 and white-color right-eye beam 605 is each reflected by broadband mirrors 606 and 607, respectively.
  • the two reflected beams are then combined into a single combined beam by a beam combiner that includes a mirror M3 (608) and a rainbow filter D2 (610).
  • the rainbow filter 610 has 50% transmission at a specified wavelength, for example 567 nm.
  • a white-color beam can be split evenly into two parts.
  • a beam reflected from the rainbow filter 610 has higher intensity of the color components having wavelengths below 567 nm, while a beam transmitted through rainbow filter 610 has higher intensity of the color components having wavelengths above 567 nm.
  • Figure 6 depicts a single- shutter image acquisition device 650 as being separate from the device 600. It is understood that in certain embodiments, the image acquisition device 650 may be an integral part of the device 600.
  • the device 600 can be used to capture color compensated 3D images without the use of a third, color-compensating channel as that of the device 500 of Figure 5. A pair of anaglyph goggles would still be used to view the full color 3D image captured by the device 600. Alternatively, a post-image processing can be used to display the 3D image on a 3D display.
  • a person of ordinary skill in the art of image acquisition will appreciate that while the foregoing discussion referred to a Bayer mask as a means of color location at the CCD/CMOS sensor, other suitable technologies can also be employed with the devices described herein.
  • One example of a Bayer mask alternative suitable for practicing with the present invention is a Foveon X3® CMOC sensor.
  • a Foveon X3 sensor uses an array of photosites, each of which consists of three vertically stacked photodiodes, organized in a two-dimensional grid. Each of the three stacked photodiodes responds to different wavelengths of light, thus capturing one of the three component colors.
  • a further example embodiment of a device of the present invention is a device that relies on polarization, rather than color, to convey the depth-of-field information.
  • an image acquisition device to which the device of the invention attaches or of which the device of the invention is a part includes a polarization mosaic array mask such as the one described in U.S. Patent No.
  • the device 900 includes a left-eye channel 902 including a first polarizing filter 906 configured to transform a left-eye beam into a first polarized beam having a first polarization.
  • the device 900 further includes a right-eye channel 904 including a second polarizer element 908 configured to transform a right-eye beam into a second polarized beam having a second polarization.
  • the first polarization is different from the second polarization.
  • the first polarization can be p-polarization, while the second polarization can be s-polarization.
  • the device 900 further includes a beam combiner 910 that includes a partially reflective mirror 91 1 and a polarizing beam-splitting cube 912. The beam combiner 910 combines the first and second polarized beams into a single combined beam.
  • Figure 9 depicts a single-shutter image acquisition device 950 as being separate from the device 900. It is understood that in certain embodiments, the image acquisition device 950 may be an integral part of the device 900.
  • the device 950 includes a detecting module 914.
  • the detecting module 914 includes Bayer mask (or a color array) 916, a polarization mosaic array 918, and a CCD/CMOC sensor 920.
  • FIGs 10A through I OC illustrate the principle of operation of the polarization mosaic array 918.
  • the array comprises a plurality of cells transparent to the electromagnetic waves of interest (e.g., visible band), each cell being a switchable polarization filter.
  • the cells of the polarization mosaic array 918 assume the configuration shown in Figure 10A, the pixels adjacent to each cell receive photons from either the left-eye beam (Figure IOC) or the right-eye beam ( Figure 10B).
  • Figure 10B both the left-eye image and the right-eye image will be detected by the detector 920, the photons from each beam being counted by its respective addressable wells.
  • FIG. 1 An alternative example embodiment of the device 900 is a device 1 100, schematically shown in Figure 1 1.
  • the device 1 100 also includes a left-eye channel 1 102 having a polarization filter 1 106 and a right-eye channel 1 104 having a polarization filter 1 108.
  • the polarization filters 1 106 and 1 108 impart different polarizations onto the left-eye beam and the right-eye beam.
  • the device 1 100 employs a non-transparent mirror 1 110, and a partially reflective mirror 1 1 12 to combine the two beams into a single combined beam.
  • a single-shutter image acquisition device may be an integral part of the device 1 100.
  • the present invention includes an image acquisition device having a frame rate. Using such an image acquisition device, each of the left-eye and right-eye images can be captured in its corresponding frame by the image acquisition device.
  • the device employs a beam controller configured to alternatively transmit either the left- eye beam or the right-eye beam to the detector at a switching rate that is equal to or less than the frame rate of the detector.
  • a beam controller can be implemented in a variety of ways known to a person of ordinary skill in the art.
  • a device 1200 includes a left-eye channel mirror 1202, a right-eye channel mirror 1204, a redirecting mirror 1206, a semitransparent (partially reflecting) mirror 1208, and an image acquisition device 1250 having a frame rate.
  • the device 1200 further includes a left-eye shutter 1210 and a right-eye shutter 1212.
  • FIG. 12B is a schematic diagram of a synchronization scheme between the shutters 1210 and 1212 and the frames of the image acquisition device 1250.
  • each consecutive frame (frames 1 through 12 are shown) is used to acquire either a left-eye (L) or a right-eye image (R).
  • the switching rate of the shutters 1210 and 1212 is equal to the frame rate of the image acquisition device 1250.
  • FIG. 12C is a schematic diagram of an alternative synchronization scheme between the shutters 1210 and 1212 and the frames of the image acquisition device 1250 (frames 1 through 12 are shown).
  • this scheme three consecutive frames are used to acquire either a left-eye (L) or a right-eye (R) image, with two consecutive frames separating the left-eye frames from the right-eye frames.
  • the switching rate of the shutters 1210 and 1212 is less than the frame rate of the image acquisition device 1250.
  • FIG. 13 Another example embodiment of a device of the present invention is a device 1300 depicted in Figure 13.
  • the device 1300 similarly to the device 1200, includes a left-eye channel mirror 1302, a right-eye channel mirror 1304, as well as an image acquisition device having a frame rate (not shown in Figure 13).
  • the device 1300 employs a movable double-sided mirror 1306.
  • the movable mirror 1306 can rotate around a hinge 1310 and adopt either the right-eye position (R-position) or the left-eye position (L-position). In the corresponding positions, the movable mirror 1306 alternatively reflects either a left-eye beam or a right-eye beam toward the objective of an image acquisition device.
  • the switching rate of the movable mirror 1306 between the R- and the L-positions is equal to or less than the frame rate of the image acquisition device, thus permitting the implementation of the synchronization schemes similar to those described above with references to Figures 12B and 12C.
  • the movable mirror 1306 can be actuated by any means known to a person of ordinary skill in the art, including a galvanometer or a solenoid. A proper alignment of the movable mirror 1306 with the optical axis of an objective lens of the image acquisition device can be ensured by mechanical stops that arrest the mirror's movement.
  • An example embodiment of the present invention is a device 1400 schematically depicted in Figure 14.
  • the device 1400 includes a left-eye channel 1402, including a first polarization filter 1406 configured to transform a left-eye beam into a first polarized beam having a first polarization.
  • the device 1400 further includes a right-eye channel 1404, including a second polarization filter 1408 configured to transform a right-eye beam into a second polarized beam having a second polarization.
  • the first polarization is different from the second polarization.
  • the first polarization can be p-polarization, while the second polarization can be s-polarization.
  • the device 1400 further includes a mirror 141 1, a polarizing beam-splitting cube 1412, and an image acquisition device 1450 having a frame rate.
  • the device 1400 further includes a polarization selecting element 1414.
  • the polarization selecting element 1414 can be any optical element known to transmit electromagnetic waves having a desirable polarization. Examples include liquid crystal-based polarizers, including spatial light modulators (SLMs), adjustable polarization filters, Pockels cells, or a mosaic polarization arrays described above with reference to Figures 9 and 10.
  • the polarization selecting element 1414 is configured to alternatively transmit to the image acquisition device 1450 either the left-eye polarized beam or the right-eye polarized beam.
  • the switching rate of the polarization selecting element 1414 between the two beams is equal to or less than the frame rate of the image acquisition device, thus permitting the implementation of the synchronization schemes similar to those described above with references to Figures 12B and 12C.
  • An image acquisition device 1450 can be a single-shutter device, and may be separate from the device 1400.
  • An example embodiment of the present invention is a device 1500 schematically depicted in Figure 15.
  • the device 1500 includes a body 1506.
  • the body 1506 includes a mirror 1508 and a dichroic semitransparent mirror 1510.
  • the dichroic semitransparent mirror 1510 can transmit red and reflect blue colored portions of the visible spectrum.
  • An image acquisition device 1520 e.g. a smart phone
  • an objective 1522 of the image acquisition device 1520 is exposed to both a beam reflected from the dichroic mirror 1510 and the beam that passed through the dichroic mirror 1510.
  • a left eye beam 1502 impinges onto the dichroic mirror 1510, which transmits, for example, the red-colored component of the right-eye beam 1502 towards the objective 1522.
  • the left-eye beam reflects off of the mirror 1508 and then also impinges onto the dichroic mirror 1510, which reflects, for example, the blue-colored component of the left-eye beam 1504 towards the objective 1522.
  • the image acquisition device 1520 captured both color-encoded beams within a single frame.
  • the device of the present invention can further include a module configured to synchronize the beam controller and the detector. Synchronization can be accomplished, for example, by using a voltage sine wave or square wave to switch shutters on or off or to switch, or gate, the detected beam. This could be phase-locked with a trigger signal coming from an output of the camera so that the frames were perfectly synchronized with the shutter or beam transmitting elements. Alternatively the element controlling the shutters of the device described herein could produce a pulse that would tell the camera to take two or more pictures in rapid succession.
  • the stereoscopic images acquired using the embodiments of the present invention that rely on the color to encode the left-eye or the right-eye perspective can be viewed using a device for viewing the stereoscopic image is selected from goggles, a lenticular array, or a parallax array.
  • the stereoscopic images acquired using the embodiments of the present invention that rely on the polarization to encode the left-eye or the right-eye perspective can be viewed using the device for viewing the stereoscopic image (goggles, a lenticular array, or a parallax array) having polarization filters.
  • the stereoscopic images can be viewed on a display configured to reproduce stereoscopic images.
  • left and right images can be displayed on a 3D TV screen where a passive system displays the left image at one polarization and the right image at an orthogonal polarization.
  • the images can be displayed simultaneously or sequentially.
  • left and right images are displayed, and goggles are actively synchronized to block the left and right eyes so that only the correct image is on when its corresponding eye is in the open goggle state.
  • Another type of viewing device includes a display with a lenticular array attachment that enables a different set of pixels to be visible from the left or right eye perspectives.
  • a parallax system also will permit pixels to be visible by either the left or right eyes.
  • Another example of a viewing device employs a side by side viewing system and a viewer that relaxes the eyes to see the stereo image.
  • the present invention can include computer code instructions causing an image display apparatus to display the stereoscopic image.
  • a camera device or other electronic device such as a handheld device, computer, or server, capturing or storing the
  • stereographic images may be equipped with control logic, such as in the form of hardware, firmware, or software, configured to arrange the stereographic images for playback via a visual display.
  • the stereographic images may be stored sequentially in left/right/left/right/... order, in left and right image files, or in some other arrangement and encoded in some manner known in the art, such as having metadata associated with each image to indicate a sequence number and left or right channel indicator corresponding with corresponding parameters during image capture operations.
  • the same or different control logic can be used to cause a display to produce graphical representations of the stereographic images to a viewer.
  • the display may be a 2D display that coordinates with passive or active 3D viewing glasses, or the display may be a display that displays 3D images without the viewer's need to wear 3D viewing glasses.
  • the electronic device includes a non-transitory computer-readable medium and a processor configured to read processor instructions stored thereon.
  • the instructions may be a sequence of instructions in any suitable software language capable of performing operations disclosed herein.
  • the processor may be any form of processor that, after loading the instructions, can perform the operations or subset of operations disclosed herein.
  • the non-transitory computer-readable medium may be any computer memory device, such as RAM, ROM, CD-ROM, or other memory storage device known in the art. Typical computer buses, input/output ports, hardware interfaces, processor logic, peripheral controllers, display controllers, and so forth may be included in the electronic device or display device or other device configured to operate in cooperation therewith.
  • the present invention can be a kit.
  • the present invention is a kit comprising an attachment for acquiring a stereoscopic image, as described above, and a device for viewing the stereoscopic image.
  • the present invention is a kit comprising an attachment for acquiring a stereoscopic image, as described above, and a computer-readable media with computer code instructions stored thereon, the computer code instructions causing an image display apparatus to display the stereoscopic image.
  • Example embodiments of the present invention include stereoscopic image acquisition devices that can be employed in conjunction with the devices (attachments) described above.
  • a device can be used in conjunction with an attachment that relies on electromagnetic wave polarization to encode the left and the right eye images, described above with reference to Figures 9, 11, and 14, among others.
  • the present invention is a stereoscopic image acquisition device that employs at least two image sensors, such as charge-coupled devices (CCDs), complementary metal-oxide- semiconductor (CMOS) devices, N-type metal-oxide-semiconductor (NMOS) devices and the like.
  • CCDs charge-coupled devices
  • CMOS complementary metal-oxide- semiconductor
  • NMOS N-type metal-oxide-semiconductor
  • the present invention is a stereoscopic image acquisition device that comprises:
  • an objective lens element configured to relay a combined beam, the combined beam including a left-eye-image polarized beam, corresponding to a left-eye image, and a right-eye-image polarized beam, corresponding to the right-eye image;
  • each beam-splitting element configured to separate its respective beam-splitter input beam into its respective first and second polarized output beams; and c) a plurality of image sensors, each image sensor configured to detect its respective image sensor input beam and to capture its respective image.
  • the left-eye-image polarized beam and the first polarized output beam each has a first polarization
  • the right-eye-image polarized beam and the second polarized output beam each has a second
  • the term “lens element” refers to one or more elements having optical power, such as lenses, that alone or in combination operate to modify an incident beam of light by changing the curvature of the wavefront of the incident beam of light.
  • the term “beam-splitting element” refers to one or more optical elements, such as polarizing beam-splitting cubes, that alone or in combination operate to separate an incident beam of light (referred to herein as “a beam-splitter input beam") into at least two components polarized beams (referred to herein as "the first and second polarized output beams").
  • An example of a beam- splitting element is a beam-splitting polarizing cube that separates the incident beam into s-polarized and p-polarized component beams.
  • An example of such a device is a device 1600, illustrated in Figure 16.
  • the device 1600 includes an objective lens element 1602.
  • the device 1600 further includes a beam-splitting element 1604.
  • Beam-splitting element 1604 can optionally further include polarizing filters 1610 and 1612.
  • the device 1600 further includes a first image sensor 1606 and a second image sensor 1608.
  • an attachment 1640 directs a combined beam 1614 into the objective lens element 1602.
  • the combined beam 1614 is relayed to the beam-splitting element 1604, thus becoming the beam-splitter input beam 1616.
  • the beam-splitting element 1604 operates to separate the combined beam 1614 into the first and the second polarized output beams, 1618 and 1620, respectively.
  • the first polarized output beam 1618 has s-polarization and carries the left-eye image
  • the second polarized output beam 1620 has the p-polarization and carries the right-eye image.
  • the first and the second polarized output beams 1618 and 1620 are directed to the first and the second image sensors 1606 and 1608, respectively, thus becoming the first and the second image sensor input beams, 1622 and 1624, respectively.
  • the first image sensor 1606 captures the left-eye image
  • the second image sensor 1608 captures the right-eye image.
  • the device 1600 can further include a processor 1626 operably coupled to the image sensors 1606 and 1608 and configured to combine representations of the left-eye and right-eye images to yield a representation of a stereoscopic image.
  • a processor 1626 operably coupled to the image sensors 1606 and 1608 and configured to combine representations of the left-eye and right-eye images to yield a representation of a stereoscopic image.
  • Such stereoscopic image can be displayed on a stereoscopic display 1628 that can be either internal or external to the device 1600.
  • the stereoscopic image can be stored for post-acquisition processing.
  • the left- eye and/or the right-eye images can be displayed using optional displays 1630 and 1632 that can be internal or external to the device 1600.
  • the attachment 1640 and the device 1600 compose a system 1650.
  • the stereoscopic image acquisition devices of the present invention can include at least one color separation element, as defined above.
  • Each such color separation element is configured to spatially separate color component rays of its respective color-separator input beam into its respective plurality of color component output beams.
  • An example of a suitable color separation element is a trichroic prism assembly configured to spatially separate color component rays of the color-separator input beam into three color component output beams.
  • Examples of such devices are devices 1700 and 1800 shown in Figures 17 and 18, respectively.
  • the device 1700 comprises an objective lens element 1702, a beam-splitting element 1704, first and second color-separation elements 1714 and 1716, respectively, and first and second pluralities of image sensors, 1718a-c and 1720a-c, respectively.
  • the beam-splitting element 1704 can optionally further include polarizing filters 1710 and 1712.
  • an attachment 1746 directs a combined beam 1722 in the objective lens element 1702.
  • the combined beam 1722 is relayed to the beam-splitting element 1704, thus becoming the beam-splitter input beam 1724.
  • the beam-splitting element 1704 operates to separate the combined beam 1722 into the first and the second polarized output beams, 1726 and 1730, respectively.
  • the first polarized output beam 1726 has s- polarization and carries the left-eye image
  • the second polarized output beam 1730 has the p-polarization and carries the right-eye image.
  • the first and the second polarized output beams 1726 and 1730 are directed to the first and the second color separating elements 1714 and 1716, respectively, thus becoming the first and the second color separator input beams 1728 and 1732, respectively.
  • the first and the second color-separating elements 1714 and 1716 each operates to spatially separate color component rays of the first and the second polarized output beams 1726 and 1730 into first and second pluralities of polarized color components output beams, 1734a-c and 1736a-c, respectively.
  • the first and the second pluralities of the polarized color components output beams, 1734a-c and 1736a-c become the first and the second pluralities of the image sensor input beams, 1735a-c and 1737a-c, respectively.
  • the first plurality of image sensors 1718a-c captures three color component left-eye images and the second plurality of image sensors 1720a-c captures three color component right-eye images.
  • the device 1700 can further include a processor 1738 operably coupled to the plurality of image sensors 1718a-c and 1720a-c and configured to combine representations of the left-eye and the right-eye color component images to yield a representation of a stereoscopic image.
  • a processor 1738 operably coupled to the plurality of image sensors 1718a-c and 1720a-c and configured to combine representations of the left-eye and the right-eye color component images to yield a representation of a stereoscopic image.
  • the stereoscopic image can be displayed on a stereoscopic display 1740 that can be internal or external to the device 1700.
  • either one or both of the left-eye and the right-eye images can be displayed on an optional display 1744 (either internal or external to the device 1700).
  • An optional processor 1742 can be employed to combine the color components images into a full-color image.
  • images captured by each of the image sensors can be stored for post-acquisition processing.
  • the attachment 1746 and the device 1700 compose a system 1750.
  • the device 1800 comprises an objective lens element 1802, a color separating element 1804, a plurality of beam-splitting elements 1806, 1808, and 1810, and first and second pluralities of image sensors, 1 818a-c and 1820a-c, respectively.
  • the beam-splitting elements 1806, 1808, and 1810 can optionally further include polarizing filters 1812a-b, 1814a-b, and 1816a-b.
  • an attachment 1836 directs a combined beam 1810 in the objective lens element 1802.
  • the combined beam 1830 is relayed to the color separating element 1804, thus becoming the color separator input beam 1832.
  • the color separating element 1804 operates to spatially separate color component rays of the combined beam 1830 into a plurality of color components output beams, 1815a-c.
  • the plurality of color components output beams 1815a-c is relayed to the plurality of the beam-splitting elements 1806, 1808, and 1810.
  • the plurality of color components output beams 1815a-c becomes the plurality of the beam-splitter input beams, 1817a-c.
  • the plurality of the beam-splitting elements 1806, 1808, and 1810 operates to separate the plurality of the color components output beams 1815a-c into first and second pluralities of polarized color component output beams, 1819a-c and 1821a-c, respectively.
  • the combined beam 1810 includes the left-eye image polarized beam having the s-polarization and the right-eye image polarized beam having the p-polarization
  • the first plurality of the polarized color component output beams 1819a-c have s-polarization and carry the left-eye color component images
  • the second plurality of polarized color component output beams 1821a-c have the p-polarization and carry the right-eye color component images.
  • the first and the second pluralities of polarized output beams 1819a-c and 1821 a-c are directed to the first and the second pluralities of image sensors 1818a-c and 1820a-c, respectively.
  • the first and second pluralities of polarized output beams 1819a-c and 1821a-c become the first and second pluralities of the image sensor input beams, 1823a-c and 1825a-c, respectively.
  • the first plurality of image sensors 1818a-c captures three color component left-eye images and the second plurality of image sensors 1820a-c captures three color component right-eye images.
  • the device 1800 can further include a processor 1822 operably coupled to the plurality of image sensors 1818a-c and 1820a-c and configured to combine representations of the left-eye and the right-eye color component images to yield a representation of a stereoscopic image.
  • a processor 1822 operably coupled to the plurality of image sensors 1818a-c and 1820a-c and configured to combine representations of the left-eye and the right-eye color component images to yield a representation of a stereoscopic image.
  • the stereoscopic image can be displayed on a stereoscopic display 1824 that can be internal or external to the device 1800.
  • either one or both of the left-eye and the right-eye images can be displayed on an optional display 1828 (either internal or external to the device 1800).
  • An optional processor 1826 can be employed to combine the color components images into a full-color image.
  • images captured by each of the image sensors can be stored for post-acquisition processing.
  • the attachment 1836 and the device 1800 compose a system 1850.
  • FIG 19 illustrates a further example embodiment of a system 1900 of the present invention.
  • the system 1900 comprises a stereoscopic image acquisition device 1904 and an attachment 1902.
  • the attachment 1902 can be any one of the attachments described above that relies on electromagnetic wave polarization to encode the left and right eye images, for example those described with reference to Figures 9, 11, and 14, among others.
  • the stereoscopic image acquisition device 1904 can be any one of those described above with reference to Figures 16-18 and further includes a processor (not shown) operably coupled to at least two image sensors (not shown).
  • the attachment 1902 includes at least one adjustable optical element 1910 and an actuator 1908 operably linked to the at least one adjustable optical element 1910.
  • the adjustable optical element can be a rotatable or a movable lens, an adjustable beam combiner, or an adjustable polarizer filter (see the description of the polarization-employing attachments with reference to Figures 9, 1 1, and 14, among others).
  • the system 1900 further includes a controller 1906 operably linked to the processor, the controller configured to adjust the at least one adjustable optical element 1908.
  • the controller 1906 can be internal or external to the device 1904.
  • Adjustment of the parameters of the attachment 1902 can improve the quality of the stereoscopic image acquired by the device 1904.
  • the vertical or horizontal alignments or the separation of the lenses, mirrors or polarizer filters within the attachment 1902 (not shown) can be adjusted to optimize the stereoscopic effect.
  • Such adjustments can be made manually by an operator, using optional controls disposed at the device 1904 or the attachment 1902 (not shown), or can be performed automatically by the processor via the controller 1906 using known correlation methods, such as those used for automated focus adjustments, facial recognition or other feature elements.
  • the device 1904 can employ the image processing techniques to optimize the stereoscopic effect. For example, using the image sensors capable of generating an ultra high definition image (e.g., "4k resolution"), the device 1904 can, under the control of the processor, digitally define the respective fields of view within the captured left-eye and right-eye images, such that an optimized stereoscopic image can be displayed using only these digitally defined fields of view.
  • the left-eye and the right-eye fields of view can be adjusted manually by an operator or automatically using the correlation method described above or other method known in the art..
  • the correlation method is executed by the processor.
  • the method may be implemented in the form of hardware, firmware, or software. If implemented in software, the software may be any language that can be loaded and executed by the processor in accordance with the embodiments described herein.
  • the software may be stored on any form of non-transient computer-readable media.
  • the processor may be any processor, including fixed logic or programmable logic. In the case of programmable logic, the processor may be any processor that can load and execute the software and execute the methods described herein.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Chemical & Material Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Materials Engineering (AREA)
  • Organic Chemistry (AREA)
  • Chemical Kinetics & Catalysis (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Optics & Photonics (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)

Abstract

A device is disclosed that utilizes color or polarization to generate two separate images of the same object taken from the two perspectives that correspond to the left and right eyes of an observer. The two separate images are captured through a single camera objective (e.g., a single shutter camera), resulting in a single image with 3D information encoded in the color or polarization. Advantageously, the images are captured simultaneously, permitting obtaining stereoscopic images of both static and moving subjects, allowing 3D video capture. Examples include stereoscopic image acquisition devices that employ two or more image sensors, allowing for an acquisition of a high-definition image. For example, the device can include a trichroic prism and six image sensors, thus capturing left-eye and right-eye sets of color component images.

Description

METHOD AND APPARATUS FOR STEREOSCOPIC IMAGING RELATED APPLICATION
[0001] This application continuation-in-part of U.S. Application No.
13/762,139, filed February 7, 2013. The entire teachings of the above application are incorporated herein by reference.
BACKGROUND OF THE INVENTION
[0002] Due to the binocular nature of human vision, two eyes "see" from slightly different perspectives. Our brains produce a stereoscopic ("3D")
combination of these images with depth perception. Compared with a projection of a three-dimensional image onto a two-dimensional surface ("2D imaging"), 3D imaging encodes more object position information, particularly depth. Currently 3D imaging requires either two integrated and matched cameras for simultaneous 3D imaging, or repositioning of a single camera for sequential 3D image capture. One method is a dedicated 3D camera with dual lens and dual image sensors. Despite the possibly higher cost, the versatility of this method is low. Another current method for 3D imaging is to acquire two "sequential" images with the same camera, each image acquired at a slightly different perspective. The images are later combined into a 3D format through post-processing. Due to the minimal requirements on camera type and model, this method is particularly popular among smartphone users. However the intrinsic drawback of this method is that it only works with still subjects. Video is not possible, as the method does not work for moving subjects where the position changes drastically between the two independent shots.
Problems of cost, design complexity, alignment and timing synchronization limit the utility of the present methods.
SUMMARY OF THE INVENTION
[0003] In one example embodiment, the present invention is a stereoscopic image acquisition device. The device comprises: an objective lens element configured to relay a combined beam, the combined beam including a left-eye- image polarized beam, corresponding to a left-eye image, and a right-eye-image polarized beam, corresponding to the right-eye image; at least one beam-splitting element, each beam-splitting element configured to separate its respective beamsplitter input beam into its respective first and second polarized output beams; and a plurality of image sensors, each image sensors configured to detect its respective image sensor input beam and to capture its respective image. The left-eye-image polarized beam and each of the first polarized output beams have a first polarization, and the right-eye-image polarized beam and each of the second polarized output beam have a second polarization, different from the first polarization.
[0004] In another example embodiment, the present invention is a system for acquiring a stereoscopic image. The system comprises: (1) an attachment configured to acquire a stereoscopic image, and a device described above. The attachment comprises a left-eye attachment channel; a right-eye attachment channel; and a beam combiner. The left-eye attachment channel configured to relay a left- eye attachment beam to the beam combiner, the right-eye attachment channel configured to relay the right-eye attachment beam to the beam combiner, the beam combiner configured to combine the left-eye attachment beam with the right-eye attachment beam and to form a combined beam; the left-eye attachment channel including a first polarizer element configured to transform the left-eye attachment beam into a first polarized attachment beam having a first polarization; and the right- eye attachment channel including a second polarizer element configured to transform the right-eye attachment beam into a second polarized attachment beam having a second polarization, the first polarization being different from the second polarization.
[0005] In yet another embodiment, the present invention is a stereoscopic image acquisition device. The device comprises; means for relaying a combined beam, the combined beam including a left-eye-image polarized beam, corresponding to a left- eye image, and a right-eye-image polarized beam, corresponding to the right-eye image; means for separating the combined beam into first and second polarized output beams; means for detecting the first polarized output beam and for capturing the left-eye image, and means for detecting the second polarized output beam and for capture the right-eye image. The left-eye-image polarized beam and the first polarized output beam have a first polarization, and the right-eye-image polarized beam and the second polarized output beam have a second polarization, different from the first polarization.
[0006] In another example embodiment, the present invention is a stereoscopic image acquisition device. The device comprises: means for relaying a combined beam, the combined beam including a left-eye-image polarized beam, corresponding to a left-eye image, and a right-eye-image polarized beam, corresponding to the right-eye image; means for separating the combined beam into first and second polarized output beams, wherein the left-eye-image polarized beam and the first polarized output beam have a first polarization, and the right-eye-image polarized beam and the second polarized output beam have a second polarization, different from the first polarization; means for spatially separating color component rays of the first and the second polarized output beams into first and second pluralities of polarized color components output beams, respectively; means for detecting the first plurality of polarized color components output beams and for capturing a plurality of left-eye color component images; and means for detecting the second plurality of polarized color components output beams and for capturing a plurality of right-eye color component images.
[0007] In yet another example embodiment, the present invention is A stereoscopic image acquisition device. The device comprises: means for relaying a combined beam, the combined beam including a left-eye-image polarized beam, corresponding to a left-eye image, and a right-eye-image polarized beam, corresponding to the right-eye image; means for spatially separating color component rays of the combined beam into a plurality of color components output beams; means for separating the plurality of color component output beams into respective first and second pluralities of polarized color component output beams, wherein the left-eye-image polarized beam and the first plurality of polarized color component output beams have a first polarization, and the right-eye-image polarized beam and the second plurality of polarized color component output beams have a second polarization, different from the first polarization; means for detecting the first plurality of polarized color components output beams and for capturing a plurality of left-eye color component images; and means for detecting the second plurality of polarized color components output beams and for capturing a plurality of right-eye color component images.
[0008] In a further example embodiment, the present invention is a method for acquiring a stereoscopic image. The method comprises: relaying a combined beam through an objective lens element, the combined beam including a left-eye-image polarized beam, corresponding to a left-eye image, and a right-eye-image polarized beam, corresponding to the right-eye image; separating at least one beam-splitter input beam into its respective first and second polarized output beams; and detecting a plurality of image sensor input beams and capturing a respective plurality of images. The left-eye-image polarized beam and the first polarized output beam each has a first polarization, and the right-eye-image polarized beam and the second polarized output beam each has a second polarization, different from the first polarization.
[0009] In a further example embodiment, the present invention is a method of acquiring a stereoscopic image. The method comprises: passing a left-eye beam through a first polarizing filter configured to transform the left-eye beam into a left- eye image polarized beam having a first polarization; passing a right-eye beam through a second polarizing filter configured to transform the right-eye beam into a right-eye image polarized beam having a second polarization, the first polarization being different from the second polarization, combining the left-eye image polarized beam and the right-eye image polarized beam to form a combined beam; relaying the combined beam through an objective lens element; separating the combined beam into the first and the second polarized output beams; relaying the first polarized output beam to a first image sensor and capturing the left-eye image; and relaying the second polarized output beam to a second image sensor and capturing the right-eye image.
[0010] In yet another example embodiment, the present invention is
[0011] A method of acquiring a stereoscopic image. The method comprises: passing a left-eye beam through a first polarizing filter configured to transform the left-eye beam into a left-eye image polarized beam having a first polarization;
passing a right-eye beam through a second polarizing filter configured to transform the right-eye beam into a right-eye image polarized beam having a second polarization, the first polarization being different from the second polarization, combining the left-eye image polarized beam and the right-eye image polarized beam to form a combined beam; relaying the combined beam through an objective lens element; separating the combined beam into the first and the second polarized output beams, spatially separating color component rays of the first and the second polarized output beams into first and second pluralities of polarized color components output beams, respectively; relaying the first plurality of polarized color components output beams to a first plurality of image sensors and capturing a plurality of left-eye color component images, and relaying the second plurality of polarized color components output beams to a second plurality of image sensors and capturing a plurality of right-eye color component images.
[0012] In another example embodiment, the present invention is a method of acquiring a stereoscopic image. The method comprises passing a left-eye beam through a first polarizing filter configured to transform the left-eye beam into a left- eye image polarized beam having a first polarization; passing a right-eye beam through a second polarizing filter configured to transform the right-eye beam into a right-eye image polarized beam having a second polarization, the first polarization being different from the second polarization, combining the left-eye image polarized beam and the right-eye image polarized beam to form a combined beam; relaying the combined beam through an objective lens element; spatially separating color component rays of the combined beam into a plurality of the color components output beams; separating the plurality of the color components output beams into respective first and second pluralities of polarized color component output beams; relaying the first plurality of polarized color component output beams to a first plurality of image sensors and capturing a plurality of left-eye color component images, and relaying the second plurality of polarized color component output beams to a second plurality of image sensors and capturing a plurality of right-eye color component images.
BRIEF DESCRIPTION OF THE DRAWINGS [0013] The patent or application file contains at least one drawing executed in color. Copies of this patent or patent application publication with color drawings will be provided by the Office upon request and payment of the necessary fee.
[0014] The foregoing will be apparent from the following more particular description of example embodiments of the invention, as illustrated in the accompanying drawings in which like reference characters refer to the same parts throughout the different views. The drawings are not necessarily to scale, emphasis instead being placed upon illustrating embodiments of the present invention.
[0015] Figure 1 is a schematic diagram showing how a Bayer- filter equipped digital camera captures color images.
[0016] Figure 2 is a schematic diagram of an example embodiment of the present invention.
[0017] Figure 3 A is a sample combined red/blue image taken by iPhone using an example attachment of the present invention.
[0018] Figures 3B and 3C are single color images that resulted in the anaglyph 3D image shown in Figure 3A. The images in Figures 3B and 3C were taken from the left-eye and the right-eye perspective, respectively.
[0019] Figure 4A is a schematic diagram of an example embodiment of an attachment of the present invention.
[0020] Figure 4B is a photograph of an example embodiment of an attachment of the present invention shown in Figure 4A.
[0021] Figure 5 is a schematic diagram of an example embodiment of the present invention.
[0022] Figure 6 is a schematic diagram of an example embodiment of the present invention. Figure 7 is a ray-tracing diagram illustrating the optical train of an example attachment of the present invention.
[0023] Figure 8 is a sample image taken by a single shutter camera using the example attachment shown in Figures 6.
[0024] Figure 9 is a schematic diagram of an embodiment of the present invention that relies on a polarization mosaic array.
[0025] Figures 10A, 10B, and IOC are collectively a schematic diagram illustrating the principle of operation of a polarization mosaic array. [0026] Figure 1 1 is a schematic diagram of an embodiment of the present invention that relies on a polarization mosaic array.
[0027] Figure 12A is a schematic diagram of an embodiment of the present invention.
[0028] Figures 12B and 12C are schematic diagrams of two synchronization schemes that can be implemented in the device shown in Figure 12 A.
[0029] Figure 13 is a schematic diagram of an embodiment of the present invention.
[0030] Figure 14 is a schematic diagram of an embodiment of the present invention.
[0031] Figure 15 is a schematic diagram of an embodiment of the present invention.
[0032] Figure 16 is a schematic diagram of an embodiment of the present invention.
[0033] Figure 17 is a schematic diagram of an embodiment of the present invention.
[0034] Figure 18 is a schematic diagram of an embodiment of the present invention.
[0035] Figure 19 is a schematic diagram of an embodiment of the present invention.
DETAILED DESCRIPTION OF THE INVENTION
[0036] A description of example embodiments of the invention follows.
[0037] An example embodiment of the present invention is a device that utilizes color filters or polarization filters to generate two separate beams carrying two separate images of the same object taken from different perspectives. The two perspectives correspond to the human left and right eye perspectives. The two separate beams are directed into a single camera objective (a single shutter camera), resulting in a single image with 3D information encoded in the color or polarization. A significant advantage of such a design is that the same lens is used for each eye perspective, thus permitting to capture a stereoscopic image with a single-shutter image acquisition device. Another advantage is that the images are captured simultaneously and work for both static and moving subjects, allowing 3D video capture. The device can be an attachment to a conventional, i.e. single shutter image capturing device.
[0038] In the example embodiments in which the device of the present invention is an attachment, the device can further include a means for securing the attachment to an image acquisition device. Examples of such means include a clip, a screw and a bolt, a pin, or any other mechanical device suitable for securing two items together. One example of such means is a metallic platform that is affixed around the lens, such as a washer affixed to the image acquisition device by a magnet. Another example of such means is a "dovetail" attachment arrangement whereby the attachment can be slid in place. Another example of such means is a conventional threaded camera mount and a number of components that link this camera base to the attachment such that the attachment can be positioned in front of the objective lens of the camera.
[0039] In certain example embodiments, such means for securing permit rotation of the attachment relative to the image acquisition device. Such rotation can allow taking the stereoscopic images in either the "portrait" or a "landscape"
configuration. It will be appreciated by a person of ordinary skill in the art that the methods described herein, in their reliance on a single objective (single shutter) image acquisition devices, advantageously permit acquiring either a portrait or a landscape images.
[0040] In further embodiments, the attachment described herein includes a mechanism that permits tilting the left and right eye angles so that they are parallel or crossed at an arbitrary or fixed position. This is important for the perspective in capturing the stereoscopic view.
[0041] In further embodiments, the attachment described herein includes a mechanism that permits moving the left-eye channel relative to the right-eye channel by an arbitrary distance. For example, the left-eye channel and right-eye channel can be separated by about 6 cm. In other examples, the channels can be moved apart beyond 6 cm, or moved closer than 6 cm to each other. Such movement can be accomplished by any mechanism known to a person of ordinary skill in the art, such as a threaded component.Another example embodiment of the present invention is a device that includes a single shutter image acquisition device. The device further includes means for generating two separate beams carrying two separate images of the same object taken from different perspectives. In one example embodiment, each of the two images is captured in a corresponding frame by the image acquisition device. In another example embodiment, both images are captured within a single frame of the image acquisition device. Described in detail below, means for generating two separate beams can include two additional shutters, movable mirrors that control which beam reaches the objective lens, two polarization filters in combination with a polarization control elements, such as a liquid crystal element or Pockels cells.
[0042] Additionally, such a single-shuter image acquisition device useful for practicing the present invention can include a photodetector (CCD or CMOS) that employs a polarization mosaic array described, for example, in U.S. Patent No. 7,420,542, incorporated herein by reference in its entirety.
[0043] To understand the present invention in more detail, some basic knowledge on how digital cameras capture color images is beneficial. Figure 1 is a schematic diagram of a conventional digital camera 100. Most digital cameras employ a Bayer filter, a standard color mask 102, usually stacked on a CCD/CMOS sensor 104. The sensor 104 of the digital camera 100 is a matrix of pixels, which can be considered as an array or matrix of wells for photons. After exposure, the number of photons falling into each well is counted and converted into a grayscale image. Without the color mask 102, the sensor 104 is actually a black-and-white device with no ability to distinguish colors by itself. To create a color image 106, a color filter array 102 is placed right before the sensor 104 to allow penetration of only a particular color. The most widely used color filter array is the Bayer filter, which passes red (R), blue (B) and green (G) alternately. After a beam 108, focused by the objective lens 1 10, passes through the Bayer filter 102, each pixel of the sensor 104 can only receive photons of one of these RBG primary colors. The true color image 106 is reconstructed from three single color images 105a, 105b, and 105c in a process called demosaicing. Demosaicing methods are well-known to a person of ordinary skill in the art. [0044] An example embodiment of the present invention is a device for acquiring a stereoscopic image that can be an attachment to a single-shutter image acquisition device. The attachment comprises a left-eye channel, a right-eye channel, and a beam combiner. The left-eye channel is configured to relay a left-eye beam to the beam combiner, the right-eye channel is configured to relay the right- eye beam to the beam combiner. The beam combiner configured to combine the left-eye beam with the right-eye beam and to form a single combined beam. Such an embodiment is a device 200 illustrated in Figure 2.
[0045] Referring to Figure 2, the device 200 includes a left-eye channel color filter Fl (204) and a left-eye channel mirror Ml (208), and a right-eye channel color filter F2 (206) and a right-eye channel mirror M2 (210). A beam combiner of the device 200 comprises a mirror M3 (212) and a dichroic filter D2 (214). In one embodiment of the device 200, color filters 204 and 206 are not included.
[0046] Referring to Figure 2, beams carrying an image of a subject 202 are directed into color filters Fl (204) and F2 (206). Color filters 204 and 206 can be anaglyphically colored. A person of ordinary skill in the art of stereoscopic image acquisition will appreciate that numerous anaglyphic color schemes exist. The colors shown throughout the instant disclosure are chosen as "red" and "blue" for illustrative purposes only.
[0047] As used herein, the term "anaglyph" refers to the stereoscopic effect achieved by means of encoding each eye's image using filters of different (usually chromatically opposite) colors. Anaglyph images contain two differently filtered colored images, one for each eye. When viewed through the "color coded"
"anaglyph glasses," each of the two images reaches one eye, revealing an integrated stereoscopic image. The visual cortex of the brain fuses this into perception of a three dimensional scene or composition.
[0048] In the example shown in Figure 2, two broadband mirrors Ml (208) and M2 (210) are mounted at approximately 45° with respect to the optical axis of the respective filters 204 and 208 to reflect light onto mirror M3 (212) and dichroic filter D2 (214), which can be a mirror. As shown in Figure 2, dichroic filter D2 (214) can operate by transmitting red light and reflecting the shorter wavelength - blue - light. Other schemes are possible. Mirror M3 (212) and dichroic filter D2 (214) in combination operate as a beam combiner. As a result, the left-eye beam 216 and the right-eye beam 218 are combined into a single combined beam 220.
[0049] Figure 2 depicts a single-shutter image acquisition device 250 as being separate from the device 200. It is understood that in certain embodiments, the image acquisition device 250 may be an integral part of the device 200.
[0050] The single combined beam 220 is then directed through a Bayer's mask 222 onto a detector 224. As a result, a standard color camera sensor can be used to obtain a 3D image. The image captured by a camera in the example embodiment of Figure 2 includes a red- and blue-light images. These images are spatially separated on the detector 224. Each image contains information from a different perspective. The stereoscopic image can be viewed on a conventional display by wearing red- blue glasses. Alternatively, image-processing software can be used to reconstruct the 3D image and to display it on a 3D display that does not require the viewer to wear a device for viewing the stereoscopic image, such as goggles, a lenticular array, or a parallax array.
[0051] Figures 3 A through 3C illustrate the use of a device exemplified in Figures 4A and 4B and operating according to the principle explained above with respect to Figure 2. The combined red/blue image in Figure 3A was taken by iPhone®. The two single images in Figures 3B and 3C show different perspectives. The 3D effect in Figure 3A can be seen with blue-red glasses. Figure 7 is a ray- tracing diagram illustrating the optical train of the device shown in Figures 2, 4 A, and 4B. Figure 8 is a sample image taken by a single shutter camera using the example attachment shown in Figures 2, 4A and 4B.
[0052] Device 100 shown in Figure 2 and in Figures 4A and 4B can be used as an attachment to a smartphone or a digital single-shutter camera.
[0053] A further example embodiment of the present invention is device 500, shown in Figure 5. The device 500 employs a color compensation scheme to convey the colors in the stereoscopic image more accurately. In the example embodiment shown in Figure 5, in addition to the elements employed in device 200 of Figure 2, the device 500 further includes a compensating color filter 530. The compensating color filter 530 can be selected to pass the light in the spectral regions disposed in between the colors passed by the left-eye channel and the right-eye channel, such as a green color where left is red and right is blue.
[0054] The mirror M3 (212) of the device 200 is replaced with a second dichroic filter Dl (532) that transmits the compensating beam 534 but reflects the colored beam 536.
[0055] Figure 5 depicts a single-shutter image acquisition device 550 as being separate from the device 500. It is understood that in certain embodiments, the image acquisition device 550 may be an integral part of the device 500.
[0056] Image post-processing, using methods well-known to one of ordinary skill in the art, can be performed either by the image acquisition device 550 or by a special or general purpose computer to render a color-compensated 3D image acquired using the device 500.
[0057] A further example embodiment of the present invention is the device 600 illustrated in Figure 6. In contrast to the device 200 of Figure 2, the device 600 does not include anaglyphic color filters disposed in its left-eye channel 602 and right-eye channel 603. Instead, the device 600 includes at least one color separation element configured to spatially separate color component rays of the left-eye beam 602 and of the right-eye beam 604.
[0058] As used herein, the term "color separation element" means "an optical filter capable of separating a "white light" into its component colors, such as a "rainbow" filter. Additional examples include dichroic and trichroic prisms and the like. As used herein, the phrase "color component ray" means a ray having a maximum intensity at one specific value of wavelength.
[0059] Referring to Figure 6, the white-color left-eye beam 604 and white-color right-eye beam 605 is each reflected by broadband mirrors 606 and 607, respectively. The two reflected beams are then combined into a single combined beam by a beam combiner that includes a mirror M3 (608) and a rainbow filter D2 (610). The rainbow filter 610 has 50% transmission at a specified wavelength, for example 567 nm. Thus, a white-color beam can be split evenly into two parts. A beam reflected from the rainbow filter 610 has higher intensity of the color components having wavelengths below 567 nm, while a beam transmitted through rainbow filter 610 has higher intensity of the color components having wavelengths above 567 nm. Using this property of the rainbow filter 610, it is possible to separate the "red-rich" left-eye beam and the "blue-rich" right-eye beam spatially on the detector 614, thus encoding the depth of field information and capturing a stereoscopic image. This process is illustrated in Figure 6.
[0060] Figure 6 depicts a single- shutter image acquisition device 650 as being separate from the device 600. It is understood that in certain embodiments, the image acquisition device 650 may be an integral part of the device 600.
[0061] The device 600 can be used to capture color compensated 3D images without the use of a third, color-compensating channel as that of the device 500 of Figure 5. A pair of anaglyph goggles would still be used to view the full color 3D image captured by the device 600. Alternatively, a post-image processing can be used to display the 3D image on a 3D display.
[0062] A person of ordinary skill in the art of image acquisition will appreciate that while the foregoing discussion referred to a Bayer mask as a means of color location at the CCD/CMOS sensor, other suitable technologies can also be employed with the devices described herein. One example of a Bayer mask alternative suitable for practicing with the present invention is a Foveon X3® CMOC sensor. A Foveon X3 sensor uses an array of photosites, each of which consists of three vertically stacked photodiodes, organized in a two-dimensional grid. Each of the three stacked photodiodes responds to different wavelengths of light, thus capturing one of the three component colors.
[0063] A further example embodiment of a device of the present invention is a device that relies on polarization, rather than color, to convey the depth-of-field information. In this embodiment, an image acquisition device to which the device of the invention attaches or of which the device of the invention is a part includes a polarization mosaic array mask such as the one described in U.S. Patent No.
7,420,542, mentioned above. An example embodiment of such a device 900 is schematically depicted in Figure 9. The device 900 includes a left-eye channel 902 including a first polarizing filter 906 configured to transform a left-eye beam into a first polarized beam having a first polarization. The device 900 further includes a right-eye channel 904 including a second polarizer element 908 configured to transform a right-eye beam into a second polarized beam having a second polarization. The first polarization is different from the second polarization. For example, the first polarization can be p-polarization, while the second polarization can be s-polarization. Other schemes are possible. The device 900 further includes a beam combiner 910 that includes a partially reflective mirror 91 1 and a polarizing beam-splitting cube 912. The beam combiner 910 combines the first and second polarized beams into a single combined beam.
[0064] Figure 9 depicts a single-shutter image acquisition device 950 as being separate from the device 900. It is understood that in certain embodiments, the image acquisition device 950 may be an integral part of the device 900.
[0065] The device 950 includes a detecting module 914. The detecting module 914 includes Bayer mask (or a color array) 916, a polarization mosaic array 918, and a CCD/CMOC sensor 920.
[0066] Figures 10A through I OC illustrate the principle of operation of the polarization mosaic array 918. The array comprises a plurality of cells transparent to the electromagnetic waves of interest (e.g., visible band), each cell being a switchable polarization filter. When the cells of the polarization mosaic array 918 assume the configuration shown in Figure 10A, the pixels adjacent to each cell receive photons from either the left-eye beam (Figure IOC) or the right-eye beam (Figure 10B). As a result, both the left-eye image and the right-eye image will be detected by the detector 920, the photons from each beam being counted by its respective addressable wells.
[0067] An alternative example embodiment of the device 900 is a device 1 100, schematically shown in Figure 1 1. As in the device 900, the device 1 100 also includes a left-eye channel 1 102 having a polarization filter 1 106 and a right-eye channel 1 104 having a polarization filter 1 108. The polarization filters 1 106 and 1 108 impart different polarizations onto the left-eye beam and the right-eye beam. Unlike the device 900, the device 1 100 employs a non-transparent mirror 1 110, and a partially reflective mirror 1 1 12 to combine the two beams into a single combined beam.
[0068] Although not shown in Figure 1 1, a single-shutter image acquisition device may be an integral part of the device 1 100. [0069] As stated above, in one example embodiment, the present invention includes an image acquisition device having a frame rate. Using such an image acquisition device, each of the left-eye and right-eye images can be captured in its corresponding frame by the image acquisition device. In such an embodiment, the device employs a beam controller configured to alternatively transmit either the left- eye beam or the right-eye beam to the detector at a switching rate that is equal to or less than the frame rate of the detector. A beam controller can be implemented in a variety of ways known to a person of ordinary skill in the art.
[0070] One example embodiment of such a device is illustrated in Figures 12A through 12C. Referring to Figure 12A, a device 1200 includes a left-eye channel mirror 1202, a right-eye channel mirror 1204, a redirecting mirror 1206, a semitransparent (partially reflecting) mirror 1208, and an image acquisition device 1250 having a frame rate. The device 1200 further includes a left-eye shutter 1210 and a right-eye shutter 1212.
[0071] Figure 12B is a schematic diagram of a synchronization scheme between the shutters 1210 and 1212 and the frames of the image acquisition device 1250. In this scheme, each consecutive frame (frames 1 through 12 are shown) is used to acquire either a left-eye (L) or a right-eye image (R). In this case, the switching rate of the shutters 1210 and 1212 is equal to the frame rate of the image acquisition device 1250.
[0072] Figure 12C is a schematic diagram of an alternative synchronization scheme between the shutters 1210 and 1212 and the frames of the image acquisition device 1250 (frames 1 through 12 are shown). In this scheme, three consecutive frames are used to acquire either a left-eye (L) or a right-eye (R) image, with two consecutive frames separating the left-eye frames from the right-eye frames. In this case, the switching rate of the shutters 1210 and 1212 is less than the frame rate of the image acquisition device 1250.
[0073] Another example embodiment of a device of the present invention is a device 1300 depicted in Figure 13. The device 1300, similarly to the device 1200, includes a left-eye channel mirror 1302, a right-eye channel mirror 1304, as well as an image acquisition device having a frame rate (not shown in Figure 13). Instead of the shutters, the device 1300 employs a movable double-sided mirror 1306. The movable mirror 1306 can rotate around a hinge 1310 and adopt either the right-eye position (R-position) or the left-eye position (L-position). In the corresponding positions, the movable mirror 1306 alternatively reflects either a left-eye beam or a right-eye beam toward the objective of an image acquisition device. The switching rate of the movable mirror 1306 between the R- and the L-positions is equal to or less than the frame rate of the image acquisition device, thus permitting the implementation of the synchronization schemes similar to those described above with references to Figures 12B and 12C.
[0074] The movable mirror 1306 can be actuated by any means known to a person of ordinary skill in the art, including a galvanometer or a solenoid. A proper alignment of the movable mirror 1306 with the optical axis of an objective lens of the image acquisition device can be ensured by mechanical stops that arrest the mirror's movement.
[0075] An example embodiment of the present invention is a device 1400 schematically depicted in Figure 14. The device 1400 includes a left-eye channel 1402, including a first polarization filter 1406 configured to transform a left-eye beam into a first polarized beam having a first polarization. The device 1400 further includes a right-eye channel 1404, including a second polarization filter 1408 configured to transform a right-eye beam into a second polarized beam having a second polarization. The first polarization is different from the second polarization. For example, the first polarization can be p-polarization, while the second polarization can be s-polarization. Other schemes are possible. The device 1400 further includes a mirror 141 1, a polarizing beam-splitting cube 1412, and an image acquisition device 1450 having a frame rate.
[0076] The device 1400 further includes a polarization selecting element 1414. The polarization selecting element 1414 can be any optical element known to transmit electromagnetic waves having a desirable polarization. Examples include liquid crystal-based polarizers, including spatial light modulators (SLMs), adjustable polarization filters, Pockels cells, or a mosaic polarization arrays described above with reference to Figures 9 and 10. The polarization selecting element 1414 is configured to alternatively transmit to the image acquisition device 1450 either the left-eye polarized beam or the right-eye polarized beam. The switching rate of the polarization selecting element 1414 between the two beams is equal to or less than the frame rate of the image acquisition device, thus permitting the implementation of the synchronization schemes similar to those described above with references to Figures 12B and 12C.
[0077] An image acquisition device 1450 can be a single-shutter device, and may be separate from the device 1400.
[0078] An example embodiment of the present invention is a device 1500 schematically depicted in Figure 15. The device 1500 includes a body 1506. The body 1506 includes a mirror 1508 and a dichroic semitransparent mirror 1510. The dichroic semitransparent mirror 1510, for example, can transmit red and reflect blue colored portions of the visible spectrum. An image acquisition device 1520 (e.g. a smart phone) is disposed within the body 1506 so that an objective 1522 of the image acquisition device 1520 is exposed to both a beam reflected from the dichroic mirror 1510 and the beam that passed through the dichroic mirror 1510. In operation, a left eye beam 1502 impinges onto the dichroic mirror 1510, which transmits, for example, the red-colored component of the right-eye beam 1502 towards the objective 1522. The left-eye beam reflects off of the mirror 1508 and then also impinges onto the dichroic mirror 1510, which reflects, for example, the blue-colored component of the left-eye beam 1504 towards the objective 1522. As a result, the image acquisition device 1520 captured both color-encoded beams within a single frame.
[0079] In the embodiments of the present invention described above that employ capturing each of the left-eye and right-eye image in its corresponding frame of the image acquisition device (i.e. the embodiments that employ a beam controller configured to alternatively transmit either the left-eye beam or the right-eye beam to the detector at a switching rate that is equal to or less than the frame rate of the detector), the device of the present invention can further include a module configured to synchronize the beam controller and the detector. Synchronization can be accomplished, for example, by using a voltage sine wave or square wave to switch shutters on or off or to switch, or gate, the detected beam. This could be phase-locked with a trigger signal coming from an output of the camera so that the frames were perfectly synchronized with the shutter or beam transmitting elements. Alternatively the element controlling the shutters of the device described herein could produce a pulse that would tell the camera to take two or more pictures in rapid succession.
[0080] The stereoscopic images acquired using the embodiments of the present invention that rely on the color to encode the left-eye or the right-eye perspective can be viewed using a device for viewing the stereoscopic image is selected from goggles, a lenticular array, or a parallax array.
[0081] The stereoscopic images acquired using the embodiments of the present invention that rely on the polarization to encode the left-eye or the right-eye perspective can be viewed using the device for viewing the stereoscopic image (goggles, a lenticular array, or a parallax array) having polarization filters.
[0082] Additionally, the stereoscopic images can be viewed on a display configured to reproduce stereoscopic images. For example, left and right images can be displayed on a 3D TV screen where a passive system displays the left image at one polarization and the right image at an orthogonal polarization. The images can be displayed simultaneously or sequentially. In another example of a viewing device, left and right images are displayed, and goggles are actively synchronized to block the left and right eyes so that only the correct image is on when its corresponding eye is in the open goggle state. Another type of viewing device includes a display with a lenticular array attachment that enables a different set of pixels to be visible from the left or right eye perspectives. Similarly, a parallax system also will permit pixels to be visible by either the left or right eyes. Another example of a viewing device employs a side by side viewing system and a viewer that relaxes the eyes to see the stereo image. In any of the above embodiments, the present invention can include computer code instructions causing an image display apparatus to display the stereoscopic image.
[0083] It should be understood that a camera device or other electronic device, such as a handheld device, computer, or server, capturing or storing the
stereographic images may be equipped with control logic, such as in the form of hardware, firmware, or software, configured to arrange the stereographic images for playback via a visual display. The stereographic images may be stored sequentially in left/right/left/right/... order, in left and right image files, or in some other arrangement and encoded in some manner known in the art, such as having metadata associated with each image to indicate a sequence number and left or right channel indicator corresponding with corresponding parameters during image capture operations. The same or different control logic can be used to cause a display to produce graphical representations of the stereographic images to a viewer. The display may be a 2D display that coordinates with passive or active 3D viewing glasses, or the display may be a display that displays 3D images without the viewer's need to wear 3D viewing glasses. In the case of software, the electronic device includes a non-transitory computer-readable medium and a processor configured to read processor instructions stored thereon. The instructions may be a sequence of instructions in any suitable software language capable of performing operations disclosed herein. Similarly, the processor may be any form of processor that, after loading the instructions, can perform the operations or subset of operations disclosed herein. The non-transitory computer-readable medium may be any computer memory device, such as RAM, ROM, CD-ROM, or other memory storage device known in the art. Typical computer buses, input/output ports, hardware interfaces, processor logic, peripheral controllers, display controllers, and so forth may be included in the electronic device or display device or other device configured to operate in cooperation therewith.
[0084] Accordingly, in certain example embodiments, the present invention can be a kit. For example, in one example, the present invention is a kit comprising an attachment for acquiring a stereoscopic image, as described above, and a device for viewing the stereoscopic image. In another example, the present invention is a kit comprising an attachment for acquiring a stereoscopic image, as described above, and a computer-readable media with computer code instructions stored thereon, the computer code instructions causing an image display apparatus to display the stereoscopic image.
[0085] Example embodiments of the present invention include stereoscopic image acquisition devices that can be employed in conjunction with the devices (attachments) described above. In certain example embodiments, such a device can be used in conjunction with an attachment that relies on electromagnetic wave polarization to encode the left and the right eye images, described above with reference to Figures 9, 11, and 14, among others. In one example, the present invention is a stereoscopic image acquisition device that employs at least two image sensors, such as charge-coupled devices (CCDs), complementary metal-oxide- semiconductor (CMOS) devices, N-type metal-oxide-semiconductor (NMOS) devices and the like.
[0086] Accordingly, in one example embodiment, the present invention is a stereoscopic image acquisition device that comprises:
a) an objective lens element configured to relay a combined beam, the combined beam including a left-eye-image polarized beam, corresponding to a left-eye image, and a right-eye-image polarized beam, corresponding to the right-eye image;
b) at least one beam-splitting element, each beam-splitting element configured to separate its respective beam-splitter input beam into its respective first and second polarized output beams; and c) a plurality of image sensors, each image sensor configured to detect its respective image sensor input beam and to capture its respective image.
In this example embodiment, the left-eye-image polarized beam and the first polarized output beam each has a first polarization, and the right-eye-image polarized beam and the second polarized output beam each has a second
polarization, different from the first polarization.
[0087] As used herein, the term "lens element" refers to one or more elements having optical power, such as lenses, that alone or in combination operate to modify an incident beam of light by changing the curvature of the wavefront of the incident beam of light. As used herein, the term "beam-splitting element" refers to one or more optical elements, such as polarizing beam-splitting cubes, that alone or in combination operate to separate an incident beam of light (referred to herein as "a beam-splitter input beam") into at least two components polarized beams (referred to herein as "the first and second polarized output beams"). An example of a beam- splitting element is a beam-splitting polarizing cube that separates the incident beam into s-polarized and p-polarized component beams. [0088] An example of such a device is a device 1600, illustrated in Figure 16. The device 1600 includes an objective lens element 1602. The device 1600 further includes a beam-splitting element 1604. Beam-splitting element 1604 can optionally further include polarizing filters 1610 and 1612. The device 1600 further includes a first image sensor 1606 and a second image sensor 1608.
[0089] As illustrated in Figure 16, in operation, an attachment 1640 directs a combined beam 1614 into the objective lens element 1602. The combined beam 1614 is relayed to the beam-splitting element 1604, thus becoming the beam-splitter input beam 1616. The beam-splitting element 1604 operates to separate the combined beam 1614 into the first and the second polarized output beams, 1618 and 1620, respectively. In an example embodiment, where the combined beam 1614 includes the left-eye image polarized beam having the s-polarization and the right- eye image polarized beam having the p-polarization, the first polarized output beam 1618 has s-polarization and carries the left-eye image, and the second polarized output beam 1620 has the p-polarization and carries the right-eye image. A person of ordinary skill in the art will understand that the operating principle of the devices described herein applies equally to an example embodiment where the left-eye image is carried by the p-polarized beam and the right-eye image is carried by the s- polarized beam. In the example embodiment shown in Figure 16, the first and the second polarized output beams 1618 and 1620 are directed to the first and the second image sensors 1606 and 1608, respectively, thus becoming the first and the second image sensor input beams, 1622 and 1624, respectively. In this example, the first image sensor 1606 captures the left-eye image and the second image sensor 1608 captures the right-eye image.
[0090] The device 1600 can further include a processor 1626 operably coupled to the image sensors 1606 and 1608 and configured to combine representations of the left-eye and right-eye images to yield a representation of a stereoscopic image. Such stereoscopic image can be displayed on a stereoscopic display 1628 that can be either internal or external to the device 1600. Alternatively, the stereoscopic image can be stored for post-acquisition processing. In an example embodiment, the left- eye and/or the right-eye images can be displayed using optional displays 1630 and 1632 that can be internal or external to the device 1600. [0091] In certain example embodiments, the attachment 1640 and the device 1600 compose a system 1650.
[0092] In further example embodiments, the stereoscopic image acquisition devices of the present invention can include at least one color separation element, as defined above. Each such color separation element is configured to spatially separate color component rays of its respective color-separator input beam into its respective plurality of color component output beams. An example of a suitable color separation element is a trichroic prism assembly configured to spatially separate color component rays of the color-separator input beam into three color component output beams.
[0093] Examples of such devices are devices 1700 and 1800 shown in Figures 17 and 18, respectively.
[0094] Referring to Figure 17, the device 1700 comprises an objective lens element 1702, a beam-splitting element 1704, first and second color-separation elements 1714 and 1716, respectively, and first and second pluralities of image sensors, 1718a-c and 1720a-c, respectively. The beam-splitting element 1704 can optionally further include polarizing filters 1710 and 1712.
[0095] As illustrated in Figure 17, in operation, an attachment 1746 directs a combined beam 1722 in the objective lens element 1702. The combined beam 1722 is relayed to the beam-splitting element 1704, thus becoming the beam-splitter input beam 1724. The beam-splitting element 1704 operates to separate the combined beam 1722 into the first and the second polarized output beams, 1726 and 1730, respectively. In the example embodiment, where the combined beam 1722 includes the left-eye image polarized beam having the s-polarization and the right-eye image polarized beam having the p-polarization, the first polarized output beam 1726 has s- polarization and carries the left-eye image, and the second polarized output beam 1730 has the p-polarization and carries the right-eye image. In the example embodiment shown in Figure 17, the first and the second polarized output beams 1726 and 1730 are directed to the first and the second color separating elements 1714 and 1716, respectively, thus becoming the first and the second color separator input beams 1728 and 1732, respectively. [0096] As shown in Figure 17, the first and the second color-separating elements 1714 and 1716 each operates to spatially separate color component rays of the first and the second polarized output beams 1726 and 1730 into first and second pluralities of polarized color components output beams, 1734a-c and 1736a-c, respectively. Thus, the first and the second pluralities of the polarized color components output beams, 1734a-c and 1736a-c, become the first and the second pluralities of the image sensor input beams, 1735a-c and 1737a-c, respectively. In the example shown in Figure 17, the first plurality of image sensors 1718a-c captures three color component left-eye images and the second plurality of image sensors 1720a-c captures three color component right-eye images.
[0097] The device 1700 can further include a processor 1738 operably coupled to the plurality of image sensors 1718a-c and 1720a-c and configured to combine representations of the left-eye and the right-eye color component images to yield a representation of a stereoscopic image.
[0098] As shown in Figure 17, the stereoscopic image can be displayed on a stereoscopic display 1740 that can be internal or external to the device 1700.
Optionally, either one or both of the left-eye and the right-eye images can be displayed on an optional display 1744 (either internal or external to the device 1700). An optional processor 1742 can be employed to combine the color components images into a full-color image.
[0099] In example embodiments of the device 1700, images captured by each of the image sensors can be stored for post-acquisition processing.
[00100] In certain example embodiments, the attachment 1746 and the device 1700 compose a system 1750.
[00101] Referring to Figure 18, the device 1800 comprises an objective lens element 1802, a color separating element 1804, a plurality of beam-splitting elements 1806, 1808, and 1810, and first and second pluralities of image sensors, 1 818a-c and 1820a-c, respectively. The beam-splitting elements 1806, 1808, and 1810 can optionally further include polarizing filters 1812a-b, 1814a-b, and 1816a-b.
[00102] As illustrated in Figure 18, in operation, an attachment 1836 directs a combined beam 1810 in the objective lens element 1802. The combined beam 1830 is relayed to the color separating element 1804, thus becoming the color separator input beam 1832. The color separating element 1804 operates to spatially separate color component rays of the combined beam 1830 into a plurality of color components output beams, 1815a-c. The plurality of color components output beams 1815a-c is relayed to the plurality of the beam-splitting elements 1806, 1808, and 1810. Thus, in the example embodiment shown in Figure 18, the plurality of color components output beams 1815a-c becomes the plurality of the beam-splitter input beams, 1817a-c.
[00103] The plurality of the beam-splitting elements 1806, 1808, and 1810 operates to separate the plurality of the color components output beams 1815a-c into first and second pluralities of polarized color component output beams, 1819a-c and 1821a-c, respectively. Where the combined beam 1810 includes the left-eye image polarized beam having the s-polarization and the right-eye image polarized beam having the p-polarization, the first plurality of the polarized color component output beams 1819a-c have s-polarization and carry the left-eye color component images, and the second plurality of polarized color component output beams 1821a-c have the p-polarization and carry the right-eye color component images.
[00104] In the example embodiment shown in Figure 18, the first and the second pluralities of polarized output beams 1819a-c and 1821 a-c are directed to the first and the second pluralities of image sensors 1818a-c and 1820a-c, respectively. Thus, the first and second pluralities of polarized output beams 1819a-c and 1821a-c become the first and second pluralities of the image sensor input beams, 1823a-c and 1825a-c, respectively.
[00105] In the example shown in Figure 18, the first plurality of image sensors 1818a-c captures three color component left-eye images and the second plurality of image sensors 1820a-c captures three color component right-eye images.
[00106] The device 1800 can further include a processor 1822 operably coupled to the plurality of image sensors 1818a-c and 1820a-c and configured to combine representations of the left-eye and the right-eye color component images to yield a representation of a stereoscopic image.
[00107] As shown in Figure 18, the stereoscopic image can be displayed on a stereoscopic display 1824 that can be internal or external to the device 1800.
Optionally, either one or both of the left-eye and the right-eye images can be displayed on an optional display 1828 (either internal or external to the device 1800). An optional processor 1826 can be employed to combine the color components images into a full-color image.
[00108] In example embodiments of the device 1800, images captured by each of the image sensors can be stored for post-acquisition processing.
[00109] In certain example embodiments, the attachment 1836 and the device 1800 compose a system 1850.
[00110] Figure 19 illustrates a further example embodiment of a system 1900 of the present invention. The system 1900 comprises a stereoscopic image acquisition device 1904 and an attachment 1902. The attachment 1902 can be any one of the attachments described above that relies on electromagnetic wave polarization to encode the left and right eye images, for example those described with reference to Figures 9, 11, and 14, among others. In this example, the stereoscopic image acquisition device 1904 can be any one of those described above with reference to Figures 16-18 and further includes a processor (not shown) operably coupled to at least two image sensors (not shown). The attachment 1902 includes at least one adjustable optical element 1910 and an actuator 1908 operably linked to the at least one adjustable optical element 1910. The adjustable optical element can be a rotatable or a movable lens, an adjustable beam combiner, or an adjustable polarizer filter (see the description of the polarization-employing attachments with reference to Figures 9, 1 1, and 14, among others). The system 1900 further includes a controller 1906 operably linked to the processor, the controller configured to adjust the at least one adjustable optical element 1908. The controller 1906 can be internal or external to the device 1904.
[00111] Adjustment of the parameters of the attachment 1902 can improve the quality of the stereoscopic image acquired by the device 1904. For example, the vertical or horizontal alignments or the separation of the lenses, mirrors or polarizer filters within the attachment 1902 (not shown) can be adjusted to optimize the stereoscopic effect. Such adjustments can be made manually by an operator, using optional controls disposed at the device 1904 or the attachment 1902 (not shown), or can be performed automatically by the processor via the controller 1906 using known correlation methods, such as those used for automated focus adjustments, facial recognition or other feature elements.
[00112] Additionally, the device 1904 can employ the image processing techniques to optimize the stereoscopic effect. For example, using the image sensors capable of generating an ultra high definition image (e.g., "4k resolution"), the device 1904 can, under the control of the processor, digitally define the respective fields of view within the captured left-eye and right-eye images, such that an optimized stereoscopic image can be displayed using only these digitally defined fields of view. The left-eye and the right-eye fields of view can be adjusted manually by an operator or automatically using the correlation method described above or other method known in the art..
[00113] It should be understood that the correlation method is executed by the processor. The method may be implemented in the form of hardware, firmware, or software. If implemented in software, the software may be any language that can be loaded and executed by the processor in accordance with the embodiments described herein. The software may be stored on any form of non-transient computer-readable media. The processor may be any processor, including fixed logic or programmable logic. In the case of programmable logic, the processor may be any processor that can load and execute the software and execute the methods described herein.
[00114] While this invention has been particularly shown and described with references to example embodiments thereof, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the scope of the invention encompassed by the appended claims.

Claims

CLAIMS is claimed is:
An attachment for acquiring a stereoscopic image, the attachment comprising:
a left-eye channel;
a right-eye channel; and
a beam combiner,
the left-eye channel configured to relay a left-eye beam to the beam combiner,
the right-eye channel configured to relay the right-eye beam to the beam combiner,
the beam combiner configured to combine the left-eye beam with the right-eye beam and to form a combined beam,
the left-eye channel including a first polarizing filter configured to transform the left-eye beam into a first polarized beam having a first polarization; and
the right-eye channel including a second polarizer element configured to transform the right-eye beam into a second polarized beam having a second polarization,
the first polarization being different from the second polarization.
2. The attachment of Claim 1,
the beam combiner including a polarizing beam-splitting cube, the beam combiner combining the first and second polarized beams into the combined beam.
3. The attachment of Claim 1,
the beam combiner including a partially reflective mirror, the beam combiner combining the first and second polarized beams into the combined beam.
4. A method for acquiring a stereoscopic image, the method comprising:
acquiring a left-eye image, carried by a left-eye beam; acquiring a right-eye image, carried by a right-eye beam; and combining the left-eye image and the right-eye image to form a combined image, wherein
acquiring the left-eye image includes passing the left-eye beam through a first-polarizing filter configured to transform the left-eye beam into a first polarized beam having a first polarization; and
acquiring the right-eye image includes passing the right-eye beam through a second polarizing filter configured to transform the right-eye beam into a second polarized beam having a second polarization,
the first polarization being different from the second polarization.
5. The method of Claim 4, wherein combining the left-eye image and the right- eye image to form a combined image includes combining the first and second polarized beams into the combined beam.
6. A system for acquiring a stereoscopic image, the system comprising:
an attachment for acquiring a stereoscopic image, the attachment comprising:
a left-eye channel;
a right-eye channel; and
a beam combiner,
the left-eye channel configured to relay a left-eye beam to the beam combiner,
the right-eye channel configured to relay the right-eye beam to the beam combiner,
the beam combiner configured to combine the left-eye beam with the right eye beam and to form a combined beam; and
an image acquisition device, the left-eye channel including a first polarizing filter configured to transform the left-eye beam into a first polarized beam having a first polarization; and
the right-eye channel including a second polarizer element configured to transform the right-eye beam into a second polarized beam having a second polarization,
the first polarization being different from the second polarization.
The system of Claim 6, wherein the attachment includes a means for securing the attachment on the image acquisition device.
The system of Claim 7, wherein the image acquisition device is a single shutter image acquisition device selected from a mobile phone, a photographic camera, or a video camera.
A kit, comprising:
an attachment for acquiring a stereoscopic image, the attachment comprising:
a left-eye channel;
a right-eye channel; and
a beam combiner,
the left-eye channel configured to relay a left-eye beam to the beam combiner,
the right-eye channel configured to relay the right-eye beam to the beam combiner,
the beam combiner configured to combine the left-eye beam with the right eye beam and to form a combined beam; and
a device for viewing the stereoscopic image,
the left-eye channel including a first polarizing filter configured to transform the left-eye beam into a first polarized beam having a first polarization; and the right-eye channel including a second polarizer element configured to transform the right-eye beam into a second polarized beam having a second polarization,
the first polarization being different from the second polarization.
10. The kit of Claim 9, wherein the device for viewing the stereoscopic image is selected from goggles, a lenticular array, or a parallax array.
11. The kit of Claim 9, the device for viewing the stereoscopic image being configured for viewing a stereoscopic image acquired with a single shutter image acquisition device selected from a mobile phone, a photographic camera, or a video camera.
12. An apparatus for acquiring a stereoscopic image, the apparatus comprising:
means for transforming a left-eye beam into a first polarized beam having a first polarization;
means for transforming a right-eye beam into a second polarized beam having a second polarization, the first polarization being different from the second polarization;
means for acquiring a left-eye image, carried by the first polarized beam;
means for acquiring a the right-eye image, carried by the second polarized beam; and
means for combining the left-eye image and the right-eye image into a combined image.
13. The apparatus of Claim 12, further including means for capturing the
combined image.
14. An attachment for acquiring a stereoscopic image, the attachment
comprising:
a left-eye channel; a right-eye channel; and
a beam combiner,
the left-eye channel configured to relay a left-eye beam to the beam combiner,
the right-eye channel configured to relay the right-eye beam to the beam combiner,
the beam combiner configured to combine the left-eye beam with the right-eye beam and to form a combined beam,
the attachment further including a color separation element configured to spatially separate color component rays of the left-eye beam and of the right-eye beam.
The attachment of Claim 14, further including a means for securing the attachment on an image acquisition device.
The attachment of Claim 15, wherein the image acquisition device is a single-shutter image acquisition device selected from a mobile phone, a photographic camera, or a video camera.
The attachment of Claim 4, the left-eye channel and the right-eye channel each including a mirror.
The attachment of Claim 14,
the beam combiner including a dichroic element,
the beam combiner combining the first and second anaglyphically colored beams into the single combined beam.
The attachment of Claim 14,
the left-eye channel including a first anaglyphical color filter configured to transform the left-eye beam into the first anaglyphically colored beam; and the right-eye channel including a second anaglyphical color filter configured to transform the right-eye beam into the second anaglyphically color beam.
20. The attachment of Claim 14, further including a third color channel
configured to relay a color correction beam to the beam combiner, the beam combiner combining the left-eye beam, the right-eye beam, and the color correction beam into the combined beam.
21. The attachment of Claim 20, the third color channel including a color filter.
22. A system for acquiring a stereoscopic image, the system comprising:
an attachment for acquiring a stereoscopic image, the attachment comprising:
a left-eye channel;
a right-eye channel; and
a beam combiner,
the left-eye channel configured to relay a left-eye beam to the beam combiner,
the right-eye channel configured to relay the right-eye beam to the beam combiner,
the beam combiner configured to combine the left-eye beam with the right eye beam and to form a combined beam; and
an image acquisition device,
the attachment further including a color separation element configured to spatially separate color component rays of the left-eye beam and of the right-eye beam
23. The system of Claim 22, wherein the attachment includes a means for securing the attachment on the image acquisition device.
24. The system of Claim 23, wherein the image acquisition device is a single shutter image acquisition device selected from a mobile phone, a photographic camera, or a video camera.
25. A kit, comprising:
an attachment for acquiring a stereoscopic image, the attachment comprising:
a left-eye channel;
a right-eye channel; and
a beam combiner,
the left-eye channel configured to relay a left-eye beam to the beam combiner,
the right-eye channel configured to relay the right-eye beam to the beam combiner,
the beam combiner configured to combine the left-eye beam with the right eye beam and to form a combined beam; and
a device for viewing the stereoscopic image,
the attachment further including a color separation element configured to spatially separate color component rays of the left-eye beam and of the right-eye beam
26. The kit of Claim 25, wherein the device for viewing the stereoscopic image is selected from goggles, a lenticular array, or a parallax array.
27. The kit of Claim 25, the device for viewing the stereoscopic image being configured for viewing a stereoscopic image acquired with a single shutter image acquisition device selected from a mobile phone, a photographic camera, or a video camera.
28. A kit, comprising:
an attachment for acquiring a stereoscopic image, the attachment comprising: a left-eye channel;
a right-eye channel; and
a beam combiner,
the left-eye channel configured to relay a left-eye beam to the beam combiner,
the right-eye channel configured to relay the right-eye beam to the beam combiner,
the beam combiner configured to combine the left-eye beam with the right eye beam and to form a combined beam; and
a computer-readable medium with computer code instructions stored thereon, the computer code instructions causing an image display apparatus to display the stereoscopic image.
29. A system for acquiring a stereoscopic image, the system comprising:
a detector having a frame rate;
a left-eye channel;
a right-eye channel;
a beam controller,
the left-eye channel configured to relay a left-eye beam to the detector,
the right-eye channel configured to relay a right-eye beam to the detector,
the beam controller configured to alternatively transmit either the left-eye beam or the right-eye beam to the detector at a switching rate that is equal to or less than the frame rate of the detector.
30. The system of Claim 29, the beam controller including a left-eye channel shutter, and a right-eye channel shutter, the shutters operable to alternatively block either the left-eye beam or the right-eye beam at the switching rate that is equal to or less than the frame rate of the detector.
31. The system of Claim 29, the beam controller including a movable mirror operable to alternatively direct either the left-eye beam or the right-eye beam to the detector at a switching rate that is equal to or less than the frame rate of the detector.
32. The system of Claim 29,
the left-eye channel including a first polarizing filter configured to transform the left-eye beam into the first polarized beam having a first polarization;
the right-eye channel including a second polarizer element configured to transform the right-eye beam into the second polarized beam having a second polarization, the first polarization being different from the second polarization; and
the beam controller including a polarization selection element operable to alternatively transmit either the left-eye beam or the right-eye beam to the detector at the switching rate that is equal to or less than the frame rate of the detector.
33. The system of Claim 29, further including a module configured to
synchronize the beam controller and the detector.
34. The system of Claim 29, wherein the detector is a single shutter image
acquisition device selected from a mobile phone, a photographic camera, or a video camera.
35. A method for acquiring a stereoscopic image, the method comprising:
transmitting a left-eye beam, carrying a left-eye image through a color separation element;
transmitting a right-eye beam, carrying a right-eye image through the color separation element, the color separation element configured to spatially separate color component rays of the left-eye beam and of the right-eye beam; acquiring a left-eye image, carried by a left-eye beam;
acquiring a right-eye image, carried by a right-eye beam; and combining the left-eye image and the right-eye image to form a combined image.
36. The method of Claim 35, further including capturing the combined image.
37. The method of Claim 35, wherein
acquiring the left-eye image includes passing the left-eye beam through a first anaglyphical color filter configured to transform the left-eye beam into the first anaglyphically colored beam; and
acquiring the right-eye image includes passing the right-eye beam through a second anaglyphical color filter configured to transform the right- eye beam into the second anaglyphically colored beam.
38. The method of Claim 37, wherein combining the left-eye image and the right-eye image includes combining the first and second anaglyphically colored beams into the single combined beam.
39. The method of Claim 35, further including
acquiring a color-correcting image, carried by a color-correcting beam; and
combining the left-eye image, the right-eye image, and the color- correcting image to form a color-corrected combined image.
40. A method for acquiring a stereoscopic image, the method Comprising:
acquiring a left-eye image carried by a left-eye beam; acquiring a right-eye image, carried by a right-eye beam; and alternatively transmitting either the left-eye beam or the right-eye beam to a detector at a switching rate, the detector having a frame rate, the switching rate being equal to or less than the frame rate of the detector.
41. The method of Claim 40, further including synchronizing the alternative transmission and frame acquisition by the detector.
42. An apparatus for acquiring a stereoscopic image, the apparatus comprising:
means for separating color component rays of a left-eye beam and of a right-eye beam;
means for acquiring the left-eye image, carried by the left-eye beam; means for acquiring the right-eye image, carried by the right-eye beam; and
means for combining the left-eye image and the right-eye image into a combined image.
43. The apparatus of Claim 42, further including means for capturing the
combined image.
44. An apparatus for acquiring a stereoscopic image, the apparatus comprising:
means for acquiring a left-eye image carried by a left-eye beam; means for acquiring a right-eye image, carried by a right-eye beam; and
means for alternatively transmitting either the left-eye beam or the right-eye beam to a detector at a switching rate, the detector having a frame rate, the switching rate being equal to or less than the frame rate of the detector.
45. The apparatus of Claim 44, further including means for synchronizing the alternative transmission and frame acquisition by the detector.
46. A stereoscopic image acquisition device, comprising:
an objective lens element configured to relay a combined beam, the combined beam including a left-eye-image polarized beam, corresponding to a left-eye image, and a right-eye-image polarized beam, corresponding to the right-eye image; at least one beam-splitting element, each beam-splitting element configured to separate its respective beam-splitter input beam into its respective first and second polarized output beams; and a plurality of image sensors, each image sensors configured to detect its respective image sensor input beam and to capture its respective image,
wherein:
the left-eye-image polarized beam and each of the first polarized output beams have a first polarization, and the right-eye-image polarized beam and each of the second polarized output beam have a second polarization, different from the first polarization.
47. The device of Claim 46, comprising one beam-splitting element and first and second image sensors, and further wherein:
the objective lens element is configured to relay the combined beam to the beam-splitting element;
the beam-splitting element is configured to separate the combined beam into the first and the second polarized output beams;
the first image sensor is configured to detect the first polarized output beam and to capture the left-eye image, and
the second image sensor is configured to detect the second polarized output beam and to capture the right-eye image.
48. The device of any of Claims 46 or 47, further comprising a processor
operably coupled to the plurality of image sensors and configured to combine representations of the left-eye and the right-eye images to yield a representation of a stereoscopic image.
49. The device of Claim 46, comprising:
one beam-splitting element;
first and second color-separation elements, each of the color- separation elements configured to spatially separate color component rays of its respective color-separator input beam into its respective plurality of color component output beams; and
first and second pluralities of image sensors,
and further wherein:
the objective lens element is configured to relay the combined beam to the beam-splitting element;
the beam-splitting element is configured to separate the combined beam into the first and the second polarized output beams;
each of the first and the second color-separating elements is configured to spatially separate color component rays of the first and the second polarized output beams into first and second pluralities of polarized color component output beams, respectively;
each of the first plurality of image sensors is configured to detect its respective first polarized color component output beam and to capture its respective left-eye color component image, thereby capturing a plurality of left-eye color component images; and
each of the second plurality of image sensors is configured to detect its respective second polarized color component output beam and to capture its respective right-eye color component image, thereby capturing a plurality of right-eye color component images.
The device of Claim 46, comprising:
one color-separation element configured to spatially separate color component rays of a color-separator input beam into a plurality of color component output beams;
a plurality of beam-splitting elements; and
first and second pluralities of image sensors,
and further wherein:
the objective lens element is configured to relay the combined beam to the color-separating element; the color-separating element is configured to spatially separate color component rays of the combined beam into a plurality of the color components output beams;
each of the plurality of beam-splitting elements is configured to separate its respective color components output beam into respective first and second polarized color component output beams, thereby forming first and second pluralities of polarized color component beams;
each of the first plurality of image sensors is configured to detect its respective polarized color component output beam and to capture its respective left-eye color component image, thereby capturing a plurality of left-eye color component images, and
each of the second plurality of image sensors is configured to detect its respective polarized color component output beam and to capture its respective right-eye color component image, thereby capturing a plurality of the right-eye color component images.
51. The device of any of Claims 49 or 50, further including a processor operably coupled to the first and the second pluralities of image sensors and configured to combine representations of the left-eye and the right-eye color component images to yield a representation of a stereoscopic image.
52. A system for acquiring a stereoscopic image, the system comprising:
(1) an attachment configured to acquire a stereoscopic image, the
attachment comprising:
a left-eye attachment channel;
a right-eye attachment channel; and
a beam combiner,
the left-eye attachment channel configured to relay a left-eye attachment beam to the beam combiner,
the right-eye attachment channel configured to relay the right-eye attachment beam to the beam combiner, the beam combiner configured to combine the left-eye attachment beam with the right-eye attachment beam and to form a combined beam;
the left-eye attachment channel including a first polarizer element configured to transform the left-eye attachment beam into a first polarized attachment beam having a first polarization; and
the right-eye attachment channel including a second polarizer element configured to transform the right-eye attachment beam into a second polarized attachment beam having a second polarization, the first polarization being different from the second polarization; and (2) the stereoscopic image acquisition device of any one of Claims 46-51.
53. The system of Claim 52, wherein:
the stereoscopic image acquisition device includes a processor operably coupled to at least two image sensors;
the attachment includes at least one adjustable optical element, and an actuator operably linked to the at least one adjustable optical element; and the system further includes a controller operably linked to the processor, the controller configured to adjust the at least one adjustable optical element of the attachment based on an instruction from the processor.
54. A stereoscopic image acquisition device, comprising:
means for relaying a combined beam, the combined beam including a left-eye-image polarized beam, corresponding to a left-eye image, and a right-eye-image polarized beam, corresponding to the right-eye image;
means for separating the combined beam into first and second polarized output beams;
means for detecting the first polarized output beam and for capturing the left-eye image, and
means for detecting the second polarized output beam and for capture the right-eye image,
wherein: the left-eye-image polarized beam and the first polarized output beam have a first polarization, and the right-eye-image polarized beam and the second polarized output beam have a second polarization, different from the first polarization.
55. A stereoscopic image acquisition device, comprising:
means for relaying a combined beam, the combined beam including a left-eye-image polarized beam, corresponding to a left-eye image, and a right-eye-image polarized beam, corresponding to the right-eye image; means for separating the combined beam into first and second polarized output beams, wherein the left-eye-image polarized beam and the first polarized output beam have a first polarization, and the right-eye-image polarized beam and the second polarized output beam have a second polarization, different from the first polarization;
means for spatially separating color component rays of the first and the second polarized output beams into first and second pluralities of polarized color components output beams, respectively;
means for detecting the first plurality of polarized color components output beams and for capturing a plurality of left-eye color component images; and
means for detecting the second plurality of polarized color components output beams and for capturing a plurality of right-eye color component images.
56. A stereoscopic image acquisition device, comprising:
means for relaying a combined beam, the combined beam including a left-eye-image polarized beam, corresponding to a left-eye image, and a right-eye-image polarized beam, corresponding to the right-eye image; means for spatially separating color component rays of the combined beam into a plurality of color components output beams;
means for separating the plurality of color component output beams into respective first and second pluralities of polarized color component output beams, wherein the left-eye-image polarized beam and the first plurality of polarized color component output beams have a first polarization, and the right-eye-image polarized beam and the second plurality of polarized color component output beams have a second polarization, different from the first polarization;
means for detecting the first plurality of polarized color components output beams and for capturing a plurality of left-eye color component images; and
means for detecting the second plurality of polarized color components output beams and for capturing a plurality of right-eye color component images.
57. The device of Claims 54 or 55, further including means for combining
representations of the left-eye and the right-eye color component images to yield a representation of a stereoscopic image.
58. A method for acquiring a stereoscopic image, comprising:
relaying a combined beam through an objective lens element, the combined beam including a left-eye-image polarized beam, corresponding to a left-eye image, and a right-eye-image polarized beam, corresponding to the right-eye image;
separating at least one beam-splitter input beam into its respective first and second polarized output beams; and
detecting a plurality of image sensor input beams and capturing a respective plurality of images,
wherein:
the left-eye-image polarized beam and the first polarized output beam each has a first polarization, and the right-eye-image polarized beam and the second polarized output beam each has a second polarization, different from the first polarization.
59. The method of Claim 58, further comprising: separating the combined beam into the first and the second polarized output beams;
relaying the first polarized output beam to a first image sensor and capturing the left-eye image; and
relaying the second polarized output beam to a second image sensor and capturing the right-eye image.
60. The method of Claim 59, further comprising combining representations of the left-eye and the right-eye images to yield a representation of a stereoscopic image.
61. The method of Claim 58, further comprising:
separating the combined beam into the first and the second polarized output beams,
spatially separating color component rays of the first and the second polarized output beams into first and second pluralities of polarized color components output beams, respectively;
relaying the first plurality of polarized color components output beams to a first plurality of image sensors and capturing a plurality of left- eye color component images, and
relaying the second plurality of polarized color components output beams to a second plurality of image sensors and capturing a plurality of right-eye color component images.
62. The method of Claim 58, comprising:
spatially separating color component rays of the combined beam into a plurality of the color components output beams;
separating the plurality of the color components output beams into respective first and second pluralities of polarized color component output beams; relaying the first plurality of polarized color component output beams to a first plurality of image sensors and capturing a plurality of left-eye color component images, and
relaying the second plurality of polarized color component output beams to a second plurality of image sensors and capturing a plurality of right-eye color component images.
63. The method of Claims 61 or 62, further including combining representations of the left-eye and the right-eye color component images to yield a representation of a stereoscopic image.
64. A method of acquiring a stereoscopic image, comprising:
passing a left-eye beam through a first-polarizing filter configured to transform the left-eye beam into a left-eye image polarized beam having a first polarization;
passing a right-eye beam through a second polarizing filter configured to transform the right-eye beam into a right-eye image polarized beam having a second polarization, the first polarization being different from the second polarization,
combining the left-eye image polarized beam and the right-eye image polarized beam to form a combined beam;
relaying the combined beam through an objective lens element; separating the combined beam into the first and the second polarized output beams;
relaying the first polarized output beam to a first image sensor and capturing the left-eye image; and
relaying the second polarized output beam to a second image sensor and capturing the right-eye image.
65. The method of Claim 64, further comprising combining representations of the left-eye and the right-eye images to yield a representation of a stereoscopic image.
66. A method of acquiring a stereoscopic image, comprising:
passing a left-eye beam through a first-polarizing filter configured to transform the left-eye beam into a left-eye image polarized beam having a first polarization;
passing a right-eye beam through a second polarizing filter configured to transform the right-eye beam into a right-eye image polarized beam having a second polarization, the first polarization being different from the second polarization,
combining the left-eye image polarized beam and the right-eye image polarized beam to form a combined beam;
relaying the combined beam through an objective lens element; separating the combined beam into the first and the second polarized output beams,
spatially separating color component rays of the first and the second polarized output beams into first and second pluralities of polarized color components output beams, respectively;
relaying the first plurality of polarized color components output beams to a first plurality of image sensors and capturing a plurality of left- eye color component images, and
relaying the second plurality of polarized color components output beams to a second plurality of image sensors and capturing a plurality of right-eye color component images.
67. A method of acquiring a stereoscopic image, comprising:
passing a left-eye beam through a first-polarizing filter configured to transform the left-eye beam into a left-eye image polarized beam having a first polarization;
passing a right-eye beam through a second polarizing filter configured to transform the right-eye beam into a right-eye image polarized beam having a second polarization, the first polarization being different from the second polarization, combining the left-eye image polarized beam and the right-eye image polarized beam to form a combined beam;
relaying the combined beam through an objective lens element; spatially separating color component rays of the combined beam into a plurality of the color components output beams;
separating the plurality of the color components output beams into respective first and second pluralities of polarized color component output beams;
relaying the first plurality of polarized color component output beams to a first plurality of image sensors and capturing a plurality of left-eye color component images, and
relaying the second plurality of polarized color component output beams to a second plurality of image sensors and capturing a plurality of right-eye color component images.
68. The method of Claims 66 or 67, further comprising combining
representations of the left-eye and the right-eye color component images to yield a representation of a stereoscopic image.
69. The method of any one of Claims 65 or 68, further comprising:
relaying at least one beam selected form the group of the left-eye beam, the right-eye beam, the left-eye-image polarized beam, the right-eye- image polarized beam, and the combined beam through at least one adjustable optical element;
adjusting the at least one adjustable optical element based the representation of a stereoscopic image.
PCT/US2014/015306 2013-02-07 2014-02-07 Method and apparatus for stereoscopic imaging Ceased WO2014124262A2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US13/762,139 2013-02-07
US13/762,139 US20140218478A1 (en) 2013-02-07 2013-02-07 Method and apparatus for stereoscopic imaging

Publications (3)

Publication Number Publication Date
WO2014124262A2 true WO2014124262A2 (en) 2014-08-14
WO2014124262A3 WO2014124262A3 (en) 2014-10-02
WO2014124262A9 WO2014124262A9 (en) 2014-11-20

Family

ID=51258903

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2014/015306 Ceased WO2014124262A2 (en) 2013-02-07 2014-02-07 Method and apparatus for stereoscopic imaging

Country Status (2)

Country Link
US (1) US20140218478A1 (en)
WO (1) WO2014124262A2 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2590439A (en) * 2019-12-18 2021-06-30 Nokia Technologies Oy Apparatus, systems and methods for detecting light

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9554113B2 (en) 2013-03-21 2017-01-24 Mediatek Inc. Video frame processing method
EP3298585A4 (en) * 2015-05-22 2018-12-26 Massachusetts Institute of Technology Rapid and precise optically multiplexed imaging
US10455214B2 (en) * 2016-03-03 2019-10-22 Disney Enterprises, Inc. Converting a monocular camera into a binocular stereo camera
US10992917B2 (en) * 2016-06-17 2021-04-27 Sony Corporation Image processing device, image processing method, program, and image processing system that use parallax information
GB2569325B (en) 2017-12-13 2020-05-06 Imperial Innovations Ltd Ear examination apparatus
US20200128224A1 (en) * 2018-10-18 2020-04-23 Brian W. Bush Computer implemented method of capturing stereo images using single lens optics of any smart device without the use of any additional hardware
US20220070348A1 (en) * 2018-12-11 2022-03-03 National University Of Singapore Assembly and method for switching direction of camera view

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4295153A (en) * 1980-03-31 1981-10-13 GIBSON Stephen Stereoscopic apparatus and method of using same
JP3542397B2 (en) * 1995-03-20 2004-07-14 キヤノン株式会社 Imaging device
US20020089744A1 (en) * 2000-01-13 2002-07-11 Myers Kenneth J. Masked split image stereoscopic system and method
JP2002034056A (en) * 2000-07-18 2002-01-31 Scalar Corp Image capturing apparatus for stereoscopic image, image capturing method for stereoscopic image
US8194119B2 (en) * 2007-05-10 2012-06-05 Chroma3D Systems, Inc. Display of generalized anaglyphs without retinal rivalry
JP2011064894A (en) * 2009-09-16 2011-03-31 Fujifilm Corp Stereoscopic image display apparatus
US8964004B2 (en) * 2010-06-18 2015-02-24 Amchael Visual Technology Corporation Three channel reflector imaging system

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2590439A (en) * 2019-12-18 2021-06-30 Nokia Technologies Oy Apparatus, systems and methods for detecting light

Also Published As

Publication number Publication date
US20140218478A1 (en) 2014-08-07
WO2014124262A3 (en) 2014-10-02
WO2014124262A9 (en) 2014-11-20

Similar Documents

Publication Publication Date Title
WO2014124262A9 (en) Method and apparatus for stereoscopic imaging
US8077964B2 (en) Two dimensional/three dimensional digital information acquisition and display device
TW548960B (en) Method and apparatus of flicker reduction for LC shutter glasses
JP5391914B2 (en) Imaging apparatus and video recording / reproducing system
US20020140835A1 (en) Single sensor chip digital stereo camera
US9479743B2 (en) Single lens 3-D camera
CN102917235A (en) Image processing apparatus, image processing method, and program
US20100321476A1 (en) Camera for capturing three-dimensional images
JP5905585B2 (en) Video processing system based on stereo video
CN102860017A (en) Stereoscopic image pickup device and control method therefor
US20150229910A1 (en) Method and apparatus for stereoscopic imaging
CN105388620B (en) A kind of laser three-dimensional projection display system based on six-basic-color color management
US20130107009A1 (en) Three-dimensional image pickup apparatus, light-transparent unit, image processing apparatus, and program
US20100309291A1 (en) Method and apparatus for capturing three-dimensional stereoscopic images
US20120307016A1 (en) 3d camera
KR20050083352A (en) The apparatus and method for acquisition and displays a panoramic and three-dimensional image using the stereo-camera in a mobile communication terminal.
JP2001337295A (en) Projector
EP1200858A1 (en) Single-lens stereoscopic light-valves and apparatuses
KR101220921B1 (en) Device for photographing three-dimensional stereoscopic video
US20100321777A1 (en) Method and apparatus for optimizing stereoscopic effect in a camera
KR100703713B1 (en) 3D mobile device capable of 3D image acquisition and display
Arai Three-dimensional television system based on spatial imaging method using integral photography
US20100321474A1 (en) Method and apparatus for capturing three-dimensional stereoscopic images
WO2012117619A1 (en) 3d imaging device
WO2012001958A1 (en) Image processing device, method and program

Legal Events

Date Code Title Description
NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 14749190

Country of ref document: EP

Kind code of ref document: A2