WO2013104075A1 - Single optical path anamorphic stereoscopic imager - Google Patents

Single optical path anamorphic stereoscopic imager Download PDF

Info

Publication number
WO2013104075A1
WO2013104075A1 PCT/CA2013/050019 CA2013050019W WO2013104075A1 WO 2013104075 A1 WO2013104075 A1 WO 2013104075A1 CA 2013050019 W CA2013050019 W CA 2013050019W WO 2013104075 A1 WO2013104075 A1 WO 2013104075A1
Authority
WO
WIPO (PCT)
Prior art keywords
lens assembly
aperture
disposed
sensor
optical axis
Prior art date
Application number
PCT/CA2013/050019
Other languages
English (en)
French (fr)
Inventor
Thomas N. Mitchell
Ichiro Shinkoda
Original Assignee
Front Street Investment Management Inc., As Manager Of Front Street Diversified Income Class
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Front Street Investment Management Inc., As Manager Of Front Street Diversified Income Class filed Critical Front Street Investment Management Inc., As Manager Of Front Street Diversified Income Class
Priority to KR1020147022684A priority Critical patent/KR101699597B1/ko
Priority to EP13735837.0A priority patent/EP2802927A4/en
Priority to CN201380014138.0A priority patent/CN104254801A/zh
Publication of WO2013104075A1 publication Critical patent/WO2013104075A1/en

Links

Classifications

    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B13/00Optical objectives specially designed for the purposes specified below
    • G02B13/08Anamorphotic objectives
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/0004Microscopes specially adapted for specific applications
    • G02B21/002Scanning microscopes
    • G02B21/0024Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
    • G02B21/0028Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders specially adapted for specific applications, e.g. for endoscopes, ophthalmoscopes, attachments to conventional microscopes
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/0004Microscopes specially adapted for specific applications
    • G02B21/002Scanning microscopes
    • G02B21/0024Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
    • G02B21/0052Optical details of the image generation
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/02Objectives
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B30/00Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images
    • G02B30/20Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes
    • G02B30/22Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes of the stereoscopic type
    • G02B30/23Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes of the stereoscopic type using wavelength separation, e.g. using anaglyph techniques
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B30/00Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images
    • G02B30/20Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes
    • G02B30/22Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes of the stereoscopic type
    • G02B30/25Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes of the stereoscopic type using polarisation techniques
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106Processing image signals
    • H04N13/161Encoding, multiplexing or demultiplexing different image signal components
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20Image signal generators
    • H04N13/204Image signal generators using stereoscopic image cameras
    • H04N13/207Image signal generators using stereoscopic image cameras using a single 2D image sensor
    • H04N13/218Image signal generators using stereoscopic image cameras using a single 2D image sensor using spatial multiplexing

Definitions

  • This invention relates, in general, to stereoscopic imaging. More specifically, this invention relates to changing the aspect ratio of stereoscopic image pairs of a scene generated along different portions of a single optical path.
  • the phenomenon of stereoscopic vision, or stereopsis, is directly associated with the ability of humans and animals with binocular vision to perceive depth in a scene. It is the perceptual effect produced by the human brain simultaneously processing two sets of slightly differing two-dimensional optical data.
  • the phenomenon, as experienced by an unaided human observer, is based on the feel ' that the retinal images formed by the two eyes of the observer differ slightly. A point object in a scene observed by the human observer is imaged in a slightly different position in the left retinal image as compared with the image of the same scene on the right retina.
  • stereoscopic imagery was created using images taken by two separate cameras.
  • Work particularly in the video-imaging field, has led to systems in which two complete imaging systems are incorporated permanently into single stereoscopic viewers.
  • Such viewers typically have dual optical axes and twin objective optical subsystems providing two optical paths. They typically have one optical axis for the right eye view and one for the left eye view in order to produce two complete images, one for the right eye perspective and that for he left eye perspective, side by side on two imaging sensors.
  • each of the images has a typical 4:3 (horizontal : vertical) landscape aspect ratio it requires two imaging sensors of that aspect ratio for optimal use of expensive sensor real estate. Projecting the two images side by side onto a single 4:3 aspect ratio imaging sensor would waste a sizeable portion of the expensive sensor.
  • a specialized double horizontal width imaging sensor could be developed with aspect ratio 8:3. Even large aspect ratio sensors, such as 16:9 will not allow two images of commercially acceptable aspect ratio to be captured side by side without reduction of the image size and consequent wastage of sensor surface in the vertical direction.
  • stereoscopic systems have a single optical path near the sensing end of the arrangement. Such viewers are most often arranged to allow the two images to be captured alternately in time on the same sensor. This approach uses synchronized time division arrangements that allow only one of the two views to be imaged at a time on the imager.
  • the read-out and display equipment is arranged to alternately display one or the other of the left and right images at a rate that allows the human viewer of the display to observe an apparently continuous display of both images, one for the left eye and one for the right.
  • Such systems have the additional burden of on board modulators and the electronics to drive such modulators, be these of the mechanical chopping, light valve or ''liquid crystal" type. For a particular image this arrangement also halves the light available to the sensors, with negative consequences for the signal to noise performance of the electro-optic circuitry. In the ease of polarization or other filtering techniques there are additional transmission tosses.
  • Yet other single optical path stereoscopic systems employ specialized sensors that have two sets of sensing elements within the same sensor area, one set sensing light of one characteristic and a second set sensing light of a second characteristic.
  • the characteristic can typically be polarization or color, -1 Tie images for the two eyes are then differentiated by suitable filters on the basis of polarization or color.
  • the non-standard sensors employed in such apparatus remain a problem in the commercial arena.
  • a stereoscopic imaging apparatus for forming on a single image sensor from light obtained along a single optical path through a front lens assembly having a single optical axis an anamorphic stereoscopic image pair comprising a first image and a second image of differing perspective from the first image
  • the apparatus comprising: first and second apertures disposed proximate an aperture plane of the front lens assembly, on opposite sides of an optical axis of the front lens assembly, and separated by an inter- aperture separation; at least one anamorphic element disposed in the single optical path; a first sampling lens located between the aperture plane and the sensor and proximate and overlapping with the first aperture; a second sampling lens located between the aperture plane and the sensor and proximate and overlapping with the second aperture; and a rear lens assembly disposed between the sampling lenses and the sensor for forming on the sensor the first and second images from light received through the first and second sampling lenses,
  • the sampl ing lenses can be disposed to direct light received through the two
  • the at least one anamorphic element can be the two sampling lenses. In other embodiments, the at least one anamorphic element can be a single anamorphic element disposed on the optical axis.
  • the first and second sampling lenses can be disposed abaxial ly with respectively the first and second apertures to form, through the rear lens assembly the first and second images aligned vertically above each other and substantially non-overlapping on the image sensor. In other embodiments the first and second sampling lenses are disposed abaxial ly with respectively the first and second apertures to form through the rear lens assembly the first and second images aligned horizontally next to each other and substantially non-overlapping on the image sensor.
  • the stereoscopic imaging apparatus may be fitted to an endoscope, in which case the front lens assembly is an endoscope front lens assembly.
  • the stereoscopic imaging apparatus may be fitted to a microscope, in which case the front lens assembly is a microscope objective lens assembly.
  • the first and second apertures can be variable apertures, including but not limited to irises, to allow changing the depth of field of the apparatus.
  • the inter- aperture separation between the apertures can be adjustable to adjust the stereopsis of the apparatus.
  • the sampling lenses can be configured to move in cooperation with the apertures when the inter-aperture separation is adjusted.
  • a stereoscopic imaging apparatus for forming an anamorphic stereoscopic image pair comprising a first image and a second image of differing perspective from the first image
  • the apparatus comprising: a front lens assembly, comprising at least an objective lens having a field of view and a single optical axis, the front lens assembly configured to direct light from the field of view along a single optical path generally about the optical axis; a single imaging sensor disposed along the optical axis behind the front lens assembly; first and second apertures disposed proximate an aperture plane of the front lens assembly, on opposite sides of an optical axis of the front lens assembly, and separated by an inter- aperture separation; at least one anamorphic element disposed in the single imaging path; a first sampling lens located between the aperture plane and the sensor and prox imate and overlapping with the first aperture; a second sampling lens located between the aperture plane and the sensor and proximate and overlapping with the second aperture; and a rear lens assembly disposed between the sampling lenses and
  • the single anamorphic element can be disposed on the optical axis in front of the front lens assembly, within the front lens assembly, between the front lens assembly and the sampling lenses, between the sampling lenses and the rear lens assembly, within the rear lens assembly or between the rear lens assembly and the image sensor,
  • the imaging sensor can be oriented in a landscape orientation with its long axis in the horizontal dimension or it can be oriented in a landscape orientation with its long axis in the horizon tal di men s ion .
  • a method for forming on a single imaging sensor an anamorphic stereoscopic image pair comprising a first and a second image comprising: gathering light from objects within a field of view of a front lens assembly; directing the gathered light along a single optical path generally about an optical axis of the front lens assembly; anamorphically magnifying the image content of the light by means of at least one anamorphic lens; sampling light from a first portion of the single optical path through a first aperture and sampling light from a second portion of the single optical path through a second aperture, the first and second apertures disposed on opposite sides of the optical axis proximate an aperture plane of the front lens assembly; and forming on the single imaging sensor disposed along the optical axis the first and second images from respectively the light sampled through the first aperture and the light sampled through a rear lens assembly.
  • the forming first and second images can be by processing respectively the light sampled through the first aperture and the light sampled through the second aperture through a second lens disposed between the apertures and. the sensor.
  • the method can further comprise routing the light from the first and second apertures via respectively first and second sampling lenses to form respectively the first and second images at predetermined positions relative to each other, the first and second sampling lenses being disposed proximate, overlapping and. abaxial with respectively the first aperture and second aperture.
  • the routing can comprise displacing the centers of the two sampling lenses abaxially in respectively opposite directions from their respective proximate apertures.
  • the anamorphically magnifying can be relatively compressing the image content of the gathered l ight by substantially 50% in a vertical dimension and the displacing can be aligning the first and second images vertically above each other on the sensor.
  • the anamorphically magnifying can be relatively compressing the image content of the gathered light by substantially 50 ⁇ in a horizontal dimension and the displacing can be aligning the. first and second images horizontally next to each other on the sensor.
  • the method further comprises extracting from the single imaging sensor data describing the first and second images and digitally restoring the aspect ratio of the two images to values that pertained to an i mage content of the l ight from, the objects within the field of view before the ananiorphically magnifying.
  • FIG. J shows a single optical path anamorphic stereoscopic imager
  • P IG.2 is a flow diagram of a method for creating a stereoscopic image
  • FIG.3 shows a single optical path anamorphic stereoscopic endoscope
  • Imaging sensors have been proposed in the prior art that retain the industry standard landscape aspect ratios of, for example, 4:3 and 16:9, but these proposals require special modifications to be implemented on. the sensors themselves, usually in the form of special, lenticular arrays or other complex, means. This points away from the use of mass produced industry standard imaging sensors.
  • the mass production of commercial Si-imaging sensors is not geared towards the fabrication of non-standard devices. Low unit costs are based on large volume manufacture of devices of standard sizes with good yield due to smoothly running standard production. It is not just lowered ran length and associated proportionally higher set-up costs that increase the prices of non-standard devices, but also the lowered yield inherent in non- routine production.
  • a single optica] path stereoscopic imaging apparatus for simultaneously obtaining a pair of stereoscopic images of a scene on a single imaging sensor.
  • a stereoscopic imaging apparatus comprises a lens 102 generally oriented with its axis along an optical axis 103 and an imaging sensor 132 located in "landscape" orientation at an image plane given by lines 138 and 114 and configured for receiving images from the lens 102.
  • the lens 102 comprises front lens assembly 124 and rear lens assembly 126.
  • the front lens assembly 124 is operable to direct light captured within a field of view of the lens 124 to an apeiture plane 104 of the lens 124.
  • the aperture plane 104 can be a physical apeiture plane of the lens 102 or can be a conjugate of the physical apeiture plane.
  • the term "aperture plane" is used to describe both the physical aperture plane and any of its conjugates.
  • Front lens assembly 124 comprises, by way of example, lenses 1 18, 120 and 122, Rear !ens assembly 126 can similarly comprise a plurality of lenses. For the sake of clarity, rear lens assembly 126 is schematically shown as a single lens.
  • An apeiture plate 108 is disposed proximate aperture plane 104.
  • the aperture plate 108 comprises a first aperture 128 and a second aperture 130 disposed either side of the optical axis 103 and separated in a horizontal plane by an inter-aperture distance.
  • inter-aperture separation is used in the present specification to describe the center-to-center distance between the two apertures 128 and 130.
  • horizontal is used in this specification to denote an orientation in a plane containing the optical axis 103 and the line between the centers of apertures 128 and 130,
  • 'vertical is used to describe a direction perpendicular to the plane containing the optical axis 103 and the line between the centers of apertures 128 and 1.30.
  • the lens 102 comprises a first sampling lens 142 disposed proximate and overlapping with the first aperture 128 and located between the aperture plane 104 and the sensor 132,
  • the lens 102 comprises a second sampling lens 144 disposed proximate and overlapping with the second aperture 130 and located between the aperture plane 104 and the sensor 132 in substantially the same plane as first sampling lens 142 perpendicular to the optical, axis 103.
  • First sampling lens 142 operates on light captured with a first perspective from within the field of view of the lens 102 by the front lens assembly 1.24.
  • Second sampling lens 144 operates on light captured with a second, perspective from, within the field of view of the lens 102 by the front lens assembly 124..
  • the first sampling lens 14.2 therefore samples light from a first portion of an optical path generally about the optical axis 103, while the second sampling lens 144 samples light from a second portion of the same optical path.
  • the first sampling lens 142 is imaged onto the imaging sensor 132 by the rear lens assembly 126 to form a first image 134 having a first perspective of an object 116 disposed within the field of view of the lens 102.
  • Light from the second, sampling lens 144 is imaged onto the imaging sensor 132 by the rear lens assembly 126 to form a second image 136 having a second perspective of the object 116.
  • an anamorphic element 110 such, as a, lens, is disposed between the front lens assembly 124 and the aperture plane 104. This ensures that any images produced on sensor 132 from, light transiting through apertures 128 and 130 are anamorphic images of the object 116.
  • the anamorphic element 1 10 can be disposed in front of front lens assembly 124 or inside front lens assembly 124.
  • the anamorphic element 110 has a magnification of substantial] ⁇ ' 50% in the horizontal as compared, with the vertical. This ensures that any images formed from, light transiting through apertures 128 and 130 are compressed by substantially 50'% in the horizontal dimension.
  • anamorphic element 110 has a magnification of substantially 50% in the vertical as compared with the horizontal. This ensures that any images formed from light transiting through apertures 128 and 130 are compressed by substantially 50% in the vertical dimension.
  • an anamorphic element 110 in the form of a lens
  • other refractive, diffractive or reflective optical elements can be employed to provide suitable anamorphic deformation of the first and second images 134 and 136.
  • the matter of directing the images 134 and 136 to be non-overlapping on sensor 132 is addressed by disposing the sampling lenses 142 and 144 to be abaxial with apertures 128 and 130 respectively.
  • Figure 1 the embodiment employing an art amorphic element 110 with substantially 50% vertical compression is shown.
  • the degree of abaxial displacement of the sampling lenses 142 and 144 is exaggerated in Figure 1 for the sake of clarity.
  • the term "abaxial” is used in the present specification to describe a mutual orientation wherein the axes through the centers of the first aperture 128 and the first sampling lens 142 are parallel, but not coinciding.
  • the term “"abaxial displacement” is used to describe the perpendicular distance between the axis through the center of the first aperture 128 and the axis through the center first the sampling lens 142.
  • the direction and size of the abaxial displacement of the second sampling lens 144 from the optical axis of the second aperture 130 is substantially opposite and equal to the direction and size of the abaxial displacement of the first sampling lens 142 from the optical axis of the first aperture 130,
  • the axes of sampling lenses 142 and 144 are displaced not just along the horizontal in order to specifically cause images 134 and to be aligned in (he horizontal, but also they are also displaced vertically in opposite directions in order cause images 134 and 136 to be substantially non-overlapping.
  • the result is a stereoscopic image pair that is aligned in the vertical and that can be arranged to be non-overlapping, but substantially abutting along their facing horizontal perimeters.
  • This arrangement makes optimal use of the sensor pixel distribution, in a more general case, the two images 134 and 136 are not constrained to abut each other.
  • the axes of sampling lenses 142 and 144 are displaced from those of apertures 128 and 130 respectively only in the horizontal dimension, and the images 134 and 136 thereby shifted horizontally on the sensor 132 to ensure that they are substantially non- overlapping and abutting along their facing vertical perimeters, thereby to make maximal use of the sensor element distribution on sensor 132.
  • the two images 134 and 136 are not constrained to abut each other. If, for some or other reason, the images 134 and 136 are not perfectly aligned, the vertical displacements of sampling lenses 142 and 144 can be adjusted by a small amount to realign the images.
  • the use of abaxially disposed sampling lenses avoids the use of expensive custom-made image sensors and provides control over the placement of images 134 and 136,
  • first image 134 and the second image 136 represent different perspectives of the object 116, they may be employed to derive three-dimensional (3D) information about the object 116. More particularly, a controller 115 may extract image data representing the two images 134 and 136 from imaging sensor via image data output connection 117. Controller 115 can be configured to process the images digitally to restore the original aspect ratio as per the optical image information content of the light from the field of view of front end lens assembly 124 before entering the anamorphic lens.
  • imaging sensor 132 can be a single array imaging sensor, including but not limited to a Charge Coupled Device (CCD).
  • CCD Charge Coupled Device
  • one portion of the vertical axis data from the sensor 132 is associated with the image 136 and another portion of the vertical axis data from the sensor 132 is associated with the image 134.
  • the two images 136 and 134 can be separately extracted from the sensor 132.
  • the degree of stereopsis achievable with a three-dimensional imager is fundamentally dependent on the angular difference between the two perspectives used to create the images used to render the three-dimensional view.
  • the specific use of sampling lenses 142 and 144 provides the benefit of- a large perspective difference as a result of the use of the front lens assembly 124 that is large in comparison with the anamorphic sampling lenses 142 and 144, whilst still producing an overall lens system, given by lens 102, that has a short focal length. This allows the lens 102 to be employed with small low cost imaging sensors.
  • the inter- aperture distance between apertures 128 and 130 is greater than that achievable in three- dimensional imagers employing such small imaging sensors in conjunction with prior art imaging lens arrangements. The result is greater stereopsis than that achievable with prior art lenses applied to comparable imaging sensors. This is particularly relevant in camera applications where adequate stereopsis is often difficult to attain.
  • apertures 128 and 130 can be variable apertures, including but not limited to irises, to provide the facility of varying the depth of field of lens 102, In some embodiments apertures 128 and 130 can be fixed apertures. In other embodiments the first and second apertures 128 and 130 can be configured to allow changing the stereopsis of the imager by changing the inter- aperture separation.
  • First sampling lens 142 can be configured to move in. cooperation with first aperture 128 and second sampling lens 144 can be configured to move in cooperation with second aperture 130, The cooperative motion ensures that images 134 and 136 remain mutually positioned as before.
  • the combined structure of front lens assembly 124 and rear lens assembly 126 form a double-Gauss lens.
  • Double-Gauss optical designs axe known in the art for their superlative performance in respect of keeping optical aberration in the system very low.
  • the use of double Gauss lenses is well established in the field of wide-aperture lenses on standard 35mm cameras.
  • the focal lengths of the first sampling lens 142 and the second sampling lens 144 can be less than half the focal length of the combination of the front lens assembly 124 and the rear lens assembly 126 in the absence of the first sampling lens 142 and the second sampling lens 144.
  • the focal length of the combination of the front lens assembly 124, the rear lens assembly 126 and one of the fi rst sampling lens 142 and second sampling lens 144 can be less than the focal length of the combination of the front lens assembly 124 and the rear lens assembly 126 in the absence of the first sampling lens 142 and the second sampling lens 144,
  • Sampling lenses 142 and 144 can each have a positive power.
  • tens 102 without the sampling lenses 142 and 144 can have a focal length of 126 mm.
  • Sampling lenses 142 and 144 can each have a focal length of 44 nun.
  • the combined lens 102 will have a resulting focal length of 60 mm.
  • the arrangement allows a 60mm lens to employ a larger inter-aperture distance that is appropriate to a much larger 126 nun lens with an associated larger entrance pupil. The consequence is a much larger stereopsis attainable with the 60 mni lens arrangement than what might be expected from a typical 60 mm lens with its wider angle and its naturally larger field of view. It combines the benefits of the 126 mm lens with those of a 60mm lens as regards three-dimensional imaging applications.
  • the combined structure of front lens assembly 124 and rear lens assembly 126 can allow the lens 102 to be a zoom lens for changing the sizes of images 134 and 136 on imaging sensor 132. in other embodiments of the invention yet further lens combinations are possible for the front lens assembly 124 and rear lens assembly 126.
  • the apparatus allows for the lens 102 to function as one or both of a zoom and a macro lens. This is a major benefit compared with several systems described in the prior art,
  • the single optical path arrangement also makes the apparatus compact and the absence of mirrors in some embodiments makes it robust and durable.
  • the single optical path arrangement also makes the invention compatible with commercial and consumer camera and video equipment.
  • the stereoscopic imaging apparatus 100 of the present invention does not create a real image of the object 100 between either the first or the second sampling lens 142 or 144 and rear lens assembly 126, This reduces the complexity of the sampling lens arrangement as compared with a system that forms an image after the sampling lenses and then relays it.
  • the stereoscopic imaging apparatus 100 samples light from the first and second portions of the optical path simultaneously and, unlike many prior art single channel stereoscopic imaging devices, can simultaneously create the first and second images 134 and 136 on imaging sensor 132,
  • the stereoscopic imaging apparatus 100 also holds the benefit of not requiring any polarization of the light from the object in order to operate. This impl ies that light levels are more than doubled in comparison with polarization based systems.
  • the double Gauss arrangement of lens 102 provides a high-speed lens system with excellent aberration peiforman.ce over a large area of imaging sensor 132.
  • the invention allows the use of industry standard imaging sensors since the vertical compression ensures that both the image 134 and the image 136 can fit on an imaging sensor that would, in the absence of the invention, have been, used for one of the two images.
  • the invention is not prescriptive in respect of the format of the sensor and is applicable to all imaging sensor aspect ratio and size formats.
  • the imaging sensor 132 can be the sensor in a "black box" of a standard commercial digital SLR (D-SLR) camera, such as but not limited to a Nikon D50, produced by the Nikon Corporation of Japan.
  • D-SLR digital SLR
  • This particular commercial D-SLR camera comprises a sensor that has 3008 pixels resolution in the horizontal direction and 2000 pixels in the vertical direction.
  • the arrangement can capture a stereoscopic image pair arranged one above the other along the vertical dimension. Ideally the images substantially abut each other and do not overlap to a degree that is objectionable to the user, the compression along the vertical dimension being substantially 50%.
  • Each of the two images is of size 3008x 1000 and the vertical dimension of each of the two images is substantially half of its natural dimension. It is a simple matter to resaniple each of the two images to 3008x2000 after downloading the image from the camera. Many graphics software tools exist to allow the user to do such resampling, even though the real resolution in the vertical dimension for each of the images remains half of what the camera is inherently capable of. The sacrifice of resolution along the vertical dimension is more than compensated for by the benefit of an apparatus thai inherently captures stereoscopic images of any scene in an easy to use format.
  • Figure 2 is a flow chart of a method for forming on the imaging sensor 132 of Figure 1 a stereoscopic image pair, the image pair comprising the first image 134 and the second image 136 providing two different perspectives of the object 1 16 within the field of view of a first lens, being the front lens assembly 124 of Figure 1, disposed along the optical axis 103,
  • the method comprises gathering [200] through the front lens assembly 124 light from a scene in the field of view of front lens assembly 124; directing [210] the gathered light along a single optical path generally about the optical axis 103 to the aperture plane 104; anamorphically magnifying [220] the image content of the light by means of at least one anamorphic lens, being either anamorphic element 110 or first and second sampling lenses 142 and 144; sampling [230] light from a first portion of the single optical path through first aperture 128 disposed proximate the aperture plane 104 and on a first side of the optical axis 103; simultaneously sampling [235] light from a second portion of the single optical path through the second aperture 130' disposed proximate the aperture plane 104 and on an opposite side of the optical axis 103 from the first aperture 128; and forming on the imaging sensor 132 disposed along the optical axis 103 first and second images 134 and 136 from respectively the light sampled from the first portion of the single imaging path and the
  • the first image 134 by processing the light sampled from the first portion of the single optical path through a second lens, being the rear lens assembly 126 of figure 1 , disposed on the optical axis 103; and the forming [245] the second image 1.36 by processing the light sampled by second sampling lens 144 from the second portion of the single optical path through the second lens, being the rear lens asseniblv 126.
  • the method further comprises routing [250] the light from the first aperture 128 and routing [255] the light from the second aperture 130 via respectively sampling lenses 142 and the sampling lenses 142 and 144 being disposed proximate, overlapping and. abaxial with respectively the first aperture 128 and the second aperture 130.
  • the method can further comprise at least one of varying a depth of field for the first image 134 by varying [260] the size of the first aperture 128 in the aperture plate 108; and varying a depth of field for the second image 136 by varying [265] the size of the second aperture 130 in the aperture plate 108.
  • the method can further comprise changing the perspective difference between the two images 134 and 136 by changing [270] the inter-aperture separation between first aperture 1.28 and second aperture 130 in the aperture plate 108,
  • the method can further comprise extracting [280] the data describing first and second, images 1.34 and 136 from imaging sensor 132 using controller 115 via image data output connection 117 and digitally restoring the original aspect ratios of images 1.34 and 136 using, for example, controller 115.
  • Stereoscopic optical subsystem 150 comprising anamorphic el.em.ent 110, aperture plate 108 with apertures 128 and 1.30, sampling lenses 142 and 144, and rear lens assembly 126 can be applied to many different optical apparatus to generate stereoscopic images.
  • the apparatus described in Figure 1 in particular is configured to serve, among other applications, as a camera or video camera as described above.
  • the front lens assembly 124 shown in Figure 1. can be a microscope lens system. All elements remain as in Figure I and retain the same numbering.
  • Stereoscopic optical, subsystem 1.50 remains the same as in the embodiment described, in Figure 1.
  • the microscope lens system can be any of a wide variety of monoscopic microscope systems.
  • lenses 118 and 1.20 together can be the objective lens system, of the microscope lens system, while lens 122 can be the ocular lens of the microscope lens system.
  • lens system 122 can be chosen to manipulate the image-bearing light to suit the input requirements of different further optical subsystems.
  • Stereoscopic optical subsystem 150 is one such further optical subsystem.
  • the application of stereoscopic optical subsystem 150 to a microscope can be as part of the inherent design of the microscope, or can be a post- manufacturing addition by the user and can be carried out in the field.
  • Endoscopic lens system 160 can be any of a wide variety of single channel endoscopic systems.
  • endoscopic lens system 160 can comprise, as shown specifically in Figure 3. an objective lens system 162; a relay lens system 164; and, optionally, an exit lens system 166.
  • an objective lens system 162 In operation, light gathered from within the field of view of the endoscopic objective lens system 162 is imaged by objective lens system. 162 and the image thus formed is relayed by relay lens system 1.64 along the length of the endoscope lens system 160.
  • Optional exit lens system 166 can be chosen to manipulate the image-bearing light to suit the input requirements of different further optical subsystems.
  • Stereoscopic optical subsystem 150 is one such further optical subsystem.
  • exit lens system 166 can be the ocular lens of an endoscope that comprises endoscope lens system 160.
  • the application of stereoscopic optical subsystem 150 to an endoscope can be as part of the inherent design of the endoscope, or can be a post- manufacturing addition by the user and can be carried out in the field.
  • front lens assembly 1.24 of Figure 1 can be the objective lens assembly of an endoscope and be located at the probe tip of the insertion part of an endoscope, while stereoscopic optical subsystem. 150 and sensor 132 can both be located in the insertion part proximate the front lens assembly 124.
  • This is popularly referred to as the "chip on a stick" implementation of endoscopes.
  • This impleinen.tati.on therefore provides a stereoscopic endoscope of simplicity suitable for incorporation within the narrow confines of the insertion part of the endoscope.
  • the absence of any modulators - particularly mechanical modulators - within stereoscopic optical subsystem 150 facilitates this particular implementation.
  • the anamorphic element 11.0 can be disposed on the optical axis 103 between the sampling lenses. 142 and 144 and the rear lens assembly 126, In other embodiments the anamorphic element 110 can be disposed inside of rear lens assembly 126 or between lens assembly 126 and sensor 132, In yet further embodiments, anamorphic element 110 can be omitted and sampling lenses 142 and 144 can be made anamorphic for compressing images 134 and 138 by substantially 50% in the vertical dimension.
  • the stereoscopic imager employs a single first objective lens that directs light through at least one anamorphic lens along a single optical path generally about the optical axis 103 to a single sensor 132 without modulating the light. While the exit pupil of the front lens assembly 124 is sampled by the combinations of apertures 128 and 130 and their corresponding sampling lenses 142 and 144, no reflective, prism, or other beam-splitting components are required.
  • the stereoscopic imager provided in this specification anamorphically alters two images with different perspectives of a field of view of an. objective lens, while maintaining max imal resolution in the horizontal dimension for associated maximal stereoscopic quality. Though the images 134 and 136 as formed on imaging sensor 132 lose substantially 50% of their resolution in the vertical compression by the anamorphic lens(es), the desired stereoscopic viewing experience is based on perspective differences in the horizontal dimension, as opposed to the compressed vertical.
  • sensor 132 can be oriented in the portrait orientation with its long axis in the vertical, and anamorphic lens(es) can be chosen to compress images 142 and 144 along the horizontal dimension to fit the sensor 132 which, in the case of a 4x3 sensor, will be in what is effectively a 3x4 orientation. This can be advantageous in applications where greater vertical resolution may be desirable and some relative loss of horizontal resolution is acceptable,
  • the invention may be combined with the subject matter of our provisional application no. 61 /586,738, entitled SINGLE AXIS STEREOSCOPIC IMAGING APPARATUS WITH DUAL SAMPLING LENSES filed on January 13. 2012 and incorporated herein by reference.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Chemical & Material Sciences (AREA)
  • Analytical Chemistry (AREA)
  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Ophthalmology & Optometry (AREA)
  • Radiology & Medical Imaging (AREA)
  • Surgery (AREA)
  • Stereoscopic And Panoramic Photography (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Studio Devices (AREA)
  • Lenses (AREA)
PCT/CA2013/050019 2012-01-13 2013-01-11 Single optical path anamorphic stereoscopic imager WO2013104075A1 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
KR1020147022684A KR101699597B1 (ko) 2012-01-13 2013-01-11 단일 광 경로 배축적 입체영상 이미징 장치
EP13735837.0A EP2802927A4 (en) 2012-01-13 2013-01-11 ANAMORPHOTIC STEREOSCOPIC IMAGEER WITH A SINGLE OPTICAL PATH
CN201380014138.0A CN104254801A (zh) 2012-01-13 2013-01-11 单光路变形立体成像器

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201261586736P 2012-01-13 2012-01-13
US61/586,736 2012-01-13

Publications (1)

Publication Number Publication Date
WO2013104075A1 true WO2013104075A1 (en) 2013-07-18

Family

ID=48781004

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CA2013/050019 WO2013104075A1 (en) 2012-01-13 2013-01-11 Single optical path anamorphic stereoscopic imager

Country Status (4)

Country Link
EP (1) EP2802927A4 (zh)
KR (1) KR101699597B1 (zh)
CN (1) CN104254801A (zh)
WO (1) WO2013104075A1 (zh)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160344955A1 (en) * 2015-05-18 2016-11-24 The Boeing Company Multi-directional, Multi-spectral Star Tracker with a Common Aperture and Common Camera
US10114279B2 (en) 2016-09-30 2018-10-30 Hyundai Motor Company Vehicle headlamp for projecting driving information

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106772982A (zh) * 2015-11-20 2017-05-31 南京理工大学 一种体视显微成像装置及方法

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3551036A (en) 1965-10-25 1970-12-29 Comitetul De Stat Pentru Cultu Method and apparatus for stereoscopic photography
US4509832A (en) * 1980-12-08 1985-04-09 Walter Meier Optical arrangement for producing two anamorphotically compressed images correlated by an interocular base distance
US5743846A (en) * 1994-03-17 1998-04-28 Olympus Optical Co., Ltd. Stereoscopic endoscope objective lens system having a plurality of front lens groups and one common rear lens group
US5835133A (en) * 1996-01-23 1998-11-10 Silicon Graphics, Inc. Optical system for single camera stereo video
US5835132A (en) * 1994-06-29 1998-11-10 Sanyo Electric Co., Ltd. Stereo-graphic system
US7181136B2 (en) * 2002-01-17 2007-02-20 Zoran Perisic Apparatus for stereoscopic photography
WO2007095307A1 (en) 2006-02-13 2007-08-23 3M Innovative Properties Company Monocular three-dimensional imaging
US7372642B2 (en) * 2006-02-13 2008-05-13 3M Innovative Properties Company Three-channel camera systems with non-collinear apertures
US20080151041A1 (en) * 2006-12-21 2008-06-26 Intuitive Surgical, Inc. Stereoscopic endoscope
WO2011049195A1 (ja) 2009-10-23 2011-04-28 オリンパスメディカルシステムズ株式会社 立体撮影用対物光学系および内視鏡

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5122650A (en) * 1991-04-18 1992-06-16 Mckinley Optics, Inc. Stereo video endoscope objective lens system
JPH10155164A (ja) * 1996-11-21 1998-06-09 N H K Technical Service:Kk ステレオ・テレビジョン・システムおよび立体表示方法
CN101588512B (zh) * 2009-01-07 2011-06-08 深圳市掌网立体时代视讯技术有限公司 一种立体摄像装置及方法

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3551036A (en) 1965-10-25 1970-12-29 Comitetul De Stat Pentru Cultu Method and apparatus for stereoscopic photography
US4509832A (en) * 1980-12-08 1985-04-09 Walter Meier Optical arrangement for producing two anamorphotically compressed images correlated by an interocular base distance
US5743846A (en) * 1994-03-17 1998-04-28 Olympus Optical Co., Ltd. Stereoscopic endoscope objective lens system having a plurality of front lens groups and one common rear lens group
US5835132A (en) * 1994-06-29 1998-11-10 Sanyo Electric Co., Ltd. Stereo-graphic system
US5835133A (en) * 1996-01-23 1998-11-10 Silicon Graphics, Inc. Optical system for single camera stereo video
US7181136B2 (en) * 2002-01-17 2007-02-20 Zoran Perisic Apparatus for stereoscopic photography
WO2007095307A1 (en) 2006-02-13 2007-08-23 3M Innovative Properties Company Monocular three-dimensional imaging
US7372642B2 (en) * 2006-02-13 2008-05-13 3M Innovative Properties Company Three-channel camera systems with non-collinear apertures
US20080151041A1 (en) * 2006-12-21 2008-06-26 Intuitive Surgical, Inc. Stereoscopic endoscope
WO2011049195A1 (ja) 2009-10-23 2011-04-28 オリンパスメディカルシステムズ株式会社 立体撮影用対物光学系および内視鏡

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP2802927A4 *

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160344955A1 (en) * 2015-05-18 2016-11-24 The Boeing Company Multi-directional, Multi-spectral Star Tracker with a Common Aperture and Common Camera
US10070080B2 (en) * 2015-05-18 2018-09-04 The Boeing Company Multi-directional, multi-spectral star tracker with a common aperture and common camera
US10114279B2 (en) 2016-09-30 2018-10-30 Hyundai Motor Company Vehicle headlamp for projecting driving information

Also Published As

Publication number Publication date
EP2802927A1 (en) 2014-11-19
KR101699597B1 (ko) 2017-01-24
CN104254801A (zh) 2014-12-31
KR20140130439A (ko) 2014-11-10
EP2802927A4 (en) 2015-08-19

Similar Documents

Publication Publication Date Title
US8077964B2 (en) Two dimensional/three dimensional digital information acquisition and display device
JP5814692B2 (ja) 撮像装置及びその制御方法、プログラム
WO2002078324A2 (en) Stereoscopic camera with only one digital image sensor
JP6031755B2 (ja) 立体画像撮像装置
CN109310278A (zh) 图像处理装置、图像处理方法、程序和图像处理系统
JP2006208407A (ja) 立体画像観察用顕微鏡システム
CA3086592A1 (en) Viewer-adjusted stereoscopic image display
JP6036840B2 (ja) 撮像装置、画像処理装置、撮像装置の制御プログラムおよび画像処理装置の制御プログラム
WO2013104075A1 (en) Single optical path anamorphic stereoscopic imager
JP2010231192A (ja) ステレオ撮像装置
CN102466961B (zh) 合成长焦段立体影像的方法及立体成像系统
US20100073464A1 (en) Method and apparatus for creating and displaying a three dimensional image
KR100753512B1 (ko) 입체 영상 디스플레이 기능을 갖는 모바일 기기 및 이를이용한 입체 영상 디스플레이 방법
US20160363852A1 (en) Single axis stereoscopic imaging apparatus with dual sampling lenses
JP2007288229A (ja) 画像撮影装置
WO2012117619A1 (ja) 立体画像撮像装置
WO2012001958A1 (ja) 画像処理装置および方法並びにプログラム
JP5452800B2 (ja) 立体像撮影装置
WO2015163350A1 (ja) 画像処理装置、撮像装置及び画像処理プログラム
KR102377499B1 (ko) 뷰어-조정식 입체 이미지 디스플레이
KR20140098040A (ko) 입체 동영상 촬영용 장치 및 카메라
JP4420315B2 (ja) 立体内視鏡及び立体内視鏡システム
JP6036784B2 (ja) 画像処理装置、画像処理方法および画像処理プログラムならびに記録媒体
JP3849910B2 (ja) 両眼視差像撮像用アダプターレンズ及びそれを用いた立体像撮像装置、立体像撮像・観察システム
KR101433645B1 (ko) 입체 동영상 촬영용 장치 및 카메라

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 13735837

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 2013735837

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 20147022684

Country of ref document: KR

Kind code of ref document: A