KR101699597B1 - Single optical path anamorphic stereoscopic imager - Google Patents

Abstract

A stereoscopic imaging device for generating a pair of monocular image images on a single imaging sensor from light acquired along a single optical path through a single optical axis front lens assembly through two apertures on opposite sides of the optical axis of the front lens assembly / RTI > The anamorphic element changes the aspect ratio of the pair of stereoscopic images to fit the two images, one on top of the other and the other vertically compressed to substantially 50%, on the same sensor. A pair of overlapping, doubly positioned sampling lenses close to the associated apertures enable the orientation of the images within the stereoscopic image pair to the respective positions on the sensor. A rear lens assembly is provided for physically forming the stereoscopic image pair on the sensor. The device may be integrated into other optical systems, including cameras, video cameras, endoscopes, and microscopes.

Description

[0001] SINGLE OPTICAL PATH ANAMORPHIC STEREOSCOPIC IMAGER [0002]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates generally to stereoscopic imaging, and in particular, to changing the aspect ratio of a stereoscopic image pair of a scene generated along other portions of a single optical path.

The phenomenon of stereoscopic vision, or stereopsis, is directly related to the ability of humans and animals to have binocular vision that can sense depth in a scene. It is the effect of the perception induced by the human brain to process two sets of slightly different two-dimensional optical data at the same time. This phenomenon is based on the fact that the retinal images formed by the two eyes of the observer are slightly different, as experienced by untouched human observers. In the scene observed by the human observer, the point object is imaged at a slightly different position in the left retina image as compared to the image of the same scene on the right retina.

Initially the stereoscopic image image was created using images taken by two separate cameras. In the field of video-imaging, in particular, the work was centered on two complete imaging systems permanently integrated into a single stereoscopic viewer. Such viewers typically have a pair of subject optical subsystems that provide a dual optical axis and two optical paths. They typically have an optical axis for the field of view of the right eye and an optical axis for the field of view of the left eye to produce two perfect images for the right and left eye views side-by-side on the two imaging sensors.

If the images have a typical 4: 3 (horizontal: vertical) landscape view aspect ratio, then two imaging sensors of the aspect ratio for the best use of the area of the expensive sensor are required. Projecting the two images onto a single 4: 3 aspect ratio imaging sensor wastes a significant portion of the costly sensor. In order to efficiently employ a single sensor in such an arrangement, a specialized dual horizontal-width imaging sensor could be developed with an aspect ratio of 8: 3. Larger aspect ratio sensors such as 16: 9 do not allow two images of commercially acceptable aspect ratios to be captured side by side without a reduction in image size and the resulting waste of sensor surface in the vertical direction.

In some implementations, stereoscopic imaging systems have a single optical path near the sensing end of the array. Such viewers are mostly arranged such that the two images are alternately captured on the same sensor over time. This approach uses synchronized time division arrangements that allow only one of the two viewers to be imaged at a time on the imaging device. The reading and display equipment is arranged to alternately display one or the other of the left and right images at a rate that allows viewers of the display to clearly see successive displays of all of the images for the left and right eye . Such systems have additional burdens on the modulators on the board and the electronic components that can be of mechanical cut, light valve, or "liquid crystal" type to drive such modulators. For a particular image, this arrangement bisects the light available to the sensors, with negative consequences for the signal on the noise performance of the electro-optical circuit. There are additional transmission losses in the case of polarization or other filtering techniques.

Additional other single optical path stereoscopic imaging systems employ specialized sensors having two sets of sensing elements, a set sensing one characteristic of light in the same sensor region and a second set sensing light of a second characteristic. The characteristic may typically be polarized or colored. Images for both eyes are distinguished by being properly filtered based on polarization or color. Non-standard sensors employed in such devices remain a problem on the commercial stage.

The present invention aims to solve the above-mentioned problems or other problems.

In a first aspect of the present invention, there is provided a method of generating a plurality of images of a plurality of images of a plurality of monocular images from a light obtained through a single optical path through a front lens assembly having a single optical axis, A stereoscopic image imaging apparatus for forming on a single imaging sensor, the apparatus comprising: a first lens assembly disposed on opposite sides of an optical axis of the front lens assembly, proximate to an aperture surface of the front lens assembly, First and second apertures; At least one anvil element disposed within the single optical path; A first sampling lens positioned between the aperture surface and the sensor and proximate to and overlapping the first aperture; A second sampling lens positioned between the aperture surface and the sensor and proximate to and overlapping the second aperture; And a rear lens assembly disposed between the sampling lens and the sensor to form the first and second images from light received through the first and second sampling lenses on the sensor. Device is provided. The sampling lenses directing light received through the two apertures to form the first and second images at positions that do not substantially overlap each other on the imaging sensor through the rear lens assembly . The at least one anomalous element may be the two sampling lenses. In other embodiments, the at least one anomaly element may be a single anomaly element disposed on the optical axis. Wherein the first and second sampling lenses are arranged to vertically align on the imaging sensor through the rear lens assembly and to form the first and second images that do not substantially overlap, And can be arranged in a stacked manner. In other embodiments, the first and second sampling lenses are arranged on the imaging sensor horizontally laterally adjacent to each other through the rear lens assembly to form the first and second images, 1 and the second apertures, respectively.

The stereoscopic image imaging apparatus may be applied to an endoscope in which the front lens assembly is an endoscope front lens assembly. The stereoscopic image imaging apparatus may be applied to a microscope in which the front lens assembly is a microscope objective lens assembly. The first and second apertures may be changeable apertures including irises capable of varying the depth of the device. The separation between the apertures between the apertures can be adjusted to adjust the stereoscopic vision of the device. The sampling lens may be configured to move in cooperation with the apertures when the separation between the apertures is adjusted.

In another aspect of the present invention, there is provided a stereoscopic image imaging apparatus for forming a pair of distorted stereoscopic image images comprising a first image and a second image of a different view from the first image, A first lens assembly including at least an objective lens and configured to direct light from an effective field of view generally along a single optical path with respect to the optical axis; A single imaging sensor disposed along the optical axis behind the front lens assembly; First and second apertures disposed on opposite sides of the optical axis of the front lens assembly, the apertures being disposed proximate the aperture surface of the front lens assembly and separated by separation between the apertures; At least one anvil element disposed within the single optical path; A first sampling lens positioned between the aperture surface and the sensor and proximate to and overlapping the first aperture; A second sampling lens positioned between the aperture surface and the sensor and proximate to and overlapping the second aperture; And a rear lens assembly disposed between the sampling lens and the sensor to form the first and second images from light received through the first and second sampling lenses on the sensor. Device is provided. The front lens assembly and the rear lens assembly may form a double gauss lens.

Wherein the single aberration element is disposed in front of the front lens assembly, in the front lens assembly, between the sampling lenses and the rear lens assembly, between the rear lens assembly and the imaging sensor, .

The imaging sensor may be oriented in a horizontal viewing orientation having a long axis at a horizontal size, or at a horizontal viewing orientation having a long axis at a horizontal size.

In another aspect of the present invention, a method for forming a pair of simulated stereoscopic image images comprising first and second images on a single imaging sensor, the method comprising: collecting light from objects within an effective field of view; Directing the collected light generally along a single optical path with respect to the optical axis; Magnifying the image content of the light in a phased manner; Sampling light from a first portion of the single optical path through the first of the first and second apertures disposed on opposite sides of the optical axis proximate the aperture plane, Sampling light from a second portion of the single optical path through the first portion; And forming the first and second images from each of the light sampled through the first aperture and the light sampled through the second aperture on the single imaging sensor disposed along the optical axis Method is provided. Wherein the forming of the first and second images comprises for each of the light sampled through the second aperture through the second lens disposed between the apertures and the sensor and the light sampled through the first aperture, It can be processed. The method includes proximate to each of the first and second apertures to form the first and second images respectively at pre-set locations relative to each other, wherein the first and second sampling lenses And routing the light from the first and second apertures through each of the first and second apertures.

The routing may comprise shifting the centers of the two sampling lenses in a direction opposite to each other from the adjacent apertures. The step of magnifying the image may be a step of relatively compressing the image content of the collected light to substantially 50% in the vertical size, and the moving step comprises vertically overlapping the first and second 2 < / RTI > images. The step of magnifying the image may be a step of relatively compressing the image content of the collected light to substantially 50% in a horizontal size, and the moving step may be a step of horizontally side-by- And aligning the second images.

The method comprising the steps of: extracting data describing the first and second images from the single imaging sensor; extracting data describing the first and second images from the subject within a valid field of view prior to the step of magnifying the aspect ratio of the first and second images; To values belonging to the image content of the light of the light source.

The foregoing and other objects, features and advantages of the present invention will be apparent from the detailed description taken in conjunction with the accompanying drawings.
1 is a diagram illustrating a single optical path-distortion image stereoscopic apparatus.
2 is a flow diagram of a method for generating a stereoscopic image.
3 is a view showing a single optical patharray stereoscopic image endoscope.

Imaging sensors that have been proposed in the prior art have, for example, standard landscape view ratios of the industry of 4: 3 and 16: 9. However, these proposals typically require special modifications to be made on the sensors in the form of special lens shaped arrays or other complex means. This is far from the use of standard imaging sensors in mass-produced industries. Mass production of commercial Si-imaging sensors does not prepare for the assembly of non-standard equipment. Lower unit prices are based on mass production of standard size equipment with good yields due to smooth standard production. It is a low yield that is inherently incurred in non-routine production, as well as a shorter operating period to increase the price of non-standard equipment, and a proportionately higher set-up cost associated with it.

Thus, there remains a need for a stereoscopic image viewer that can accommodate single industry standard imaging sensors and simple, compact, robust optical designs to enable mass production while overcoming the limitations described herein.

According to a first aspect of the present invention there is provided a single optical path stereoscopic imaging device for simultaneously acquiring a pair of stereoscopic images for a scene on a single imaging sensor. In accordance with a first embodiment of the present invention, a stereoscopic imaging device, as schematically shown generally at 100 in FIG. 1, includes a lens 102 and a line (e.g., And an imaging sensor 132 positioned in the " landscape view "orientation on the image plane given by the lens 102 and receiving images from the lens 102. [ The lens 102 includes a front lens assembly 124 and a rear lens assembly 126. The front lens assembly 124 may direct the captured light within the effective field of view of the lens 124 to the aperture plane 104 of the lens 124. The aperture surface 104 may be a bonded body of a physical aperture surface or a physical aperture surface of the lens 102. The word "aperture surface" is used to describe any of the physical aperture faces and any of its junctions. For example, the front lens assembly 124 includes lenses 118, 120, 122, and similarly, the rear lens assembly 126 may include a plurality of lenses. For simplicity, the rear lens assembly 126 is schematically shown as a single lens.

An aperture plate 108 is disposed proximate to the aperture surface 104. The aperture plate 108 includes a first aperture 128 and a second aperture 130 disposed at either side of the optical axis 103 and separated from the horizontal plane by a distance between the apertures. The term "separation between apertures" is used herein to describe the distance from the center to the center between the two apertures 128,130. The term "horizontal" is used herein to denote orientation in a plane that includes the line between the optical axis 103 and the centers of the apertures 128 and 130. The word "vertical" is used to describe the direction perpendicular to the plane including the line between the optical axis 103 and the centers of the apertures 128 and 130. In Figure 1, 'vertical' is shown as line 138.

The lens 102 includes a first sampling lens 142 positioned adjacent to and overlapping the first aperture 128 and positioned between the aperture 104 and the sensor 132. The lens 102 is disposed adjacent to and overlapped with the second aperture 130 on a substantially same plane as the first sampling lens 142 orthogonal to the optical axis 103, And a second sampling lens 144 positioned between the first and second sampling lenses 132 and 132. The first sampling lens 142 manipulates the light captured in the first perspective within the effective field of view of the lens 102 by the front lens assembly 124. The second sampling lens 144 operates the light captured by the front lens assembly 124 at the second time within the effective field of view of the lens 102. [ Thus, the first sampling lens 142 generally samples light from a first portion of the optical path with respect to the optical axis 103, while the second sampling lens 144 samples light from a second portion of the same optical path The light is sampled. The light from the first sampling lens 142 is incident on the rear lens assembly 126 to form a first image 134 at a first time relative to the subject 116 disposed within the effective field of view of the lens 102. [ The image is imaged onto the imaging sensor 132 by the imaging sensor 132. The light from the second sampling lens 144 is reflected by the rear lens assembly 126 onto the imaging sensor 132 to form a second image 136 of a second time for the subject 116 Lt; / RTI >

In one embodiment, an anamorphic element 110, such as a lens, is disposed between the front lens assembly 124 and the aperture surface 104. This ensures that any images generated on the sensor 132 from the light traveling through the apertures 128,130 are the anomaly images of the subject 116. [ In a more general practice, the aberration element 110 may be disposed in front of the front lens assembly 124 or inside the front lens assembly 124.

In one embodiment, the aberration element 110 has a magnification of substantially 50% horizontally relative to vertical. This ensures that any images formed from light traveling through the apertures 128,130 are compressed to substantially 50% in horizontal size.

In another embodiment, the aberration element 110 has a magnification of substantially 50% vertically relative to the horizontal. This ensures that any images formed from light traveling through the apertures 128,130 will be compressed to substantially 50% in vertical size.

Although the above description is based on a parabolic element 110 in the form of a lens, diffractive or reflective optical elements of different refractive index may be employed to provide appropriate distortion of the first and second images 134, 136 .

The problem of directing the images 134,136 so that they do not overlap on the sensor 132 can be said to place the sampling lenses 142,144 so as to be abaxial to each of the apertures 128,130. FIG. 1 discloses an embodiment employing an anvil element 110 with substantially 50% vertical compression. The degree of defocusing of the sampling lenses 142 and 144 is exaggerated in FIG. 1 for clarity. The word " deficiency "is used herein to describe mutual orientation. The axes through the centers of the first aperture 128 and the first sampling lens 142 are parallel but not coincident. Is used to describe a perpendicular distance between an axis passing through the center of the first aperture 128 and an axis passing through the center of the first sampling lens 142. [ The direction and size of the movement of the second sampling lens 144 from the optical axis of the second aperture 130 are determined by the direction and size of the movement of the first sampling lens 142 from the optical axis of the first aperture 130 Direction and size.

1, the axes of the sampling lenses 142 and 144 are not only moved along the horizon but also for the images 134 and 136 to generate specially images 134 and to be horizontally aligned, And is moved vertically in the opposite direction so as not to overlap substantially. As a result, they may be arranged so that they are vertically aligned and not superimposed, but they are substantially pairs of adjacent stereoscopic image images along their opposing horizontal perimeters. This arrangement enables optimal use of the sensor pixel distribution. In a more general case, the two images 134 and 136 need not be adjacent to each other.

In the case of the selected aberration element 110 having a relative horizontal magnification of substantially 50%, the axes of the sampling lenses 142 and 144 are each moved only in horizontal magnitude from the axes of the apertures 128 and 130, 134, 136) are arranged on the sensor (132) for optimal use of the sensor element distribution on the sensor (132), so as not to be substantially overlapped by it and to abut along their opposing vertical perforations As shown in FIG. In a more general case, the two images 134 and 136 need not be adjacent to each other. If the images 134,136 are not perfectly aligned for some other reason, the vertical placement of the sampling lenses 142,144 may be adjusted slightly to rearrange the images. The use of double-stacked sampling lenses avoids the use of expensive custom-made imaging sensors and allows for control over the placement of the images 134,136.

Within the range in which the first image 134 and the second image 136 represent different times of the subject 116, they may be employed to obtain three-dimensional (3D) information about the subject 116 It is possible. More specifically, the controller 115 may extract image data representative of the two images 134, 136 from the imaging sensor via the image data output connection 117. [ The controller 115 may digitally process the images to restore the original aspect ratio according to the optical image information content of the light from the effective field of view of the front lens assembly 124 before entering the anamorphic lens. Whereby the stereoscopic image pair is provided in a format suitable for a three-dimensional display or viewing system (not shown). The imaging sensor 132 may be a single array imaging sensor including a CCD (Charge Coupled Device). However, it is not limited thereto.

When the imaging data is extracted from the sensor 132 for further processing and display, a portion of the vertical axis data from the sensor 132, when returned to the substantially 50% vertical compression run, (136) and another portion of the vertical axis data from the sensor (132) is associated with the image (134). Based on this difference, the two images 136,134 can be extracted separately from the sensor 132. [

The degree of stereopsis achievable with a three-dimensional imager basically depends on the angular difference between the two views used to create the three-dimensional views and to create the images. The special use of the sampling lenses 142,144 during production of the entire lens system with the short focal length still given by the lens 102 in this description is greater than the large front lens assembly 142,144, RTI ID = 0.0 > 124 < / RTI > This allows the lens 102 to employ small and inexpensive imaging sensors. The distance between the apertures 128 and 130 is greater than that achievable in 3D imaging devices employing small imaging sensors with conventional imaging lens placement. As a result, a stereoscopic vision greater than that achievable with conventional lenses applied to similar imaging sensors can be obtained. This is particularly relevant in camera applications where it is difficult to obtain adequate stereoscopic vision.

In some embodiments of the present invention, apertures 128 and 130 may be variable apertures that include irises to provide the ability to vary the depth of lens 102. However, it is not limited thereto. In some embodiments, the apertures 128 and 130 may be fixed apertures. In other embodiments, the first and second apertures 128, 130 may be configured to be able to change the stereoscopic vision of the imaging device by varying the separation between the apertures. The first sampling lens 142 may be configured to move in cooperation with the first aperture 128 and the second sampling lens 144 may be configured to move in cooperation with the second aperture 130. The cooperative movement can ensure that the images 134,136 are positioned one above the other as before.

In one embodiment, the combined structure of the front lens assembly 124 and the rear lens assembly 126 forms a double-Gauss lens. Double-Gaussian optical designs are known in the art for their best performance in keeping optical aberrations very low in systems. The use of double gauss lenses is well established in the field of wide-aperture lenses in standard 35mm cameras. The focal lengths of the first sampling lens 142 and the second sampling lens 144 are set such that the focal lengths of the front lens assembly 124 and the rear lens 144, May be less than half the focal length of the combination of assemblies 126. With the selection of the focal lengths, the focal length of the combination of the front lens assembly 124, the rear lens assembly 126, and either the first sampling lens 142 or the second sampling lens 144, The focal length of the combination of the front lens assembly 124 and the rear lens assembly 126 when the lens 142 and the second sampling lens 144 are absent.

Each of the sampling lenses 142 and 144 may have a positive power. For example, the lens 102 without the sampling lenses 142 and 144 may have a focal length of 126 mm. The sampling lenses 142 and 144 may each have a focal length of 44 mm. Based on these selections, the combined lens 102 will eventually have a focal length of 60 mm. This arrangement allows a 60 mm lens to adopt a larger aperture distance that is applied to a much larger 126 mm lens with larger associated entrance pupil. As a result, the stereoscopic vision obtained with the 60 mm lens arrangement is larger than can be expected from a typical 60 mm lens with a wider angle and naturally a larger effective field of view. It combines the advantages of a 126mm lens with the benefits of a 60mm lens in conjunction with 3D imaging applications.

The combined structure of the front lens assembly 124 and the rear lens assembly 126 is such that the lens 102 can be used as a zoom lens for changing the size of the images 134 and 136 on the imaging sensor 132. [ . In still other embodiments of the present invention, additional lens combinations are possible for the front lens assembly 124 and the rear lens assembly 126. Because of the single optical path arrangement, the device allows the lens 102 to function as both a zoom and macro lens or as one of them. This is a major advantage compared to some systems described in the prior art. The single optical path arrangement may also make the device compact in some embodiments, allow the mirrors to be removed, and be robust and durable. The single optical path arrangement also makes the present invention compatible with commercial cameras and video equipment as well as consumer cameras and video equipment.

1, a stereoscopic image imaging apparatus 100 according to the present invention includes a stereoscopic image capturing apparatus 100 for capturing an image of an object 100 between one of first or second sampling lenses 142 and 144 and a rear lens assembly 126, You will notice that you are not creating an image. This reduces the complexity of the sampling lens arrangement compared to a system that forms an image after the sampling lenses and delivers it again. Unlike many conventional single-channel stereoscopic imaging devices, the stereoscopic imaging apparatus 100 simultaneously samples light from the first and second portions of the optical path and provides first and second Images 134 and 136 can be generated at the same time. In addition, the stereoscopic image imaging apparatus 100 has an advantage in that it does not require any light polarization from the subject to operate. This implies that the light level is more than double as compared to a polarization based system. The double Gauss arrangement of the lens 102 provides a high speed lens system with excellent aberration performance over a large area of the imaging sensor 132.

Since the vertical compression ensures that both the image 134 and the image 136 are aligned on the imaging sensor that would have been used for one of the two images in the absence of the present invention, Can be used. The present invention is not limited to the format of the sensor, but is applicable to all imaging sensor aspect ratio and size formats.

In an actual application of the present invention, the imaging sensor 132 may be a sensor in a "black box" of a standard commercial digital SLR (D-SLR) such as NiKon D50 produced by Nikon Corporation of Japan. However, the present invention is not limited thereto.

This particular commercial D-SLR camera includes a sensor with a resolution of 3008 pixels in the horizontal direction and 2000 pixels in the vertical direction. With the lens 102 according to the preceding embodiments mounted on the D50 D-SLR camera, the arrangement can capture a pair of stereoscopic images in which the other one is arranged along the vertical size. Ideally, the images are substantially adjacent to one another and do not uncomfortably overlap the user, and the compression according to the vertical size is substantially 50%. Each of the two images is 3008x1000 size and the vertical size of each of the two images is substantially half of its natural size. It is a simple matter to download the image from the camera and then resample each of the two images to 3008x2000. Even though the actual resolution at the vertical size for each of these images is half of what the camera can do in nature, there are many graphics software tools that allow the user to re-sample so. The sacrifice of the resolution according to the vertical size is largely compensated by the advantage of a device that can essentially capture stereoscopic images of all scenes in an easy-to-use format.

2 is a flow chart of a method for forming a stereoscopic image pair on the imaging sensor 132 of FIG. The image pair includes a first image 134 that provides two different views of the subject 116 within the effective field of view of the first lens being the front lens assembly 124 of Figure 1 disposed along the optical axis 103, And a second image (136).

The method includes collecting light from a scene through the front lens assembly (124) in an effective field of view of the front lens assembly (124); Directing the collected light along the single optical path to the aperture 104 generally relative to the optical axis 103; Anamorphically enlarging (220) the image content of the light to at least one anamorphic lens means, which is either the aberration element (110) or the first and second sampling lenses (142,144); Sampling (230) light from a first portion of the single optical path through a first aperture (128) disposed proximate the aperture surface (104) on a first side of the optical axis (103); From the second portion of the single optical path through the second aperture 130 disposed proximate to the aperture surface 104 on the opposite side of the optical axis 130 from the first aperture 128, A step 235 of sampling; And an imaging sensor (132) disposed along the optical axis (103) from light sampled from a first portion of the single optical path and sampled from a second portion of the imaging path, (134, 136); Processing the light sampled from the first portion of the single optical path through a second lens, which is the rear lens assembly 126 of Figure 1, disposed on the optical axis 103 to direct the first image 134 Forming [240]; And processing the light sampled by the second sampling lens 144 from the second portion of the single optical path through the second lens to be the rear lens assembly 126 to form the second image 136 Step [245].

The method includes the steps of providing a plurality of images 134 and 136 in close proximity to and overlapping each of the first aperture 128 and the second aperture 130 to form images 134 and 136, respectively, Includes routing light 250 from the first aperture 128 through each of the sampling lenses 142 and 144 to be disposed and routing light 255 from the second aperture 130.

The method further includes varying the depth of the first image (134) by changing the size of the first aperture (128) in the aperture plate (108) and changing the depth of the aperture plate Changing the depth of the second image 136 by varying the size of the second aperture 130 in the second aperture 136. In another embodiment,

The method may include extracting data 280 describing the first and second images 134 and 136 from the imaging sensor 132 using the controller 115 via the image data output connection 117 and extracting data Further comprising digitally restoring an original aspect ratio of the images (134,136) using the controller (115). Thus, the two images 134 and 136 having the restored aspect ratio constitute a pair of stereoscopic images, which may be appreciated by a suitable stereoscopic viewing apparatus.

A stereoscopic image optical subsystem 150, including an aberration element 110, an aperture plate 108 with apertures 128 and 130, sampling lenses 142 and 144, and a rear lens assembly 126, Lt; RTI ID = 0.0 > optical < / RTI > In particular, the device described in Figure 1 serves as a camera or video as described above among other applications. In a further embodiment, the front lens assembly 124 shown in FIG. 1 may be a microscope lens system. All components in FIG. 1 are numbered the same. The microscope lens system can be any of a variety of monoscopic microscope systems. By way of example and not limitation, the lens 122 may be an eyepiece lens of a microscope lens system, while the lenses 118,120 may together be an objective lens system of a microscope lens system. In operation, light collected within the effective field of view of the microscope objective system (including lens 118 and lens 120) is imaged onto the front of lens 122. Lens system 122 may be selected to manipulate the imaged light to match the input requirements of other additional optical subsystems. The stereoscopic image optical subsystem 150 is one of the additional optical subsystems. The application of the stereoscopic image optical subsystem 150 to the microscope may be part of the original design of the microscope, or may be added to the post-process by the user, or performed in the field.

In a further embodiment, the front lens assembly 124 of FIG. 1 may be replaced by a single optical channel endoscopic lens system 160, as shown schematically and unmodified in FIG. All components as in Fig. 1 are numbered the same. Endoscopic lens system 160 may be any of a variety of single channel endoscopic systems. By way of example and not limitation, the endoscopic lens system 160 includes an objective lens system 162, as shown specifically in FIG. 3; A relay lens system 164; And an exit lens system 166, as shown in FIG. In operation, light collected within the effective field of view of the endoscope objective system is imaged by the objective lens system 162, and the image thus formed is directed to the relay lens system 164 along the length of the endoscope lens system 160 Lt; / RTI > The optional emergent lens system 166 may be selected to manipulate the imaged light to match the input requirements of other additional optical subsystems. The stereoscopic image optical subsystem 150 is one of the additional optical subsystems. In such an arrangement, the exit lens system 166 may be an eyepiece of an endoscope including an endoscope lens system 160. The application of the stereoscopic image light subsystem 150 to the endoscope can be part of the original design of the endoscope, or can be added by the user in a post-process, and can also be performed in the field.

1, the front lens assembly 124 of FIG. 1 may be an objective lens assembly of an endoscope and may be located at a probe tip of an endoscope insertion portion, while the end lens assembly of FIG. Both of the stereoscopic image optical subsystem 150 and the sensor 132 may be located within the insert proximate the front lens assembly 124. This can be generally represented by a "chip on a stick" implementation of the endoscope. Thus, this embodiment provides a suitably simple stereoscopic endoscopy for coupling into the narrow space of the insertion portion of the endoscope. The absence of modulators, particularly mechanical modulators, within the stereoscopic optical subsystem facilitates this particular implementation.

In another embodiment, the aberration element 110 may be disposed on the optical axis 103 between the sampling lenses 142, 144 and the rear lens assembly 126. In other embodiments, the aberration element 110 may be disposed inside the rear lens assembly 126 or between the lens assembly 126 and the sensor 132. In still other embodiments, the aberration element 110 may be omitted and the sampling lenses 142,144 may be made fictitious to compress the images 134,138 at substantially a 50% substantial magnitude.

Without limiting the scope of the present invention, in all of the embodiments described above, the stereoscopic imaging apparatus is generally configured to include at least one aberration lens (not shown) along a single optical path with respect to the optical axis 103, So that it can be said to employ a single first objective lens that directs light to a single sensor 132 through a single first objective lens 132. [ While the exit pupil of the front lens assembly 124 is sampled by the combination of the apertures 128 and 130 and the corresponding sampling lenses 142 and 144. [ No reflections, prisms, or other beam-splitting elements are required. The stereoscopic image imaging apparatus provided herein changes the two images with different views of the effective field of view of the objective lens while maintaining the maximum resolution in the horizontal size for the maximum stereoscopic image quality involved. Although the images 134 and 136 are formed on the imaging sensor 136 and are vertically compressed by the aberration lens (s) to lose their resolution by substantially 50%, the desired stereoscopic viewing experience may be vertical It is based on differences in perspective in horizontal size versus compressed.

In another embodiment, the sensor 132 may be oriented vertically with a portrait orientation with its long axis, and in the case of a 4x3 sensor, the anisotropic lens (s) May be selected to compress the images 142,144 along a horizontal extent to fit the image 132. [ This can be an advantage in applications where larger vertical resolution is required and may tolerate loss of some horizontal resolution.

Remarks

The description related to the drawings is provided to illustrate embodiments of the present invention and does not limit the scope of the present invention. Reference in the specification to "one embodiment" or "an embodiment" is intended to indicate that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the invention. The appearances of the phrase " in one embodiment "or" an embodiment "in various places in the above specification are not necessarily all referring to the same embodiment. As used herein, the word "comprises" and its various forms of " comprising, "" including," ≪ / RTI > or steps.

It should also be noted that the above embodiments are disclosed as a process depicted as a flow chart, a flow diagram, a structure diagram, or a block diagram. Although many of the operations may be performed in parallel or concurrently, the flow chart may initiate various steps of operations as a continuous process. The steps shown are not intended to be limiting, but are merely exemplary and are not intended to indicate that each of the described steps is essential to the method.

In the foregoing specification, the invention has been described with reference to specific embodiments thereof. It will, however, be evident that various modifications and changes may be made thereto without departing from the broader spirit and scope of the invention. Accordingly, the specification and drawings are to be regarded in an illustrative rather than a restrictive sense. And the present invention should not be construed as being limited by such embodiments.

It is apparent from the foregoing description that the present invention has many advantages, some of which have been described herein, and the remainder are herein incorporated into the claimed inventions herein. It is also to be understood that the modifications may be made to the equipment, apparatus, and methods described herein without departing from the teachings of the invention described herein. As such, the invention is not limited to the embodiments described, except as required by the appended claims.

In the illustrated embodiment, the present invention may be combined with the content assigned to 61 / 586,738 as the name of a single optical stereoscopic imaging device with dual sampling lenses on January 13, 2012, and incorporated herein by reference.

100. Single optical stereoscopic imaging device
102. Lens
103. Optical axis
104. Aperture surface
108. Aperture Plate
110. An anomaly element
118. Lens
120. Lens
122. Lens
124. Front lens assembly
126. Rear lens assembly
128. First aperture
130. The second aperture
132. Imaging sensor
114. Image plane
116. Subject
134. First image
136. Second image
138. Vertical line
142. A first sampling lens
144. Second sampling lens
150. Stereoscopic optical subsystem
160. Endoscopic Lens System
162. Objective lens system
164. Relay lens system
165. Exit Lens System
115. Controller
117. Connecting image data output
[200] Collecting light from the effective field of view of the lens
[210] directing light along a single optical path
[220] Step of magnifying the image content of the image horizontally
[230] sampling light from a first portion of the single optical path with a first sampling lens
[235] sampling light from a second portion of the single optical path with a second sampling lens
[240] The step of forming the first image on the imaging sensor using the second lens (rear lens assembly 126)
[245] Step of forming a second image on the imaging sensor using the second lens (rear lens assembly 126)
[250] Routing light from a first aperture using a first deflection sampling lens
[255] routing the light from the second aperture using a second deflection sampling lens
[260] adjusting the depth of the first image by changing the size of the first aperture;
Adjusting the depth for the second image by changing the size of the second aperture
[270] Step of changing the separation between the apertures
[280] extracting data describing the first and second images from the sensor
[0030] The step of digitally restoring the initial aspect ratios of the first and second images

Claims (53)

A method for forming a pair of distorted stereoscopic image images comprising a first image and a second image at a different time from the first image on a single imaging sensor from light acquired along a single optical path through a front lens assembly having a single optical axis In a stereoscopic imaging apparatus,
First and second apertures disposed on opposite sides of the optical axis of the front lens assembly, the aperture being disposed proximate the aperture surface of the front lens assembly and separated by separation between the apertures;
At least one anvil element disposed within the single optical path for compressing the first image and the second image;
A first sampling lens positioned between the aperture surface and the sensor and proximate to and overlapping the first aperture;
A second sampling lens positioned between the aperture surface and the sensor and proximate to and overlapping the second aperture; And
And a rear lens assembly disposed between the first and second sampling lenses and the sensor to form the first and second images from the light received through the first and second sampling lenses on the sensor Dimensional image. The method according to claim 1,
Wherein the first and second sampling lenses are configured to receive the first and second apertures to form the first and second images at locations that do not substantially overlap each other on the imaging sensor through the rear lens assembly Wherein the stereoscopic imaging device is arranged to direct light received through the stereoscopic imaging device. The method according to claim 1,
Wherein the first and second sampling lenses are arranged on the imaging sensor via the rear lens assembly so as to form the first and second images that are aligned with one another and do not substantially overlap, Wherein the first and second imaging devices are arranged in a stacked manner. The method according to claim 1,
Wherein the first and second sampling lenses are arranged to horizontally side-align with each other on the imaging sensor through the rear lens assembly and to form the first and second images that do not substantially overlap, Wherein each of the at least one of the at least two of the at least two of the at least one of the at least two of the at least one of the at least two of the at least one processor. The method according to claim 1,
Wherein the at least one diaphragm element is a single anamorphic lens disposed on the optical axis between the first and second sampling lenses and the rear lens assembly. The method according to claim 1,
Wherein the at least one diaphragm element is a single anamorphic lens disposed on the optical axis between the rear lens assembly and the imaging sensor. The method according to claim 1,
Wherein the at least one diaphragm element is a single anamorphic lens disposed on the optical axis within the rear lens assembly. The method according to claim 1,
Wherein the at least one diagonal element is a single anamorphic lens disposed on the optical axis between the front lens assembly and the first and second sampling lenses. The method according to claim 1,
Wherein the first and second sampling lenses define the at least one anomaly element. The method according to claim 1,
Wherein the front lens assembly is an endoscope front lens assembly. The method according to claim 1,
Wherein the front lens assembly is a microscope objective lens assembly. The method according to claim 1,
Wherein the front lens assembly is a camera lens assembly. The method according to claim 1,
Wherein the first and second apertures are adjustable apertures. The method according to claim 1,
Wherein the separation between the apertures is adjustable. 15. The method of claim 14,
Wherein the first and second sampling lenses are configured to cooperate with the apertures when the separation between the apertures is adjusted. A stereoscopic image imaging device for forming a pair of aberrant stereoscopic image images comprising a first image and a second image of a different time from the first image, the device comprising:
A front lens assembly including at least an objective lens having an effective field of view and a single optical axis and configured to direct light from an effective field of view generally along a single optical path with respect to the optical axis;
A single imaging sensor disposed along the optical axis behind the front lens assembly;
First and second apertures disposed on opposite sides of the optical axis of the front lens assembly, the aperture being disposed proximate the aperture surface of the front lens assembly and separated by separation between the apertures;
At least one anvil element disposed within the single optical path for compressing the first image and the second image;
A first sampling lens positioned between the aperture surface and the sensor and proximate to and overlapping the first aperture;
A second sampling lens positioned between the aperture surface and the sensor and proximate to and overlapping the second aperture; And
And a rear lens assembly disposed between the first and second sampling lenses and the sensor to form the first and second images from the light received through the first and second sampling lenses on the sensor Dimensional image. 17. The method of claim 16,
Wherein the front lens assembly and the rear lens assembly form a double gauss lens. 17. The method of claim 16,
Wherein the first and second sampling lenses are configured to receive the first and second apertures to form the first and second images at locations that do not substantially overlap each other on the imaging sensor through the rear lens assembly Wherein the stereoscopic imaging device is arranged to direct light received through the stereoscopic imaging device. 17. The method of claim 16,
Wherein the first and second sampling lenses are arranged on the imaging sensor via the rear lens assembly so as to form the first and second images that are aligned with one another and do not substantially overlap, Wherein the first and second imaging devices are arranged in a stacked manner. 17. The method of claim 16,
Wherein the first and second sampling lenses are arranged to horizontally side-align with each other on the imaging sensor through the rear lens assembly and to form the first and second images that do not substantially overlap, Wherein each of the at least one of the at least two of the at least two of the at least one of the at least two of the at least one of the at least two of the at least one processor. 17. The method of claim 16,
Wherein the at least one diagonal element is a single anamorphic lens disposed on the optical axis between the first and second sampling lenses and the rear lens assembly. 17. The method of claim 16,
Wherein the at least one diaphragm element is a single anamorphic lens disposed on the optical axis between the rear lens assembly and the imaging sensor. 17. The method of claim 16,
Wherein the at least one diaphragm element is a single anamorphic lens disposed on the optical axis within the rear lens assembly. 17. The method of claim 16,
Wherein the at least one diagonal element is a single anamorphic lens disposed on the optical axis between the front lens assembly and the first and second sampling lenses. 17. The method of claim 16,
Wherein the at least one diagonal element is a single anamorphic lens disposed on the optical axis in front of the front lens assembly. 17. The method of claim 16,
Wherein the at least one diagonal element is a single anamorphic lens disposed on the optical axis within the front lens assembly. 17. The method of claim 16,
Wherein the first and second sampling lenses define the at least one anomaly element. 17. The method of claim 16,
Wherein the front lens assembly is an endoscope front lens assembly. 17. The method of claim 16,
Wherein the front lens assembly is a microscope objective lens assembly. 17. The method of claim 16,
Wherein the front lens assembly is a camera lens assembly. 17. The method of claim 16,
Wherein the first and second apertures are adjustable apertures. 17. The method of claim 16,
Wherein the separation between the apertures is adjustable. 33. The method of claim 32,
Wherein the first and second sampling lenses are configured to cooperate with the first and second apertures when the separation between the apertures is adjusted. 17. The method of claim 16,
Wherein the imaging sensor is oriented in a landscape orientation with a long axis at a horizontal size. 17. The method of claim 16,
Wherein the imaging sensor is oriented vertically with a long axis at a vertical size. A method for forming a pair of monoscopic image images comprising a first and a second image on a single imaging sensor from light acquired along a single optical path through a front lens assembly having a single optical axis,
Collecting light from objects in an effective field of view;
Directing the collected light generally along a single optical path with respect to the optical axis;
Exponentially enlarging image content of the light to compress the first image and the second image;
Sampling light from a first portion of the single optical path through the first of the first and second apertures disposed on opposite sides of the optical axis proximate the aperture plane, Sampling light from a second portion of the single optical path; And
The first and second images are formed by the rear lens assembly from the light sampled through the first aperture and the light sampled through the second aperture on the single imaging sensor disposed along the optical axis, ≪ / RTI > 37. The method of claim 36,
Wherein forming the first and second images comprises sampling through a first aperture and light sampled through a second aperture through a second lens disposed between the first and second apertures and the sensor, Lt; RTI ID = 0.0 > and / or < / RTI > 39. The method of claim 37,
Wherein each of the first and second apertures is proximate to each of the first and second apertures for respectively forming the first and second images at respective predetermined positions relative to each other, 0.0 > 1, < / RTI > and a second aperture. 39. The method of claim 38,
Wherein the routing includes moving the centers of the first and second sampling lenses in a direction opposite to each other from adjacent apertures. 40. The method of claim 39,
Wherein the step of magnifying the image relatively compresses the image content of the collected light to substantially 50% at a vertical size relative to a horizontal size,
Wherein the moving comprises aligning the first and second images with each other vertically on the sensor. 40. The method of claim 39,
Wherein the step of magnifying the image relatively compresses the image content of the collected light to substantially 50% at a horizontal size relative to the vertical size,
Wherein said moving comprises aligning said first and second images horizontally next to each other on said sensor. 39. The method of claim 38,
Wherein said step of magnifying is performed by said first and second sampling lenses. 37. The method of claim 36,
Wherein said step of magnifying is performed by a single aberration element disposed on said optical axis between a front lens assembly and an aperture surface of said front lens assembly. 37. The method of claim 36,
Wherein said step of magnifying is performed by a single aberration element disposed on said optical axis in front of said front lens assembly. 37. The method of claim 36,
Wherein said step of magnifying is performed by a single anamorphic lens disposed on said optical axis in said front lens assembly. 39. The method of claim 38,
Wherein the step of magnifying is performed by a single anamorphic element disposed on the optical axis between the first and second sampling lenses and the rear lens assembly. 37. The method of claim 36,
Wherein said step of magnifying is performed by a single anamorphic element disposed on said optical axis between said rear lens assembly and said imaging sensor. 37. The method of claim 36,
Wherein said step of magnifying is performed by a single anomaly element disposed on said optical axis in said rear lens assembly. 37. The method of claim 36,
Further comprising adjusting the depth for at least one of the first image and the second image by varying the size of the corresponding aperture at which light is sampled. 37. The method of claim 36,
Further comprising modifying a time difference between the first and second images by varying the separation between the apertures between the first aperture and the second aperture. 51. The method of claim 50,
Moving the positions of the first and second sampling lenses in cooperation with each of the first and second apertures while varying the separation between the apertures. 37. The method of claim 36,
Further comprising extracting data describing the first and second images from the single imaging sensor. 53. The method of claim 52,
Further comprising digitally restoring the values of the image content of the light from the subject within an effective field of view prior to the step of magnifying the aspect ratio of the first and second images.

Images