WO2018057935A1 - Dithered fiber-bundle imager and high-resolution imaging method - Google Patents
Dithered fiber-bundle imager and high-resolution imaging method Download PDFInfo
- Publication number
- WO2018057935A1 WO2018057935A1 PCT/US2017/053027 US2017053027W WO2018057935A1 WO 2018057935 A1 WO2018057935 A1 WO 2018057935A1 US 2017053027 W US2017053027 W US 2017053027W WO 2018057935 A1 WO2018057935 A1 WO 2018057935A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- bundle
- fiber
- proximal
- distal
- imager
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B23/00—Telescopes, e.g. binoculars; Periscopes; Instruments for viewing the inside of hollow bodies; Viewfinders; Optical aiming or sighting devices
- G02B23/24—Instruments or systems for viewing the inside of hollow bodies, e.g. fibrescopes
- G02B23/2476—Non-optical details, e.g. housings, mountings, supports
- G02B23/2484—Arrangements in relation to a camera or imaging device
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/00163—Optical arrangements
- A61B1/00165—Optical arrangements with light-conductive means, e.g. fibre optics
- A61B1/00167—Details of optical fibre bundles, e.g. shape or fibre distribution
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B23/00—Telescopes, e.g. binoculars; Periscopes; Instruments for viewing the inside of hollow bodies; Viewfinders; Optical aiming or sighting devices
- G02B23/24—Instruments or systems for viewing the inside of hollow bodies, e.g. fibrescopes
- G02B23/26—Instruments or systems for viewing the inside of hollow bodies, e.g. fibrescopes using light guides
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B26/00—Optical devices or arrangements for the control of light using movable or deformable optical elements
- G02B26/08—Optical devices or arrangements for the control of light using movable or deformable optical elements for controlling the direction of light
- G02B26/10—Scanning systems
- G02B26/103—Scanning systems having movable or deformable optical fibres, light guides or waveguides as scanning elements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
- H04N23/55—Optical parts specially adapted for electronic image sensors; Mounting thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/75—Circuitry for compensating brightness variation in the scene by influencing optical camera components
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B17/00—Surgical instruments, devices or methods
- A61B2017/00367—Details of actuation of instruments, e.g. relations between pushing buttons, or the like, and activation of the tool, working tip, or the like
- A61B2017/00398—Details of actuation of instruments, e.g. relations between pushing buttons, or the like, and activation of the tool, working tip, or the like using powered actuators, e.g. stepper motors, solenoids
- A61B2017/00402—Piezo electric actuators
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
- H04N23/555—Constructional details for picking-up images in sites, inaccessible due to their dimensions or hazardous conditions, e.g. endoscopes or borescopes
Definitions
- Fiber bundle-based imaging systems employ a bundle of coherent imaging fibers to transfer an image from a distal end, where the object is located, to a proximal end, where the image is either recorded on a detector or viewed by an observer.
- the major advantage of fiber bundle imaging systems is their inherent flexibility and ability to reach remote areas, such as those inside the human body, which are difficult to reach with conventional imaging systems.
- the spatial resolution and space-bandwidth product and number of pixels in the images are limited by the physical structure of the fiber bundle. Because the fiber bundle only passes light incident on the fiber cores, light incident on the claddings is lost, which results in lowered throughput and a structured fixed pattern noise in the images.
- the inherent sampling leads to potential aliasing of high spatial frequency information.
- the spatial resolution and space-bandwidth product (# of pixels) in the images are limited by the physical structure of the fiber bundle. Because the fiber bundle passes only light incident on the cores, light incident on the cladding is lost, which results in lowered throughput and a structured fixed pattern noise in the images. Moreover, the inherent sampling, due to the non-zero core-to-core spacing of adjacent fibers in the fiber bundle leads to the potential for aliasing of high spatial frequency information.
- a dithered fiber-bundle imager includes a fiber imaging bundle.
- the fiber imaging bundle includes (i) a plurality of optical fibers, (ii) a proximal bundle end exposing a respective proximal end of each of the plurality of optical fibers, and (iii) a distal bundle end exposing a respective distal end of each of the optical fibers.
- Each of the optical fibers have a respective optical axis parallel to (a) a proximal longitudinal direction at the proximal bundle end, and (b) a distal longitudinal direction at the distal bundle end.
- the imager also includes a first piezoelectric actuator configured to move a proximal device in a proximal plane orthogonal to the proximal longitudinal direction.
- the proximal device is one of (i) the proximal bundle end and (ii) a proximal lens.
- the imager also includes a second piezoelectric actuator configured to move a distal device in a distal plane orthogonal to the distal longitudinal direction, such that motion of the distal device and the proximal device are synchronized.
- the distal device is one of (i) the distal bundle end and (ii) a distal lens.
- a method for high-resolution imaging includes: (i) forming, via a first lens, a first image at a first bundle-end of a fiber imaging bundle that has a second bundle-end opposite the first bundle-end and (ii) forming, via a second lens, an image of the second bundle-end onto an image sensor.
- the method also includes (iii) vibrating the first bundle-end relative to the first lens to dither the first image, and (iv) synchronously vibrating, relative to the vibrating first bundle-end, the second bundle-end relative to the second lens.
- FIG. 1 is a schematic view of an embodiment of a dithered fiber-bundle imager in an embodiment of an imaging system where the fiber bundle is vibrated relative to lens and housing.
- FIG. 2 is a schematic view of how vibrating a lens off-center to a light path can shift or dither the resulting image.
- FIG. 3 is a schematic view of an embodiment of a dithered fiber-bundle imager in an embodiment of an imaging system where the lenses are vibrated and fiber bundle stationary in a housing.
- FIGs. 4A and 4B are respective plan views of a distal end and proximal end of a fiber imaging bundle of dithered fiber-bundle imager of FIG. 1, in an embodiment.
- FIG. 5 depicts an exemplary trajectory of the distal end and proximal end of the dithered fiber-bundle imager of FIG. 1, in an embodiment.
- FIG. 6 is a flowchart of a method of high-resolution imaging using an embodiment of a dithered fiber-bundle imager, in an embodiment.
- FIG. 7 includes are images of a test pattern obtained using an embodiment without dithering, with dithering in single axes, and with dithering in both axes.
- FIG. 8 includes images of a single fiber simulated without dithering, with dithering in single axes, and with dithering in both axes.
- FIGs. 9A and 9B illustrate amplitude modulated waveforms for generating a spiral trajectory more widely spaced near a center of the spiral than near a periphery of the spiral.
- FIG. 10 illustrates a spiral trajectory useful in an embodiment for dithering.
- piezoelectric devices were employed to dither a fiber bundle synchronously on both ends to reduce fixed pattern noise and improve the imaging system modulation transfer function.
- FIG. 1 shows one dithered fiber-bundle imager 100 as part of an imaging system 180.
- Imaging system 180 forms an image 1821 of an object 182 on an image sensor 188 via a distal imaging objective 184, dithered fiber-bundle imager 100, and proximal imaging objective 186.
- Dithered fiber-bundle imager 100 includes a coherent fiber imaging bundle 110, a first piezoelectric actuator 120, and a second piezoelectric actuator 130. At least one of piezoelectric actuator 120, piezoelectric actuator 130, objective 184, and objective 186 may be mounted to be stable relative to a mount 190, which may be an endoscope tube.
- Mount 190 is a housing, for example.
- coherent fiber imaging bundle 1 10 is hereinafter referred to as fiber imaging bundle 1 10.
- Fiber imaging bundle 1 10 includes a plurality of optical fibers 1 12( 1, 2, ... , N), a proximal bundle end 1 10P, a distal bundle end 1 10D, and a central axis 1 19.
- Each optical fiber 112 has a respective axis.
- Central axis 119 may correspond to the optical axis of an optical fiber 1 12 at a geometric center of the fiber bundle formed by optical fibers 1 12.
- Quantity N is for example 30,000.
- FIGs. 4A and 4B are respective plan views of distal bundle end HOD and proximal bundle end 1 10P.
- FIGs. 1-3 are best viewed together in the following description.
- Each optical fiber 112 has a fiber diameter D 2 and a core diameter D 1 ; a respective proximal end 1 12P exposed on proximal bundle end 1 10P, and a respective distal end 1 12D exposed on distal bundle end 1 10D.
- Fiber diameter D 2 is, for example, 0.75 ⁇ 0.10 mm.
- the optical axis of each optical fiber 1 12 is (a) parallel to a proximal longitudinal direction 19 IP at proximal bundle end 11 OP, and (b) parallel to a distal longitudinal direction 191D at distal bundle end 110D. For simplicity of illustration, directions 191P and 191D are shown as parallel to each other.
- FIG. 1 includes a distal plane 192D and a proximal plane 192P, which define orthogonal directions (x y') and (x,y), respectively.
- Directions 191D and 191P are orthogonal to planes 192D and 192P, respectively.
- references to directions x, y, x', or y' are references to said directions as illustrated in FIG. 1, unless otherwise specified.
- Dithering may be achieved by shifting a lens in the light path.
- a spherical lens vibrated in X and Y axes will shift or dither an image focused through that lens.
- piezoelectric actuators 321, 331 are coupled to vibrate one or more components of the lens systems while the fiber bundle remains stationary relative to mount 190.
- vibrating off-axis spherical lenses, vibrating off-axis cylindrical lenses, or vibrating other components of the lens system to shift or dither an image on a stationary fiber bundle end is referred to herein as vibrating the lens.
- Remaining components illustrated on FIG. 3 resemble those on FIG. 1, and their descriptions will not be repeated here for brevity.
- the piezoelectric actuators vibrate the fiber bundle relative to the lens such that the image of object 182 is dithered across an end of the fiber bundle, but they differ in whether the lens or the bundle vibrates relative to a housing or mount.
- FIG. 4A illustrates distal bundle end 110D with locations PC, PX' and PY' which, with central axis 119, define directions ⁇ x' and ⁇ y', and corresponding coordinate plane (x',y'), on distal bundle end 110D.
- Locations PC, PX' and PY' are, for example, locations of respective axes of two different optical fibers 112(m 0 ), 1 llim-i) and 112(m 2 ), where m 0 1 2 ⁇ ⁇ 1, , ... , N ⁇ .
- FIG. 1 illustrates distal bundle end 110D with locations PC, PX' and PY' which, with central axis 119, define directions ⁇ x' and ⁇ y', and corresponding coordinate plane (x',y'), on distal bundle end 110D.
- Locations PC, PX' and PY' are, for example, locations of respective axes of two different optical fibers 112(m 0 ), 1 llim-i) and 112(
- FIG. 4B illustrates proximal bundle end HOP with locations PC, PX and PY which, with central axis 119, define directions ⁇ x and ⁇ y and corresponding coordinate plane (x,y) on proximal bundle end 110P.
- Locations PC, PX and PY are, for example, locations of respective axes of the same optical fibers 112(m 0 ), 112(01! and 112(m 2 ) that define directions ⁇ x' and ⁇ y'.
- Coordinates (x,y) and (x',y') are in planes 192P and 192D, respectively.
- each fiber 112 may be viewed as being at the center of a respective hexagonal region 116.
- fiber 112(i 3 ) is at the center of hexagonal region 116(i 3 ), which has a maximum width 25 in the x direction (or x' direction, equivalently), and a maximum height A/35 in the y direction (or y' direction, equivalently).
- Optical fibers 112 may be close-packed (e.g., in a hexagonal lattice) such that inter-fiber spacing S equals fiber diameter D 2 .
- First piezoelectric actuator 120 is configured to impart a trajectory 122P on proximal bundle end 110P in plane 192P that is orthogonal to direction 191P.
- Second piezoelectric actuator 130 is configured to impart trajectory 122D on distal bundle end HOD in plane 192D that is orthogonal to direction 191D.
- First piezoelectric actuator 120 may be a tube actuator and may enclose proximal bundle end 110P.
- Second piezoelectric actuator 130 may be a tube actuator and may enclose distal bundle end HOD.
- trajectories 122D and 122P are equal such that bundle ends HOP and HOD move synchronously, which eliminates relative motion therebetween that would blur image 1821.
- embodiments of dithered fiber-bundle imager 100 have trajectories 122D and 122P being equal to a common trajectory 122.
- amplitudes A x and A y are determined such that common trajectory 122 uniformly covers hexagonal region 116 associated with a fiber 112. Such uniform coverage may be both spatially uniform and temporally uniform, e.g., within a time interval corresponding to a period of the Lissajous curve. For example, amplitude A x ⁇ S and amplitude A y ⁇ V35/2.
- Common trajectory 122 may be a trajectory other than the above-mentioned x t) and y(t), e.g., any trajectory, without departing from the scope hereof.
- Piezoelectric actuators 120 and 130 are configured to impart movement on respective bundle ends 110P and 110D, per x(t) and y(t) for example.
- the movement is, for example, (i) periodic motion in the x direction having a frequency f x and (ii) periodic motion in the y direction having a frequency f y .
- Frequencies f x and f y may be chosen such that trajectories 122P, 122D uniformly sample respective planes 192P, 192D. Applicant has found that setting ⁇ f x — f y ⁇ > 50 Hz results in adequately uniform sampling for typical frame rates.
- piezoelectric actuators 120 and 130 are piezoelectric tubes (outer diameter 3.2 ⁇ 0.2 mm, I.D. 2.2 ⁇ 0.2 mm, length of 30 mm) that are configured to produce deflections in respective planes 192P and 192D.
- the deflection amplitude is, for example, between five micrometers and one hundred micrometers. Deflection is linearly proportional to voltage.
- the piezoelectric actuators 120 and 130 are driven by electrical amplifiers designed for piezoelectric actuators. The amplifiers in turn are driven by two signal generators, one for each orthogonal axis, e.g., (x,y) or (x',y').
- FIG. 5 illustrates a trajectory 522 corresponding to these parameters. Trajectory 522 is an example of common trajectory 122.
- the frequency is chosen to provide a multiple greater than four of periods of motion of the lowest frequency actuator during each exposure time, and the difference in frequency between frequencies f x and f y being at least 50 Hz.
- FIG. 6 is a flowchart illustrating a method 600 for high-resolution imaging.
- Method 600 includes at least one of steps 610, 620, 630, and 640.
- Step 610 is one of forming, using a first lens, a first image at a first bundle-end of a fiber imaging bundle that has a second bundle-end opposite the first bundle-end.
- objective 184 forms an image of object 182 on distal bundle end 1 10D, as shown in FIG. 1.
- Step 620 is one of forming, using a second lens, an image of the second bundle-end onto an image sensor.
- objective 186 forms an image
- Step 630 is one of vibrating the first bundle-end relative to the first lens to dither the first image.
- piezoelectric actuator 130 vibrates distal bundle end 1 10D relative to objective 184.
- piezoelectric actuator 331 vibrates objective 184 relative to distal bundle end 110D.
- Step 640 is one of synchronously vibrating, relative to the vibrating first bundle-end, the second bundle-end relative to the second lens.
- piezoelectric actuator 130 synchronously vibrates, relative to vibrating distal bundle end 110D, proximal bundle end HOP relative to objective 186.
- piezoelectric actuator 321 vibrates objective 186 relative to proximal bundle end 110P.
- Applicant evaluated the efficacy of method 600 using images obtained from a 1951 United States Air Force resolution test chart, shown in images 701, 702, 703, and 704 of FIG. 7.
- Image 701 is an image obtained with no dithering.
- Images 702 and 703 show image results with dithering in the x direction and in the y direction, respectively.
- Image 704 shows the result with dithering motion in both the ⁇ x and ⁇ y directions, using sinusoidal oscillations frequencies of 500 Hz and 588 Hz, respectively.
- images 701-704 It is apparent from images 701-704 that dithering reduces fixed pattern noise due to the fiber structure. It is also apparent that motion in both directions is required to achieve the best performance. While the fixed pattern noise is reduced with dynamic dithering, it is not entirely eliminated. Comparison of images 701 and 704 illustrates that dithering improves the spatial resolution.
- the 242 line pairs per millimeter (lp/mm) spatial frequency for the resolution limit without dithering roughly corresponds to the frequency of the group 7, element 6 bars (228 lp/mm), located in the bottom right in the figure. Evaluation of image 701 shows that the resolution may be slightly worse, but it is close to that frequency.
- FIG. 8 shows calculated images 801, 802, 803, and 804 of the scan patterns of a single fiber core under the conditions of dithering motion used to obtain the images 701-704.
- the resulting Lissajous pattern is a circle. If the sinusoidal deflector waveform is amplitude-modulated with a triangular modulation waveform of increasing amplitude from zero to a maximum deflector voltage throughout a modulation cycle, the resulting Lissajous pattern is a uniformly-spaced spiral.
- Time t ranges from t m to t m + T, where trajectory period
- Frequency / is, for example, between 400 Hz and 1.0 kHz.
- FIG. 9A illustrates an envelope function 910 representing repeated instances of x(t) over a period T without the sinusoidal time dependence.
- trajectory period T may be determined such that an integer multiple of trajectory period T equals at least one of an image-capture frame rate and an exposure time associated with image sensor 188, FIG. 1.
- the integer multiple is, for example, between five and twenty.
- Such a relationship between trajectory period and image-capture frame rate and/or an exposure time may apply to any trajectory 122 disclosed herein, there trajectory 122 periodically repeats.
- FIG. 10 illustrates such as spiral 1000, traced from its center to its periphery.
- An integral seen by a camera of light from a fiber core deflected according to a spiral more widely spaced in center than in periphery is more nearly uniform across the deflection pattern than an integral seen by a camera of light from the fiber core deflected according to a uniformly-spaced spiral.
- Modulation waveform of FIG. 9A may be time-reversed as illustrated in FIG. 9B, illustrating envelope function 920, to trace the spiral from periphery of the deflection pattern to center.
- the traced amplitude modulation waveform monotonically decreases and has a negative and monotonically decreasing first derivative in each modulation cycle.
- piezoelectric actuators 120, 130, or 221, 231 are driven in x and y axes by amplitude-modulated, same-frequency waveforms having ninety-degree phase shift between the x and y axes with the amplitude modulation increasing along an arc from zero to a maximum deflector voltage along a curve having a positive but monotonically decreasing first derivative in each cycle, as illustrated in FIG. 9A such that the image focused on bundle end shifts relative to the fiber bundle end in a spiral pattern more widely spaced near the center of the deflection pattern as illustrated in FIG. 10 than near the periphery of the spiral, the spiral being traced from center to periphery.
- FIG. 9B such that the image focused on bundle end shifts relative to the fiber bundle end in a spiral pattern more widely spaced near the center of the deflection pattern as illustrated in
- FIG. 10 than near the periphery of the spiral, the spiral being traced from periphery to center.
- the spiral pattern provides uniform coverage of a unit cell covered by relative motion of a single fiber of the fiber bundle.
- piezoelectric actuators 120, 130, or 221, 231 are driven in x and y axes by amplitude-modulated drive waveforms having ninety- degree phase shift between the x and y axes to produce an evenly-spaced spiral, where the angular frequency of the x and y axis drive waveforms that decrease as a function of increasing spiral radius.
- spiral 1000 includes points Al, Bl near a first radius Rl and points A2 and B2 near a second radius R2 > Rl.
- spiral 1000 has a radius- dependent angular frequency, the angular velocity of its trajectory points Al and Bl exceeds that of the trajectory between points A2 and B2.
- the piezoelectric actuator is configured so a small-radius turn of the spiral (e.g., at radius Rl) is performed in less time than a large-radius turn of the spiral (e.g., at radius R2).
- the tubular piezoelectric actuator is configured to vibrate a first end of the fiber bundle relative to an image stationary relative to a housing, while at a second end of the fiber bundle actuators are used to vibrate a lens element positioned to image the second end of the fiber bundle on an image sensor of a digital camera.
- the magnification and vibration of the lens element and fiber bundle are adjusted so relative motion of image and bundle match at each end of the bundle.
- a dithered fiber-bundle imager designated Al includes a fiber imaging bundle including (i) a plurality of optical fibers, (ii) a proximal bundle end exposing a respective proximal end of each of the plurality of optical fibers, and (iii) a distal bundle end exposing a respective distal end of each of the optical fibers.
- Each of the optical fibers has a respective optical axis parallel to (a) a proximal longitudinal direction at the proximal bundle end, and (b) a distal longitudinal direction at the distal bundle end.
- the imager also includes a first piezoelectric actuator configured to move a proximal device in a proximal plane orthogonal to the proximal longitudinal direction.
- the proximal device is one of (i) the proximal bundle end and (ii) a proximal lens.
- the imager also include a second piezoelectric actuator configured to move a distal device in a distal plane orthogonal to the distal longitudinal direction, such that motion of the distal device and the proximal device are synchronized.
- the distal device is one of (i) the distal bundle end and (ii) a distal lens.
- a dithered fiber-bundle imager designated A2 including the dithered fiber- bundle imager designated A 1 where the distal device is the distal bundle end and the first piezoelectric actuator is a piezoelectric tube actuator enclosing the fiber imaging bundle near the proximal bundle end, and the proximal device is a proximal bundle end and the second piezoelectric actuator is a tube actuator enclosing the fiber imaging bundle near distal bundle end.
- a dithered fiber-bundle imager designated A3 including the dithered fiber- bundle imager designated A 1 where the first piezoelectric actuator is coupled to vibrate the proximal lens.
- a dithered fiber-bundle imager designated A4 including the dithered fiber- bundle imager designated A 1, A2, or A3, the proximal plane and the distal plane having orthogonal x and y directions, the first piezoelectric actuator imparting (i) periodic motion in the x direction having a frequency f x and (ii) periodic motion in the y direction having a frequency f y such that a difference between f x and f y exceeds 50 Hz such that the trajectory uniformly covers the proximal plane.
- a dithered fiber-bundle imager designated A5 including the dithered fiber- bundle imager designated A4 wherein the periodic motions are non-sinusoidal.
- a dithered fiber-bundle imager designated A6 including the dithered fiber- bundle imager designated A 1, A2, A3, A4, or A5 wherein the imager is configured to focus an image from the proximal bundle end onto an electronic image sensor.
- a dithered fiber-bundle imager designated A7 including the dithered fiber- bundle imager designated A 1, A2, A3, A4, A5, or A6 the proximal and distal planes having orthogonal x and y directions, the plurality of optical fibers each having a fiber diameter, the trajectory having, in a plane parallel to the x-y plane, at least one of an ⁇ -direction amplitude and a y-direction amplitude being at least V3/2 times the fiber diameter.
- a dithered fiber-bundle imager designated A 8 including the dithered fiber- bundle imager designated Al, A2, A3, A4, A5, A6, or A7, the first piezoelectric actuator configured to move the proximal end in a Lissajous-curve trajectory, the second piezoelectric actuator configured to move the distal end in the Lissajous-curve trajectory.
- a dithered fiber-bundle imager designated A9 including the dithered fiber- bundle imager designated A 1, A2, or A3, the piezoelectric actuator configured to move the proximal device, in the proximal plane, in a spiral trajectory.
- a dithered fiber-bundle imager designated A 10 including the dithered fiber-bundle imager designated A 1, A2, or A3, the spiral trajectory being more widely spaced near a center of the spiral than near a periphery of the spiral.
- a dithered fiber bundle imager designated Al l including the dithered fiber bundle imager designated A9 or A 10, the spiral trajectory having an angular velocity that decreases as a function of increasing distance of the proximal device from a center of the spiral trajectory.
- a method for high-resolution imaging designated B l includes: (i) forming, via a first lens, a first image at a first bundle-end of a fiber imaging bundle that has a second bundle-end opposite the first bundle-end and (ii) forming, via a second lens, an image of the second bundle-end onto an image sensor.
- the method also includes (iii) vibrating the first bundle-end relative to the first lens to dither the first image, and (iv) synchronously vibrating, relative to the vibrating first bundle-end, the second bundle-end relative to the second lens.
- the step of the vibrating of the first bundle-end includes vibrating the first bundle-end at a first frequency in a first axis perpendicular to an optical axis of the fiber imaging bundle and vibrating at a second frequency in a second axis perpendicular to both the optical axis and the first axis.
- a method of high-resolution imaging designated B3 including the method designated B 1 or B2, at least one of: (a) the step of vibrating the first bundle-end being performed by a first piezoelectric actuator configured to vibrate the first bundle-end relative to a housing, and (b) the step of vibrating the second bundle-end being performed by a second piezoelectric actuator configured to vibrate the second bundle-end relative to the housing.
- a method of high-resolution imaging designated B4 including the method designated B l, B2, or B3, at least one of (a) the piezoelectric actuator being a piezoelectric tube disposed about the first bundle-end, and (b) the second piezoelectric actuator being a piezoelectric tube disposed about the second bundle-end.
- the first frequency and the second frequency differ by at least fifty hertz.
- the fiber imaging bundle includes a plurality of optical fibers each having a respective one of a plurality of parallel optical axes
- the step of vibrating the first bundle-end includes vibrating the first bundle-end in two orthogonal directions each perpendicular to the plurality of parallel optical axes at the first bundle-end
- the step of vibrating the second bundle-end includes vibrating the second bundle-end in two orthogonal directions each perpendicular to the plurality of parallel optical axes at the second bundle-end.
- the step of synchronously vibrating the second bundle-end includes vibrating the second bundle-end such that the second bundle-end and the first bundle-end move in a same trajectory.
- the spiral trajectory having an angular velocity that decreases as a function of increasing distance, from a center of the spiral trajectory, of one of the of the proximal device and the first lens.
Landscapes
- Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Astronomy & Astrophysics (AREA)
- Multimedia (AREA)
- Surgery (AREA)
- Signal Processing (AREA)
- Biomedical Technology (AREA)
- Veterinary Medicine (AREA)
- Biophysics (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Heart & Thoracic Surgery (AREA)
- Medical Informatics (AREA)
- Radiology & Medical Imaging (AREA)
- General Health & Medical Sciences (AREA)
- Molecular Biology (AREA)
- Public Health (AREA)
- Animal Behavior & Ethology (AREA)
- Pathology (AREA)
- Endoscopes (AREA)
- Instruments For Viewing The Inside Of Hollow Bodies (AREA)
- Mechanical Optical Scanning Systems (AREA)
Abstract
A method for high-resolution imaging includes: (i) forming, via a first lens, a first image at a first bundle-end of a fiber imaging bundle that has a second bundle-end opposite the first bundle-end and (ii) forming, via a second lens, an image of the second bundle-end onto an image sensor. The method also includes (iii) vibrating the first bundle-end relative to the first lens to dither the first image, and (iv) synchronously vibrating, relative to the vibrating first bundle-end, the second bundle-end relative to the second lens.
Description
DITHERED FIBER-BUNDLE IMAGER AND HIGH-RESOLUTION IMAGING
METHOD
U.S. GOVERNMENT RIGHTS
[0001] This invention was made with government support under Grant No. R01 CA l 15780 awarded by the National Institutes of Health. The government has certain rights in the invention.
CLAIM TO PRIORITY
[0002] The present document claims priority from United States Provisional Patent Application number 62/398,410 filed September 22, 2016, the contents of which are incorporated herein by reference.
BACKGROUND
[0003] Fiber bundle-based imaging systems employ a bundle of coherent imaging fibers to transfer an image from a distal end, where the object is located, to a proximal end, where the image is either recorded on a detector or viewed by an observer. The major advantage of fiber bundle imaging systems is their inherent flexibility and ability to reach remote areas, such as those inside the human body, which are difficult to reach with conventional imaging systems. However, the spatial resolution and space-bandwidth product and number of pixels in the images are limited by the physical structure of the fiber bundle. Because the fiber bundle only passes light incident on the fiber cores, light incident on the claddings is lost, which results in lowered throughput and a structured fixed pattern noise in the images. Moreover, the inherent sampling leads to potential aliasing of high spatial frequency information.
[0004] However, the spatial resolution and space-bandwidth product (# of pixels) in the images are limited by the physical structure of the fiber bundle. Because the fiber bundle passes only light incident on the cores, light incident on the cladding is lost, which results in lowered throughput and a structured fixed pattern noise in the images. Moreover, the inherent sampling, due to the non-zero core-to-core spacing of adjacent fibers in the fiber bundle leads to the potential for aliasing of high spatial frequency information.
SUMMARY
[0005] In a first embodiment, a dithered fiber-bundle imager is disclosed. The dithered fiber-bundle imager includes a fiber imaging bundle. The fiber imaging bundle includes (i) a plurality of optical fibers, (ii) a proximal bundle end exposing a respective
proximal end of each of the plurality of optical fibers, and (iii) a distal bundle end exposing a respective distal end of each of the optical fibers. Each of the optical fibers have a respective optical axis parallel to (a) a proximal longitudinal direction at the proximal bundle end, and (b) a distal longitudinal direction at the distal bundle end. The imager also includes a first piezoelectric actuator configured to move a proximal device in a proximal plane orthogonal to the proximal longitudinal direction. The proximal device is one of (i) the proximal bundle end and (ii) a proximal lens. The imager also includes a second piezoelectric actuator configured to move a distal device in a distal plane orthogonal to the distal longitudinal direction, such that motion of the distal device and the proximal device are synchronized. The distal device is one of (i) the distal bundle end and (ii) a distal lens.
[0006] In a second embodiment, a method for high-resolution imaging is disclosed. The method includes: (i) forming, via a first lens, a first image at a first bundle-end of a fiber imaging bundle that has a second bundle-end opposite the first bundle-end and (ii) forming, via a second lens, an image of the second bundle-end onto an image sensor. The method also includes (iii) vibrating the first bundle-end relative to the first lens to dither the first image, and (iv) synchronously vibrating, relative to the vibrating first bundle-end, the second bundle-end relative to the second lens.
BRIEF DESCRIPTION OF THE FIGURES
[0007] FIG. 1 is a schematic view of an embodiment of a dithered fiber-bundle imager in an embodiment of an imaging system where the fiber bundle is vibrated relative to lens and housing.
[0008] FIG. 2 is a schematic view of how vibrating a lens off-center to a light path can shift or dither the resulting image.
[0009] FIG. 3 is a schematic view of an embodiment of a dithered fiber-bundle imager in an embodiment of an imaging system where the lenses are vibrated and fiber bundle stationary in a housing.
[0010] FIGs. 4A and 4B are respective plan views of a distal end and proximal end of a fiber imaging bundle of dithered fiber-bundle imager of FIG. 1, in an embodiment.
[0011] FIG. 5 depicts an exemplary trajectory of the distal end and proximal end of the dithered fiber-bundle imager of FIG. 1, in an embodiment.
[0012] FIG. 6 is a flowchart of a method of high-resolution imaging using an embodiment of a dithered fiber-bundle imager, in an embodiment.
[0013] FIG. 7 includes are images of a test pattern obtained using an embodiment
without dithering, with dithering in single axes, and with dithering in both axes.
[0014] FIG. 8 includes images of a single fiber simulated without dithering, with dithering in single axes, and with dithering in both axes.
[0015] FIGs. 9A and 9B illustrate amplitude modulated waveforms for generating a spiral trajectory more widely spaced near a center of the spiral than near a periphery of the spiral.
[0016] FIG. 10 illustrates a spiral trajectory useful in an embodiment for dithering.
DETAILED DESCRIPTION OF THE EMBODIMENTS
[0017] To overcome the limitations discussed in the Background section, piezoelectric devices were employed to dither a fiber bundle synchronously on both ends to reduce fixed pattern noise and improve the imaging system modulation transfer function.
[0018] FIG. 1 shows one dithered fiber-bundle imager 100 as part of an imaging system 180. Imaging system 180 forms an image 1821 of an object 182 on an image sensor 188 via a distal imaging objective 184, dithered fiber-bundle imager 100, and proximal imaging objective 186. Dithered fiber-bundle imager 100 includes a coherent fiber imaging bundle 110, a first piezoelectric actuator 120, and a second piezoelectric actuator 130. At least one of piezoelectric actuator 120, piezoelectric actuator 130, objective 184, and objective 186 may be mounted to be stable relative to a mount 190, which may be an endoscope tube. Mount 190 is a housing, for example. For sake of brevity, coherent fiber imaging bundle 1 10 is hereinafter referred to as fiber imaging bundle 1 10.
[0019] Fiber imaging bundle 1 10 includes a plurality of optical fibers 1 12( 1, 2, ... , N), a proximal bundle end 1 10P, a distal bundle end 1 10D, and a central axis 1 19. Each optical fiber 112 has a respective axis. Central axis 119 may correspond to the optical axis of an optical fiber 1 12 at a geometric center of the fiber bundle formed by optical fibers 1 12. Quantity N is for example 30,000. FIGs. 4A and 4B are respective plan views of distal bundle end HOD and proximal bundle end 1 10P. FIGs. 1-3 are best viewed together in the following description.
[0020] Each optical fiber 112 has a fiber diameter D2 and a core diameter D1 ; a respective proximal end 1 12P exposed on proximal bundle end 1 10P, and a respective distal end 1 12D exposed on distal bundle end 1 10D. Fiber diameter D2 is, for example, 0.75 ± 0.10 mm. The optical axis of each optical fiber 1 12 is (a) parallel to a proximal longitudinal direction 19 IP at proximal bundle end 11 OP, and (b) parallel to a distal longitudinal direction
191D at distal bundle end 110D. For simplicity of illustration, directions 191P and 191D are shown as parallel to each other. As fiber imaging bundle 110 is flexible, e.g., sufficiently so for endoscopic applications, directions 191P and 191D are generally not parallel. FIG. 1 includes a distal plane 192D and a proximal plane 192P, which define orthogonal directions (x y') and (x,y), respectively. Directions 191D and 191P are orthogonal to planes 192D and 192P, respectively. Herein, references to directions x, y, x', or y' are references to said directions as illustrated in FIG. 1, unless otherwise specified.
[0021] There are other ways to shift an image on fiber imaging bundle 110 than shifting the bundle. Dithering may be achieved by shifting a lens in the light path. A spherical lens vibrated in X and Y axes will shift or dither an image focused through that lens.
Effectively, what matters is relative position of lens axis and the image it forms on the fiber bundle. In an alternative embodiment 380, as illustrated in FIG. 3, piezoelectric actuators 321, 331 are coupled to vibrate one or more components of the lens systems while the fiber bundle remains stationary relative to mount 190. For brevity, vibrating off-axis spherical lenses, vibrating off-axis cylindrical lenses, or vibrating other components of the lens system to shift or dither an image on a stationary fiber bundle end is referred to herein as vibrating the lens. Remaining components illustrated on FIG. 3 resemble those on FIG. 1, and their descriptions will not be repeated here for brevity.
[0022] It should be noted that, in both the embodiments of FIG. 1 and FIG. 3, the piezoelectric actuators vibrate the fiber bundle relative to the lens such that the image of object 182 is dithered across an end of the fiber bundle, but they differ in whether the lens or the bundle vibrates relative to a housing or mount.
[0023] FIG. 4A illustrates distal bundle end 110D with locations PC, PX' and PY' which, with central axis 119, define directions ±x' and ±y', and corresponding coordinate plane (x',y'), on distal bundle end 110D. Locations PC, PX' and PY' are, for example, locations of respective axes of two different optical fibers 112(m0), 1 llim-i) and 112(m2), where m0 1 2 ε {1, , ... , N}. FIG. 4B illustrates proximal bundle end HOP with locations PC, PX and PY which, with central axis 119, define directions ±x and ±y and corresponding coordinate plane (x,y) on proximal bundle end 110P. Locations PC, PX and PY are, for example, locations of respective axes of the same optical fibers 112(m0), 112(01!) and 112(m2) that define directions ±x' and ±y'. Coordinates (x,y) and (x',y') are in planes 192P and 192D, respectively.
[0024] Core centers of adjacent optical fibers 112 are separated by an inter-fiber spacing S. Each fiber 112 may be viewed as being at the center of a respective hexagonal
region 116. For example, fiber 112(i3) is at the center of hexagonal region 116(i3), which has a maximum width 25 in the x direction (or x' direction, equivalently), and a maximum height A/35 in the y direction (or y' direction, equivalently). Optical fibers 112 may be close-packed (e.g., in a hexagonal lattice) such that inter-fiber spacing S equals fiber diameter D2.
[0025] First piezoelectric actuator 120 is configured to impart a trajectory 122P on proximal bundle end 110P in plane 192P that is orthogonal to direction 191P. Second piezoelectric actuator 130 is configured to impart trajectory 122D on distal bundle end HOD in plane 192D that is orthogonal to direction 191D.
[0026] First piezoelectric actuator 120 may be a tube actuator and may enclose proximal bundle end 110P. Second piezoelectric actuator 130 may be a tube actuator and may enclose distal bundle end HOD.
[0027] In an embodiment, trajectories 122D and 122P are equal such that bundle ends HOP and HOD move synchronously, which eliminates relative motion therebetween that would blur image 1821. Hereinafter, embodiments of dithered fiber-bundle imager 100 have trajectories 122D and 122P being equal to a common trajectory 122. Time dependence of common trajectory 122 may be expressed as x(t) = x'(t) = Ax cos(fxt~) and y(t) = y'(t = Ay cos(fyt + 5), and may follow a Lissajous curve. In an embodiment, amplitudes Ax and Ay are determined such that common trajectory 122 uniformly covers hexagonal region 116 associated with a fiber 112. Such uniform coverage may be both spatially uniform and temporally uniform, e.g., within a time interval corresponding to a period of the Lissajous curve. For example, amplitude Ax≥ S and amplitude Ay≥ V35/2. Common trajectory 122 may be a trajectory other than the above-mentioned x t) and y(t), e.g., any trajectory, without departing from the scope hereof.
[0028] Piezoelectric actuators 120 and 130 are configured to impart movement on respective bundle ends 110P and 110D, per x(t) and y(t) for example. The movement is, for example, (i) periodic motion in the x direction having a frequency fx and (ii) periodic motion in the y direction having a frequency fy. Frequencies fx and fy may be chosen such that trajectories 122P, 122D uniformly sample respective planes 192P, 192D. Applicant has found that setting \fx— fy \ > 50 Hz results in adequately uniform sampling for typical frame rates.
[0029] In an embodiment, piezoelectric actuators 120 and 130 are piezoelectric tubes (outer diameter 3.2 ± 0.2 mm, I.D. 2.2 ± 0.2 mm, length of 30 mm) that are configured to produce deflections in respective planes 192P and 192D. The deflection amplitude is, for example, between five micrometers and one hundred micrometers. Deflection is linearly
proportional to voltage. The piezoelectric actuators 120 and 130 are driven by electrical amplifiers designed for piezoelectric actuators. The amplifiers in turn are driven by two signal generators, one for each orthogonal axis, e.g., (x,y) or (x',y').
[0030] Because of the methods used for developing the system (for example, mounting of the piezoelectric actuators 120, 130 in the system, and the fixation of the optical fiber to the piezoelectric actuators 120, 130), equivalent voltages on both the distal and proximal ends of the optical fiber may, in an embodiment, not produce equivalent deflections in the transverse plane. This is due to a non-equivalent length of piezoelectric tube protruding from the mount, as well as non-equivalent lengths of fiber protruding from the end of the piezoelectric tube. There is also a possible effect on the system due to tolerances in capacitance on the piezoelectric tube (e.g., 2.1 nF, with a tolerance of ±20%). The result of all of these effects is a difference in the transverse deflections by each piezoelectric tube along the various axes. In this embodiment, this could be corrected by the use of a voltage-dividing circuit, with one component being a potentiometer. Through this, the voltage going to either side is variable, which allows for the correction of the voltage while both piezoelectric tubes are running. The resultant voltages were determined by visual inspection of the images as voltages were varied, and the voltages were chosen to provide the best image quality.
[0031] In an embodiment, \ fx— fy \ = 88 Hz and min^, fy) = 500 Hz, which corresponds to ten periods of motion during a twenty-millisecond exposure time. FIG. 5 illustrates a trajectory 522 corresponding to these parameters. Trajectory 522 is an example of common trajectory 122. In other embodiments, the frequency is chosen to provide a multiple greater than four of periods of motion of the lowest frequency actuator during each exposure time, and the difference in frequency between frequencies fx and fy being at least 50 Hz.
[0032] FIG. 6 is a flowchart illustrating a method 600 for high-resolution imaging. Method 600 includes at least one of steps 610, 620, 630, and 640. Step 610 is one of forming, using a first lens, a first image at a first bundle-end of a fiber imaging bundle that has a second bundle-end opposite the first bundle-end. In an example of step 610, objective 184 forms an image of object 182 on distal bundle end 1 10D, as shown in FIG. 1.
[0033] Step 620 is one of forming, using a second lens, an image of the second bundle-end onto an image sensor. In an example of step 620, objective 186 forms an image
1821 of proximal bundle end on image sensor 188. Step 630 is one of vibrating the first bundle-end relative to the first lens to dither the first image. In an example of step 630, piezoelectric actuator 130 vibrates distal bundle end 1 10D relative to objective 184. In a second example of step 630, piezoelectric actuator 331 vibrates objective 184 relative to
distal bundle end 110D.
[0034] Step 640 is one of synchronously vibrating, relative to the vibrating first bundle-end, the second bundle-end relative to the second lens. In an example of step 640, piezoelectric actuator 130, synchronously vibrates, relative to vibrating distal bundle end 110D, proximal bundle end HOP relative to objective 186. In a second example of step 640, piezoelectric actuator 321 vibrates objective 186 relative to proximal bundle end 110P. Resultant Images
[0035] Applicant evaluated the efficacy of method 600 using images obtained from a 1951 United States Air Force resolution test chart, shown in images 701, 702, 703, and 704 of FIG. 7. Image 701 is an image obtained with no dithering. Images 702 and 703 show image results with dithering in the x direction and in the y direction, respectively. Image 704 shows the result with dithering motion in both the ±x and ±y directions, using sinusoidal oscillations frequencies of 500 Hz and 588 Hz, respectively.
[0036] It is apparent from images 701-704 that dithering reduces fixed pattern noise due to the fiber structure. It is also apparent that motion in both directions is required to achieve the best performance. While the fixed pattern noise is reduced with dynamic dithering, it is not entirely eliminated. Comparison of images 701 and 704 illustrates that dithering improves the spatial resolution. The 242 line pairs per millimeter (lp/mm) spatial frequency for the resolution limit without dithering roughly corresponds to the frequency of the group 7, element 6 bars (228 lp/mm), located in the bottom right in the figure. Evaluation of image 701 shows that the resolution may be slightly worse, but it is close to that frequency. In image 704 it could be argued that the bar target is resolved out to group 8, element 2, (287 lp/mm), which is an improvement but not nearly as good as the theoretical limit of 814 lp/mm of this particular fiber bundle due to the size of core diameter Dx of optical fiber 112. If that theoretical spatial resolution was achieved, the bars of group 9 element 5 would be resolved.
[0037] The experimental results show that the fixed pattern noise of fiber bundle imaging is greatly reduced but not entirely eliminated by the synchronous dithering.
Moreover, the spatial resolution is also improved by dithering but not by as much as theoretically predicted. One possible reason for failure to reach resolution equivalent to the core size of the fibers is the scan pattern of the dithering motion. FIG. 8 shows calculated images 801, 802, 803, and 804 of the scan patterns of a single fiber core under the conditions of dithering motion used to obtain the images 701-704.
[0038] Without dithering, there is no motion and the single circular fiber core is
stationary, as shown in image 801. With a sinusoidal signal in the x direction, there is a sinusoidal motion of the core in the x direction and the fiber distribution is spread out along that direction (image 802). With sinusoidal motion, the fiber slows down and reverses direction at the ends of the scan and therefore the fiber core spends more time at the motion extremes than at the center. The intensity of the pattern indicates how much time is spent integrating signal from the object over the two-dimensional plane of the object. The same pattern is observed in the y direction in image 803 when the sinusoidal signal is applied to the actuator's y channel. When a 500-Hz sinusoidal signal is applied in the x direction and a 588 Hz sinusoidal signal is applied in the y direction the pattern is spread out over the x, y plane image 804. While the hexagonal area of a single core cell is covered, the intensity, which effectively represents sampling sensitivity, is not uniform. This effect may be overcome by using non-sinusoidal waveforms, such as triangular waveforms, in the signal generators and amplifiers that drive the piezoelectric actuators (e.g., actuators 120, 130, 321, 331) to vibrate the fiber bundle or lens.
[0039] If a sinusoidal deflector waveform is applied to the actuator's x channel, and a ninety-degree phase-shifted version of that waveform is applied to the actuator's y channel, the resulting Lissajous pattern is a circle. If the sinusoidal deflector waveform is amplitude-modulated with a triangular modulation waveform of increasing amplitude from zero to a maximum deflector voltage throughout a modulation cycle, the resulting Lissajous pattern is a uniformly-spaced spiral.
[0040] Since motion of light deflection along a uniformly-spaced spiral is slower near the center than at the periphery, an integral seen by a camera of light from a fiber core deflected according to a uniformly-spaced spiral is denser towards the center of the pattern than the periphery. If the modulation waveform increases along an arc from zero to the maximum deflector voltage along a curve having a positive but monotonically decreasing first derivative in each cycle, the resulting spiral is more widely spaced near the center of the deflection pattern than near the periphery.
[0041] For example, common trajectory 122 may be expressed by x(t) and y(t), where x t) = A0tasm(ft) and y(t) = A0tacos(ft), where amplitude A0 is a constant, and exponent a < 1, e.g, = \. Time t ranges from tm to tm + T, where trajectory period
T = 0.5/-1 and m is an integer indexing times t when x t) = 0. Frequency / is, for example, between 400 Hz and 1.0 kHz. FIG. 9A illustrates an envelope function 910 representing repeated instances of x(t) over a period T without the sinusoidal time dependence. To ensure consistent sampling within a sequence captured images, trajectory
period T may be determined such that an integer multiple of trajectory period T equals at least one of an image-capture frame rate and an exposure time associated with image sensor 188, FIG. 1. The integer multiple is, for example, between five and twenty. Such a relationship between trajectory period and image-capture frame rate and/or an exposure time may apply to any trajectory 122 disclosed herein, there trajectory 122 periodically repeats.
[0042] FIG. 10 illustrates such as spiral 1000, traced from its center to its periphery. An integral seen by a camera of light from a fiber core deflected according to a spiral more widely spaced in center than in periphery is more nearly uniform across the deflection pattern than an integral seen by a camera of light from the fiber core deflected according to a uniformly-spaced spiral.
[0043] Modulation waveform of FIG. 9A may be time-reversed as illustrated in FIG. 9B, illustrating envelope function 920, to trace the spiral from periphery of the deflection pattern to center. Here, the traced amplitude modulation waveform monotonically decreases and has a negative and monotonically decreasing first derivative in each modulation cycle.
[0044] In alternative embodiments, piezoelectric actuators 120, 130, or 221, 231 are driven in x and y axes by amplitude-modulated, same-frequency waveforms having ninety-degree phase shift between the x and y axes with the amplitude modulation increasing along an arc from zero to a maximum deflector voltage along a curve having a positive but monotonically decreasing first derivative in each cycle, as illustrated in FIG. 9A such that the image focused on bundle end shifts relative to the fiber bundle end in a spiral pattern more widely spaced near the center of the deflection pattern as illustrated in FIG. 10 than near the periphery of the spiral, the spiral being traced from center to periphery.
[0045] In additional alternative embodiments, piezoelectric actuators 120, 130, or
221, 231 are driven in x and y axes by amplitude-modulated, same-frequency waveforms having ninety-degree phase shift between the x and y axes with the amplitude modulation decreasing along an arc from a maximum to a minimum deflector voltage along a curve having a negative and monotonically decreasing first derivative in each cycle, as illustrated in
FIG. 9B such that the image focused on bundle end shifts relative to the fiber bundle end in a spiral pattern more widely spaced near the center of the deflection pattern as illustrated in
FIG. 10 than near the periphery of the spiral, the spiral being traced from periphery to center.
In particular embodiments, the spiral pattern provides uniform coverage of a unit cell covered by relative motion of a single fiber of the fiber bundle.
[0046] In additional alternative embodiments, piezoelectric actuators 120, 130, or
221, 231 are driven in x and y axes by amplitude-modulated drive waveforms having ninety- degree phase shift between the x and y axes to produce an evenly-spaced spiral, where the angular frequency of the x and y axis drive waveforms that decrease as a function of increasing spiral radius. For example, spiral 1000 includes points Al, Bl near a first radius Rl and points A2 and B2 near a second radius R2 > Rl. When spiral 1000 has a radius- dependent angular frequency, the angular velocity of its trajectory points Al and Bl exceeds that of the trajectory between points A2 and B2. For example, the angular velocity of the trajectory monotonically decreases between points Al and B2. In this embodiment, the piezoelectric actuator is configured so a small-radius turn of the spiral (e.g., at radius Rl) is performed in less time than a large-radius turn of the spiral (e.g., at radius R2).
[0047] In an alternative embodiment, the tubular piezoelectric actuator is configured to vibrate a first end of the fiber bundle relative to an image stationary relative to a housing, while at a second end of the fiber bundle actuators are used to vibrate a lens element positioned to image the second end of the fiber bundle on an image sensor of a digital camera. The magnification and vibration of the lens element and fiber bundle are adjusted so relative motion of image and bundle match at each end of the bundle.
Combinations
[0048] The features herein described may be combined in various ways to make a usable imaging device, some but not all of which are given below:
[0049] A dithered fiber-bundle imager designated Al includes a fiber imaging bundle including (i) a plurality of optical fibers, (ii) a proximal bundle end exposing a respective proximal end of each of the plurality of optical fibers, and (iii) a distal bundle end exposing a respective distal end of each of the optical fibers. Each of the optical fibers has a respective optical axis parallel to (a) a proximal longitudinal direction at the proximal bundle end, and (b) a distal longitudinal direction at the distal bundle end. The imager also includes a first piezoelectric actuator configured to move a proximal device in a proximal plane orthogonal to the proximal longitudinal direction. The proximal device is one of (i) the proximal bundle end and (ii) a proximal lens. The imager also include a second piezoelectric actuator configured to move a distal device in a distal plane orthogonal to the distal longitudinal direction, such that motion of the distal device and the proximal device are synchronized. The distal device is one of (i) the distal bundle end and (ii) a distal lens.
[0050] A dithered fiber-bundle imager designated A2 including the dithered fiber- bundle imager designated A 1 where the distal device is the distal bundle end and the first piezoelectric actuator is a piezoelectric tube actuator enclosing the fiber imaging bundle near
the proximal bundle end, and the proximal device is a proximal bundle end and the second piezoelectric actuator is a tube actuator enclosing the fiber imaging bundle near distal bundle end.
[0051] A dithered fiber-bundle imager designated A3 including the dithered fiber- bundle imager designated A 1 where the first piezoelectric actuator is coupled to vibrate the proximal lens.
[0052] A dithered fiber-bundle imager designated A4 including the dithered fiber- bundle imager designated A 1, A2, or A3, the proximal plane and the distal plane having orthogonal x and y directions, the first piezoelectric actuator imparting (i) periodic motion in the x direction having a frequency fx and (ii) periodic motion in the y direction having a frequency fy such that a difference between fx and fy exceeds 50 Hz such that the trajectory uniformly covers the proximal plane.
[0053] A dithered fiber-bundle imager designated A5 including the dithered fiber- bundle imager designated A4 wherein the periodic motions are non-sinusoidal.
[0054] A dithered fiber-bundle imager designated A6 including the dithered fiber- bundle imager designated A 1, A2, A3, A4, or A5 wherein the imager is configured to focus an image from the proximal bundle end onto an electronic image sensor.
[0055] A dithered fiber-bundle imager designated A7 including the dithered fiber- bundle imager designated A 1, A2, A3, A4, A5, or A6 the proximal and distal planes having orthogonal x and y directions, the plurality of optical fibers each having a fiber diameter, the trajectory having, in a plane parallel to the x-y plane, at least one of an ^-direction amplitude and a y-direction amplitude being at least V3/2 times the fiber diameter.
[0056] A dithered fiber-bundle imager designated A 8 including the dithered fiber- bundle imager designated Al, A2, A3, A4, A5, A6, or A7, the first piezoelectric actuator configured to move the proximal end in a Lissajous-curve trajectory, the second piezoelectric actuator configured to move the distal end in the Lissajous-curve trajectory.
[0057] A dithered fiber-bundle imager designated A9 including the dithered fiber- bundle imager designated A 1, A2, or A3, the piezoelectric actuator configured to move the proximal device, in the proximal plane, in a spiral trajectory.
[0058] A dithered fiber-bundle imager designated A 10 including the dithered fiber-bundle imager designated A 1, A2, or A3, the spiral trajectory being more widely spaced near a center of the spiral than near a periphery of the spiral.
[0059] A dithered fiber bundle imager designated Al l including the dithered fiber bundle imager designated A9 or A 10, the spiral trajectory having an angular velocity that
decreases as a function of increasing distance of the proximal device from a center of the spiral trajectory.
[0060] A method for high-resolution imaging designated B l includes: (i) forming, via a first lens, a first image at a first bundle-end of a fiber imaging bundle that has a second bundle-end opposite the first bundle-end and (ii) forming, via a second lens, an image of the second bundle-end onto an image sensor. The method also includes (iii) vibrating the first bundle-end relative to the first lens to dither the first image, and (iv) synchronously vibrating, relative to the vibrating first bundle-end, the second bundle-end relative to the second lens.
[0061] In a method of high-resolution imaging designated B2 including the method designated Bl, the step of the vibrating of the first bundle-end includes vibrating the first bundle-end at a first frequency in a first axis perpendicular to an optical axis of the fiber imaging bundle and vibrating at a second frequency in a second axis perpendicular to both the optical axis and the first axis.
[0062] In a method of high-resolution imaging designated B3 including the method designated B 1 or B2, at least one of: (a) the step of vibrating the first bundle-end being performed by a first piezoelectric actuator configured to vibrate the first bundle-end relative to a housing, and (b) the step of vibrating the second bundle-end being performed by a second piezoelectric actuator configured to vibrate the second bundle-end relative to the housing.
[0063] In a method of high-resolution imaging designated B4 including the method designated B l, B2, or B3, at least one of (a) the piezoelectric actuator being a piezoelectric tube disposed about the first bundle-end, and (b) the second piezoelectric actuator being a piezoelectric tube disposed about the second bundle-end.
[0064] In a method of high-resolution imaging designated B8 including the method designated Bl, the vibrating of the first bundle-end relative to the lens describing a repeated spiral at a first frequency.
[0065] In a method of high-resolution imaging designated B9 including the method designated B8, wherein the vibrating of the first bundle-end describing a spiral follows a spiral more widely spaced near a center of the spiral than near a periphery of the spiral.
[0066] In a method of high-resolution imaging designated B6 including the method designated B2, B3, B4, or B5, the first frequency and the second frequency differ by at least fifty hertz.
[0067] In a method of high-resolution imaging designated B7 including the
method designated B2, B3, B4, B5, or B6, the first frequency exceeding five hundred hertz.
[0068] In a method of high-resolution imaging designated B8 including the method designated B2, B3, B4, B5, B6, or B7, the fiber imaging bundle includes a plurality of optical fibers each having a respective one of a plurality of parallel optical axes, (a) the step of vibrating the first bundle-end includes vibrating the first bundle-end in two orthogonal directions each perpendicular to the plurality of parallel optical axes at the first bundle-end, and (b) the step of vibrating the second bundle-end includes vibrating the second bundle-end in two orthogonal directions each perpendicular to the plurality of parallel optical axes at the second bundle-end.
[0069] In a method of high-resolution imaging designated B9 including the method designated B2, B3, B4, B5, B6, B7, or B8, the step of synchronously vibrating the second bundle-end includes vibrating the second bundle-end such that the second bundle-end and the first bundle-end move in a same trajectory.
[0070] In a method of high-resolution imaging designated B 10 including the method designated B8 or B9, the spiral trajectory having an angular velocity that decreases as a function of increasing distance, from a center of the spiral trajectory, of one of the of the proximal device and the first lens.
[0071] Changes may be made in the above methods and systems without departing from the scope hereof. It should thus be noted that the matter contained in the above description or shown in the accompanying drawings should be interpreted as illustrative and not in a limiting sense. The following claims are intended to cover all generic and specific features described herein, as well as all statements of the scope of the present method and system, which, as a matter of language, might be said to fall therebetween.
Claims
1. A dithered fiber-bundle imager, comprising:
a fiber imaging bundle including (i) a plurality of optical fibers, (ii) a proximal bundle end exposing a respective proximal end of each of the plurality of optical fibers, and (iii) a distal bundle end exposing a respective distal end of each of the optical fibers, each of the optical fibers having a respective optical axis parallel to (a) a proximal longitudinal direction at the proximal bundle end, and (b) a distal longitudinal direction at the distal bundle end; a first piezoelectric actuator configured to move a proximal device in a proximal plane orthogonal to the proximal longitudinal direction, the proximal device being one of (i) the proximal bundle end and (ii) a proximal lens; and a second piezoelectric actuator configured to move a distal device in a distal plane orthogonal to the distal longitudinal direction, such that motion of the distal device and the proximal device are synchronized, the distal device being one of (i) the distal bundle end and (ii) a distal lens.
2. The dithered fiber-bundle imager of claim 1,
the proximal device being the proximal bundle end and the first piezoelectric actuator being a first tube actuator enclosing the fiber imaging bundle near the proximal bundle end,
the distal device being the distal bundle end and the second piezoelectric actuator being a second tube actuator enclosing the fiber imaging bundle near the distal bundle end.
3. The dithered fiber-bundle imager of claim 1, the first piezoelectric actuator being configured to vibrate the proximal lens.
4. The dithered fiber-bundle imager of claim 1 , the piezoelectric actuator configured to move the proximal device, in the proximal plane, in a spiral trajectory.
5. The dithered fiber-bundle imager of claim 4, the spiral trajectory being more widely spaced near a center of the spiral than near a periphery of the spiral.
6. The dithered fiber-bundle imager of claim 1, the proximal plane and the distal plane having orthogonal x and y directions, the first piezoelectric actuator imparting (i) periodic motion in the x direction having a frequency fx and (ii) periodic motion in the y direction having a frequency fy such that a difference between fx and fy exceeds 50 Hz such that the trajectory uniformly covers the proximal plane.
7. The dithered fiber-bundle imager of claim 6, the periodic motions being non- sinusoidal.
8. The dithered fiber-bundle imager of claim 6, the proximal lens being configured to form an image of the proximal bundle end onto an image sensor.
9. The dithered fiber-bundle imager of claim 6, the proximal and distal planes having orthogonal x and y directions, the plurality of optical fibers each having a fiber diameter, the trajectory having, in a plane parallel to the x-y plane, at least one of an x-direction amplitude and a y-direction amplitude being at least V3/2 times the fiber diameter.
10. The dithered fiber-bundle imager of claim 1, the first piezoelectric actuator
configured to move the proximal bundle end in a Lissajous-curve trajectory, the second piezoelectric actuator configured to move the distal bundle end in the Lissajous-curve trajectory.
11. The dithered fiber-bundle imager of claim 1, 2, 3, 4, 5, 6, 7, 8, 9, or 10 wherein the distal bundle end is disposed within an endoscope.
12. A method for high-resolution imaging comprising:
forming, via a first lens, a first image at a first bundle-end of a fiber imaging bundle that has a second bundle-end opposite the first bundle-end;
forming, via a second lens, an image of the second bundle-end onto an image sensor; vibrating the first bundle-end relative to the first lens to dither the first image; and synchronously vibrating, relative to the vibrating first bundle-end, the second bundle- end relative to the second lens.
13. The method of claim 12, the step of the vibrating of the first bundle-end further comprising:
vibrating the first bundle-end at a first frequency in a first axis perpendicular to an optical axis of the fiber imaging bundle and vibrating at a second frequency in a second axis perpendicular to both the optical axis and the first axis.
14. The method of claim 12, at least one of: (a) the step of vibrating the first bundle- end being performed by a first piezoelectric actuator configured to vibrate the first bundle-end relative to a housing, and (b) the step of vibrating the second bundle- end being performed by a second piezoelectric actuator configured to vibrate the second bundle-end relative to the housing.
15. The method of claim 14, at least one of (a) the first piezoelectric actuator being a first piezoelectric tube disposed about the first bundle-end, and (b) the second piezoelectric actuator being a second piezoelectric tube disposed about the second bundle-end.
16. The method of claim 13, the first frequency and the second frequency differing by at least fifty hertz.
17. The method of claim 12, the step of vibrating comprising moving the first bundle- end relative to the first lens in a spiral trajectory at a first frequency.
18. The method imager of claim 17, the spiral trajectory being more widely spaced near a center of the spiral than near a periphery of the spiral.
19. The method of claim 13, 14, 15, 16, 17, or 18, the first frequency exceeding five hundred hertz.
20. The dithered fiber bundle imager of claim 4, the spiral trajectory having an
angular velocity that decreases as a function of increasing distance of the proximal device from a center of the spiral trajectory.
21. The method of claim 17, the spiral trajectory having an angular velocity that decreases as a function of increasing distance, from a center of the spiral trajectory, of one of the of the proximal device and the first lens.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US16/333,087 US10754144B2 (en) | 2016-09-22 | 2017-09-22 | Dithered fiber-bundle imager and high-resolution imaging method |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US201662398410P | 2016-09-22 | 2016-09-22 | |
| US62/398,410 | 2016-09-22 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2018057935A1 true WO2018057935A1 (en) | 2018-03-29 |
Family
ID=61690684
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/US2017/053027 Ceased WO2018057935A1 (en) | 2016-09-22 | 2017-09-22 | Dithered fiber-bundle imager and high-resolution imaging method |
Country Status (2)
| Country | Link |
|---|---|
| US (1) | US10754144B2 (en) |
| WO (1) | WO2018057935A1 (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109347559A (en) * | 2018-11-26 | 2019-02-15 | 上海波汇科技股份有限公司 | A method of eliminating the hexagonal pattern interference of image transmission optical fibre |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US12326520B2 (en) | 2021-03-04 | 2025-06-10 | Beijing Voyager Technology Co., Ltd. | Scanning fiber transmitter for distance detection |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4867136A (en) * | 1987-04-23 | 1989-09-19 | Olympus Optical Co., Ltd. | Endoscope apparatus |
| US20080137363A1 (en) * | 2005-01-21 | 2008-06-12 | Optiscan Pty Ltd. | Fibre Bundle Confocal Endomicroscope |
| US20080249369A1 (en) * | 2007-04-05 | 2008-10-09 | University Of Washington | Compact scanning fiber device |
| US20150173606A1 (en) * | 2013-12-23 | 2015-06-25 | Novartis Ag | Forward Scanning Optical Probes and Associated Devices, Systems, and Methods |
| WO2015098115A1 (en) * | 2013-12-26 | 2015-07-02 | オリンパス株式会社 | Optical scanning-type image forming device and optical scanning image forming method |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8904560B2 (en) * | 2007-05-07 | 2014-12-02 | Bruker Nano, Inc. | Closed loop controller and method for fast scanning probe microscopy |
| US7770231B2 (en) * | 2007-08-02 | 2010-08-03 | Veeco Instruments, Inc. | Fast-scanning SPM and method of operating same |
| KR101873936B1 (en) * | 2008-11-13 | 2018-07-04 | 브루커 나노, 인코퍼레이션. | Scanning probe microscope |
| JP5424634B2 (en) * | 2008-12-19 | 2014-02-26 | Hoya株式会社 | Optical scanning endoscope processor and optical scanning endoscope apparatus |
| CN102844666B (en) * | 2009-12-01 | 2016-03-30 | 布鲁克纳米公司 | The method and apparatus of operation scanning probe microscopy |
| US8347409B2 (en) * | 2010-05-24 | 2013-01-01 | Massachusetts Institute Of Technology | Resonance compensation in scanning probe microscopy |
| US10335991B2 (en) * | 2015-12-08 | 2019-07-02 | Xerox Corporation | System and method for operation of multi-nozzle extrusion printheads in three-dimensional object printers |
-
2017
- 2017-09-22 US US16/333,087 patent/US10754144B2/en not_active Expired - Fee Related
- 2017-09-22 WO PCT/US2017/053027 patent/WO2018057935A1/en not_active Ceased
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4867136A (en) * | 1987-04-23 | 1989-09-19 | Olympus Optical Co., Ltd. | Endoscope apparatus |
| US20080137363A1 (en) * | 2005-01-21 | 2008-06-12 | Optiscan Pty Ltd. | Fibre Bundle Confocal Endomicroscope |
| US20080249369A1 (en) * | 2007-04-05 | 2008-10-09 | University Of Washington | Compact scanning fiber device |
| US20150173606A1 (en) * | 2013-12-23 | 2015-06-25 | Novartis Ag | Forward Scanning Optical Probes and Associated Devices, Systems, and Methods |
| WO2015098115A1 (en) * | 2013-12-26 | 2015-07-02 | オリンパス株式会社 | Optical scanning-type image forming device and optical scanning image forming method |
| US20160306164A1 (en) * | 2013-12-26 | 2016-10-20 | Olympus Corporation | Optical scanning image forming apparatus and optical scanning image forming method |
Non-Patent Citations (1)
| Title |
|---|
| ENGELBRECHT, CHRISTOPH ET AL.: "Ultra-compact fiber-optic two-photon microscope for functional fluorescence imaging in vivo", OPTICS EXPRESS, vol. 16, no. 8, 14 April 2008 (2008-04-14), pages 5556 - 5559, XP055477024, Retrieved from the Internet <URL:https://pdfs.semanticscholar.org/3f08/ab469b3741484dd7a0c9a7b2c9cOcb2ab283.pdf> [retrieved on 20171102] * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109347559A (en) * | 2018-11-26 | 2019-02-15 | 上海波汇科技股份有限公司 | A method of eliminating the hexagonal pattern interference of image transmission optical fibre |
| CN109347559B (en) * | 2018-11-26 | 2021-10-08 | 上海波汇科技有限公司 | A method for eliminating the interference of hexagonal pattern of image-transmitting optical fiber |
Also Published As
| Publication number | Publication date |
|---|---|
| US20190227299A1 (en) | 2019-07-25 |
| US10754144B2 (en) | 2020-08-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US5436655A (en) | Endoscope apparatus for three dimensional measurement for scanning spot light to execute three dimensional measurement | |
| US4867136A (en) | Endoscope apparatus | |
| US10754144B2 (en) | Dithered fiber-bundle imager and high-resolution imaging method | |
| DE112013003679T5 (en) | Dual-axis scanning mirror | |
| JP2006520022A (en) | Method and apparatus for imaging using a continuous non-raster pattern | |
| DE102012218219A1 (en) | Method for controlling the tilting of a mirror element | |
| DE102010003608B4 (en) | Device and method for characterizing a deflectable micromirror | |
| CN102525384A (en) | Two-dimensional grid-type scanning method adopting optical fiber cantilever resonance-type scanner | |
| US20070268548A1 (en) | Spatial light modulator alignment | |
| CA1293881C (en) | Electronic imaging apparatus and method | |
| JP2014149354A (en) | Calibration method and scanning type endoscope system | |
| DE10013299A1 (en) | Geometric calibration of a pixel oriented photosensitive element of a type used in a CCD camera | |
| DE10205207B4 (en) | Arrangement and method for measuring a resonant oscillator and for controlling it | |
| JP2018128579A (en) | Method of manufacturing diffraction grating | |
| WO2019220689A1 (en) | X-ray imaging device | |
| DE112015002334T5 (en) | Optical scanning device and optical scanning observation device | |
| DE10259667B4 (en) | Process for enlarging the field of view of a focal plane array camera | |
| DE102021116121B3 (en) | MICROSCANNER WITH MEANANDER SPRING-BASED MIRROR MOUNTING | |
| JP2009501960A (en) | Method and system for balancing scanning beam devices | |
| CN102542887A (en) | Demonstrating device for light oscillography vector synthesis graph line | |
| CN109347559B (en) | A method for eliminating the interference of hexagonal pattern of image-transmitting optical fiber | |
| JP2007533992A (en) | Method and apparatus for high accuracy detection of substantially straight contrast edges and system for tracking and fixing the contrast edges | |
| JP2014145899A (en) | Optical scanner | |
| WO2018092302A1 (en) | Optical scanning device and assembly adjusting method for optical scanning device | |
| JP3268445B2 (en) | Electron microscope equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 17854014 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 17854014 Country of ref document: EP Kind code of ref document: A1 |