US10025087B2 - Optical scanning observation apparatus - Google Patents

Optical scanning observation apparatus Download PDF

Info

Publication number
US10025087B2
US10025087B2 US15/444,895 US201715444895A US10025087B2 US 10025087 B2 US10025087 B2 US 10025087B2 US 201715444895 A US201715444895 A US 201715444895A US 10025087 B2 US10025087 B2 US 10025087B2
Authority
US
United States
Prior art keywords
light
detection
period
detecting section
photodetector
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active, expires
Application number
US15/444,895
Other versions
US20170168286A1 (en
Inventor
Takeshi Mori
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Olympus Corp
Original Assignee
Olympus Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Olympus Corp filed Critical Olympus Corp
Assigned to OLYMPUS CORPORATION reassignment OLYMPUS CORPORATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: MORI, TAKESHI
Publication of US20170168286A1 publication Critical patent/US20170168286A1/en
Application granted granted Critical
Publication of US10025087B2 publication Critical patent/US10025087B2/en
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B23/00Telescopes, e.g. binoculars; Periscopes; Instruments for viewing the inside of hollow bodies; Viewfinders; Optical aiming or sighting devices
    • G02B23/24Instruments or systems for viewing the inside of hollow bodies, e.g. fibrescopes
    • G02B23/2407Optical details
    • G02B23/2461Illumination
    • G02B23/2469Illumination using optical fibres
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00002Operational features of endoscopes
    • A61B1/00004Operational features of endoscopes characterised by electronic signal processing
    • A61B1/00006Operational features of endoscopes characterised by electronic signal processing of control signals
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00163Optical arrangements
    • A61B1/00165Optical arrangements with light-conductive means, e.g. fibre optics
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00163Optical arrangements
    • A61B1/00172Optical arrangements with means for scanning
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/04Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/04Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances
    • A61B1/042Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances characterised by a proximal camera, e.g. a CCD camera
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/04Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances
    • A61B1/044Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances for absorption imaging
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/04Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances
    • A61B1/045Control thereof
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/06Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements
    • A61B1/063Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements for monochromatic or narrow-band illumination
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/06Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements
    • A61B1/0655Control therefor
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/06Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements
    • A61B1/0661Endoscope light sources
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/06Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements
    • A61B1/07Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements using light-conductive means, e.g. optical fibres
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B23/00Telescopes, e.g. binoculars; Periscopes; Instruments for viewing the inside of hollow bodies; Viewfinders; Optical aiming or sighting devices
    • G02B23/24Instruments or systems for viewing the inside of hollow bodies, e.g. fibrescopes
    • G02B23/2476Non-optical details, e.g. housings, mountings, supports
    • G02B23/2484Arrangements in relation to a camera or imaging device
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B26/00Optical devices or arrangements for the control of light using movable or deformable optical elements
    • G02B26/08Optical devices or arrangements for the control of light using movable or deformable optical elements for controlling the direction of light
    • G02B26/10Scanning systems
    • G02B26/103Scanning systems having movable or deformable optical fibres, light guides or waveguides as scanning elements

Definitions

  • the present disclosure relates to an optical scanning observation apparatus which scans light on an object to detect light resulting from the irradiated object, to thereby perform observation.
  • Optical scanning observation apparatuses have been conventionally known (see, for example, JP 2013-121455A (PTL 1)).
  • the apparatuses is configured to irradiate laser light emitted from a fiber to form a spot on an observation object, where the tip part of the fiber is caused to vibrate, to thereby spirally scan or raster scan the irradiation position of the laser light.
  • signal light such as transmitted light, reflected light, and fluorescence resulting from the observation object are detected by the light detecting section and converted into an electric signal, which is associated with data on the scanning position at each scan point, to thereby generate image data.
  • An example of such apparatus may include, for example, an optical scanning endoscope apparatus for observing living tissues.
  • the disclosed optical scanning observation apparatus which scans light from a light source onto an object to obtain an image of the object, includes:
  • the term “effective” pixel information on the object herein refers to image information for use in generating an image of the object to be output for observation by the optical scanning observation apparatus.
  • the detection property of the light detecting section may be a photomultiplication factor.
  • the detection property of the light detecting section may be an offset.
  • the light detecting section may have a plurality of detection properties, and the light detection controller may sequentially control the plurality of detection properties in a period other than the effective detection period.
  • the actuator may drive the fiber in a predetermined scanning pattern to repeatedly perform scanning for one frame on the object, and the light detection controller may control the detection property in a period positioned at a boundary between temporally-adjacent frames and outside the effective detection period.
  • FIG. 1 is a block diagram illustrating a schematic configuration of an optical scanning endoscope apparatus as an example of the disclosed optical scanning observation apparatus according to Embodiment 1;
  • FIG. 2 is an overview schematically illustrating the scope of the optical scanning endoscope apparatus of FIG. 1 ;
  • FIG. 3 is a sectional view of the tip part of the scope of FIG. 2 ;
  • FIGS. 4A and 4B each illustrate the actuator and the oscillation part of the illumination optical fiber of the optical scanning endoscope apparatus, in which FIG. 4A is a side view thereof, and FIG. 4B is A-A sectional view of FIG. 4A ;
  • FIG. 5 shows vibration waveforms in the x-direction and y-direction of the illumination optical fiber
  • FIG. 6 shows a scanning locus of irradiation light on the observation object
  • FIG. 7 is a timing chart showing operation states of components of the optical scanning endoscope apparatus according to Embodiment 1;
  • FIG. 8 is a timing chart showing operation states of components of the optical scanning endoscope apparatus according to Embodiment 2.
  • FIG. 9 is a timing chart showing operation states of components of the optical scanning endoscope apparatus according to Embodiment 3.
  • the optical scanning observation apparatus may use, as light receiving elements of the light detecting section, photodiodes and photomultiplier tubes.
  • Photodetectors output an analog signal corresponding to the received light, but its multiplication factor and offset are known to vary depending on changes in temperature and in use conditions during operation.
  • the temperature and offset of the light detecting section need be detected as appropriate to correct the photodetector, based on the detected temperature and offset.
  • a conceivable method of correcting the temperature may involve providing a temperature sensor for measuring the temperature of the light detecting section to detect the temperature of the light detecting section in operation, to thereby output, to the light detecting section, a signal for correcting the multiplication factor based on the detection result.
  • the temperature sensor detecting the temperature outputs a digital signal
  • digital processing operates in the temperature sensor, which may potentially cause high frequency noise to flow into the output signal of the light detecting section under the influence of the clock.
  • the output of the light detecting section is affected by high frequency noise, the resulting image data also includes noise, deteriorating the quality of output image.
  • the offset may be obtained from the photodetector, with the irradiation of laser light being stopped.
  • the output of digital signals by the temperature sensor and the detection and adjustment of the offset from the photodetector temporally overlap, signals from the temperature sensor and from the photodetector interfere with each other, which may result in incorrect setting of the offset. This case also fails to obtain an image with stable quality.
  • FIG. 1 is a block diagram illustrating a schematic configuration of an optical scanning endoscope apparatus 10 as an example of the disclosed optical scanning observation apparatus according to Embodiment 1.
  • the optical scanning endoscope apparatus 10 is configured by including: a scope 20 , a control device body 30 , and a display 40 .
  • the control device body 30 is configured by including: a controller 31 for controlling throughout the optical scanning endoscope apparatus 10 ; a light emission timing controller 32 ; lasers 33 R, 33 G, 33 B; and a coupler 34 .
  • the light emission timing controller 32 causes, based on the light emission timing instructed by the controller 31 , the lasers 33 R, 33 G, 33 B emitting laser lights of three primary colors of red (R), green (G), and blue (B), respectively, to sequentially emit lights at designated timings.
  • Exemplary lasers that can be used as the lasers 33 R, 33 G, 33 B may include, for example, a diode-pump solid state (DPSS) laser and a laser diode.
  • the paths of laser lights emitted by the lasers 33 R, 33 G, 33 B are coupled, via a coupler 34 , to an illumination optical fiber 11 as the same single mode fiber.
  • the light source of the optical scanning endoscope apparatus 10 may use other plurality of light sources, without being limited to the aforementioned configuration.
  • the lasers 33 R, 33 G, 33 B and the coupler 34 may be stored in a separate casing different from the control device body 30 , the separate casing being connected to the control device body 30 via a signal line.
  • the illumination optical fiber 11 is connected through to the tip part of the scope 20 , and light incident on the illumination optical fiber 11 from the coupler 34 is guided through to the tip part of the scope 20 to be irradiated as illumination light toward an object 100 .
  • an actuator 21 is vibratorily driven, which causes the illumination light emitted from the illumination optical fiber 11 to be spirally scanned on the observation surface of the object 100 .
  • the actuator 21 is controlled by the controller 31 via an actuator driver 38 of the control device body 30 .
  • Signal light such as reflected light, scattered light, and florescence obtained from the object 100 irradiated with the illumination light is received by the tip ends of a plurality of detection optical fibers 12 constituted of multimode fibers and guided through inside the scope 20 up to the control device body 30 .
  • the control device body 30 further includes: a photodetector 35 (light detecting section); an analog-to-digital converter (ADC) 36 ; and a signal processor 37 , for processing signal light.
  • the photodetector 35 is configured by including light receiving elements such as photodiodes and photomultiplier tubes and a circuit for amplifying and reading out signals, and converts signal light guided through the detection optical fibers 12 , into electric signals. Further, the photodetector 35 is configured to be capable of adjusting offset and image magnification of signals, based on external control signals.
  • the output of the photodetector 35 is converted into a digital signal by the ADC 36 and input to the signal processor 37 .
  • the controller 31 calculates information on the scanning position on the scanning path, based on information such as the start time, amplitude, and phase of the vibration voltage applied by an actuator driver 38 , and delivers the information thus calculated to the signal processor 37 .
  • the output signal from the photodetector 35 is associated with the scanning position information.
  • the controller 31 may hold in advance, as a table, the scanning position information calculated beforehand.
  • the signal processor 37 synchronizes signals of different wavelengths output in time division from the ADC 36 , subjects the signals to necessary image processing such as interpolation processing, emphasis processing, and ⁇ processing, to generate an image of the object 100 , and displays the image on the display 40 .
  • the signal processor 37 may include, for example, a processor for signal processing, a memory, and a program to be executed by the processor for signal processing.
  • the controller 31 synchronously controls the light emission timing controller 32 , the photodetector 35 , the actuator driver 38 , and the signal processor 37 .
  • FIG. 2 is an overview schematically illustrating the scope 20 .
  • the scope 20 includes an operation portion 22 and an insertion portion 23 .
  • the operation portion 22 has the illumination optical fiber 11 , the detection optical fibers 12 , and the wiring cable 13 from the control device body 30 each connected thereto.
  • the illumination optical fiber 11 , the detection optical fibers 12 , and the wiring cable 13 each pass through inside the insertion portion 23 to be guided up to the tip part 24 (the portion inside the broken line of FIG. 2 ) of the insertion portion 23 .
  • FIG. 3 is a sectional view of the tip part 24 of the scope 20 of FIG. 2 .
  • the tip part 24 is configured by including: the actuator 21 ; projection lenses 25 a, 25 b; the illumination optical fiber 11 passing through the center; and the detection optical fibers 12 passing through the outer circumference.
  • the actuator 21 is configured by including: an actuator tube 27 fixed inside the insertion portion 23 of the scope 20 via an attachment ring 26 ; and a fiber holding member 29 and piezoelectric elements 28 a to 28 d disposed inside the actuator tube 27 (see FIGS. 4A and 4B ).
  • the illumination optical fiber 11 is supported by the fiber holding member 29 while having an oscillatably-supported oscillation part 11 b defined between a fixed end 11 a supported by the fiber holding member 29 and the tip part 11 c.
  • the detection optical fibers 12 are arranged so as to pass through the outer periphery of the insertion portion 23 and extends to the tip of the tip part 24 of the insertion portion 23 . Further, the detection optical fibers 12 each include, at the tip part thereof, a detection lens, which is not shown.
  • the projection lenses 25 a, 25 b and a detection lens are disposed at an extreme tip of the tip part 24 .
  • the projection lenses 25 a, 25 b are arranged such that laser light emitted from the tip part 11 c of the illumination optical fiber 11 is irradiated on the object 100 so as to be substantially converged thereon.
  • the projection lenses 25 a, 25 b constitute an optical system which irradiates light emitted from the illumination optical fiber 11 , toward the object 100 .
  • the laser light converged on the object 100 is reflected, scattered, and refracted by the object 100 or obtained as fluorescent, which is taken in as signal light by the detection lens arranged so as to converge and couple the light to the detection optical fibers 12 disposed behind the detection lens.
  • the projection lenses 25 a, 25 b may include a single lens alone or a plurality of lenses, without being limited to the two-lens configuration.
  • FIG. 4A illustrates a vibration driving mechanism of the actuator 21 and the oscillation part 11 b of the illumination optical fiber 11 of the optical scanning endoscope apparatus 10
  • FIG. 4B is A-A sectional view of FIG. 4A
  • the illumination optical fiber 11 passes through the center of the fiber holding member 29 in a prism shape, so as to be held by the fiber holding member 29 .
  • Four side faces of the fiber holding member 29 are each facing +Y-direction, +X-direction and directions opposite thereto.
  • the fiber holding member 29 has the piezoelectric elements 28 a, 28 c fixed in a pair in the +Y-direction and ⁇ Y-direction and the piezoelectric elements 28 b , 28 d fixed in a pair in the +X-direction and ⁇ X-direction.
  • the piezoelectric elements 28 a to 28 d are each connected to the wiring cable 13 from the actuator driver 38 of the control device body 30 .
  • piezoelectric elements 28 b, 28 d disposed opposite to each other in the X-direction across the fiber holding member 29 one expands while the other contracts in a reciprocal manner, to thereby cause deflection in the fiber holding member 29 , which may be repeated to generate vibration in the X-direction. Vibration in the Y-direction may similarly be caused.
  • the piezoelectric elements 28 b and 28 d in the X-direction may employ piezoelectric elements which extend and contract in the same direction with respect to the polarity of the voltage applied, and may always be applied with the same voltage opposite in polarity.
  • the piezoelectric elements 28 a and 28 c in the Y-direction may employ piezoelectric elements which extend and contract in the same direction with respect to the polarity of the voltage applied, and may always be applied with the same voltage opposite in polarity.
  • the actuator driver 38 controls the piezoelectric elements 28 a to 28 d such that the tip part 11 c of the illumination optical fiber 11 draws a spiral locus.
  • the piezoelectric elements 28 b, 28 d for X-direction driving and the piezoelectric elements 28 a, 28 c for Y-direction driving may be applied with alternating voltages which vary with time in amplitude from 0 to a maximum value.
  • the alternating voltages are different from one another in phase by 90°, and have frequencies set in the vicinity of the same resonance frequency.
  • FIG. 5 shows a vibration waveform in the X-direction of the illumination optical fiber 11 .
  • the tip part 11 c of the illumination optical fiber 11 vibrates at predetermined intervals in the X-direction as expanding the amplitude from 0 to a predetermined maximum value.
  • the piezoelectric elements 28 b, 28 d are applied with no voltage or applied with a voltage controlled to reduce the amplitude, which rapidly attenuates the amplitude of the tip part 11 c of the illumination optical fiber 11 .
  • the amplitude in the Y-direction may similarly be expanded and attenuated. In this manner, the tip part 11 c of the illumination optical fiber 11 is drive repeatedly.
  • the controller 31 controls the emission of the lasers 33 R, 33 G, 33 B through the light emission timing controller 32 , in synchronous with the driving of the tip part 11 c of the illumination optical fiber 11 by the actuator driver 38 .
  • the lasers 33 R, 33 G, 33 B are controlled to emit light along the expansion of the amplitude until reaching the maximum value and to turn off during the attenuation thereafter.
  • the tip part 11 c of the illumination optical fiber 11 may be controlled as described above, the illumination light emitted from the tip part 11 c is scanned on the object 100 as illustrated by the solid line of FIG. 6 .
  • the detection property refers to a property of the multiplication factor of a signal detected by the photodetector 35 .
  • the multiplication factor of the photodetector 35 varies with temperature.
  • the control device body 30 includes a temperature sensor 39 for measuring the temperature of the photodetector 35 .
  • An example of the temperature sensor 39 may include a temperature sensor IC, but other types of temperature sensors such as a thermistor and a thermocouple may also be used.
  • the temperature sensor 39 outputs temperature data as digital signals, to a light detection controller 31 a of the controller 31 .
  • the light detection controller 31 a calculates, based on the temperature data, the multiplication factor for the photodetector 35 for obtaining a preferred output signal level, and generates a signal for controlling the photodetector 35 to have the multiplication factor thus calculated.
  • the light detection controller 31 a constitutes part of the controller 31 , and may be implemented as a module constituting part of a program implementing the function of the controller 31 .
  • FIG. 7 is a timing chart showing operation states of the respective components of the optical scanning endoscope apparatus 10 according to Embodiment 1.
  • the lasers 33 R, 33 G, 33 B are turned on for a period to sequentially repeat continuous emission of light and turned off for another period, while scanning the illumination light for one frame (spiral scan for one cycle) on the object 100 .
  • the photodetector 35 detects reflected light and scattered light obtained from the object irradiated with the illumination light and the signal detected by the ADC 36 is digitized to be processed by the signal processor 37 .
  • defined as an effective detection period is a period where the photodetector 35 is detecting illumination light contributing to image formation of the object and outputting electric signals.
  • the photodetector 35 and the signal processor 37 are each in the operation state. However, in the turned-off period, no signal light is generated from the object, no effective detection and processing of pixel information is performed.
  • the light detection controller 31 a receives temperature data from the temperature sensor 39 and sets a multiplication factor for the photodetector 35 , in a period where the lasers 33 R, 33 G, 33 B are turned off, that is, in a period other than the effective detection period.
  • the transmission may be performed across a plurality of frames.
  • data for giving an instruction of changing the multiplication factor is divided into a plurality of pieces, which are sequentially transmitted in a period other than the effective detection period.
  • the photodetector 35 waits until all the data is received, before changing the multiplication factor.
  • Embodiment 1 even when the temperature of the photodetector 35 has changed during the observation by the optical scanning endoscope apparatus 10 , such change in temperature can be detected by the temperature sensor 39 and transmitted to the light detection controller 31 a.
  • the light detection controller 31 a determines the photomultiplication factor for the photodetector 35 and sets the factor to the photodetector 35 . Accordingly, undesired variation in the output of the photodetector 35 can be corrected, allowing a stable observation image to be obtained.
  • data for controlling the detection property of the photodetector 35 is generated and set to the photodetector 35 in a period that does not contribute to image formation, the period being outside the effective detection period, to thereby set the detection property of the photodetector 35 without affecting the quality of the image to be generated.
  • Embodiment 1 illustrates an example where the image data of the object 100 is obtained only in a period where the amplitude of the spiral scan is expanded, with no data obtained in a period where the amplitude is diminished.
  • the method of the spiral scan is not limited thereto, and the period of expanding the amplitude and the period of diminishing the amplitude may be set to substantially the same length of time, so that image data for one frame can be obtained for both of the periods of expanding and diminishing the amplitude. In that case, there may be a period where no illumination light for use in generating effective pixel information is irradiated or detected at the boundary between the frames, when scanning the outermost circumference and/or the center of the spiral scan.
  • the outermost circumferential part of the spiral scan may generate a region not to be displayed on the display 40 when the image is displayed.
  • sampling may be omitted at some points. Accordingly, laser light may be turned off in a period that does not contribute to image formation, the period being outside the effective detection period, to thereby adjust the multiplication factor of the photodetector 35 .
  • FIG. 8 is a timing chart showing operation states of components of the optical scanning endoscope apparatus according to Embodiment 2.
  • the optical scanning endoscope apparatus includes the same components as those of the optical scanning endoscope apparatus 10 of Embodiment 1 illustrated in FIG. 1 , and thus, the description of each component is omitted.
  • the optical scanning endoscope apparatus 10 of Embodiment 2 is different from the optical scanning endoscope apparatus 10 of Embodiment 1 in terms of how each component is controlled by the controller 31 .
  • the lasers 33 R, 33 G, 33 B are turned off when diminishing the amplitude of the spiral scan.
  • the signal processing by the signal processor 37 is stopped, without stopping the sequential pulse emission of the lasers 33 R, 33 G, 33 B. Therefore, in a period where the amplitude of the spiral scan on the object 100 is diminished, light obtained through irradiation of illumination light on the object 100 is only to be detected by the photodetector 35 and then discarded, without being processed by the signal processor 37 . Accordingly, the effective detection period for detecting light obtained from an object for use in generating effective pixel information to be used for effective image generation falls under a period where the signal processor 37 is in operation.
  • the light detection controller 31 a receives output of the temperature sensor 39 , generates a signal for controlling the multiplication factor of the photodetector 35 , and corrects the multiplication factor of the photodetector 35 , in a period where the signal processor 37 is stopped. As described above, even in a period where the lasers 33 R, 33 G, 33 B are emitting light, when the signal light detected by the photodetector 35 does not contribute the image formation by the optical scanning endoscope apparatus 10 , the detection property of the photodetector 35 can be controlled without giving any influence such as distortion or noise on the image to be generated of the object 100 .
  • the signal processor 37 is stopped in a period of diminishing the amplitude with no pixel data of the spiral scan being obtained.
  • the operation of the photodetector 35 may be stopped instead.
  • two or more of the lasers 33 R, 33 G, 33 B, the photodetector 35 , and the signal processor 37 may be stopped.
  • the light detection controller 31 a is controlled to set the multiplication factor of the photodetector 35 in a period other than the period where the photodetector 35 detects signal light to be used for displaying an effective object image in the later process and outputs the signal light as an electric signal.
  • FIG. 9 is a timing chart showing operation states of the components of the optical scanning endoscope apparatus according to Embodiment 3. Unlike Embodiment 1 which controls only the multiplication factor as the detection property of the photodetector 35 , Embodiment 3 additionally controls offset.
  • the optical scanning endoscope apparatus of Embodiment 3 includes the same components as those of the optical scanning endoscope apparatus 10 of Embodiment 1 illustrated in FIG. 1 , and thus the description of the apparatus configuration is omitted.
  • the light detection controller 31 a sequentially executes the control of the multiplication factor of the photodetector 35 based on the temperature detected by the temperature sensor 39 similar to that of Embodiment 1 and the control of offset.
  • the photodetector 35 detects an output level from the ADC 36 in a state where the lasers 33 R, 33 G, 33 B are turned off, and determines the output level as the offset and returns the offset to a desired value when the offset is deviated.
  • the multiplication factor and the offset are controlled at predetermined timings that do not temporally overlap each other.
  • data added with a header indicating the type of the data may be sequentially delivered between the light detection controller 31 a and the photodetector 35 .
  • the aforementioned configuration allows various kinds of detection properties to be set by the light detection controller 31 a to the photodetector 35 , which allows further stable pixel signals to be obtained. Further, the multiplication factor and the offset are controlled at temporally separate timings, which can avoid the inter-signal interference to be otherwise generated due to mutual control of two detection properties, to thereby perform stable control. In particular, inter-signal interference between digital signals output from the temperature sensor 39 to the light detection controller 31 a and signals for detecting and controlling the offset between the photodetector 35 and the light detection controller 31 a can be avoided, which prevents an incorrect value from being set as the offset of the photodetector 35 .
  • the disclosed apparatus is not limited to those of the aforementioned Embodiments, and may be subjected to various alterations and modifications.
  • the method of scanning the object is not limited to spiral scan, which may be Lissajous scan or raster scan.
  • laser irradiation may be stopped when scanning both ends in the lower speed scanning direction, so as to control the detection property of the photodetector by the light detection controller. In this case, the both ends in the low speed scanning direction of the raster scan are not displayed as an image.
  • the detection property of the photodetector is controlled between the frames of the displayed image, but the timing of controlling the detection property of the photodetector is not limited thereto.
  • the detection property of the light detecting section may be controlled during the irradiation of each pulsed light by each laser and reading out of pixel data.
  • the driving mechanism of the optical scanning observation apparatus may employ an electromagnet to use an electromagnetic force for driving, without being limited to those using piezoelectric elements.
  • the lasers serving as light sources of illumination light may be employ lasers of three wavelengths, which may be continuously oscillated (cw oscillation) simultaneously and multiplexed so as to scan the resulting white illumination light on the object, instead of having the lasers to sequentially cause pulse emission at separate timings.
  • the signal light may be separated for each wavelength in the former stage of the light detecting section and detected by different photodetectors, to thereby obtain signals for the respective wavelengths.

Abstract

The optical scanning endoscope apparatus (10) includes: an illumination optical fiber (11) guiding light form lasers (33R, 33G, 33B) and irradiating the light toward an object (100) from an oscillatably-supported tip part of the fiber; an actuator (21) vibratorily driving the tip part of the illumination optical fiber (11); a photodetector (35) detecting light resulting from the object (100) irradiated with the light from the lasers (33R, 33G, 33B) and converting the detected light into an electric signal; a signal processor (37) generating pixel information based on the electric signal output by the photodetector (35); and a light detection controller (31 a) controlling a detection property of the photodetector (35) in a period other than an effective detection period.

Description

CROSS-REFERENCE TO RELATED APPLICATION
The present application is a Continuing Application based on International Application PCT/JP2015/004089 filed on Aug. 18, 2015, which, in turn, claims priority to Japanese Patent Application No. 2014-177164 filed on Sep. 1, 2014, the entire disclosure of these earlier applications being herein incorporated by reference.
TECHNICAL FIELD
The present disclosure relates to an optical scanning observation apparatus which scans light on an object to detect light resulting from the irradiated object, to thereby perform observation.
BACKGROUND ART
Optical scanning observation apparatuses have been conventionally known (see, for example, JP 2013-121455A (PTL 1)). The apparatuses is configured to irradiate laser light emitted from a fiber to form a spot on an observation object, where the tip part of the fiber is caused to vibrate, to thereby spirally scan or raster scan the irradiation position of the laser light. Then, signal light such as transmitted light, reflected light, and fluorescence resulting from the observation object are detected by the light detecting section and converted into an electric signal, which is associated with data on the scanning position at each scan point, to thereby generate image data. An example of such apparatus may include, for example, an optical scanning endoscope apparatus for observing living tissues.
CITATION LIST Patent Literature
PTL 1: JP2013-121455A
SUMMARY
The disclosed optical scanning observation apparatus, which scans light from a light source onto an object to obtain an image of the object, includes:
    • a fiber guiding light form the light source and irradiating the light toward the object from an oscillatably-supported tip part of the fiber;
    • an actuator vibratorily driving the tip part of the fiber;
    • a light detecting section detecting light resulting from the object irradiated with the light from the light source and converting the detected light into an electric signal;
    • a signal processor generating pixel information based on the electric signal output by the light detecting section; and
    • a light detection controller controlling a detection property of the light detecting section in a period other than an effective detection period, the effective detection period being an period where the light detecting section detects light obtained from the object and outputs the electric signal, the electric signal output by the light detecting section being used in the signal processor for generating effective pixel information on an image of the object.
The term “effective” pixel information on the object herein refers to image information for use in generating an image of the object to be output for observation by the optical scanning observation apparatus.
Preferably, the detection property of the light detecting section may be a photomultiplication factor. Alternatively, the detection property of the light detecting section may be an offset.
Further, the light detecting section may have a plurality of detection properties, and the light detection controller may sequentially control the plurality of detection properties in a period other than the effective detection period.
The actuator may drive the fiber in a predetermined scanning pattern to repeatedly perform scanning for one frame on the object, and the light detection controller may control the detection property in a period positioned at a boundary between temporally-adjacent frames and outside the effective detection period.
BRIEF DESCRIPTION OF DRAWINGS
In the accompanying drawings:
FIG. 1 is a block diagram illustrating a schematic configuration of an optical scanning endoscope apparatus as an example of the disclosed optical scanning observation apparatus according to Embodiment 1;
FIG. 2 is an overview schematically illustrating the scope of the optical scanning endoscope apparatus of FIG. 1;
FIG. 3 is a sectional view of the tip part of the scope of FIG. 2;
FIGS. 4A and 4B each illustrate the actuator and the oscillation part of the illumination optical fiber of the optical scanning endoscope apparatus, in which FIG. 4A is a side view thereof, and FIG. 4B is A-A sectional view of FIG. 4A;
FIG. 5 shows vibration waveforms in the x-direction and y-direction of the illumination optical fiber;
FIG. 6 shows a scanning locus of irradiation light on the observation object;
FIG. 7 is a timing chart showing operation states of components of the optical scanning endoscope apparatus according to Embodiment 1;
FIG. 8 is a timing chart showing operation states of components of the optical scanning endoscope apparatus according to Embodiment 2; and
FIG. 9 is a timing chart showing operation states of components of the optical scanning endoscope apparatus according to Embodiment 3.
DESCRIPTION OF EMBODIMENTS
The optical scanning observation apparatus may use, as light receiving elements of the light detecting section, photodiodes and photomultiplier tubes. Photodetectors output an analog signal corresponding to the received light, but its multiplication factor and offset are known to vary depending on changes in temperature and in use conditions during operation. Thus, in order to obtain stable output, the temperature and offset of the light detecting section need be detected as appropriate to correct the photodetector, based on the detected temperature and offset.
However, no such apparatus capable of correcting the light detecting section as described above has been hitherto proposed. A conceivable method of correcting the temperature may involve providing a temperature sensor for measuring the temperature of the light detecting section to detect the temperature of the light detecting section in operation, to thereby output, to the light detecting section, a signal for correcting the multiplication factor based on the detection result. Here, assuming a case where the temperature sensor detecting the temperature outputs a digital signal, when the temperature is detected simultaneously with the light detecting section detecting signal light and outputting electric signals, digital processing operates in the temperature sensor, which may potentially cause high frequency noise to flow into the output signal of the light detecting section under the influence of the clock. When the output of the light detecting section is affected by high frequency noise, the resulting image data also includes noise, deteriorating the quality of output image.
The offset may be obtained from the photodetector, with the irradiation of laser light being stopped. However, when the output of digital signals by the temperature sensor and the detection and adjustment of the offset from the photodetector temporally overlap, signals from the temperature sensor and from the photodetector interfere with each other, which may result in incorrect setting of the offset. This case also fails to obtain an image with stable quality.
It could therefore be helpful to provide an optical scanning observation apparatus capable of adjusting the detection property of the photodetector without affecting the output of an image of the observation object.
The following describes Embodiments of the disclosed apparatus, with reference to the drawings.
Embodiment 1
FIG. 1 is a block diagram illustrating a schematic configuration of an optical scanning endoscope apparatus 10 as an example of the disclosed optical scanning observation apparatus according to Embodiment 1. The optical scanning endoscope apparatus 10 is configured by including: a scope 20, a control device body 30, and a display 40.
The control device body 30 is configured by including: a controller 31 for controlling throughout the optical scanning endoscope apparatus 10; a light emission timing controller 32; lasers 33R, 33G, 33B; and a coupler 34. The light emission timing controller 32 causes, based on the light emission timing instructed by the controller 31, the lasers 33R, 33G, 33B emitting laser lights of three primary colors of red (R), green (G), and blue (B), respectively, to sequentially emit lights at designated timings.
Exemplary lasers that can be used as the lasers 33R, 33G, 33B may include, for example, a diode-pump solid state (DPSS) laser and a laser diode. The paths of laser lights emitted by the lasers 33R, 33G, 33B are coupled, via a coupler 34, to an illumination optical fiber 11 as the same single mode fiber. Needless to say, the light source of the optical scanning endoscope apparatus 10 may use other plurality of light sources, without being limited to the aforementioned configuration. Further, the lasers 33R, 33G, 33B and the coupler 34 may be stored in a separate casing different from the control device body 30, the separate casing being connected to the control device body 30 via a signal line.
The illumination optical fiber 11 is connected through to the tip part of the scope 20, and light incident on the illumination optical fiber 11 from the coupler 34 is guided through to the tip part of the scope 20 to be irradiated as illumination light toward an object 100. Along therewith, an actuator 21 is vibratorily driven, which causes the illumination light emitted from the illumination optical fiber 11 to be spirally scanned on the observation surface of the object 100. The actuator 21 is controlled by the controller 31 via an actuator driver 38 of the control device body 30. Signal light such as reflected light, scattered light, and florescence obtained from the object 100 irradiated with the illumination light is received by the tip ends of a plurality of detection optical fibers 12 constituted of multimode fibers and guided through inside the scope 20 up to the control device body 30.
The control device body 30 further includes: a photodetector 35 (light detecting section); an analog-to-digital converter (ADC) 36; and a signal processor 37, for processing signal light. The photodetector 35 is configured by including light receiving elements such as photodiodes and photomultiplier tubes and a circuit for amplifying and reading out signals, and converts signal light guided through the detection optical fibers 12, into electric signals. Further, the photodetector 35 is configured to be capable of adjusting offset and image magnification of signals, based on external control signals.
The output of the photodetector 35 is converted into a digital signal by the ADC 36 and input to the signal processor 37. The controller 31 calculates information on the scanning position on the scanning path, based on information such as the start time, amplitude, and phase of the vibration voltage applied by an actuator driver 38, and delivers the information thus calculated to the signal processor 37. As a result, the output signal from the photodetector 35 is associated with the scanning position information. Here, the controller 31 may hold in advance, as a table, the scanning position information calculated beforehand. The signal processor 37 synchronizes signals of different wavelengths output in time division from the ADC 36, subjects the signals to necessary image processing such as interpolation processing, emphasis processing, and γ processing, to generate an image of the object 100, and displays the image on the display 40. The signal processor 37 may include, for example, a processor for signal processing, a memory, and a program to be executed by the processor for signal processing.
In the aforementioned processing, the controller 31 synchronously controls the light emission timing controller 32, the photodetector 35, the actuator driver 38, and the signal processor 37.
FIG. 2 is an overview schematically illustrating the scope 20. The scope 20 includes an operation portion 22 and an insertion portion 23. The operation portion 22 has the illumination optical fiber 11, the detection optical fibers 12, and the wiring cable 13 from the control device body 30 each connected thereto. The illumination optical fiber 11, the detection optical fibers 12, and the wiring cable 13 each pass through inside the insertion portion 23 to be guided up to the tip part 24 (the portion inside the broken line of FIG. 2) of the insertion portion 23.
FIG. 3 is a sectional view of the tip part 24 of the scope 20 of FIG. 2. The tip part 24 is configured by including: the actuator 21; projection lenses 25 a, 25 b; the illumination optical fiber 11 passing through the center; and the detection optical fibers 12 passing through the outer circumference.
The actuator 21 is configured by including: an actuator tube 27 fixed inside the insertion portion 23 of the scope 20 via an attachment ring 26; and a fiber holding member 29 and piezoelectric elements 28 a to 28 d disposed inside the actuator tube 27 (see FIGS. 4A and 4B). The illumination optical fiber 11 is supported by the fiber holding member 29 while having an oscillatably-supported oscillation part 11 b defined between a fixed end 11 a supported by the fiber holding member 29 and the tip part 11 c. Meanwhile, the detection optical fibers 12 are arranged so as to pass through the outer periphery of the insertion portion 23 and extends to the tip of the tip part 24 of the insertion portion 23. Further, the detection optical fibers 12 each include, at the tip part thereof, a detection lens, which is not shown.
Further, the projection lenses 25 a, 25 b and a detection lens (not shown) are disposed at an extreme tip of the tip part 24. The projection lenses 25 a, 25 b are arranged such that laser light emitted from the tip part 11 c of the illumination optical fiber 11 is irradiated on the object 100 so as to be substantially converged thereon. Thus, the projection lenses 25 a, 25 b constitute an optical system which irradiates light emitted from the illumination optical fiber 11, toward the object 100. The laser light converged on the object 100 is reflected, scattered, and refracted by the object 100 or obtained as fluorescent, which is taken in as signal light by the detection lens arranged so as to converge and couple the light to the detection optical fibers 12 disposed behind the detection lens. The projection lenses 25 a, 25 b may include a single lens alone or a plurality of lenses, without being limited to the two-lens configuration.
FIG. 4A illustrates a vibration driving mechanism of the actuator 21 and the oscillation part 11 b of the illumination optical fiber 11 of the optical scanning endoscope apparatus 10, and FIG. 4B is A-A sectional view of FIG. 4A. The illumination optical fiber 11 passes through the center of the fiber holding member 29 in a prism shape, so as to be held by the fiber holding member 29. Four side faces of the fiber holding member 29 are each facing +Y-direction, +X-direction and directions opposite thereto. Then, the fiber holding member 29 has the piezoelectric elements 28 a, 28 c fixed in a pair in the +Y-direction and −Y-direction and the piezoelectric elements 28 b, 28 d fixed in a pair in the +X-direction and −X-direction.
The piezoelectric elements 28 a to 28 d are each connected to the wiring cable 13 from the actuator driver 38 of the control device body 30.
Of the piezoelectric elements 28 b, 28 d disposed opposite to each other in the X-direction across the fiber holding member 29, one expands while the other contracts in a reciprocal manner, to thereby cause deflection in the fiber holding member 29, which may be repeated to generate vibration in the X-direction. Vibration in the Y-direction may similarly be caused. For example, the piezoelectric elements 28 b and 28 d in the X-direction may employ piezoelectric elements which extend and contract in the same direction with respect to the polarity of the voltage applied, and may always be applied with the same voltage opposite in polarity. Similarly, the piezoelectric elements 28 a and 28 c in the Y-direction may employ piezoelectric elements which extend and contract in the same direction with respect to the polarity of the voltage applied, and may always be applied with the same voltage opposite in polarity.
The actuator driver 38 controls the piezoelectric elements 28 a to 28 d such that the tip part 11 c of the illumination optical fiber 11 draws a spiral locus. Specifically, the piezoelectric elements 28 b, 28 d for X-direction driving and the piezoelectric elements 28 a, 28 c for Y-direction driving may be applied with alternating voltages which vary with time in amplitude from 0 to a maximum value. The alternating voltages are different from one another in phase by 90°, and have frequencies set in the vicinity of the same resonance frequency.
FIG. 5 shows a vibration waveform in the X-direction of the illumination optical fiber 11. As illustrated in FIG. 5, the tip part 11 c of the illumination optical fiber 11 vibrates at predetermined intervals in the X-direction as expanding the amplitude from 0 to a predetermined maximum value. When the amplitude reaches the maximum value, the piezoelectric elements 28 b, 28 d are applied with no voltage or applied with a voltage controlled to reduce the amplitude, which rapidly attenuates the amplitude of the tip part 11 c of the illumination optical fiber 11. The amplitude in the Y-direction may similarly be expanded and attenuated. In this manner, the tip part 11 c of the illumination optical fiber 11 is drive repeatedly.
The controller 31 controls the emission of the lasers 33R, 33G, 33B through the light emission timing controller 32, in synchronous with the driving of the tip part 11 c of the illumination optical fiber 11 by the actuator driver 38. The lasers 33R, 33G, 33B are controlled to emit light along the expansion of the amplitude until reaching the maximum value and to turn off during the attenuation thereafter. The tip part 11 c of the illumination optical fiber 11 may be controlled as described above, the illumination light emitted from the tip part 11 c is scanned on the object 100 as illustrated by the solid line of FIG. 6.
Next, returning to FIG. 1, a method of controlling detection property of the photodetector 35 is described. Here, the detection property refers to a property of the multiplication factor of a signal detected by the photodetector 35. The multiplication factor of the photodetector 35 varies with temperature. Thus, the control device body 30 includes a temperature sensor 39 for measuring the temperature of the photodetector 35. An example of the temperature sensor 39 may include a temperature sensor IC, but other types of temperature sensors such as a thermistor and a thermocouple may also be used. The temperature sensor 39 outputs temperature data as digital signals, to a light detection controller 31 a of the controller 31. The light detection controller 31 a calculates, based on the temperature data, the multiplication factor for the photodetector 35 for obtaining a preferred output signal level, and generates a signal for controlling the photodetector 35 to have the multiplication factor thus calculated. The light detection controller 31 a constitutes part of the controller 31, and may be implemented as a module constituting part of a program implementing the function of the controller 31.
Next, description is given of the timing of controlling the photodetector 35 by the light detection controller 31 a. FIG. 7 is a timing chart showing operation states of the respective components of the optical scanning endoscope apparatus 10 according to Embodiment 1. As explained with reference to FIGS. 5 and 6, the lasers 33R, 33G, 33B are turned on for a period to sequentially repeat continuous emission of light and turned off for another period, while scanning the illumination light for one frame (spiral scan for one cycle) on the object 100. During the period where the lasers 33R, 33G, 33B are emitting light, the photodetector 35 detects reflected light and scattered light obtained from the object irradiated with the illumination light and the signal detected by the ADC 36 is digitized to be processed by the signal processor 37. As described above, defined as an effective detection period is a period where the photodetector 35 is detecting illumination light contributing to image formation of the object and outputting electric signals. Meanwhile, as illustrated in FIG. 7, despite that the lasers 33R, 33G, 33B are turned off, the photodetector 35 and the signal processor 37 are each in the operation state. However, in the turned-off period, no signal light is generated from the object, no effective detection and processing of pixel information is performed.
The light detection controller 31 a receives temperature data from the temperature sensor 39 and sets a multiplication factor for the photodetector 35, in a period where the lasers 33R, 33G, 33B are turned off, that is, in a period other than the effective detection period. In a case where the reception of temperature data and the transmission of data on the multiplication factor to be set to the photodetector 35 should fail to be completed within one frame of the period where the lasers 33R, 33G, 33B are turned off, the transmission may be performed across a plurality of frames. In this case, data for giving an instruction of changing the multiplication factor is divided into a plurality of pieces, which are sequentially transmitted in a period other than the effective detection period. The photodetector 35 waits until all the data is received, before changing the multiplication factor.
In this manner, according to Embodiment 1, even when the temperature of the photodetector 35 has changed during the observation by the optical scanning endoscope apparatus 10, such change in temperature can be detected by the temperature sensor 39 and transmitted to the light detection controller 31 a. The light detection controller 31 a determines the photomultiplication factor for the photodetector 35 and sets the factor to the photodetector 35. Accordingly, undesired variation in the output of the photodetector 35 can be corrected, allowing a stable observation image to be obtained. Further, data for controlling the detection property of the photodetector 35 is generated and set to the photodetector 35 in a period that does not contribute to image formation, the period being outside the effective detection period, to thereby set the detection property of the photodetector 35 without affecting the quality of the image to be generated.
Here, Embodiment 1 illustrates an example where the image data of the object 100 is obtained only in a period where the amplitude of the spiral scan is expanded, with no data obtained in a period where the amplitude is diminished. However, the method of the spiral scan is not limited thereto, and the period of expanding the amplitude and the period of diminishing the amplitude may be set to substantially the same length of time, so that image data for one frame can be obtained for both of the periods of expanding and diminishing the amplitude. In that case, there may be a period where no illumination light for use in generating effective pixel information is irradiated or detected at the boundary between the frames, when scanning the outermost circumference and/or the center of the spiral scan. For example, the outermost circumferential part of the spiral scan may generate a region not to be displayed on the display 40 when the image is displayed. In the vicinity of the center of the spiral scan, where the density of the sampling points is high, sampling may be omitted at some points. Accordingly, laser light may be turned off in a period that does not contribute to image formation, the period being outside the effective detection period, to thereby adjust the multiplication factor of the photodetector 35.
Embodiment 2
FIG. 8 is a timing chart showing operation states of components of the optical scanning endoscope apparatus according to Embodiment 2. The optical scanning endoscope apparatus includes the same components as those of the optical scanning endoscope apparatus 10 of Embodiment 1 illustrated in FIG. 1, and thus, the description of each component is omitted.
The optical scanning endoscope apparatus 10 of Embodiment 2 is different from the optical scanning endoscope apparatus 10 of Embodiment 1 in terms of how each component is controlled by the controller 31. In Embodiment 1, the lasers 33R, 33G, 33B are turned off when diminishing the amplitude of the spiral scan. In Embodiment 2, however, the signal processing by the signal processor 37 is stopped, without stopping the sequential pulse emission of the lasers 33R, 33G, 33B. Therefore, in a period where the amplitude of the spiral scan on the object 100 is diminished, light obtained through irradiation of illumination light on the object 100 is only to be detected by the photodetector 35 and then discarded, without being processed by the signal processor 37. Accordingly, the effective detection period for detecting light obtained from an object for use in generating effective pixel information to be used for effective image generation falls under a period where the signal processor 37 is in operation.
The light detection controller 31 a receives output of the temperature sensor 39, generates a signal for controlling the multiplication factor of the photodetector 35, and corrects the multiplication factor of the photodetector 35, in a period where the signal processor 37 is stopped. As described above, even in a period where the lasers 33R, 33G, 33B are emitting light, when the signal light detected by the photodetector 35 does not contribute the image formation by the optical scanning endoscope apparatus 10, the detection property of the photodetector 35 can be controlled without giving any influence such as distortion or noise on the image to be generated of the object 100.
In the aforementioned description, the signal processor 37 is stopped in a period of diminishing the amplitude with no pixel data of the spiral scan being obtained. However, the operation of the photodetector 35 may be stopped instead. Alternatively, two or more of the lasers 33R, 33G, 33B, the photodetector 35, and the signal processor 37 may be stopped. The light detection controller 31 a is controlled to set the multiplication factor of the photodetector 35 in a period other than the period where the photodetector 35 detects signal light to be used for displaying an effective object image in the later process and outputs the signal light as an electric signal.
Embodiment 3
FIG. 9 is a timing chart showing operation states of the components of the optical scanning endoscope apparatus according to Embodiment 3. Unlike Embodiment 1 which controls only the multiplication factor as the detection property of the photodetector 35, Embodiment 3 additionally controls offset. The optical scanning endoscope apparatus of Embodiment 3 includes the same components as those of the optical scanning endoscope apparatus 10 of Embodiment 1 illustrated in FIG. 1, and thus the description of the apparatus configuration is omitted.
When the lasers 33R, 33G, 33B are turned off along with the reduction of the amplitude during the spiral scan, the light detection controller 31 a sequentially executes the control of the multiplication factor of the photodetector 35 based on the temperature detected by the temperature sensor 39 similar to that of Embodiment 1 and the control of offset. To control offset, for example, the photodetector 35 detects an output level from the ADC 36 in a state where the lasers 33R, 33G, 33B are turned off, and determines the output level as the offset and returns the offset to a desired value when the offset is deviated. The multiplication factor and the offset are controlled at predetermined timings that do not temporally overlap each other. Alternatively, data added with a header indicating the type of the data may be sequentially delivered between the light detection controller 31 a and the photodetector 35.
The aforementioned configuration allows various kinds of detection properties to be set by the light detection controller 31 a to the photodetector 35, which allows further stable pixel signals to be obtained. Further, the multiplication factor and the offset are controlled at temporally separate timings, which can avoid the inter-signal interference to be otherwise generated due to mutual control of two detection properties, to thereby perform stable control. In particular, inter-signal interference between digital signals output from the temperature sensor 39 to the light detection controller 31 a and signals for detecting and controlling the offset between the photodetector 35 and the light detection controller 31 a can be avoided, which prevents an incorrect value from being set as the offset of the photodetector 35.
The disclosed apparatus is not limited to those of the aforementioned Embodiments, and may be subjected to various alterations and modifications. For example, the method of scanning the object is not limited to spiral scan, which may be Lissajous scan or raster scan. For example, in the case of raster scan, laser irradiation may be stopped when scanning both ends in the lower speed scanning direction, so as to control the detection property of the photodetector by the light detection controller. In this case, the both ends in the low speed scanning direction of the raster scan are not displayed as an image.
Further, in Embodiments above, the detection property of the photodetector is controlled between the frames of the displayed image, but the timing of controlling the detection property of the photodetector is not limited thereto. For example, the detection property of the light detecting section may be controlled during the irradiation of each pulsed light by each laser and reading out of pixel data.
Further, the driving mechanism of the optical scanning observation apparatus may employ an electromagnet to use an electromagnetic force for driving, without being limited to those using piezoelectric elements. The lasers serving as light sources of illumination light may be employ lasers of three wavelengths, which may be continuously oscillated (cw oscillation) simultaneously and multiplexed so as to scan the resulting white illumination light on the object, instead of having the lasers to sequentially cause pulse emission at separate timings. In the case of scanning white illumination light, the signal light may be separated for each wavelength in the former stage of the light detecting section and detected by different photodetectors, to thereby obtain signals for the respective wavelengths.
REFERENCE SIGNS LIST
  • 10 optical scanning endoscope apparatus
  • 11 illumination optical fiber
  • 11 a fixed end
  • 11 b oscillation part
  • 11 c tip part
  • 12 detection optical fiber
  • 13 wiring cable
  • 20 scope
  • 21 actuator
  • 22 operation portion
  • 23 insertion portion
  • 24 tip part
  • 25 a, 25 b projection lens
  • 26 attachment ring
  • 27 actuator tube
  • 28 a to 28 d piezoelectric element
  • 29 fiber holding member
  • 30 control device body
  • 31 controller
  • 31 a light detection controller
  • 32 light emission timing controller
  • 33R, 33G, 33B laser
  • 34 coupler
  • 35 photodetector
  • 36 ADC
  • 37 signal processor
  • 38 actuator driver
  • 40 display

Claims (5)

The invention claimed is:
1. An optical scanning observation apparatus which scans light from a light source onto an object to obtain an image of the object, the apparatus comprising:
a fiber guiding light form the light source and irradiating the light toward the object from an oscillatably-supported tip part of the fiber;
an actuator vibratorily driving the tip part of the fiber;
a light detecting section detecting light resulting from the object irradiated with the light from the light source and converting the detected light into an electric signal;
a signal processor generating pixel information based on the electric signal output by the light detecting section; and
a light detection controller controlling a detection property of the light detecting section in a period other than an effective detection period, the effective detection period being an period where the light detecting section detects light obtained from the object and outputs the electric signal, the electric signal output by the light detecting section being used in the signal processor for generating effective pixel information on an image of the object.
2. The optical scanning observation apparatus according to claim 1, wherein the detection property of the light detecting section is a photomultiplication factor.
3. The optical scanning observation apparatus according to claim 1, wherein the detection property of the light detecting section is an offset.
4. The optical scanning observation apparatus according to claim 1, wherein the light detecting section has a plurality of detection properties, and the light detection controller sequentially controls the plurality of detection properties in a period other than the effective detection period.
5. The optical scanning observation apparatus according to claims 1, wherein the actuator drives the fiber in a predetermined scanning pattern to repeatedly perform scanning for one frame on the object, and the light detection controller controls the detection property in a period positioned at a boundary between temporally-adjacent frames and outside the effective detection period.
US15/444,895 2014-09-01 2017-02-28 Optical scanning observation apparatus Active 2035-08-30 US10025087B2 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP2014-177164 2014-09-01
JP2014177164A JP6445809B2 (en) 2014-09-01 2014-09-01 Optical scanning observation device
PCT/JP2015/004089 WO2016035265A1 (en) 2014-09-01 2015-08-18 Optical scanning observation device

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2015/004089 Continuation WO2016035265A1 (en) 2014-09-01 2015-08-18 Optical scanning observation device

Publications (2)

Publication Number Publication Date
US20170168286A1 US20170168286A1 (en) 2017-06-15
US10025087B2 true US10025087B2 (en) 2018-07-17

Family

ID=55439355

Family Applications (1)

Application Number Title Priority Date Filing Date
US15/444,895 Active 2035-08-30 US10025087B2 (en) 2014-09-01 2017-02-28 Optical scanning observation apparatus

Country Status (5)

Country Link
US (1) US10025087B2 (en)
JP (1) JP6445809B2 (en)
CN (1) CN106572787B (en)
DE (1) DE112015003539T5 (en)
WO (1) WO2016035265A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11033173B2 (en) * 2019-03-19 2021-06-15 Sony Olympus Medical Solutions Inc. Medical light source device and medical observation system

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108601504A (en) * 2016-11-25 2018-09-28 深圳迈瑞生物医疗电子股份有限公司 A kind of endoscopic system and its control method

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020188176A1 (en) 2001-06-08 2002-12-12 Fuji Photo Film Co., Ltd. Endoscope apparatus and method of controlling same
JP2004073532A (en) 2002-08-20 2004-03-11 Fuji Photo Film Co Ltd Imaging device
JP2013121455A (en) 2011-12-12 2013-06-20 Hoya Corp Scanning type endoscope system
US9921098B2 (en) * 2014-03-20 2018-03-20 Olympus Corporation Optical unit and endoscope system
US9943216B2 (en) * 2014-05-02 2018-04-17 Olympus Corporation Mucous membrane lifting instrument for endoscope and endoscopic treatment system
US9949645B2 (en) * 2011-03-31 2018-04-24 Olympus Corporation Fluorescence imaging apparatus for identifying fluorescence region based on specified processing condition and superimposing fluorescence region at corresponding region in return-light image

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070213618A1 (en) * 2006-01-17 2007-09-13 University Of Washington Scanning fiber-optic nonlinear optical imaging and spectroscopy endoscope
JP2014145942A (en) * 2013-01-29 2014-08-14 Olympus Corp Optical scanning observation device

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020188176A1 (en) 2001-06-08 2002-12-12 Fuji Photo Film Co., Ltd. Endoscope apparatus and method of controlling same
JP2002360510A (en) 2001-06-08 2002-12-17 Fuji Photo Film Co Ltd Endoscopic apparatus and control method for the same
JP2004073532A (en) 2002-08-20 2004-03-11 Fuji Photo Film Co Ltd Imaging device
US9949645B2 (en) * 2011-03-31 2018-04-24 Olympus Corporation Fluorescence imaging apparatus for identifying fluorescence region based on specified processing condition and superimposing fluorescence region at corresponding region in return-light image
JP2013121455A (en) 2011-12-12 2013-06-20 Hoya Corp Scanning type endoscope system
US9921098B2 (en) * 2014-03-20 2018-03-20 Olympus Corporation Optical unit and endoscope system
US9943216B2 (en) * 2014-05-02 2018-04-17 Olympus Corporation Mucous membrane lifting instrument for endoscope and endoscopic treatment system

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
Chinese Office Action dated Sep. 5, 2017 received in 201580044490.8.
English translation of International Preliminary Report on Patentability dated Mar. 16, 2017 together with the Written Opinion received in related International Application No. PCT/JP2015/004089.
International Search Report dated Nov. 17, 2015 issued in PCT/JP2015/004089.
Japanese Office Action dated May 8, 2018 in Japanese Patent Application No. 2014-177164.

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11033173B2 (en) * 2019-03-19 2021-06-15 Sony Olympus Medical Solutions Inc. Medical light source device and medical observation system

Also Published As

Publication number Publication date
DE112015003539T5 (en) 2017-04-27
JP2016049336A (en) 2016-04-11
CN106572787A (en) 2017-04-19
US20170168286A1 (en) 2017-06-15
JP6445809B2 (en) 2018-12-26
WO2016035265A1 (en) 2016-03-10
CN106572787B (en) 2018-05-08

Similar Documents

Publication Publication Date Title
US10151914B2 (en) Optical scanning observation apparatus
US20160150948A1 (en) Optical scanning unit, optical scanning observation apparatus, and optical fiber scanning apparatus
US20170090181A1 (en) Optical scanning endoscope apparatus
US9993139B2 (en) Optical scanning observation apparatus and optical scanning observation method
US9345396B2 (en) Scanning endoscope system
US20160327782A1 (en) Optical scanning observation apparatus
US10025087B2 (en) Optical scanning observation apparatus
JP2010148764A (en) Optical scanning endoscope apparatus, optical scanning endoscope, and optical scanning endoscope processor
US20170227755A1 (en) Optical scanning endoscope apparatus
US20170311779A1 (en) Optical scanning endoscope apparatus
US10034599B2 (en) Scanning endoscope apparatus with scanning endoscope and determination circuit for determining whether scanning endoscope is abnormal
JP6143953B2 (en) Scanning endoscope system
JP5974208B1 (en) Optical scanning observation system
JP6218596B2 (en) Scanning observation device
JP6265781B2 (en) Endoscope system and control method of endoscope system
US20180309915A1 (en) Optical scanning observation apparatus and method for adjusting irradiation parameter of pulsed laser light
WO2016017199A1 (en) Optical scanning observation system
JP6382004B2 (en) Optical scanning observation device
WO2017109814A1 (en) Light scanning observation device
JP6081678B1 (en) Scanning endoscope
WO2017195256A1 (en) Optical scanning type observation device and optical scanning type observation method
JP6424035B2 (en) Optical scanning observation apparatus and pulsed laser beam irradiation parameter adjustment method

Legal Events

Date Code Title Description
AS Assignment

Owner name: OLYMPUS CORPORATION, JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:MORI, TAKESHI;REEL/FRAME:041400/0340

Effective date: 20170214

STCF Information on status: patent grant

Free format text: PATENTED CASE

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 4