JP2015123106A - Scan type observation device - Google Patents

Scan type observation device Download PDF

Info

Publication number
JP2015123106A
JP2015123106A JP2013267486A JP2013267486A JP2015123106A JP 2015123106 A JP2015123106 A JP 2015123106A JP 2013267486 A JP2013267486 A JP 2013267486A JP 2013267486 A JP2013267486 A JP 2013267486A JP 2015123106 A JP2015123106 A JP 2015123106A
Authority
JP
Japan
Prior art keywords
electromagnetic wave
light
laser
object
unit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
JP2013267486A
Other languages
Japanese (ja)
Other versions
JP6218596B2 (en
Inventor
祐平 高田
Yuhei Takada
祐平 高田
Original Assignee
オリンパス株式会社
Olympus Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by オリンパス株式会社, Olympus Corp filed Critical オリンパス株式会社
Priority to JP2013267486A priority Critical patent/JP6218596B2/en
Publication of JP2015123106A publication Critical patent/JP2015123106A/en
Application granted granted Critical
Publication of JP6218596B2 publication Critical patent/JP6218596B2/en
Application status is Active legal-status Critical
Anticipated expiration legal-status Critical

Links

Images

Abstract

PROBLEM TO BE SOLVED: To provide a scan type observation device capable of improving the S/N and the brightness of an image.SOLUTION: The scan type observation device includes electromagnetic wave sources 33R, 33G, 33B, an electromagnetic wave source drive part 32 for making the electromagnetic wave sources 33R, 33G, 33B emit a pulse-shaped electromagnetic wave, scanning parts 11, 21 for emitting a pulse-shaped electromagnetic wave to an object 100 to scan the object 100, an electromagnetic wave detection part 35 for detecting an electromagnetic wave obtained from the object 100 by emitting the pulse-shaped electromagnetic wave and converting the electromagnetic wave into an analog electric signal, an analog/digital conversion part 36 for sampling the electric signal from the electromagnetic wave detection part 35 to convert the sampled electric signal into a digital signal, an image processing part 37 for generating an image of the object 100 on the basis of an output of the analog/digital conversion part 36, and a control part 31 for relatively controlling the emission timing of the pulse-shaped electromagnetic wave from the electromagnetic sources 33R, 33G, 33B by the electromagnetic wave drive part 32 and sampling timing of the electric signal from the electromagnetic wave detection part 35 by the analog/digital conversion part 36.

Description

  The present invention relates to a scanning observation apparatus.

  As a conventional scanning observation apparatus, for example, an optical fiber scanning endoscope that obtains an image by driving the tip of an optical fiber in a spiral shape and scanning an object with light is known (for example, Patent Document 1). reference). In the optical fiber scanning endoscope disclosed in Patent Document 1, three color lasers that emit red (R), green (G), and blue (B) light are used as light sources, and pulsed light from these lasers. Are combined to generate white pulsed light, and the generated pulsed light is guided by an optical fiber to irradiate the object. The return light from the object is guided by the image fiber, split into R, G, and B light by the spectral filter, and the split light is received by the respective photodetectors, and the output signals thereof. And an image is constructed based on the scanning position of the optical fiber.

JP 2010-142602 A

  However, in the optical fiber scanning endoscope disclosed in Patent Document 1, the object is irradiated with white light, the return light is split into R, G, and B light, and the respective photodetectors are used. Since it receives light, a spectral filter and respective photodetectors for R, G, and B are required. For this reason, the number of parts is large, resulting in an increase in size and cost of the apparatus. In addition, the light loss due to the spectral filter is increased, and it is difficult to obtain a bright image.

  As a solution, for example, it is assumed that RGB lasers are sequentially switched in accordance with the sampling rate, and the target is sequentially irradiated with RGB pulsed light. In this way, since no spectral filter is required and only one photodetector is required, the number of components can be reduced, the size and cost of the apparatus can be reduced, the loss of light amount can be reduced, and a bright image can be obtained. There are advantages.

  However, as a result of intensive studies by the present inventors, the peak of the output waveform of the pulsed light emitted from each of the RGB lasers varies depending on the characteristics of the laser diode, temperature, changes with time, manufacturing variations, etc. in the semiconductor laser. Arise. In addition, the responsiveness of the photodetector also varies due to temperature, changes with time, manufacturing variations, and the like. Further, when the output signal of the photodetector is sampled through a circuit filter such as a band pass filter, a delay occurs in the output signal due to the responsiveness of the circuit filter, and the delay amount is also affected by the temperature or the like. Also, the driving of the tip of the optical fiber has a variation in the locus that the tip does not pass the same position at the same timing.

  Therefore, even if the output signal of the photodetector is sampled by sequentially switching the RGB lasers according to the sampling rate, the peak of the output waveform of the pulsed light emitted from each laser and the output signal of the photodetector It has been found that the sampling timing does not necessarily match, and the S / N and brightness of the image may decrease. Such a problem occurs similarly in various scanning observation apparatuses that emit pulsed electromagnetic waves.

  Accordingly, an object of the present invention made in view of such a viewpoint is to provide a scanning observation apparatus capable of improving the S / N and brightness of an image.

A scanning observation apparatus according to the present invention that achieves the above object is
An electromagnetic source,
An electromagnetic wave source driving unit for emitting a pulsed electromagnetic wave from the electromagnetic wave source;
A scanning unit that scans the object by irradiating the object with the pulsed electromagnetic wave;
An electromagnetic wave detection unit that detects an electromagnetic wave obtained from the object by irradiation with the pulsed electromagnetic wave and converts it into an analog electric signal;
An analog / digital converter that samples the electrical signal from the electromagnetic wave detector and converts it into a digital signal;
An image processing unit for generating an image of the object based on an output of the analog / digital conversion unit;
A control unit that relatively controls an emission timing of the pulsed electromagnetic wave from the electromagnetic wave source by the electromagnetic wave source driving unit and a sampling timing of the electric signal from the electromagnetic wave detection unit by the analog / digital conversion unit;
Is provided.

  The scanning unit may include a fiber that guides the pulsed electromagnetic wave emitted from the electromagnetic wave source and irradiates the object, and a fiber drive unit that drives the emission end of the fiber to vibrate. .

  The control unit may relatively control the emission timing of the pulsed electromagnetic wave and the sampling timing of the electric signal so that the output of the analog / digital conversion unit becomes a maximum value.

  The control unit relatively controls the emission timing of the pulsed electromagnetic wave and the sampling timing of the electrical signal so that the average value of the overall brightness of the image generated by the image processing unit is maximized. May be.

  The control unit relatively sets the emission timing of the pulsed electromagnetic wave and the sampling timing of the electrical signal so that the average value of the brightness of the region of interest of the image generated by the image processing unit is maximized. You may control.

  The region of interest may be a central portion or a peripheral portion of the image.

The electromagnetic wave source includes a first laser that emits red light, a second laser that emits green light, and a third laser that emits blue light,
The electromagnetic wave source driving unit selectively drives the first laser, the second laser, and the third laser so that pulse lights of different colors in time series are sequentially emitted.
The control unit is configured to make the emission timing of the pulsed light and the sampling timing of the electrical signal corresponding to the pulsed light relative to each of the first laser, the second laser, and the third laser. May be controlled automatically.

The electromagnetic wave source has a fourth laser that emits excitation light of a predetermined wavelength,
The electromagnetic wave detection unit detects signal light generated from the object by irradiating the object with the excitation light,
The control unit may relatively control the emission timing of the excitation light and the sampling timing of the electrical signal corresponding to the signal light.

  According to the present invention, it is possible to provide a scanning observation apparatus capable of improving the S / N and brightness of an image.

1 is a block diagram illustrating a schematic configuration of an optical scanning endoscope apparatus that is an example of a scanning observation apparatus according to a first embodiment. FIG. FIG. 2 is an overview diagram schematically showing the scope of FIG. 1. It is sectional drawing which expands and shows the front-end | tip part of the insertion part of the scope of FIG. It is a figure which shows the oscillation drive mechanism of the drive part of FIG. 1, and the rocking | swiveling part of the optical fiber for illumination. It is a figure for demonstrating operation | movement of 1st Embodiment. It is a flowchart which shows an example of the setting operation | movement of the sampling timing in 1st Embodiment. It is a figure which shows two examples of a region of interest. It is a flowchart which shows an example of the setting operation | movement of the sampling timing in 2nd Embodiment. It is a block diagram which shows schematic structure of the optical scanning endoscope apparatus which is an example of the scanning observation apparatus which concerns on 3rd Embodiment. It is a figure which shows the relationship between the peak timing of the reflected light of excitation light, and the peak timing of signal light. It is a flowchart which shows an example of the setting operation | movement of the sampling timing in 3rd Embodiment. It is a figure which shows the ringing characteristic of a photodetector. It is a flowchart which shows an example of the setting operation | movement of the sampling timing in 4th Embodiment.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

(First embodiment)
FIG. 1 is a block diagram showing a schematic configuration of an optical scanning endoscope apparatus which is an example of a scanning observation apparatus according to the first embodiment. The optical scanning endoscope apparatus 10 includes a scope 20, a control device main body 30, and a display 40.

  The control device main body 30 includes a control unit 31 that controls the entire optical scanning endoscope device 10, a laser driving unit 32, first to third lasers 33 </ b> R, 33 </ b> G, 33 </ b> B, and a coupler 34. The first to third lasers 33R, 33G, and 33B constitute an electromagnetic wave source. The first laser 33R uses red laser light, the second laser 33G uses green laser light, and the third laser 33B. Emits blue laser light. The laser drive unit 32 constitutes an electromagnetic wave source drive unit. Under the control of the control unit 31, pulsed R, G, B laser beams are emitted from the first to third lasers 33R, 33G, 33B. The first to third lasers 33R, 33G, and 33B are driven so as to selectively emit sequentially. As the first to third lasers 33R, 33G, and 33B, for example, a DPSS laser (semiconductor excitation solid-state laser) or a laser diode can be used.

  Each laser beam sequentially emitted from the first to third lasers 33R, 33G, and 33B is incident on the illumination optical fiber 11 made of a single mode fiber as illumination light through an optical path that is coaxially coupled by the coupler 34. Is done. The coupler 34 includes, for example, a dichroic prism. Of course, the configuration of the light source of the optical scanning endoscope apparatus 10 is not limited to this, and a single laser may be used or a plurality of other light sources may be used. The first to third lasers 33R, 33G, and 33B and the coupler 34 may be housed in a separate housing from the control device main body 30 connected to the control device main body 30 by a signal line.

  The illumination optical fiber 11 extends to the tip of the scope 20. The light that has entered the illumination optical fiber 11 through the coupler 34 is guided to the distal end portion of the scope 20 and irradiated toward the object 100. At that time, the distal end portion of the illumination optical fiber 11 is driven to vibrate by the drive unit 21. Thereby, the observation surface of the object 100 is two-dimensionally scanned by the illumination light emitted from the illumination optical fiber 11. Therefore, the illumination optical fiber 11 and the drive unit 21 constitute a scanning unit. The drive unit 21 is driven and controlled under the control of the control unit 31 by a drive control unit 38 provided in the control device main body 30. Light such as reflected light and scattered light obtained from the object 100 by irradiation of illumination light is received by the detection optical fiber bundle 12 made of a multimode fiber extending in the scope 20 and guided to the control device main body 30. Is done.

  The control device main body 30 includes a photodetector 35 for processing light guided by the detection optical fiber bundle 12, an ADC (analog / digital conversion unit) 36, an image processing unit 37, a drive control unit 38, and various types. And a memory 39 for storing the programs and data. The photodetector 35 constitutes an electromagnetic wave detection unit, and includes a photodiode, an avalanche photodiode, a photomultiplier tube, and the like, and converts light guided by the detection optical fiber bundle 12 into an electrical signal. The ADC 36 samples the output signal from the photodetector 35, converts it into a digital signal, and outputs it to the image processing unit 37. Based on information such as the amplitude and phase of the drive voltage applied to the drive unit 21 by the drive control unit 38, the control unit 31 calculates the information on the scanning position on the scanning path by the illumination optical fiber 11, and the calculation is performed. Information is supplied to the image processing unit 37. The image processing unit 37 stores the pixel data (pixel value) of the object 100 in the built-in memory based on the digital signal output from the ADC 36 and the scanning position information from the control unit 31, and after the scanning ends or during the scanning. Necessary processing such as interpolation processing is performed to generate an image of the object 100 and display it on the display 40.

  FIG. 2 is a schematic view schematically showing the scope 20. The scope 20 includes an operation unit 22 and an insertion unit 23. The operation unit 22 is connected to the illumination optical fiber 11, the detection optical fiber bundle 12, and the wiring cable 13 from the control device main body 30. The illumination optical fiber 11, the detection optical fiber bundle 12, and the wiring cable 13 pass through the insertion portion 23 and extend to the distal end portion 24 (portion in the broken line portion in FIG. 2).

  FIG. 3 is an enlarged cross-sectional view of the distal end portion 24 of the insertion portion 23 of the scope 20 of FIG. The distal end portion 24 includes a drive unit 21, projection lenses 25a and 25b, an illumination optical fiber 11 passing through the center portion, and a detection optical fiber bundle 12 passing through the outer peripheral portion.

  The drive unit 21 includes an actuator tube 27 fixed inside the insertion unit 23 of the scope 20 by a mounting ring 26, a fiber holding member 29 and piezoelectric elements 28a to 28d arranged in the actuator tube 27 (FIG. 4A). ) And (b)). The illuminating optical fiber 11 is supported by a fiber holding member 29, and a fixed portion 11a supported by the fiber holding member 29 to a tip end surface 11c constitute a swinging portion 11b that is swingably supported. On the other hand, the detection optical fiber bundle 12 is disposed so as to pass through the outer peripheral portion of the insertion portion 23, and extends to the distal end of the distal end portion 24. Further, a detection lens (not shown) is provided at the tip of each fiber of the detection optical fiber bundle 12.

  Further, the projection lenses 25 a and 25 b and the detection lens are disposed at the forefront of the distal end portion 24. The projection lenses 25 a and 25 b are configured such that laser light emitted from the distal end surface 11 c of the illumination optical fiber 11 is substantially condensed on the object 100. The detection lens captures light (light interacting with the object 100) or the like that is reflected, scattered, or refracted by the object 100 from the laser light collected on the object 100. It arrange | positions so that it may condense and inject into the optical fiber bundle 12 for a detection arrange | positioned after a lens. Note that the projection lens is not limited to a two-lens configuration, and may be composed of one lens or a plurality of other lenses.

  4A is a diagram showing a vibration driving mechanism of the driving unit 21 of the optical scanning endoscope apparatus 10 and a swinging unit 11b of the illumination optical fiber 11, and FIG. 4B is a diagram of FIG. It is an AA line sectional view of). The illumination optical fiber 11 passes through the center of the fiber holding member 29 having a prismatic shape and is fixedly held by the fiber holding member 29. The four side surfaces of the fiber holding member 29 are oriented in the ± Y direction and the ± X direction, respectively. A pair of piezoelectric elements 28a, 28c for driving in the Y direction are fixed to both side surfaces in the ± Y direction of the fiber holding member 29, and a pair of piezoelectric elements 28b for driving in the X direction are fixed to both side surfaces in the ± X direction. 28c is fixed.

  The piezoelectric elements 28a to 28d are driven and controlled via the wiring cable 13 by the drive control unit 38 under the control of the control unit 31 as shown in FIG. For example, a voltage having the opposite polarity and the same magnitude is applied between the piezoelectric elements 28b and 28d in the X direction, and the polarity is also reversed between the piezoelectric elements 28a and 28c in the Y direction. Voltages of equal magnitude are applied. When the piezoelectric elements 28b and 28d arranged opposite to each other with the fiber holding member 29 interposed therebetween contract one another, the other contracts, causing the fiber holding member 29 to bend, and by repeating this, vibration in the X direction is generated. Close. The same applies to the vibration in the Y direction.

  The drive control unit 38 applies vibration voltages having the same or different frequencies to the piezoelectric elements 28b and 28d for driving in the X direction and the piezoelectric elements 28a and 28c for driving in the Y direction, and drives the piezoelectric elements 28a to 28d to vibrate. Let When the piezoelectric elements 28a and 28c for driving in the Y direction and the piezoelectric elements 28b and 28d for driving in the X direction are driven to vibrate, the swinging portion 11b of the illumination optical fiber 11 shown in FIGS. 3 and 4 vibrates. Thus, the tip 11c is deflected. Thereby, the laser beam emitted from the tip portion 11 c scans the surface of the object 100.

  In the present embodiment, in synchronization with the vibration drive of the illumination optical fiber 11, pulsed laser beams of R, G, and B are sequentially and repeatedly emitted from the first to third lasers 33R, 33G, and 33B. Then, using the output signal corresponding to the sequential three RGB pulses obtained from the photodetector 35 as one pixel information of the object 100, a large number of pieces of pixel information are acquired by one scanning with the illumination optical fiber 11, and these pixels are obtained. An image of the object 100 is generated based on the information.

  Here, the RGB output signal waveforms sequentially obtained from the photodetector 35 correspond to the output waveforms of the RGB pulsed light. For this reason, as shown in FIG. 5A, with respect to the RGB output signal waveforms sequentially obtained from the photodetector 35, it is bright if the respective sampling timings in the ADC 36 do not coincide with the peak position of the output signal waveform. I cannot get an image. Therefore, in the present embodiment, as shown in FIG. 5B, the RGB sampling timings in the ADC 36 coincide with the peak positions of the corresponding output signal waveforms obtained from the photodetector 35, respectively. It is set in advance so that the maximum output can be obtained.

  FIG. 6 is a flowchart showing an example of the sampling timing setting operation in this embodiment. The sampling rate in the ADC 36 is determined by the resolution (for example, 100,000 pixels) required for the endoscopic image, and is, for example, 10 MHz to 50 MHz. Similarly, the emission rate of RGB pulsed light is, for example, 10 MHz to 50 MHz in accordance with the sampling rate in the ADC 36. Therefore, for example, when the sampling rate in the ADC 36 is 30 MHz (period is about 33 ns) and the sampling timing can be adjusted in N stages for each of RGB, for example, when N = 10, the adjustment width Tw in one stage is 3. 3 ns.

  In the setting operation, for example, a white chart is used as the object 100, and the setting is performed for each laser (for each color). First, as shown in FIG. 6, the control unit 31 drives the drive unit 21 by the drive control unit 38 to start swinging (vibration) of the swinging unit 11b of the illumination optical fiber 11 (step S601). Next, the control unit 31 drives one of the first to third lasers 33R, 33G, and 33B, for example, the first laser 33R, by the laser driving unit 32, and performs the same predetermined process as in actual image observation. Only the R light pulse light is emitted at the light emission timing (step S602). Further, the control unit 31 initializes the sampling timing T in the ADC 36 corresponding to the light emission timing of the first laser 33R to the initial value 0 (step S603), and the image processing unit 37 acquires one frame image of the R image. (Step S604). Here, T = 0 is, for example, an emission timing of R light pulse light.

  Thereafter, the control unit 31 searches for the maximum value of the pixel values of the R image acquired by the image processing unit 37, and stores the searched pixel maximum value in the memory 39 in association with the sampling timing T (step S605). Here, the pixel maximum value may be the pixel maximum value of the entire R image, or the pixel maximum value of the image of the region of interest. For example, as shown in FIG. 7A, the region of interest can be the center of the image, and in the case of screening diagnosis using an endoscope, the luminal wall of the peripheral portion of the image is the object of diagnosis. As shown in FIG. 7B, it can be the peripheral portion of the image.

  Next, the control unit 31 increments the sampling timing T (step S606) and increases the adjustment range by one step. Then, the operations from step S604 to step S607 are repeated until the sampling timing T reaches a predetermined adjustment stage (T = NTw) in step S607. Thereafter, when the sampling timing T reaches a predetermined adjustment stage in step S607, the control unit 31 reads the pixel maximum value in each adjustment stage stored in the memory 39, and sets the sampling timing of the R light in the ADC 36 to the maximum. The sampling timing T corresponding to a large pixel maximum value (maximum pixel value) is set (step S608). The above setting operation is similarly performed for the G light and the B light.

  According to the present embodiment, the RGB sampling timings T in the ADC 36 are set to timings at which the maximum pixel values are obtained by matching the peak positions of the corresponding output signal waveforms obtained from the photodetector 35. Therefore, the brightest image having a high S / N can be acquired as the entire image or the image of the region of interest.

(Second Embodiment)
In the second embodiment of the present invention, in the configuration shown in FIG. 1, the RGB sampling timing T in the ADC 36 is set to a value corresponding to the maximum pixel average value in each RGB image. FIG. 8 is a flowchart showing an example of the setting operation in this case. This embodiment differs from the setting operation shown in FIG. 6 in the following points.

  That is, in step S805 corresponding to step S605 in FIG. 6, the average value (pixel average value) of the pixel values of the entire image of the R image or the region of interest acquired by the image processing unit 37 is calculated, and the calculated pixel average value Is stored in the memory 39 in association with the adjustment value. In step S808 corresponding to step S608 in FIG. 6, the pixel average value in each adjustment stage stored in the memory 39 is read, and the sampling timing T of the R light in the ADC 36 is maximized. Set to value. Other steps S801 to S804, S806, and S807 are the same processes as steps S601 to S604, S606, and S607 in FIG.

  According to the present embodiment, the RGB sampling timing T in the ADC 36 is set to a timing corresponding to the maximum pixel average value calculated in each RGB image. Therefore, even when the pixel signal at the same position cannot be obtained due to the shake of the illumination optical fiber 11, the average pixel value is calculated. Therefore, the entire image or the region of interest is not affected by the shake of the illumination optical fiber 11. It is possible to improve the S / N and brightness of the image.

(Third embodiment)
FIG. 9 is a block diagram showing a schematic configuration of an optical scanning endoscope apparatus which is an example of a scanning observation apparatus according to the third embodiment. In the present embodiment, signal light such as fluorescence and phosphorescence can be further detected in the configuration shown in FIG. Therefore, the electromagnetic wave source is provided with a fourth laser 33 that emits excitation light. When observing a fluorescent image or a phosphorescent image of the object 100, the fourth laser 33 is driven so as to sequentially emit pulsed excitation light under the control of the control unit 31. As the fourth laser 33, for example, a DPSS laser (semiconductor excitation solid-state laser) or a laser diode can be used.

  The excitation light sequentially emitted from the fourth laser 33 is incident on the illumination optical fiber 11 through the optical path coupled coaxially by the coupler 34 and is irradiated toward the object 100. At that time, the distal end portion of the illumination optical fiber 11 is driven to vibrate by the drive unit 21, and the observation surface of the object 100 is two-dimensionally scanned by the excitation light emitted from the illumination optical fiber 11. And the signal light which generate | occur | produces from the target object 100 by irradiation of excitation light is light-received with the photodetector 35 through the optical filter (not shown) which interrupts | blocks excitation light and permeate | transmits only signal light, for example.

  Here, as shown in FIG. 10, the peak timing T2 of the signal light from the object 100 received by the photodetector 35 due to the irradiation of the excitation light to the object 100 is the peak timing of the reflected light of the excitation light. Occurs after T1. Therefore, in this embodiment, taking into account the delay of the signal light, the sampling timing of the signal light output from the photodetector 35 by the ADC 36 is set with respect to the emission timing of the excitation light. In FIG. 10, T0 indicates the emission timing of the excitation light.

  FIG. 11 is a flowchart showing an example of the sampling timing setting operation according to this embodiment. In the present embodiment, for example, the setting operation is performed using a sample stained with a fluorescent material. First, the control unit 31 drives the drive unit 21 by the drive control unit 38 to start swinging (vibration) of the swinging unit 11b of the illumination optical fiber 11 (step S1101). Next, the control unit 31 drives the fourth laser 33 by the laser driving unit 32 to emit the pulsed light of the excitation light at the same predetermined light emission timing as that during actual image observation (step S1102). Further, the control unit 31 sets the sampling timing T in the ADC 36 corresponding to the light emission timing of the fourth laser 33 to the initial value T0 (step S1103), and the image processing unit 37 acquires one frame image by the signal light. (Step S1104).

  Thereafter, the control unit 31 executes a search process for the pixel maximum value of the image acquired by the image processing unit 37 or a calculation process for the pixel average value, and uses the searched pixel maximum value or the calculated pixel average value as the sampling timing T. Correspondingly, it is stored in the memory 39 (step S1105). Here, the pixel maximum value and the pixel average value may be for the entire image or for the region of interest.

  Next, the control unit 31 increments the sampling timing T to “T + ΔT” (step S1106), and increases the adjustment range by one step. Here, ΔT is set by dividing the period from T0 in FIG. 10 until the signal light disappears into a plurality of N as appropriate. Then, the operations from step S1104 to step S1107 are repeated until the sampling timing T reaches a predetermined adjustment stage (T = T0 + NΔT) in step S1107. Thereafter, when the sampling timing T reaches a predetermined adjustment stage in step S1107, the control unit 31 reads the pixel maximum value and the pixel average value in each adjustment stage stored in the memory 39, and samples the signal light in the ADC 36. Timing T is set to a timing corresponding to the largest pixel maximum value (maximum pixel value) or the maximum pixel average value (maximum pixel average value) (step S1108).

  Therefore, according to the present embodiment, it is possible to improve the S / N and brightness of an image as in the above-described embodiment even when an image using fluorescent or phosphorescent signal light is observed. In the present embodiment, the first to third laser lasers 33R, 33G, and 33B are provided. However, these are omitted, and a scanning endoscope that observes only an image of signal light such as fluorescence or phosphorescence. It can also be a device. In this case, the coupler 34 may be omitted and the excitation light from the fourth laser 33 may be incident on the illumination optical fiber 11.

(Fourth embodiment)
In the fourth embodiment of the present invention, for example, in the configuration shown in FIG. 1, the sampling timing is set in consideration of the ringing characteristics of the photodetector 35. That is, the photodetector 35 has a ringing characteristic in which noise is generated at a timing delayed from the original detection light timing, as shown in FIG. Therefore, for example, even if the sampling timing of each of the RGB lights is set to the output peak positions of R1, G1, and B1, the ringing of the immediately preceding B light affects the detection of the R light, and the G light is detected. In this case, the ringing of the immediately preceding R light may be affected, and the ringing of the immediately preceding G light may be affected when detecting the B light. Therefore, in the present embodiment, in each of the first to third lasers 33R, 33G, and 33B, in the ADC 36, the difference between the luminance value of the original detection light and the luminance value of the other color due to ringing is maximized. Set each sampling timing. That is, the sampling timing of each RGB light is set as indicated by R2, G2, and B2 in FIG.

  FIG. 13 is a flowchart showing an example of the sampling timing setting operation in the present embodiment. Hereinafter, a description will be given with reference to FIG. In the setting operation, for example, a white chart is used as the object 100. First, the control unit 31 drives the drive unit 21 by the drive control unit 38 to start the swing (vibration) of the swing unit 11b of the illumination optical fiber 11 (step S1301). Next, the control unit 31 drives one of the first to third lasers 33R, 33G, and 33B, for example, the first laser 33R, by the laser driving unit 32, and performs the same predetermined process as in actual image observation. Only the R light pulse light is emitted at the light emission timing (step S1302). In addition, the control unit 31 initializes the sampling timing T in the ADC 36 corresponding to the light emission timing of the first laser 33R to an initial value 0 (step S1303), and the image processing unit 37 acquires one frame image of the R image. (Step S1304). Here, T = 0 is the emission timing of the pulsed light of the R light.

  Thereafter, the control unit 31 executes a search process for the pixel maximum value of the R image acquired by the image processing unit 37 or a calculation process for the pixel average value, and sets the searched pixel maximum value or the calculated pixel average value to the sampling timing T. And stored in the memory 39 (step S1305). Here, the pixel maximum value and the pixel average value may be for the entire image or for the region of interest.

  Next, the control unit 31 increments the sampling timing T to “T + ΔT” (step S1306), and increases the adjustment range by one step. Here, ΔT is set by dividing the period from T0 in FIG. 12 until ringing disappears into an appropriate number N. Then, the operations from step S1304 to step S1307 are repeated until the sampling timing T reaches a predetermined adjustment stage (T = T0 + NΔT) in step S1307. The operations from step S1302 to step S1307 are repeated until the processing is completed for each color of RGB in step S1308.

  Thereafter, the control unit 31 reads the pixel maximum value and the pixel average value at each adjustment stage for the sequential two colors stored in the memory 39, and sets the original pixel maximum value or pixel average value of the color for each color. The sampling timing T in the ADC 36 is set so that the difference from the pixel maximum value or the pixel average value of the previous color due to ringing is maximized, that is, the difference between the two colors is maximized (step S1309). As a result, the S / N and brightness of the image can be improved without being affected by the ringing characteristics of the photodetector 35.

  In addition, this invention is not limited only to the said embodiment, Many deformation | transformation or a change is possible. For example, in the above embodiment, the sampling timing of the corresponding output signal from the photodetector 35 by the ADC 36 is controlled with respect to the laser emission timing, but the laser emission timing is controlled with respect to the sampling timing of the ADC 36. Alternatively, for example, the sparse adjustment may be performed by controlling the laser emission timing, and the fine adjustment may be performed by controlling the sampling timing of the ADC 36. Further, when controlling the light emission timing, the width of the pulsed light may be controlled by controlling the rise of the pulsed light. Moreover, the drive part 21 of the optical fiber 11 for illumination is not restricted to a piezoelectric type, but can also be an electromagnetic type having a coil and a permanent magnet. Furthermore, the present invention can be effectively applied to a scanning observation apparatus that obtains an image by irradiating infrared light, ultraviolet light, X-rays, gamma rays, or the like, and uses, for example, a galvanometer mirror without using an optical fiber. Thus, the present invention can be effectively applied to a fluorescence microscope that scans excitation light.

DESCRIPTION OF SYMBOLS 10 Optical scanning endoscope apparatus 11 Illumination optical fiber 12 Detection optical fiber bundle 20 Scope 21 Drive part 22 Operation part 23 Insertion part 24 Tip part 30 Control apparatus main body 31 Control part 32 Laser drive part 33R, 33G, 33B 1st 1st-3rd laser 33 4th laser 34 coupler 35 photodetector 36 ADC
37 Image processing unit 38 Drive control unit 39 Memory 40 Display 100 Object

Claims (8)

  1. An electromagnetic source,
    An electromagnetic wave source driving unit for emitting a pulsed electromagnetic wave from the electromagnetic wave source;
    A scanning unit that scans the object by irradiating the object with the pulsed electromagnetic wave;
    An electromagnetic wave detection unit that detects an electromagnetic wave obtained from the object by irradiation with the pulsed electromagnetic wave and converts it into an analog electric signal;
    An analog / digital converter that samples the electrical signal from the electromagnetic wave detector and converts it into a digital signal;
    An image processing unit for generating an image of the object based on an output of the analog / digital conversion unit;
    A control unit that relatively controls an emission timing of the pulsed electromagnetic wave from the electromagnetic wave source by the electromagnetic wave source driving unit and a sampling timing of the electric signal from the electromagnetic wave detection unit by the analog / digital conversion unit;
    A scanning observation apparatus.
  2.   The scanning unit includes a fiber that guides the pulsed electromagnetic wave emitted from the electromagnetic wave source and irradiates the object, and a fiber drive unit that vibrates and drives an emission end of the fiber. The scanning observation apparatus described in 1.
  3.   3. The control unit according to claim 1, wherein the control unit relatively controls an emission timing of the pulsed electromagnetic wave and a sampling timing of the electric signal so that an output of the analog / digital conversion unit becomes a maximum value. 4. Scanning observation device.
  4.   The control unit relatively controls the emission timing of the pulsed electromagnetic wave and the sampling timing of the electrical signal so that the average value of the overall brightness of the image generated by the image processing unit is maximized. The scanning observation apparatus according to claim 1 or 2.
  5.   The control unit relatively sets the emission timing of the pulsed electromagnetic wave and the sampling timing of the electrical signal so that the average value of the brightness of the region of interest of the image generated by the image processing unit is maximized. The scanning observation apparatus according to claim 1 or 2, which is controlled.
  6.   The scanning observation apparatus according to claim 5, wherein the region of interest is a central portion or a peripheral portion of the image.
  7. The electromagnetic wave source includes a first laser that emits red light, a second laser that emits green light, and a third laser that emits blue light,
    The electromagnetic wave source driving unit selectively drives the first laser, the second laser, and the third laser so that pulse lights of different colors in time series are sequentially emitted.
    The control unit is configured to make the emission timing of the pulsed light and the sampling timing of the electrical signal corresponding to the pulsed light relative to each of the first laser, the second laser, and the third laser. To control,
    The scanning observation apparatus according to any one of claims 1 to 6.
  8. The electromagnetic wave source has a fourth laser that emits excitation light of a predetermined wavelength,
    The electromagnetic wave detection unit detects signal light generated from the object by irradiating the object with the excitation light,
    The control unit relatively controls the emission timing of the excitation light and the sampling timing of the electrical signal corresponding to the signal light.
    The scanning observation apparatus according to any one of claims 1 to 6.
JP2013267486A 2013-12-25 2013-12-25 Scanning observation device Active JP6218596B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2013267486A JP6218596B2 (en) 2013-12-25 2013-12-25 Scanning observation device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2013267486A JP6218596B2 (en) 2013-12-25 2013-12-25 Scanning observation device

Publications (2)

Publication Number Publication Date
JP2015123106A true JP2015123106A (en) 2015-07-06
JP6218596B2 JP6218596B2 (en) 2017-10-25

Family

ID=53534293

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2013267486A Active JP6218596B2 (en) 2013-12-25 2013-12-25 Scanning observation device

Country Status (1)

Country Link
JP (1) JP6218596B2 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017013804A1 (en) * 2015-07-23 2017-01-26 オリンパス株式会社 Optical-scanning-type observation device
WO2017109815A1 (en) * 2015-12-21 2017-06-29 オリンパス株式会社 Optical-scanning-type observation device and irradiation parameter adjustment method for pulsed laser light

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001159734A (en) * 1999-09-24 2001-06-12 Olympus Optical Co Ltd Laser scanning microscope
JP2002525133A (en) * 1998-09-15 2002-08-13 アシスタンス ピュブリック−オピト ド パリ Endoscopic device exhibiting an improved viewing quality
JP2010125270A (en) * 2008-12-01 2010-06-10 Hoya Corp Endoscope apparatus
JP2010142602A (en) * 2008-12-22 2010-07-01 Hoya Corp Endoscope system
JP2010148769A (en) * 2008-12-26 2010-07-08 Hoya Corp Optical scanning endoscope apparatus, optical scanning endoscope, and optical scanning endoscope processor

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002525133A (en) * 1998-09-15 2002-08-13 アシスタンス ピュブリック−オピト ド パリ Endoscopic device exhibiting an improved viewing quality
JP2001159734A (en) * 1999-09-24 2001-06-12 Olympus Optical Co Ltd Laser scanning microscope
JP2010125270A (en) * 2008-12-01 2010-06-10 Hoya Corp Endoscope apparatus
JP2010142602A (en) * 2008-12-22 2010-07-01 Hoya Corp Endoscope system
JP2010148769A (en) * 2008-12-26 2010-07-08 Hoya Corp Optical scanning endoscope apparatus, optical scanning endoscope, and optical scanning endoscope processor

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017013804A1 (en) * 2015-07-23 2017-01-26 オリンパス株式会社 Optical-scanning-type observation device
WO2017109815A1 (en) * 2015-12-21 2017-06-29 オリンパス株式会社 Optical-scanning-type observation device and irradiation parameter adjustment method for pulsed laser light

Also Published As

Publication number Publication date
JP6218596B2 (en) 2017-10-25

Similar Documents

Publication Publication Date Title
US7608842B2 (en) Driving scanning fiber devices with variable frequency drive signals
US6545260B1 (en) Light scanning optical device which acquires a high resolution two-dimensional image without employing a charge-coupled device
JP5190267B2 (en) Remapping method to reduce image distortion
CN101821607B (en) Method and device for imaging structure labeled by fluorescent dye in specimen
US6687000B1 (en) Photon-sorting spectroscopic microscope system
US6663561B2 (en) Video endoscope system
US7252236B2 (en) Methods of driving a scanning beam device to achieve high frame rates
JP2008531112A (en) Scanning beam device having a detector assembly
US7784697B2 (en) Methods of driving a scanning beam device to achieve high frame rates
JP2010131161A (en) Optical scanning endoscope processor, image processing apparatus, and optical scanning endoscope system
WO2001024686A1 (en) Optical scanning probe system
US8921809B2 (en) Device for microscopy having selective illumination of a plane
US20110310395A1 (en) Three-dimensional optical coherence tomography confocal imaging apparatus
JP2015508685A (en) Extended depth of focus for high resolution image scanning
US20060226231A1 (en) Methods and systems for creating sequential color images
DE102009059979A1 (en) Endoscope system with scraper function
JP5860952B2 (en) Imaging device and endoscope apparatus provided with the same
JP5776992B2 (en) STED microscopy, STED fluorescence correlation spectroscopy, and STED fluorescence microscope for pulse excitation, continuous deexcitation, and gate recording of spontaneous emission fluorescence
US20130184524A1 (en) Scanning Endoscope Device
JP5640273B2 (en) High resolution optical scanning method and apparatus for sample
JPWO2012132754A1 (en) Scanning endoscope device
EP2808718B1 (en) Optical scanning observation apparatus
EP2742848B1 (en) Endoscope and endoscope device
JP4672023B2 (en) Method for driving a scanning beam device to achieve a high frame rate
EP2752150A1 (en) Calibration instrument for scanning-type endoscope

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20160822

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20170518

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20170530

A521 Written amendment

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20170726

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20170919

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20170926

R151 Written notification of patent or utility model registration

Ref document number: 6218596

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R151