JP2004145302A - Optical scanning type observation device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an optical scanning type observation device capable of realizing picture recording with good operability. <P>SOLUTION: By using an optical scanning probe incorporating a scanner, returning light from an observation object side is received, and it is photoelectrically converted to display a cell observation picture in a cell observation picture display area R1 at the display surface of a monitor, and a display preservation parameter for deciding the conditions of display and preservation is displayed on a display preservation parameter setting window R4 under the area R1, so as to be easily selected and set with a mouse or the like, whereby the operability is improved so that only the desired picture satisfying a condition set by a user can be recorded (preserved). <P>COPYRIGHT: (C)2004,JPO

Description

{Circle over (1)} The present invention relates to an optical scanning type observation apparatus that obtains an observation image by scanning light.

2. Description of the Related Art In recent years, a light-scanning observation apparatus that obtains a microscope image or the like by two-dimensionally scanning light using a confocal relationship is disclosed in, for example, JP-A-2000-75210 and JP-A-2001-512606. And JP-A-2001-356273.
The first publication discloses an apparatus for obtaining a microscopic image by reducing the size, the second publication also discloses a function of storing an image, and the third publication obtains an image with less distortion. The configuration is disclosed.
JP-A-2000-75210 JP 2001-512606 A JP 2001-356273 A

In such an optical scanning observation apparatus, an optical image in a focused state may be displayed, but an optical image in an out-of-focus state is often displayed. For this reason, when storing images, there is a drawback that a desired image cannot be recorded with a function as disclosed in the second publication.
For example, in the function as disclosed in the second publication, an image including many images out of focus is recorded, and an editing operation of extracting an in-focus image from the recorded image is troublesome. However, when an image portion of a predetermined area is extracted, or when an image having an appropriate luminance level is to be extracted, it is necessary to edit the image, and the operation in that case takes time and effort. .
In other words, in the conventional example, the desired image cannot be efficiently recorded, so that it is necessary to perform an operation such as editing to extract the desired image, and the operability is low.

(Object of the invention)
The present invention has been made in view of the above points, and has as its object to provide an optical scanning observation device capable of recording an image with good operability.
It is another object of the present invention to provide an optical scanning observation apparatus capable of reducing unnecessary images and filing capacity of recorded images.

A light source,
At least one or more scanning means for scanning a light beam emitted from the light source against an object,
Signal generating means for driving the scanning means to generate a timing signal;
An optical system that irradiates the object with light from the light source and receives return light from the object,
Photoelectric conversion means for converting the light received by the optical system into an electric signal,
An AD converter that converts an electric signal from the photoelectric conversion unit into digital data;
A memory for recording digital data from the AD converter;
Image generation means for converting the data stored in the memory to generate an image,
A monitor for displaying an image generated by the image generating means,
Storage means for storing an image generated by the image generation means,
Display save selection means for setting a display save parameter that determines a display and save method to be selectable, which is displayed on the monitor together with the image generated by the image generation means,
A control unit that controls at least one of the light source, the image generation unit, and the storage unit based on the display storage parameter to execute display and storage,
By setting the display storage parameter by the display storage selection unit, the image displayed on the monitor and the image stored in the storage unit can be controlled, and the desired image can be efficiently stored. Is improving.

According to the present invention, a light source;
At least one or more scanning means for scanning a light beam emitted from the light source against an object,
Signal generating means for driving the scanning means to generate a timing signal;
An optical system that irradiates the object with light from the light source and receives return light from the object,
Photoelectric conversion means for converting the light received by the optical system into an electric signal,
An AD converter that converts an electric signal from the photoelectric conversion unit into digital data;
A memory for recording digital data from the AD converter;
Image generation means for converting the data stored in the memory to generate an image,
A monitor for displaying an image generated by the image generating means,
Storage means for storing an image generated by the image generation means,
Display save selection means for setting a display save parameter that determines a display and save method to be selectable, which is displayed on the monitor together with the image generated by the image generation means,
A control unit that controls at least one of the light source, the image generation unit, and the storage unit based on the display storage parameter to execute display and storage,
It is possible to control the image displayed on the monitor and the image stored in the storage unit by selectively setting the display storage parameter by the display storage selection unit, and efficiently save the desired image, etc. Operability can be improved.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
(First Embodiment)
1 to 23 relate to a first embodiment of the present invention. FIG. 1 shows the overall configuration of an optical scanning observation apparatus according to the first embodiment of the present invention, and FIG. 2 shows a display example of a monitor. FIG. 3 is an explanatory diagram of an area determination method when an area reference is used as a display reference, FIG. 4 shows the entire processing contents from setting of display / save method to display / save processing, and FIG. FIG. 6 shows the contents of processing for setting the selection criterion, FIG. 7 shows the contents of processing for setting the area, FIG. 8 shows the contents of processing for setting the timing, FIG. Shows the contents of the setting processing of the simultaneous storage data, FIG. 10 shows a pattern in which display and storage of a specific image can be selectively set by setting various parameters, and FIG. Is luminance (luminance value is 150), size is no (OFF), timing is scan, blur correction is invalid (OFF), and the contents of display / save processing when the simultaneous storage data is a normal endoscope image and scale are shown. FIG. 12 shows a signal when the selection criterion is luminance. FIG. 13 shows a timing chart of display / storage start / stop when the timing is scan, and FIG. 14 shows a process when the size parameter is turned on in the parameter setting of FIG. FIG. 15 shows the processing contents when the display save mode is a specific image display, all images are saved, the selection criterion is area, the timing is frozen (still image display), the blur correction is disabled (OFF), and the simultaneous save data is text. FIG. 16 is a timing chart in the case of the operation of FIG. 15, and FIG. 17 is a display save mode in which all images are displayed and a specific image is saved. FIG. 18 shows the processing contents when the frame, the designated number of frames is 1 to 50 frames, the timing is before and after the freeze (the timing position is -10), the blur correction is invalid (OFF), and the simultaneous storage data is the cursor. FIG. 19 is a timing chart of display & save start before and after the freeze in the case of FIG. 19, FIG. 19 shows data to be saved before and after the freeze, FIG. 20 shows the display save mode in the specific image display save, and the selection criterion is time. 21 shows the processing content when the designated time is 1000 msec, the timing is laser, the blur correction is invalid (OFF), and the simultaneous storage data is a normal endoscopic image. FIG. 21 shows the display & storage start / stop timing in the case of FIG. FIG. 22 shows a chart. In the display saving mode, all images are displayed and saved, the timing is blur correction, the blur correction is enabled (ON), and the simultaneous storage data is scaled. FIG. 23 shows a timing chart of display / save start / stop in the case of FIG.

An optical scanning observation device (also referred to as an optical probe device) 1 according to the first embodiment shown in FIG. 1 is, for example, an observation device in which a confocal optical scanning probe 2 and the optical scanning probe 2 are detachably connected. It comprises a device 3 and a monitor 4 connected to the observation device 3 and displaying an optical scanning image or the like.
The optical scanning probe 2 can be used by being inserted into a channel of an endoscope (not shown). The connector 5 at the rear end of the optical scanning probe 2 can be detachably connected to the connector receiver 6 of the observation device 3. A light beam from a light source device 7 configured by, for example, a semiconductor laser or the like built in the observation device 3 is incident on the optical scanning probe 2.
A light beam (light beam) from the light source device 7 is incident on the optical fiber 9 in the optical scanning probe 2 from the connector 5 via the optical fiber 8, and the optical fiber 9 guides the light to the distal end side of the optical scanning probe 2. Is done.

An optical element 10 including an objective lens for condensing and irradiating the light beam and a scanning mirror is disposed at the distal end portion. The light beam emitted from the distal end portion of the optical fiber 9 is scanned by an X scanner 11 and a Y scanner as scanning means. The light is converged on the subject 13 via an optical scanning mirror or an objective lens that is scanned in the X and Y directions by the scanner 12.
A light beam emitted from the optical element 10 to the subject 13 such as a living tissue in the body is two-dimensionally scanned in the X direction and the Y direction by the X scanner 11 and the Y scanner 12, and the reflected light is reflected as described below. By detecting light (return light), two-dimensional image information can be obtained.
A part of the light beam irradiated to the subject 13 is reflected and enters the optical element 10, and further enters the tip of the optical fiber 9. In this case, the tip of the optical fiber 9 has a small area size in the form of a spot so that only the reflected light from the focal position on the subject 13 which has a confocal relationship with the optical element 10 is incident. Become.

The light incident on the optical fiber 9 is further branched at an optical coupler section of the optical fiber 8, received by a photodetector 14, photoelectrically converted into an electric signal, input to an A / D converter 15, and input to an A / D converter 15. It is D-converted and converted into digital data. Note that a photomultiplier tube (photomultiplier tube) may be used instead of the photodetector (photodetector) 14 as a photoelectric conversion unit.
The A / D-converted signal is input to a memory 16 for storing (recording) digital data, so that image data for at least a plurality of frames can be stored. The memory 16 may be a cine memory capable of recording a large-capacity moving image.
The image data output from the output terminal of the memory 16 is input to an imaging device 17, where the image data is subjected to processing for generating a displayable image signal, and then output to a monitor 4 as image display means. On the display surface, an optical scanning image by the return light when the optical element 10 of the optical scanning probe 2 is two-dimensionally scanned, specifically, a cell observation image of a living tissue is displayed.
Further, the imaging device 17 has a built-in recording medium (or storage device) 18 such as a hard disk, and can record (save) an optical scanning image or the like displayed on the monitor 4.

A signal generator 21 for determining the timing of image generation is provided in the observation device 3. A clock signal serving as a reference for the signal generator 21 and a reference synchronization signal for forming an image of one frame are provided. The X-sync and Y-sync signals in the X and Y directions are input to the A / D converter 15, and the A / D converter 15 performs A / D conversion in synchronization with the two signals.
The signal generator 21 outputs both X-Drive and Y-Drive drive signals synchronized with the synchronization signal to the amplifiers 22 and 23, respectively, and uses the drive signals amplified by the amplifiers 22 and 23 to generate an X-scanner signal. 11 and the Y scanner 12 are driven.
Further, although not shown in FIG. 1, in addition to the two-dimensional scanning by the X scanner 11 and the Y scanner 12, a unit provided with a means for scanning in a direction orthogonal to these scanning planes, usually in a depth direction may be used.
Further, a control device 24 having a built-in CPU and the like for controlling the whole is provided in the observation device 3, and the control device 24 includes the light source device 7, the photodetector 14, the A / D converter 15, the memory 16, It controls the imaging device 17.

Further, as described with reference to FIG. 12, the control device 24 can also take in the signal A / D converted by the A / D converter 15. Then, whether or not the display storage parameter selected by the user satisfies the selected condition can be detected by comparison or the like.
Further, a keyboard 25 which can be pressed by hand and a mouse 26 which can be pressed and dragged by hand are connected to the control device 24 as display / storage selecting means for selecting and specifying parameters for display and storage. . In addition, other than the mouse 26, an input device such as a trackball having a similar function may be employed.
Further, in addition to the optical scanning probe 2 using the confocal point, a light observation image may be obtained by employing low coherence light from a low coherence light source.

In the present embodiment, an endoscope image signal from a video processor or a camera control unit for generating an endoscope image in an endoscope device (not shown) is input to the imaging device 17, and the imaging device 17 An endoscope image and an optical scanning image are output to the monitor 4 via a device or the like, so that both images can be displayed on the monitor 4.
A CPU (not shown) inside the control device 24 performs a control operation according to a program stored in a ROM (not shown) inside the control device 24.
As a control operation in this case, as described later with reference to FIG. 2 and the like, a display of an optical scanning image (specifically, a cell observation image of a living tissue) displayed on the monitor 4 and a display stored in the recording medium 18 It is a feature of the present embodiment that a storage mode can be selectively set, a selection criterion setting and the like can be selected and set, and control is performed to display and save an optical scanning image under the selected and set conditions. ing.

That is, in the present embodiment, a display storage selecting means for selecting display storage parameters for determining conditions to be displayed on the monitor 4 or stored in the recording medium 18 is provided. By doing so, the control device 24 controls the image forming device 17 and the light source device 7 that perform signal processing for image generation so as to perform display and storage under the conditions set by selection and the like.
As described above, the control device 24 controls to perform display and storage under the condition preliminarily selected by the user, so that only the cell observation image that satisfies the condition desired by the user and that is desired to be stored is stored, and the condition is satisfied. Unnecessary cell observation images are not stored.
Therefore, the editing work for saving only the cell observation images required later is unnecessary or can be simplified, and the storage capacity by recording the unnecessary cell observation images (in the conventional example) is limited. The operability is improved by efficiently storing the required cell observation image without causing any problem (in other words, the filing capacity to be recorded can be reduced).

Further, as described below, a display storage parameter that determines display and storage is displayed on the monitor 4 that displays the cell observation image, and the user can set the parameter in a state where the cell observation image can be observed. In addition, it is easy to check the settings, improving usability (operability).
Next, details of a display storage mode and the like that can be selected in the present embodiment will be described with reference to FIG. As shown in FIG. 2, on the display surface of the monitor 4, a cell observation image display region R1 for displaying a cell observation image as an optical scanning image obtained by the optical scanning probe 2 on the upper right, and a patient for displaying patient information on the upper left. An information display area R2, a normal endoscope image display area R3 for displaying a normal endoscope image in the lower left, and a display storage parameter setting window R4 for setting a display storage parameter in the lower right are displayed in a divided manner. I have.

In the cell observation display region R1, in addition to the cell observation image obtained by the optical scanning probe 2, a scale S indicating the size of the cell observation cursor R that can be moved by operation with the mouse 26 or the like is displayed at an arbitrary position. The text T can be superimposed and displayed at an arbitrary position by the keyboard 25.
In the display save setting window R4, display save setting conditions such as a display save mode, a selection criterion, simultaneous save data, timing, and blur correction are displayed, and these conditions can be set. By selecting and setting each of these parameters, information on the selected and set parameters is stored in a memory (not shown) inside the control device 24 or the like, and the control device 24 performs display and / or storage processing according to the selected and set parameters. (Described later in the flowchart of FIG. 4).

Four display / save modes are displayed as the display save modes. Specifically, a specific image display save mode, a specific image display all image save mode, an all image display specific image save mode, and an all image display save mode are prepared.
The specific image display / save mode is a mode for displaying a specific image and storing the specific image.
The specific image display all image storage mode is a mode in which a specific image is displayed and all images are stored.
In addition, the all image display specific image saving mode is a mode in which all images are displayed and the specific image is saved.
The all image display / save mode is a mode in which all images are displayed and all images are saved.
As described above, the user selects a desired mode from the four modes by using the input device such as the keyboard 25 or the mouse 26, and can select the display and storage modes. In this case, circles and circles before four modes such as the specific image display / save mode indicate that the setting is invalid (OFF) and the setting is valid (ON), respectively. The same applies to selection settings such as other selection criteria.

Although the setting of the initial setting is set to display and save all images, the present invention is not limited to this, and other three modes may be used (described later in the flowchart of FIG. 5).
When a specific image is selected for display or storage in the display / save mode, the specific image can be specified based on a selection criterion. In this case, selection criteria can be selected and set from five parameters of luminance, size, area, frame, and time. In this selection criterion, the size is a selection criterion that can be additionally selected when luminance is used as the selection criterion (thus, it can be said that four items are the main selection criterion).
A horizontal bar H1 is displayed below the selection criterion, so that the value of the item parameter serving as the selection criterion can be easily set by the horizontal bar H1.
When the luminance is selected as the selection criterion, the selection criterion is provided such that the image having a value equal to or higher than the luminance value (luminance level) is determined as the specific image.

Specifically, the luminance value is represented by, for example, 8 bits, and the luminance range in that case is 0 to 255, and 255 is the maximum value. The initial setting is luminance and the set value is 255, but the present invention is not limited to this, and an arbitrary luminance value may be set. Further, other items can be set to the initial settings.
When the selection criterion is set to a luminance value, when the luminance value is moved by moving the horizontal bar H1 below the selection criterion in FIG. 2 by using the keyboard 25 or the mouse 26, 0 to 255 (8 bits) according to the moved position. Can be easily set to either.
In the example of FIG. 2, the brightness is selected based on the selection criterion by ●, and the brightness value is set to 150 by moving the horizontal bar H1. In this case, when the specific image is selected and set, and the luminance value is 150 or more, the specific image is displayed or stored.

The “size” as the selection criterion is based on the selection criterion of an image displayed in the cell observation display region R1 or an image to be stored having cells having that size.
The area as a selection criterion specifies a display area or a storage area.
In this case, a cross cursor K1 as shown in FIG. 3 appears, and it is clicked and dragged with the keyboard 25 or the mouse 26, and the designated region Rc indicated by the hatched portion (as a selection criterion) is displayed or saved. Set as follows.
That is, as shown in the flowchart of FIG. 7, first in a first step S26, the cross cursor K1 is clicked at an arbitrary position on the image to determine a start point (processing of a portion shown by (1)), and then in the next step S27 Drag the cross cursor K1 to an arbitrary position and move it to the end point (processing of the portion shown by (2)). Further, in the next step S28, click the cross cursor K1 at an arbitrary position on the image to determine the end point ( (Processing of the portion indicated by (3)) to set the selection reference region Rc.

When a frame (data constituting one image) is selected as a selection criterion, the horizontal bar H1 under the selection criterion in FIG. 2 is stopped after display and / or storage is started by the keyboard 25 or the mouse 26. Then, the number of frames until the number of frames is specified (0 to 160 in the case of the display example of FIG. 2).
When the time is selected as the selection criterion, the horizontal bar H1 below the selection criterion in FIG. 2 is designated by the keyboard 25 or the mouse 26 to specify the time from when the display and / or the storage is started to when it is stopped (FIG. 2). In the case of the display example, 0-8000 msec).
In addition, as the simultaneous storage data that is simultaneously stored with the cell observation image, a normal endoscope image, a scale S, a text T, and a cursor K can be selected. According to the selection criteria, only one item can be mainly selected, but in this case, a plurality of items can also be selected. In the case of FIG. 2, the normal observation image and the scale S are selected as data to be stored simultaneously.

The timing determines conditions for starting display and / or storage of a specific image at a certain timing. The timing includes scanning, freeze (still image), before and after freeze (images before and after image stop). ), Laser, and blur correction items.
When the scan is selected, the specific image is displayed in synchronization with the scan, that is, the optical scanning timing. When the freeze is selected, the specific image is synchronized with the freeze (still image) timing. Is displayed, and after the freeze is selected, the number of frames before and after the freeze (still image) is selected and set as the timing of the display or the like. In this case, a horizontal bar H2 is displayed below the display before and after the freeze, like the horizontal bar H1 of the selection criterion. When the number of frames before and after the freeze is set by the same operation as in the case of the horizontal bar H1, the setting is performed. Display and the like are performed in synchronization with the timing.
When a laser is selected, a specific image is displayed in synchronization with the timing of the start of laser oscillation (light output), and when the blur correction is selected, the start of the blur correction is started. A specific image is displayed in synchronization with the timing.

A condition for starting and stopping image display and / or storage in synchronization with which of the timings is set.
In addition, the blur correction at the right end is for selecting a condition of whether or not to perform the blur correction. When performing the blur correction is selected, it is turned on, and when not performed, it is turned off.
Next, the operation of the present embodiment will be described with reference to FIG.
FIG. 4 shows processing contents from setting of the display / save method to display / save processing. When the power of the optical scanning observation device 1 is turned on and its operation is started, the process of setting the display storage mode in step S1 is performed.
The details of the process of setting the display save mode are shown in FIG. 5. When the process of setting the display save mode starts, as shown in step S7, all the images are initially set as the display save mode. In the save mode, the next step S8 is a process of selecting a display save mode so that a display save mode other than the all image display save can be selected.

When the process of setting the display storage mode in step S1 in FIG. 4 ends, it is determined whether the display storage mode in step S2 is the all image display storage mode. If the mode is not the all image display storage mode, the process of setting the selection criterion in step S3 is performed, and then the process proceeds to step S4. FIG. 6 shows details of the process of setting the selection criterion. On the other hand, in the determination of the display storage mode in step S2, if the mode is not the all image display storage mode, the process proceeds to the timing setting process in step S4. FIG. 8 shows details of the timing setting process.
When the timing setting process is completed, the simultaneous save data setting process in step S5 and the display / save process in step S6 are performed, and the process in FIG. 4 ends. FIGS. 9 and 10 show the details of the process of setting the simultaneous save data in step S5 and the display / save process in step S6, respectively.

Next, the process of setting the selection criteria in FIG. 6 will be described.
When the process of setting the selection criterion is started, the initial setting for setting the selection criterion to the brightness in step S11 is performed, and the initial setting for setting the brightness value to 255 in the next step S12 is performed. Move on to processing.
Then, since it is required to determine whether or not to select luminance as a selection criterion in step S14, the user selects this luminance as a selection criterion, and sets a luminance value in the range of 0 to 255 in the next step S15. Then, in the next step S16, a selection is made as to whether or not to turn the size ON. When the size is selected (ON), the size is set in the next step S17. For example, it is set to 10 μm or less. Then, the process proceeds to step S18.

On the other hand, if the user does not select luminance as a selection criterion, the process proceeds to step S18. In this step S18, it is required to select whether to set an area as a selection criterion. When this area is selected, an area setting process is performed in the next step S19. The details of the area setting process have been described above with reference to FIG.
When the setting processing of this area is completed, it is required to determine whether to select a frame as a selection criterion in step S20. When a frame is selected, start / stop frames are set in the next step S21, and the process proceeds to the next step S22. move on. As a specific example of the setting of the start / stop frame in step S21, for example, the number of frames from 0 to 160 is set.

If no frame is selected in step S20, the process proceeds to step S22. In this step S22, a determination is made as to whether to select a time as a selection criterion. If this time is selected, the start / stop time is set in the next step S23, and the processing in FIG. 6 ends. As a specific example of the setting of the start / stop time, for example, a setting of 0 to 8000 msec is performed. When the time is not selected, the process in FIG. 6 is terminated without performing the process in step S23.
Next, the timing setting process of FIG. 8 will be described.
When the timing setting process starts, an initial setting for scanning as a timing is performed in step S31, and a timing selection process is performed in the next step S32. Then, in step S33, a determination is made as to whether or not to select shake correction as a timing. When this shake correction is selected, a determination is made in step S34 as to whether or not shake correction is to be selected.

If the blur correction is turned off, the process does not match the selection in step S33, and the process returns to step S33. On the other hand, if the shake correction is not selected as the timing, the process proceeds to step S35, and it is required to determine whether to select before and after the freeze as the timing. In response to this determination, if before and after freeze is selected, the number of frames before and after freeze is set in the next step S36. Specifically, for example, the number of frames from −80 to +80 is set, and the processing in FIG. 8 ends. Also, if the timing before and after the freeze is not selected as the timing in step S35, the process in FIG. 8 ends without performing step S36.
Next, the setting processing of the simultaneously stored data in FIG. 9 will be described. When the process of setting the simultaneously stored data is started, as shown in step S38, the initial settings of the normal endoscope image ON, the scale OFF, the text OFF, and the cursor OFF are performed. Then, in the next step S39, a process of selecting or deselecting the parameters of the simultaneously stored data is performed. That is, in step S39, a selection different from the parameter of the initial setting is performed, and the processing in FIG. 9 ends.

When the setting of various parameters is completed as described above, the specific image is displayed and saved in accordance with the settings, and the specific image based on the user's settings can be displayed and saved.
As shown in the table of FIG. 10, the number of display and / or save settings is 80 in total.
Note that FIG. 10 shows the number of display storage patterns when one of each of luminance, area, freeze, and time is selected as a selection criterion. For example, as shown in the flowchart of FIG. If the luminance is selected as a reference and a plurality of items are set as a selection criterion so as to further select an area, the number of display storage patterns becomes much larger.

Hereinafter, typical setting examples will be sequentially described with reference to FIGS. 11, 14, 15, 17, 20, and 22.

The flowchart of FIG. 11 is, specifically, as shown in the display example of FIG. 2, the display storage mode is specific image display storage, the selection criterion is luminance (luminance value = 150), the size is invalid (OFF), the timing is scan, This is the case where the shake correction is invalid (OFF) and the simultaneously stored data is the normal endoscope image and the scale, and the operation will be described.
When the power of the optical scanning type observation apparatus 1 is turned on and the operation starts, the control device 24 enters an operation state, and enters a state of waiting for the start of scanning as shown in step S41 of FIG. When the scanning starts, display and storage start as shown in step S42. Next, as shown in step S43, it is determined whether or not the luminance value in the frame has reached 150 or more at least once.

FIG. 12 shows a circuit configuration of a signal processing system that determines whether or not a signal of a cell observation image having a luminance equal to or higher than a set luminance value is input as in this case.
For example, as shown in FIG. 12, an output signal of the A / D converter 15 is input to one end of a comparator 31 in the control device 24, and a luminance value (= 150) stored in a parameter storage unit 32 in the control device 24. ) Is input to the other input terminal of the comparator 31 as a reference value, and it is determined whether or not a signal of a cell observation image having a reference luminance value (= 150) or more is input by the comparator 31. The signal writing to the memory 16 is controlled by the output signal.
If the luminance value in the frame has never reached 150 or more, the writing to the memory 16 is prohibited as shown in step S44, and in the next step S45, immediately before the writing to the memory 16 is prohibited. Then, the data written in the memory 16 is read out, the data is stored in the display RAM or the like, and the data is displayed on the monitor 4, and the process proceeds to the next step S46.

In other words, if the luminance value in the frame has never reached 150 or more, the latest data in which the luminance value in the frame has reached 150 or more at least once is read out, and the data is stored in the display RAM or the like. And the data is continuously displayed on the monitor 4.
In step S46, it is determined whether or not the scanning has been stopped. If the scanning has not been stopped, the process proceeds to the process of the next frame in step S47. After the process has proceeded to the process of the next frame, the process returns to step S43.
On the other hand, if the luminance value in the frame becomes 150 or more at least once in step S43, the writing space of the memory 16 in step S48 is stored in the writing space of one frame or more (more precisely, simultaneously with the image data of one frame). It is determined whether there is free space (for the data to be stored). If there is no free space, as shown in step S49, the oldest data in the memory 16 is secured as an overwrite area, and the process proceeds to the next step S50.

On the other hand, if there is more than one frame space in the writing space of the memory 16, the process proceeds to step S50, where the cell observation image (abbreviated as a cell image in FIG. 11 and the like) and the simultaneously stored data are simultaneously stored in the memory 16 in this step S50. After writing, the process proceeds to the next step S51.
In step S51, the written data is read from the memory 16 and displayed on the monitor 4, and then the process proceeds to step S46. It is determined whether the scanning is stopped as described above. If the scanning is not stopped, the process returns to step S43 via step S47.
If the user instructs to stop scanning in step S46, the process advances to step S52 to perform display and storage stop processing.
Then, in the next step S53, a determination is made as to whether or not to save the file. If the user selects the save, a process of designating the file name and format and saving it in the recording medium 18 is performed as shown in step S54. Then, the processing of FIG. 11 ends. If the file saving is not selected in step S53, the process of FIG. 11 ends without performing the process of saving to the recording medium 18.

FIG. 13 shows a timing chart of the operation in the case of FIG. As shown in FIG. 13, display and storage are started simultaneously with the start of scanning. The display and the storage are stopped in synchronization with the stop of the scan. The scanning is stopped, and the image data recorded in the memory 16 is stored in a predetermined file format on a recording medium 18 (for example, a magnetic disk such as an HDD, or a magneto-optical disk such as a CD-R, MO, or DVD-R). it can. The file name can be set arbitrarily, and the file format can be saved as a multi-still image file such as Multi TIFF or a moving image file such as AVI, MPEG-1, MPEG-2.
Next, the operation in the case of the second representative example will be described with reference to FIG. In this case, the operation is performed when the size is further enabled (ON) in the selection setting state of FIG. In other words, the size is enabled under the display / save condition of FIG. 11, and specifically, the display save mode is the specific image display save, the selection criterion is luminance (the luminance value is 150), and the size is Valid (ON), timing is scan, blur correction is invalid (OFF), and this corresponds to the operation of the display / save processing when the simultaneously saved data is a normal endoscope image and scale.

For example, when a cell image having a size of 10 μm exists in one frame, for example, among the total number of display pixels of 512 × 512 (= about 200,000 pixels), the number of pixels having a luminance value of 150 or more is It can be determined to be approximately 10,000 pixels.
Therefore, if the luminance value is 150 or more and the number of pixels per frame is 10,000 pixels, it is determined that a cell image exists in one frame, and only that frame is displayed and stored.
The flowchart shown in FIG. 14 is different from the flowchart shown in FIG. 11 in that steps S61 and S65 are performed between steps S42 and S43 (more precisely, similar step S43 ′) and steps S62 and S65 are performed between steps S43 and S44. The operation is provided. Therefore, a description will be given of a part basically different from FIG.

When the operation starts, the pixel number counter is initialized in step S61 through steps S41 and S42 as in FIG. That is, after setting the count variable i to 0, it is determined in the next step S43 'whether or not the luminance value of the input image data (each pixel) is 150 or more (as a reference luminance value).
If this condition is satisfied, the count variable i is incremented by 1 in the next step S62, and it is determined whether the end of the frame is reached in the next step S63. If it is not the end of the frame, the processing of the next pixel in step S64 And returns to step S43 '. If it is determined in step S43 'that the luminance value of the input pixel does not exceed 150, step S62 is skipped and the process proceeds to step S63.
In step S63, if the end of the frame is reached, the process proceeds to step S65 to determine whether the value of the count variable i is equal to or greater than 10000 (that is, i ≧ 10000). Determines that there is a cell image having a size of 10 μm in one frame, proceeds to step S48, and performs a process of writing to the memory 16. On the other hand, if the condition of step S65 is not satisfied, the process proceeds to step S44, in which writing to the memory is prohibited, and the latest data written to the memory 16 earlier than that is read and displayed on the monitor 4.
Other operations are the same as those in FIG.

Next, as a third representative example, the display save mode is to save a specific image and save all images, the selection criterion is area, the timing is frozen (still image display), the blur correction is disabled (OFF), and the simultaneous save data is text. The case will be described.
Regardless of the setting of the shake correction and the simultaneous storage data, any setting does not affect the processing, and a description thereof will be omitted. In this case, only the still image of the designated region Rc set by the region setting shown in FIG. 3 is displayed, and all display pixels of the still image are stored. When the input device such as the keyboard 25 and the mouse 26 freezes, an operation as shown in the flowchart of FIG. 15 is performed. The operation starts and waits for the start of scanning in step S71, and then waits for a freeze instruction as shown in step S72. When this freeze instruction is given, it is determined whether or not there is a free space in the write space to the memory 16 as shown in step S73. If there is no free space, the oldest in the memory 16 as shown in step S74 is determined. The data is secured as an overwrite area, and the cell observation image and the simultaneously stored data are simultaneously written in the memory 16 in the next step S75, and the process proceeds to the next step S76.

On the other hand, if there is a free space in the write space for the memory 16 in step S73, the process proceeds to step S75.
In step S76, the written data is read from the memory and displayed on the monitor 4, and in the next step S77, the target pixel is outside the designated area Rc (for simplicity, the symbol Rc is omitted and abbreviated to the designated area in FIG. 15). Is determined.
If the target pixel is outside the designated area Rc, the luminance value of that pixel is set to 0 as shown in step S78. That is, the image is displayed at the black level outside the designated region Rc. Thereafter, in the next step S79, it is determined whether or not the frame is the end. If it is not the end of the frame, the process proceeds to the next pixel as shown in a step S80 and returns to the step S77.
On the other hand, if it is determined in step S77 that the target pixel is within the designated area Rc, the process proceeds to step S79. If the end of the frame is determined in step S79, the cell observation image of the designated region Rc is displayed on the monitor 4 as shown in step S81.

Then, in the next step S82, a determination is made as to whether or not to save the file. If saving is selected, data is read from the memory 16 and a process of designating the file name and format and saving it on the recording medium 18 is performed. Then, the processing of FIG. 15 ends. If the user does not select to save the file, the process in step S83 is skipped, and the process in FIG. 15 ends.
FIG. 16 is a timing chart of the operation of FIG. As shown in FIG. 16, in synchronization with the freeze timing at which the scan starts, a freeze instruction is given, and a freeze instruction signal is output, all the still images are recorded in the memory 16 at that timing, and the data read out from the memory 16 is read. The control device 24 controls such that only the image of the designated area Rc is displayed as a still image.
Image data recorded in the memory 16 is stored in a recording medium 18 in a file format. The file name can be set arbitrarily, and the file format can be saved as a still image file such as TIFF or BMF.

Next, as a fourth representative example, the display / save mode is all image display / specific image save, the selection criterion is frame, the number of designated frames is 1 to 50 frames, the timing is before and after freezing (timing position is -10), The case where the correction is invalid (OFF) and the simultaneous storage data is a cursor will be described.
Regardless of the setting of the shake correction and the simultaneous storage data, any setting does not affect the processing, and a description thereof will be omitted. In this case, display and storage are started at a timing 10 frames earlier than the freeze timing, only 1-50 frames are saved, and a still image that is 10 frames earlier is displayed. When the input device such as the keyboard 25 and the mouse 26 freezes, the data written in the memory 16 is read back and displayed for 10 frames as shown in the processing of FIG. 17 and the timing chart of FIG.

Further, at the time of saving a file, 50 consecutive images are saved from an image that is 10 frames back.
Hereinafter, the operation will be described with reference to FIG. As in the case of FIG. 15, the process waits for the start of scanning in step S71, and determines in the next step S72 whether a freeze instruction has been issued.
When the freeze instruction is given, the data written 10 frames before is read from the memory 16 and displayed on the monitor 4 as shown in the next step S85, and the process proceeds to the next step S73. Steps S73 to S76 are the same as those in FIG. 15. The data read from the memory 16 is displayed on the monitor 4, and in the next step S86, it is determined whether to stop scanning or release the freeze.

If neither the stop of scanning nor the release of freeze is applicable, the process proceeds to the next frame as shown in step S87, and returns to step S75. On the other hand, if the freeze instruction has not been issued in step S72, the process skips step S85 and performs the process in step S73.
If it is determined in step S86 that the scanning is to be stopped or the freeze is released, the process proceeds to step S82 to perform a process for determining whether or not to save a file. When the process is completed and save is selected, as shown in step S88, data for 50 frames is read out from the memory 16 on the basis of the frozen image, and a process of designating a file name and a format and saving the data on the recording medium 18 is performed. Then, the process of FIG. 17 ends.

FIG. 18 shows the timing of start / stop of display and storage in the case of FIG. 17. When a freeze instruction operation is performed after the start of scanning as shown in FIG. 18, the memory 16 is stored 10 frames before the timing. Read and display the written data and save it.
FIG. 19 shows a data storage state in the memory 16, and as shown in FIG. 19, data for 50 frames after the frame 10 frames before the freeze instruction timing is stored.
Note that FIG. 18 shows an example in which scanning is performed until the display / storage stop timing reaches the specified number of frames. However, if the scan is stopped before reaching the specified number of frames, the scan is synchronized with the timing. Then, the display / save is stopped (in this case, the display or the save of less than 50 frames is performed).

Next, as a fifth representative example, the display save mode is the specific image display save, the selection criterion is time, the designated time is 1000 msec, the timing is laser, the blur correction is invalid (OFF), and the simultaneous save data is within the normal range. The case of an endoscope image will be described.
Regardless of the setting of the shake correction and the simultaneous storage data, any setting does not affect the processing, and a description thereof will be omitted.
An outline of the operation will be described. As shown in FIGS. 20 and 21, when the timing is a laser, the ON / OFF timing of the laser is synchronized with the start / stop of the scan, and thus is similar to the flowchart shown in FIG. However, when the timing is asynchronous with the start / stop timing of the scan, display and storage are performed only when the laser is emitted, so that useless display and storage of an image can be omitted. Similar to the description of the fourth representative example, in FIG. 21, when the laser (or scanning) is stopped before reaching the selection criterion range 0 to 1000 msec, the display is performed at that timing. Or stop saving.

Next, a description will be given with reference to the flowchart of FIG. Since the operation in this case is similar to the flowchart in FIG. 11, the description will be made using the same step numbers as those in FIG.
As in the case of FIG. 11, the first step S41 waits for the start of scanning, then waits for the laser to be turned on as shown in step S91, then starts the display and storage of step S42, and starts the memory in the next step S48. It is determined whether there is a free space in the writing space. In steps S48 to S51, the same processing as in FIG. 11 is performed, and thereafter, it is determined in step S92 whether the time has elapsed 1000 msec. If not, it is determined in step S46 whether to stop scanning. If the scanning is not stopped, a process for shifting to the next frame after step S47 is performed, and the process returns to step S48. In the case of stopping the scanning, it is further determined at step S93 that the laser should be stopped, and after waiting until the laser is stopped, the process proceeds to the display and saving stop processing at step S52. Thereafter, the process proceeds to steps S53 and S54 as in FIG.
If it is determined in step S92 that 1000 msec has elapsed, the process proceeds to step S52.

As described above, the timing chart in this case is as shown in FIG. FIG. 21 shows the case where the start of laser oscillation and the start of scan are synchronized, and the case where the laser oscillation is stopped is also shown as synchronized.
Next, as a sixth representative example, a case will be described in which the display save mode is the display and save of all images, the timing is blur correction, the blur correction is valid (ON), and the simultaneously stored data is scale. Since the setting of the simultaneous storage data does not affect the processing regardless of the setting, the description is omitted. In this case, the storage is started at the timing when the blur correction is performed by an input device such as the keyboard 25 and the mouse 26 (in synchronization with the start of the scan if the blur correction is set in advance), and the blur correction is released or the scan is performed. (See the flowchart of FIG. 22 and the timing chart of FIG. 23).
22 and 23, if the scan is stopped before the blur correction is stopped, the scan is stopped at that timing.

In addition, blur correction, for example, depending on the degree of the shift of the cell image between frames, if the degree exceeds a certain degree, without extracting and displaying the frame, continue to display and retain the data of the previous frame, such as It shall be realized by a method which can be realized by a generally known algorithm.
The operation will be described with reference to the flowchart of FIG.
Since the operation in this case is similar to the operation of the flowchart in FIG. 11, the description will be made using the same step numbers as those in FIG.
As in FIG. 11, the process waits for the start of scanning in the first step S41, and then waits for the blur correction to be turned on as shown in step S95. After the blur correction is turned on, the process proceeds to step S42, and then the processes of steps S48 to S51 are performed.

After step S51, it is determined whether the blur correction is canceled or the scan is stopped in step S96, and if not, processing for shifting to the next frame after step S47 is performed, and the process returns to step S48.
On the other hand, if it is determined that the blur correction is canceled or the scanning is stopped, the process proceeds to the display and storage stop processing in step S52, and the processing in steps S53 and S54 is performed, and the processing in FIG.
The timing chart in this case is as shown in FIG. That is, the display and storage are started at the timing when the scan or the like is started, and thereafter, the blur correction is performed. When the blur correction is subsequently released, the display and the storage are stopped at the timing.

As described above, according to the present embodiment, it is possible to set or select the display and storage setting conditions on the monitor 4 on which the cell observation image obtained by the optical scanning probe 2 is displayed. Since only images that satisfy the conditions are displayed or saved, usability (operability) can be improved.
Further, the setting conditions can be confirmed on the monitor 4. That is, the setting conditions can be easily confirmed, and the usability is good.
In addition, a desired image can be efficiently saved, and unnecessary images in the conventional example can be saved, and work such as editing for extracting a desired still image from an unnecessary image later is unnecessary or greatly reduced. it can.
Further, since unnecessary images can be prevented from being saved wastefully, the recording medium 18 does not need to have a large recording capacity.

(Second embodiment)
Next, a second embodiment of the present invention will be described with reference to FIGS. FIG. 24 shows an internal configuration of a rigid type optical scanning probe in the optical scanning observation apparatus according to the second embodiment, and FIG. 25 shows an example of use of the optical scanning probe.
The optical scanning observation device 50 of the present embodiment employs a rigid type optical scanning probe 51 shown in FIG. The rigid-type optical scanning probe 51 includes a rigid probe housing 55 having a focusing unit 53 and a two-dimensional scanning unit 54 at the distal end of a flexible sheath 52 (made of a flexible tube). It comprises objective units 56A and 56B that can be selectively attached to and detached from the probe housing 55.
The probe housing 55 is small and lightweight, for example, having a side of about several tens of mm, and the lens barrel 64 of the objective units 56A and 56B has an outer diameter of about several mm, for example, about φ3.

An optical fiber 57 and an electric cable 58 are inserted into the sheath 52, and a connector 5 is provided at a base end of the sheath 52, and is connected to a connector receiver 6 of the observation device 3B.
The light beam from the light source device in the observation device 3B is incident on the optical fiber 57 via the optical fiber.
Then, this light beam is transmitted by the optical fiber 57 and transmitted to the distal end surface. The distal end of the optical fiber 57 further extends from the distal end of the sheath 52 toward the probe housing 55. The distal end of the optical fiber 57 is held by the ferrule 59 in the focusing unit 53. The ferrule 59 is further movably held in the axial direction of the optical fiber 57 (Z direction in FIG. 24) by a focus driving unit 62 via a ferrule holding member 61 holding the ferrule 59, as shown by the arrow in FIG. Have been.

The focus drive unit 62 is configured to control the position of an actuator. The actuator is constituted by, for example, a linear stage 62b having a motor 62a to which an encoder is attached. For example, the ferrule holding member 61 is movably held on a movable portion of the linear stage 62b, and is moved in the axial direction of the optical fiber 57 via a gear (not shown) by rotation of the stepping motor 62a. The moving stroke in this case is, for example, about several mm, specifically, 5 mm, and the resolution is about several μm, for example, 5 μm. The actuator that forms the focusing drive unit 62 may be a combination of a stepping motor and a ball screw.

In this embodiment, the focusing unit 53 has been described as an example in which the ferrule 59 is moved in the optical axis direction. However, the focusing unit 53 may be a device that moves the collimator lens 63 in the optical axis direction. That is, instead of the ferrule holding member 61, a device that moves the member holding the collimator lens 63 (not shown) by the focus driving unit 62 may be used.
Further, since the focusing unit 53 can change the observation unit 68 in the optical axis direction, it is also possible to acquire a tomographic image of the observation target 67 in the depth direction.
The light emitted from the distal end face of the optical fiber 57 is converted into a parallel light beam by the collimator lens 63 and reflected by the two-dimensional scanning means 54 formed by a micromachine mirror or the like. When the micromachine mirror constituting the two-dimensional scanning means 54 is driven two-dimensionally, the reflected light beam is two-dimensionally scanned (in FIG. 24, the X and Y directions perpendicular to the axis of the optical fiber 57). Scan).

The light beam reflected by the two-dimensional scanning means 54 is attached to the distal end of the lens barrel 64 via a pupil lens relay 65 mounted near the base end of the lens barrel 64 of the objective unit 56I (I = A or B). The light is condensed and irradiated on the observation target 67 via the lens 66I, and can be adjusted by the focusing unit 53 so that the observation section 68 near the surface of the observation target 67 becomes a focus point.
In the present embodiment, the pupil lens relay 65 is shown as an example arranged in the objective unit 56I. However, the pupil lens relay 65 is arranged in the probe housing 55 and has a structure that can be separated from the objective unit 56I. May be.

The probe housing 55 can be attached to an opening provided in the light scanning direction of the two-dimensional scanning means 54 in a state of being positioned in contact with the base end 70 of the lens barrel 64 constituting the objective unit 56I. An objective unit mounting section 69 is provided.
In addition, an ID detection section 71 is provided at a position opposite to the objective unit mounting section 69 so as to sandwich the base section 70 of the lens barrel 64 in the opening, and provided at the base section 70 of the objective unit 56I. The magnification and the like of the objective lens 66I are determined by detecting the notch 72I.
The objective units 56A and 56B have, for example, different magnifications of the objective lenses 66A and 66B, and therefore have different positions where the notches 72A and 72B are provided. Then, the ID detection unit 71 detects the positions of the cutouts 72A and 72B using an electric contact, an optical sensor, or the like, and outputs an ID detection signal in accordance with the detection of the positions.

It should be noted that, in addition to the above-described notch portions 72A and 72B, which perform ID identification based on a difference in mechanical structure, a recording medium on which ID information is recorded, ID information recorded from a recording element (for example, ROM), or the like. May be electrically read.
The electric cable 58 includes a drive line 58A for driving the focusing drive unit 62, a drive line 58B for driving the two-dimensional scanning unit 54, and a signal line 58C for transmitting an ID detection signal from the ID detection unit 71. The electric cable 58 is connected to a control device in the observation device 3B by connecting the connector 5 to the observation device 3B.
The observation device 3B has a two-dimensional scanning unit 54 that uses a function of outputting a drive signal for focusing and an ID detection signal from the ID detection unit 71 in addition to the function of the control device 24 in FIG. And a function of controlling the scanning range when scanning by driving the.

For example, assuming that the magnification of the objective lens 66A of the objective unit 56A is four times the magnification of the objective lens 66B of the objective unit 56B, the control device performs two-dimensional The amplitude of the signal for scanning the scanning means 54 is controlled to １ ／ of that when the objective unit 56B is mounted. That is, control is performed so that the images can be displayed in the same display area.
The light scanned in the two-dimensional direction by the two-dimensional scanning means 54, reflected by the objective lens 66A, reflected near the observation unit 68, and further incident on the distal end surface of the optical fiber 57 via the objective lens 66A and the like is observed. The image is formed by photoelectric conversion in the device 3B, and the image is displayed on a monitor connected to the observation device 3B.
Also in the present embodiment, the tip surface of the optical fiber 57 and the focal point (observation section 68) of the objective lens 66I have almost a confocal relationship, and a confocal microscope is formed.

The above-mentioned focusing can be finely adjusted so that the observation section 68 is focused during continuous observation for a long period of several weeks to several months. This focusing is a focus adjustment mechanism in a depth direction (or a distance direction) orthogonal to the two-dimensional scanning direction.
An arm attachment portion 73 is provided on the outer surface of the probe housing 55, and a passive joint 75 provided at the tip of an arm 74 can be attached to the arm attachment portion 73 as shown in FIG. .
FIG. 25 shows an example of using the optical scanning probe 51 mainly in the optical scanning observation device 50 of the present embodiment. The optical scanning probe 51 is held at an arbitrary position by an arm 74 having a base end fixed to the observation table 81. The arm 74 is provided with first to third joints 82a to 82c rotatably connected in the middle of the arm 74 in a longitudinal direction. The holding position of the optical scanning probe 51 to which the passive joint 75 at the distal end is attached is three-dimensionally set. The probe positioning and holding mechanism 87 is formed so that it can be adjusted or set to an arbitrary position.

The first joint 82a is rotatable around the axis of the arm 74, and the second and third joints 82b and 82c are rotatably connected in a direction orthogonal to the axis of the arm 74.
An XY stage 82, which is movable in the X and Y directions, is attached to the observation table 81. On the XY stage 82, for example, a U-shaped observation target fixing portion 83 is fixed.
The observation target fixing portion 83 is fixed so as to sandwich, for example, a rat 67 a as the observation target object 67.
Further, on the upper surface of the observation target fixing portion 83, an objective unit fixing portion 84 for fixing the front end side of the objective unit 56I so as to sandwich it is shown (in FIG. 25, the case of the objective unit 56A is shown).

A driving means such as a stepping motor (not shown) in the XY stage 82 is connected to one end of an electric cable 86 extending from the observation table 81, and the other end of the electric cable 86 is connected to the observation device 3B.
Then, by operating a keyboard 25 (see FIG. 1) provided on the observation device 3B and the like, the drive of the stepping motor is controlled by a control signal via the control device 24, and the XY stage 82 The position of the portion 83) is freely movable in each of two axial directions such as the X and Y directions, so that the position can be adjusted to an arbitrary position on the XY plane.

Then, the objective unit 56A of the rigid type optical scanning probe 51 is positioned by the observation target fixing part 83 attached to the upper surface of the XY stage 82, so that the rat 67a as the observation target 67 can be observed for a long period of time. Like that. In such a long-term observation, the position of the observation unit 68 can be finely adjusted by moving the XY stage 82.
According to the present embodiment, it is possible to observe an observation object with a confocal microscope for a long period of time with a simple operation.

[Appendix]
1. A light source,
At least one or more scanning means for scanning a light beam emitted from the light source against an object,
Signal generating means for driving the scanning means to generate a timing signal;
An optical system that irradiates the object with light from the light source and receives return light from the object,
Photoelectric conversion means for converting the light received by the optical system into an electric signal,
An AD converter that converts an electric signal from the photoelectric conversion unit into digital data;
A memory for recording digital data from the AD converter;
Image generation means for converting the data stored in the memory to generate an image,
A monitor for displaying an image generated by the image generating means,
Storage means for storing an image generated by the image generation means,
Display save selection means for setting a display save parameter that determines a display and save method to be selectable, displayed on the monitor together with the image generated by the image generation means,
A control unit that controls at least one of the light source, the image generation unit, and the storage unit based on the display storage parameter to execute display and storage,
A scanning observation apparatus, comprising:

2. The display storage parameter is:
A display save mode for displaying and / or saving at least a specific image;
A selection criterion for specifying an image to be displayed and / or saved and generated by the image generating means;
Simultaneous storage data for specifying data other than the image stored together with the image generated by the image generating means,
Save timing for deciding at what timing to save the image generated by the image generating means,
Blur correction for determining whether to correct the blur of the image generated by the image generating means,
The scanning observation apparatus according to claim 1, wherein the scanning observation apparatus comprises at least one of the following.
3. The image generation means, together with the image generated by the image generation means,
Normal endoscope observation image,
A scale indicating the size of the image generated by the image generating means,
Any text,
Any cursor and
2. The scanning observation apparatus according to claim 1, wherein at least one of them can be simultaneously displayed on the monitor.

4. The display storage selection means, the display storage mode,
A specific image display / save mode for displaying and saving only a specific image among the images generated by the image generating means;
Among the images generated by the image generation means, only a specific image is displayed, and a specific image display all image storage mode for storing all images,
An all image display specific image storage mode for displaying all images among the images generated by the image generating means and storing only specific images;
An all-image display saving mode for displaying and saving all images among the images generated by the image generating means;
3. The scanning observation apparatus according to claim 2, wherein any one of them is set to be selectable.
5. The display storage selection unit sets the selection criterion to:
A luminance reference based on a luminance value of light received by the optical system,
An area reference based on a specific area of the range scanned by the scanning means,
A frame reference based on a specific number of images among the images generated one after another from the image generating means,
A time reference based on an image within a specific time among images generated one after another from the image generating means,
3. The scanning observation apparatus according to claim 2, wherein any one of them is set to be selectable.

5-1. When the selection criterion is set to the luminance criterion by the display storage selection means, the control means displays and / or saves when the luminance criterion is equal to or more than a predetermined luminance value, and displays and / or saves when the luminance is less than a predetermined luminance value. 6. The scanning observation apparatus according to claim 5, wherein the image generation unit and the storage unit are controlled so as not to store the image.
5-1-1. When the selection criterion is set to the luminance criterion by the display storage selection means, the control means determines that the size of the subject displayed in one frame constituting one image is equal to or higher than a predetermined luminance value. The image generating means and the storing means are controlled so as to display and / or save if the size is equal to or larger than a predetermined size, and otherwise not to display and / or save. Scanning observation device.
5-1-2. The scan according to Supplementary Notes 5-1 and 5-1-1, wherein the display storage selection unit can arbitrarily set the predetermined luminance value when setting the selection criterion to the luminance criterion. Mold observation device.
5-1-3. The display storage and selection means may set the predetermined brightness value and the predetermined size arbitrarily when setting the selection criterion to the brightness criterion, supplementary notes 5-1 and 5-1. -1, and the scanning observation device according to 5-1-2.

5-2. When the selection criterion is set to the area criterion by the display storage selection means, the control means displays and / or saves only a predetermined area, and does not display and / or save the other area. The scanning observation apparatus according to claim 5, wherein the scanning observation apparatus controls the storage unit.
5-2-1. The scanning observation apparatus according to supplementary note 5-2, wherein the display storage selection unit can arbitrarily set the predetermined area when setting the selection criterion to the area criterion.
5-3. When the selection criterion is set to the frame criterion by the display / storage selection means, the control means displays and / or saves only a predetermined frame and does not display and / or save other frames. 6. The scanning observation apparatus according to claim 5, wherein the scanning type observation device controls the means and the storage means.

5-3-1. The scanning observation apparatus according to Supplementary Note 5-3, wherein the display storage selection unit can arbitrarily set the predetermined frame when setting the selection criterion to the frame criterion.
5-4. The control means displays and / or saves for a predetermined time when the selection criterion is set to the time reference by the display / save selection means, and otherwise displays and / or saves the image. The scanning observation apparatus according to claim 5, wherein the scanning observation apparatus controls the generation unit and the storage unit.
5-4-1. 5. The scanning observation apparatus according to claim 5, wherein the display storage selection unit can arbitrarily set the predetermined time when setting the selection criterion to the time reference.

6. The display storage selection means, the simultaneous storage data,
The normal endoscope observation image,
The scale,
Said any text,
Said arbitrary cursor,
4. The scanning observation apparatus according to Supplementary Notes 2 and 3, wherein at least one of them is set to be selectable.
7. The display save selection means sets the save timing,
Timing at the start and / or stop of scanning generated by the control means, at the time of generating a still image or before and after the generation of a still image,
Timing of starting and / or stopping light output of the light source generated from the control means,
Timing at the time of executing and / or canceling the shake correction generated by the control means,
3. The scanning observation apparatus according to claim 2, wherein any one of them is set to be selectable.

8. 3. The scanning observation apparatus according to claim 2, wherein the display storage selection unit sets the shake correction so that the shake correction can be switched to either execution or cancellation.
9. 2. The scanning observation apparatus according to claim 1, wherein the light source is a laser.
9-1. 10. The scanning observation apparatus according to claim 9, wherein the laser is a semiconductor laser.
10. The scanning observation apparatus according to claim 1, wherein the optical system includes an optical fiber that transmits light, an optical coupler that separates light, and at least one lens that forms an image on the light. .
11. 2. The scanning observation apparatus according to claim 1, wherein the photoelectric conversion unit includes a photodetector (photodetector).

12. 2. The scanning observation apparatus according to claim 1, wherein the photoelectric conversion unit includes a photomultiplier tube.
13. 2. The scanning observation device according to claim 1, wherein the gradation of the AD converter has at least 8 bits or more.
14． 2. The scanning observation apparatus according to claim 1, wherein the memory is a cine memory capable of recording a large-capacity moving image.
15. 2. The scanning observation apparatus according to claim 1, wherein the display storage selection unit includes an input device for setting the display storage parameter.
15-1. 16. The scanning observation apparatus according to claim 15, wherein the input device is a keyboard that can be manually pressed.
15-2. 16. The scanning observation apparatus according to claim 15, wherein the input device is a mouse or a trackball that can be pressed and dragged by hand.

16. The optical system is a rigid body that has a built-in scanning means at the end of a sheath through which an optical fiber for transmitting light is inserted, and a detachable objective unit with an objective lens that focuses light toward an observation target. The scanning observation device according to attachment 1, further comprising a probe covered by a housing. {16-1. The scanning observation apparatus according to attachment 16, wherein the probe is held (fixed) three-dimensionally at an arbitrary position by a probe holding mechanism provided with an articulated arm provided on an observation table. 16-1-1. The scanning observation apparatus according to attachment 16-1, wherein the probe holding mechanism is provided with observation target fixing means for fixing an observation target at an arbitrary position two-dimensionally.

FIG. 1 is an overall configuration diagram of an optical scanning observation apparatus according to a first embodiment of the present invention. The figure which shows the example of a display of a monitor. FIG. 7 is an explanatory diagram of an area determination method when an area reference is used as a display reference. FIG. 9 is a flowchart showing the entire processing content from setting of a display / save method to display / save processing. FIG. 9 is a flowchart showing processing for setting a display storage mode. The flowchart figure which shows the processing content of the setting of a selection standard. FIG. 9 is a flowchart showing the contents of an area setting process. The flowchart figure which shows the processing content of the setting of timing. The flowchart figure which shows the processing content of the setting processing of simultaneous storage data. 9 is a table showing a pattern in which display and storage of a specific image can be selectively set by setting various parameters. Display save mode is specific image display save, selection criterion is brightness (brightness value is 150), size is invalid (OFF), timing is scan, blur correction is invalid (OFF), simultaneous save data is usually endoscopic image and scale The flowchart figure which shows the processing content of the display / save processing in the case of. FIG. 4 is a block diagram showing a configuration of a signal processing circuit when a selection criterion is luminance. FIG. 11 is a timing chart of display & storage start / stop when the timing is scan. FIG. 12 is a flowchart showing the processing content when the size parameter is turned ON in the parameter setting of FIG. 11. The flowchart figure which shows the processing content when the display preservation mode is specific image display all image preservation, a selection criterion is an area, the timing is frozen (still image display), the blur correction is invalid (OFF), and the simultaneous preservation data is text. FIG. 16 is a timing chart in the case of the operation in FIG. 15. Display save mode is Full image display Save specific image, Selection criterion is Frame, Number of designated frames is 1-50 frames, Timing is before and after freeze (Timing position is -10), Shake correction is invalid (OFF), Simultaneous save data is cursor The flowchart figure which shows the processing content in the case of. FIG. 18 is a timing chart of display and storage start before and after the freeze in FIG. 17. FIG. 4 is an explanatory diagram showing data to be saved before and after a freeze. The flowchart figure which shows the process content when a display preservation mode is a specific image display preservation, a selection criterion is time, a designated time is 1000 msec, a timing is laser, blurring correction is invalid (OFF), and simultaneous preservation | save data is a normal endoscope image. FIG. 21 is a timing chart for display / save start / stop in the case of FIG. 20. The flowchart figure which shows the processing content when the display preservation | save mode is all image display preservation | save, timing is blurring correction, blurring correction is effective (ON), and simultaneous storage data is a scale. FIG. 23 is a timing chart of display / save start / stop in the case of FIG. 22. FIG. 5 is a configuration diagram of an optical scanning observation device according to a second embodiment of the present invention. The figure which shows the example of use of an optical scanning probe.

Explanation of reference numerals

DESCRIPTION OF SYMBOLS 1 ... Optical scanning type observation device 2 ... Optical scanning probe 3 ... Observation device 4 ... Monitor 5 ... Connector 7 ... Light source device 8, 9 ... Optical fiber 10 ... Optical element 11 ... X scanner 12 ... Y scanner 13 ... Subject 14 ... Photodetector 15 A / D converter 16 Memory 18 Imaging device 18 Recording medium 21 Signal generator 22, 23 Amplifier 24 Controller 25 Keyboard 26 Mouse R1 Cell observation image display area R2 ... Patient information display area R3 ... Normal endoscope image display area R4 ... Display storage parameter setting window Attorney Attorney Susumu Ito

Claims (2)

A light source,
At least one or more scanning means for scanning a light beam emitted from the light source against an object,
Signal generating means for driving the scanning means to generate a timing signal;
An optical system that irradiates the object with light from the light source and receives return light from the object,
Photoelectric conversion means for converting the light received by the optical system into an electric signal,
An AD converter that converts an electric signal from the photoelectric conversion unit into digital data;
A memory for recording digital data from the AD converter;
Image generation means for converting the data stored in the memory to generate an image,
A monitor for displaying an image generated by the image generating means,
Storage means for storing an image generated by the image generation means,
Display save selection means for setting a display save parameter that determines a display and save method to be selectable, which is displayed on the monitor together with the image generated by the image generation means,
A control unit that controls at least one of the light source, the image generation unit, and the storage unit based on the display storage parameter to execute display and storage,
An optical scanning type observation device comprising: The display storage parameter is:
A display save mode for displaying and / or saving at least a specific image;
A selection criterion for specifying an image to be displayed and / or saved and generated by the image generating means;
Simultaneous storage data for specifying data other than the image stored together with the image generated by the image generating means,
Save timing for deciding at what timing to save the image generated by the image generating means,
Blur correction for determining whether to correct the blur of the image generated by the image generating means,
The optical scanning observation device according to claim 1, comprising at least one of the following.

Images