JP4878815B2 - Microscope equipment - Google Patents

Description

  The present invention relates to a microscope technique, and in particular, to a technique for acquiring a microscope image of an observation body and displaying the acquired microscope image.

  When observing an observation body using a microscope, the range that can be observed at one time (observation range) is mainly determined by the magnification of the objective lens. Here, when a high-magnification objective lens is used, the observation range is limited to a very small part of the observation body.

  For example, in pathological diagnosis such as cell or histological diagnosis, there is a demand for grasping the entire image of an observation body in order to prevent oversight of a diagnosis part. In addition, the development of information processing technology has promoted the conversion of electronic images into images even in such pathological diagnoses. Microscopic images captured via video cameras, etc., have the same high resolution as conventional silver halide films. There is a request to want.

  In order to realize these demands, for example, in Patent Document 1 and Patent Document 2, an image of an observation body is divided into small sections in advance, and a portion of the observation body corresponding to the small sections is formed with a high-resolution objective lens. A system for reconstructing an image of an observation body by photographing and joining the obtained microscopic images for each small section is disclosed. By using such a so-called virtual microscope system, it is possible to perform microscopic observation of an observation object even in an environment where the observation object does not actually exist. The following observations can be made.

  First, during low-magnification observation, for example, a wide-angle image is provided by reducing the connected microscope images. On the other hand, during high-magnification observation, high resolution is achieved by displaying a partial image taken for each small section. I will provide a.

Further, the display range of the microscope image being displayed is moved in response to an XY direction operation (horizontal movement operation on a plane perpendicular to the optical axis) by the observer.
In such a system, it is possible to diagnose an observation body without being limited by time, and by sharing image data representing a microscope image with each person, a plurality of diagnosers can be different at the same time. Even in a place, it is possible to observe different places of the same observation body.

  In addition, when performing observation while using the entity of the observation object while performing the XY direction operation, it is necessary to correct the focus shift caused by the inclination of the observation object. Since observation can be continued in a state where there is an error, observation efficiency increases, observation omission due to out-of-focus is reduced, and diagnosis reliability is increased accordingly.

  In addition, for example, when educating a pathologist, conventionally, it has been necessary to create a plurality of the same observation bodies and perform training such as observation training, whereas according to the system described above, image data Utilizing the advantage that can be shared, education using the same observation object image becomes possible.

  Furthermore, it is extremely difficult to restore the actual observation object enclosed in the slide glass if it is faded or damaged, but the image data can be backed up. Therefore, in the system as described above, an observation body in the same state can be observed anytime and anywhere.

As described above, the virtual microscope system is efficient, highly accurate, and highly reliable for microscope observation using the substance of the observation body.
Japanese Patent Laid-Open No. 9-281405 Japanese Patent Laid-Open No. 10-333056

  By the way, when performing the actual observation of the observation object, for detailed analysis and analysis, for example, the same part of the observation object is subjected to a plurality of spectroscopic methods as in the fluorescence observation by switching the excitation wavelength in the fluorescence observation. It may be required to observe. In order to meet this demand, many actual microscope apparatuses have means for quickly switching the microscopic method.

  However, since the conventional virtual microscope system assumes only the accumulation of image data for a single microscopic method, the image data for the same observation object is prepared by what microscopic method. It was not easy to figure out if they were. In addition, for the same part of the observation body, for example, switching of the observation method between bright field and dark field, observation at different wavelengths in fluorescence observation, etc. can be performed smoothly. There wasn't. For this reason, the work burden on the observer has been increased.

  The present invention has been made in view of the above-described problems, and the problem to be solved is a microscopic method in a so-called virtual microscope system in which a microscope image of an observation object is provided in the form of image data. Is to enable smooth switching.

A microscope apparatus according to one aspect of the present invention includes an imaging unit that captures a microscope image of an observation object under a predetermined spectroscopic method, and each of a plurality of resolutions that are set in advance by controlling the imaging unit. And an imaging control means for imaging a microscope image of the same observation body, and a microscopic method switching means for switching the microscopic method, and the imaging control means has a first resolution controlled in advance. A first imaging control unit that causes the imaging unit to perform imaging of the observation body, and a plurality of small sections that divide the first microscope image captured by the imaging unit under the control of the first imaging control unit And imaging means for a portion corresponding to the small section of the observation body at the second resolution that is a second resolution that is set in advance and is higher than the first resolution. The imaging The second imaging control means to be performed at the stage and the microscopic image for each of the small sections imaged by the imaging means under the control of the second imaging control means a microscope apparatus includes an image combining means for generating a second microscope image is the resolution, and an image storage means for storing microscopic image is captured is the binding by a plurality of specular methods for each observation object A display means for displaying a microscope image captured under the microscopic method stored in the image storage means, and a microscopic image captured under the microscopic method stored in the image storage means A first display control means for displaying a first partial image that is a partial image of the specified resolution on the display means, a microscopic method switching instruction acquisition means for acquiring an instruction for switching the microscopic method, A partial image of a microscopic image captured by the microscopic method according to the instruction by switching the display of the first partial image by the display unit in response to acquisition of the instruction for switching the microscopic method, The second partial image captured by the switched spectroscopic method representing the portion of the observation body at the same position as that represented in the partial image at the same resolution as the first partial image. And a second display control means for displaying the partial image on the display means . This feature solves the above-described problems.

In the above-described microscope apparatus according to the present invention, the composite display instruction acquisition means for acquiring the composite display instruction, and the first partial image and the second partial image are superimposed and combined in response to the acquisition of the composite display instruction. You may comprise further the 3rd display control means to display the synthesized image which is the image which carried out on the said display means.

  Further, at this time, a rotation instruction acquisition unit that acquires an instruction to rotate the image displayed on the display unit, and the display unit that rotates the image displayed on the display unit according to the rotation instruction. And a fourth display control means for displaying the first partial image displayed by the display means at the time of obtaining the switching instruction in a rotated state. In such a case, the second partial image may be configured to be displayed on the display unit by being rotated in the same manner as the first partial image.

  In addition, a microscope apparatus according to another aspect of the present invention includes an imaging unit that captures a microscopic image of an observation body under a predetermined microscopic method, an image captured by the first microscopic method, and a second microscopic image. An image storage unit that stores an image captured by the microscopic method, a display unit that displays an image captured under the microscopic method stored in the image storage unit, and an image storage unit First display control means for causing the display means to display a first partial image that is a partial image of an image that has been picked up by the first spectroscopic method and has a specified resolution among the stored images. And a microscopic method switching instruction acquisition means for acquiring an instruction for switching between the first microscopic method and the second microscopic method, and the display means according to the instruction for switching the microscopic method. Switch the display of the first part image, and The partial image of the image captured by the microscopic method, and the portion of the observation body that is in the same position as that represented in the first partial image is represented with the same resolution as the first partial image, and the switching is performed. And a second display control means for displaying on the display means a second partial image that is the partial image captured by a later spectroscopic method. Resolve.

  In the above-described microscope apparatus according to the present invention, the composite display instruction acquisition means for acquiring the composite display instruction, and the first partial image and the second partial image are superimposed and combined in response to the acquisition of the composite display instruction. You may comprise further the 3rd display control means to display the synthesized image which is the image which carried out on the said display means.

  Further, at this time, a rotation instruction acquisition unit that acquires an instruction to rotate the image displayed on the display unit, and the display unit that rotates the image displayed on the display unit according to the rotation instruction. A second display control means for displaying the first partial image displayed by the display means at the time of obtaining the switching instruction in a rotated state. In such a case, the second partial image may be configured to be displayed on the display unit by being rotated in the same manner as the first partial image.

  According to the present invention configured as described above, the so-called virtual microscope system in which the microscopic image of the observation object is provided in the form of image data has an effect that the switching of the microscopic method can be performed smoothly.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

FIG. 1 shows a first example of the configuration of a microscope system for carrying out the present invention.
The microscope apparatus 1 includes, as a transmission observation optical system, a transmission illumination light source 6, a collector lens 7 that collects illumination light from the transmission illumination light source 6, a transmission filter unit 8, and a transmission field stop 9. A transmission aperture stop 10, a condenser optical element unit 11, and a top lens unit 12 are provided. The epi-illumination observation optical system includes an epi-illumination light source 13, a collector lens 14, an epi-illumination filter unit 15, an epi-illumination shutter 16, an epi-illumination field stop 17, and an epi-illumination aperture stop 18.

  In addition, on the observation optical path where the optical path of the transmission observation optical system and the optical path of the epi-illumination observation optical system overlap, an electric stage 20 on which the observation body 19 is placed and movable in the vertical and horizontal directions is provided. ing. The movement control of the electric stage 20 is performed by the stage XY drive control unit 21 and the stage Z drive control unit 22. The electric stage 20 has an origin detection function (not shown) by an origin sensor, and coordinates can be set for each part of the observation body 19 placed on the electric stage 20.

  In addition, a revolver 24 that selects a plurality of objective lenses 23a, 23b,... (Hereinafter collectively referred to as “objective lens 23” as necessary) to be used for observation on the observation optical path by a rotating operation. A cube unit 25 for switching the microscopic method and a beam splitter 27 for branching the observation optical path to the eyepiece 26 side and the video camera 3 side are provided. Further, a polarizer 28 for differential interference observation, a DIC (Differential Interference Contrast) prism 29, and an analyzer 30 can be inserted into the observation optical path. Each of these units is motorized, and its operation is controlled by a microscope controller 31 described later.

  The microscope controller 31 connected to the host system 2 has a function of controlling the operation of the entire microscope apparatus 1. In accordance with a control signal from the host system 2, the microscopic method is changed, the transmitted illumination light source 6, The light source 13 for epi-illumination is dimmed and has a function of sending the current microscopic state of the current microscope apparatus 1 to the host system 2. The microscope controller 31 is also connected to the stage XY drive control unit 21 and the stage Z drive control unit 22, and the electric stage 20 can also be controlled by the host system 2.

  A microscope image of the observation body 19 captured by the video camera 3 is taken into the host system 2 via the video board 32. The host system 2 can perform automatic gain control ON / OFF, gain setting, automatic exposure control ON / OFF, and exposure time setting for the video camera 3 via the camera controller 33. The host system 2 can store the microscope image sent from the video camera 3 in the data recording unit 4 as an image data file. The image data recorded in the data recording unit 4 is read out by the host system 2, and the microscope image represented by the image data can be displayed on the monitor 5 which is a display unit.

Furthermore, the host system 2 also provides a so-called video AF function that performs a focusing operation based on the contrast of an image captured by the video camera 3.
The host system 2 receives a CPU (central processing unit) that controls the operation of the entire microscope system by executing a control program, a main memory that the CPU uses as a work memory as necessary, a mouse, a keyboard, and the like. An input unit for acquiring various instructions, an interface unit for managing the exchange of various data with each component of the microscope system, and an auxiliary storage such as a hard disk device for storing various programs and data It is a computer with a very standard configuration having a device.

The operation of this microscope system will be described below.
First, FIG. 2A and FIG. 2B will be described. These drawings are flowcharts showing the processing contents of the microscope image data acquisition processing performed by the host system 2. This process is a process for acquiring the microscope image data of the observation body 19 in the microscope system shown in FIG. 1, and is realized and started when the CPU of the host system 2 executes a predetermined control program. The

First, in S101 of FIG. 2A, a process of acquiring an instruction for a microscopic method in observation of the observation body 19 from the user is performed.
In S <b> 102, processing is performed to determine whether or not there remains a microscopic image that has not yet been captured among the microscopic methods acquired by the processing in S <b> 101. Here, when it is determined that it remains (when the determination result is Yes), the process proceeds to S103. On the other hand, when it is determined that the microscopic images have been captured by all the acquired microscopic methods (when the determination result is No), the microscopic image data acquisition process is terminated.

  In S103, an instruction is given to the microscope controller 31 to change the setting of the microscope apparatus 1 to a setting for capturing a microscope image in the microscopic method for which imaging has not yet been performed. In response to this instruction, the microscope controller 31 controls the operation of each component of the microscope apparatus 1 to obtain a state for performing imaging with the microscopic method. At this time, the coordinate system of the observation body 19 is set by the origin sensor of the electric stage 20 and its initialization operation.

  In S104, an instruction is given to the microscope controller 31, and the revolver 24 is rotated to select the low-magnification objective lens 23a. In S105, the observation object 19 captured by the video camera 3 at this time is processed. Control processing for focusing operation based on the contrast of the microscope image is performed.

  In S106, an instruction is given to the camera controller 33, and a process of capturing the entire image of the observation body 19 with the video camera 3 is performed. In subsequent S107, the low-resolution microscope image obtained by the imaging is displayed on the video camera 3. Is taken into the host system 2 via the video board 32.

  In S108, after the microscopic image data acquisition process is started, a low-resolution microscopic image captured using the low-magnification objective lens 23a is used for imaging the observation body 19 using the high-magnification objective lens 23b. Processing for determining whether or not processing for defining a small section (mesh) corresponding to the field of view (view angle) region has already been performed is performed. Here, when it is determined that the process of this definition has already been performed (when the determination result is Yes), the process proceeds to S111 (FIG. 2B).

  On the other hand, in the determination process of S108, when it is determined that the definition process has not yet been performed (when the determination result is No), the process proceeds to S109, and the captured low-resolution microscope image is processed. Processing to define this mesh is performed. Here, it is assumed that a rectangular mesh of l × n (l rows and n columns) is defined.

  In subsequent S110, it is determined whether each partial region of the low-resolution microscope image divided by the defined mesh includes an image of the portion of the observation body 19, and imaging using the high-magnification objective lens 23b is performed. Processing to determine the target mesh is performed. This determination can be made based on, for example, the presence or absence of a contour image (contrast image) of the observation body 19 obtained by calculating the difference between adjacent pixels, the color of each mesh image, and the like. A number is assigned to the mesh of the high-resolution imaging target determined in this way.

The process proceeds to FIG. 2B. In S111, an instruction is given to the microscope controller 31, and the revolver 24 is rotated to select the high-magnification objective lens 23b.
In S112, a process is performed to determine whether or not there remains a mesh that has not yet been subjected to the high-resolution imaging in the current spectroscopic method among the high-resolution imaging target meshes determined in the process of S110. When it is determined that it is left (when the determination result is Yes), the process proceeds to S113. On the other hand, when it is determined that all the meshes to be imaged have been subjected to high-resolution imaging by the current spectroscopic method (when the determination result is No), the process proceeds to S117.

  In S113, an instruction is given to the microscope controller 31, and the electric stage 20 is set so that the portion of the observation body 19 represented in the mesh area that has not been captured in the low-resolution microscope image is positioned directly below the objective lens 23b. Processing to move is performed.

  In S114, control processing for focusing operation based on the contrast of the microscope image of the observation object 19 captured by the video camera 3 at this time is performed, and in S115, an instruction is given to the camera controller 33. Processing for capturing an image of the portion of the observation body 19 with the video camera 3 is performed. In S116, a process of taking a high-resolution microscope image of the portion of the observation body 19 obtained by the imaging from the video camera 3 to the host system 2 through the video board 32 is performed, and then the process returns to S112. The above-described processing is repeated.

  By the way, in the determination process of S112, when it is determined that the high-resolution imaging by the current microscopic method has been completed for all of the imaging target meshes, in S117, the high-resolution microscopic images for each mesh are combined, A process for creating a high-resolution microscope image showing the entire observation object 19 is performed.

  In S118, a low-resolution microscope image of the observation object 19 captured in the host system 2 by the process of S107 (FIG. 2A) and a high-resolution microscope image of the observation object 19 obtained by the process of S117. Processing to integrate as one image data file is performed. Note that each microscope image integrated into one image data file at this time is taken under the same microscopic method.

  In S119, a process of recording the image data file obtained by the process of the previous step is performed by the data recording unit 4, and thereafter, the process returns to S102 (FIG. 2A) and the above-described process is repeated.

The above processing is the microscope image data acquisition processing.
Here, the case where the user instructs bright field observation, differential interference observation, and fluorescence observation as the spectroscopic methods as the spectroscopic methods in the observation of the observation body 19 as an example, the microscopic image by this microscopic image data acquisition processing The state of acquisition will be described.

  First, a low-resolution microscope image of the observation body 19 by bright field observation is obtained by the processing from S103 to S107, and then the low-resolution microscope image under the bright field observation is obtained by processing from S108 to S110. A mesh that is a target for imaging a microscopic image at a high resolution is determined. Then, the high resolution microscope image for each mesh of the observation body 19 by bright field observation is obtained by the processing from S112 to S116, and the high resolution microscope of the observation body 19 by bright field observation is combined by the processing of S117. An image is created. Then, the low resolution microscopic image and the high resolution microscopic image of the observation body 19 by bright field observation are integrated by the process of S118, and one image data file is created.

  Thereafter, a low-resolution microscopic image of the observation body 19 by differential interference observation is obtained by the processing from S102 to S107. At this time, since the mesh has already been defined for the low-resolution microscopic image of the observation body 19 by the bright field observation, the result of the determination process in S108 is No, and the bright field observation is performed by the subsequent processes from S112 to S116. According to the definition of the mesh for the low-resolution microscope image according to, a high-resolution microscope image for each mesh of the observation body 19 by differential interference observation is obtained. Thereafter, the meshes are combined by the process of S117, and a high-resolution microscope image of the observation body 19 by differential interference observation is created. Then, the low resolution microscopic image and the high resolution microscopic image of the observation body 19 by differential interference observation are integrated by the process of S118, and one image data file is created.

  Thereafter, a low-resolution microscope image of the observation body 19 by fluorescence observation is obtained by the processing from S102 to S107. At this time, since the mesh has already been defined for the low-resolution microscopic image of the observation body 19 by the bright field observation, the result of the determination process in S108 is No, and the bright field observation is performed by the subsequent processes from S112 to S116. According to the definition of the mesh for the low-resolution microscope image according to, a high-resolution microscope image for each mesh of the observation body 19 by fluorescence observation is obtained. Thereafter, the meshes are combined by the process of S117, and a high-resolution microscope image of the observation body 19 by fluorescence observation is created. Then, the low resolution microscopic image and the high resolution microscopic image of the observation body 19 by fluorescence observation are integrated by the process of S118, and one image data file is created.

  Examples of high-resolution microscope images integrated in the image data file for each microscopic method obtained as described above are shown in FIG. 3, FIG. 4, and FIG. Explaining these figures, the image example of layer 1 shown in FIG. 3 is a high-resolution microscope image of the observation body 19 captured by bright-field observation, and the image of layer 2 shown in FIG. An example is a high-resolution microscope image of the observation body 19 imaged by differential interference observation, and the image example of the layer 3 shown in FIG. 5 is a high-resolution microscope image of the observation body 19 imaged by fluorescence observation. is there. FIG. 6 shows the relationship between the image examples of these layers.

  As described above, when the host system 2 performs the above-described microscope image data acquisition processing, as shown in FIG. 6, different spectroscopic methods such as bright field observation, differential interference observation, and fluorescence observation are performed on the same observation body 19. Microscopic images are acquired by the method. Moreover, as can be seen by comparing the coordinates of mesh a (2, 2, 1) in FIG. 3, mesh b (2, 2, 2) in FIG. 4, and mesh c (2, 2, 3) in FIG. The observation body 19 represented in these microscope images is located at the same coordinates in each image.

  Next, FIGS. 7A and 7B will be described. These drawings are flowcharts showing the processing contents of the microscope image reproduction display processing performed by the host system 2. This process is a process for reproducing and displaying on the monitor 5 in order to perform virtual observation of the microscope image represented by the image data file recorded in the data recording unit 4 by executing the above-described microscope image data acquisition process. Yes, it is realized and started by the CPU of the host system 2 executing a predetermined control program.

In this process, it is assumed that a user instruction or operation is performed on an input unit (not shown) of the host system 2.
First, in S151 of FIG. 7A, a process of acquiring an instruction for the microscopic method in the virtual observation of the observation body 19 from the user is performed.

  In S152, among the image data files recorded in the data recording unit 4, the image data file in which the microscopic images captured by the microscopic method acquired in the process of S151 are integrated is read, and the read image data file Among the microscopic images integrated in the above, a process for displaying the one with the lowest resolution (obtained by imaging the observation body 19 at the lowest magnification) on the monitor 5 as a macro image is performed.

In S153, processing for acquiring the selection contents of the objective lens 23 by the user in the virtual observation is performed.
In S154, among the microscope images integrated in the image data file read out in the process of S152, those having a resolution corresponding to the objective lens 23 according to the selection content acquired in the process of S153 (the selected objective lens 23 obtained by imaging the observation body 19 at 23 and temporarily stored in a predetermined work storage area of the host system 2 is performed.

  In S155, among the microscopic images acquired by the process of S154, the image of the range corresponding to the magnification of the objective lens 23 according to the selection content acquired by the process of S153 is enlarged from the image of the macro image portion described above. As an image, a process of displaying the macro image side by side on the monitor 5 is performed. At this time, the user observes the microscope image displayed on the monitor 5 and performs virtual observation.

  In S156, a process for determining whether or not an instruction for switching the spectroscopic method in the virtual observation of the observation body 19 is performed, and when it is determined that the instruction for switching is acquired (when the determination result is Yes). The process proceeds to S157, and when it is determined that the switching instruction has not been acquired (when the determination result is No), the process proceeds to S161.

In S157, processing for obtaining the resolution and display position (enlarged position in the macro image of the enlarged image being displayed) of the microscope image (enlarged image) currently displayed on the monitor 5 is performed.
In S158, among the image data files recorded in the data recording unit 4, an image data file integrated with the microscopic image after switching according to the instruction acquired in the process of S156 is read and read. Among the microscope images integrated in the output image data file, a process of switching and displaying the lowest resolution image on the monitor 5 as a new macro image is performed.

  In S159, among the microscope images integrated in the image data file read out in the process of S158, those having the resolution acquired in the process of S157, that is, the microscope image (enlarged image) currently displayed on the monitor 5 A process of acquiring the same resolution and temporarily storing it in a predetermined working storage area of the host system 2 is performed.

  The process proceeds to FIG. 7B, and in S160, a partial image in a range corresponding to the magnification of the objective lens 23 currently selected in the virtual observation among the microscopic images acquired by the process of S159, is obtained by the process of S157. A process of causing the monitor 5 to switch and display the macro image in the same position as the acquired display position is performed, and then the process returns to S156 (FIG. 7A) and the above-described process is repeated.

  By the processing from S157 to S160, the display of the image on the monitor 5 is switched, and is a partial image of the microscope image captured by the microscopic method according to the switching instruction, and is displayed on the display partial image before switching. The partial image representing the portion of the observation body 19 at the same position as that of the displayed portion is displayed with the same resolution as the display partial image before switching.

  By the way, in the determination process of S156 of FIG. 7A, when it is determined that an instruction to switch the spectroscopic method has not been acquired, the movement operation of the XY position by the user, that is, the monitor 5 is displayed in S161. Processing is performed to determine whether or not the host system 2 has detected an operation for moving the display part of the observation body 19 in the enlarged image. Here, when it is determined that the moving operation is detected (when the determination result is Yes), the process proceeds to S162, and when it is determined that the moving operation is not detected (when the determination result is No). Advances the process to S163.

  In S162, a microscope image temporarily stored in a predetermined work storage area of the host system 2 by the processing of S154, S159 described above or S164 described later is referred to and displayed as an enlarged image on the monitor 5 in the microscope image. The display position being moved is moved in the direction and amount corresponding to the detected moving operation and switched to the monitor 5 for display. Thereafter, the processing returns to S156 and the above-described processing is repeated.

  As described above, in the process of S162, the image data file is sequentially stored from the data recording unit 4 by performing display using the microscopic image temporarily stored (cached) in the working storage area. Compared with the case of reading, it is possible to smoothly switch the image display. Instead of temporarily storing the entire microscope image in the working storage area, only the partial image in the vicinity of the partial image currently displayed on the monitor 5 among the microscope images is stored in the working storage area. In the process of S162, a partial image in the vicinity thereof is displayed in response to the user's operation for moving the XY position, and the image data file is read out from the data recording unit 4 and the vicinity of the newly displayed partial image is displayed. The partial image may be stored again in the work storage area.

  On the other hand, when it is determined in the determination process of S161 that the movement operation of the XY position is not detected, an instruction to switch the selection contents of the objective lens 23 in the virtual observation of the observation body 19 is acquired in S163. When it is determined that the switching instruction has been acquired (when the determination result is Yes), the process proceeds to S164. On the other hand, when it is determined that the switching instruction has not been acquired (when the determination result is No), the process returns to S156, and the above-described process is repeated.

  In S164, among the microscope images integrated in the image data file read out by the above-described processing of S152 or S158, the resolution corresponding to the objective lens 23 related to the selected content determined to be acquired by the processing of S163 is obtained. A process of acquiring the data and temporarily storing it in a predetermined working storage area of the host system 2 is performed.

  In S165, among the microscopic images acquired by the process of S164, an image in a range corresponding to the magnification of the objective lens 23 according to the selection content acquired by the process of S163 is displayed on the monitor 5 in a switching manner. The process is performed, and then the process returns to S156, and the above-described process is repeated.

The above processing is the microscopic image reproduction display processing.
Here, as an example, a case where an image data file in which microscopic images taken by each spectroscopic method of bright field observation, differential interference observation, and fluorescence observation are integrated is recorded in the data recording unit 4 is taken as an example. The display state of the microscope image by the microscope image reproduction display process will be described.

  For example, when the user instructs virtual observation by bright field observation, the macro image of the observation body 19 as illustrated on the left side of FIG. 8 and the right side of the same figure are displayed on the monitor 5 by the processing of S151 to S155. For example, an enlarged image as if a part of the macro image is enlarged is displayed.

  Here, when the user performs an operation of moving the XY position (especially, an operation of moving in the X direction here), the display of the enlarged image on the monitor 5 is performed as illustrated in FIG. 9 by the processing of S161 and S162. Switching from the display of FIG. 8 on the observation body 19 to the display of the portion moved in the X direction.

  At this time, when the user gives an instruction to switch the selection of the objective lens 23 to a higher magnification, the display of the enlarged image on the monitor 5 is performed as shown in FIG. 10 by the processing from S163 to S165. Then, the display of FIG. 9 on the observation body 19 is switched to the display of the further enlarged image.

  At this time, when the user switches the instruction of the microscopic method from bright field observation to differential interference observation, display of an image on the monitor 5 is performed as shown in FIG. 11A by the processing from S156 to S160. It switches from what was imaged by visual field observation to the microscope image imaged by differential interference observation. In the microscope images before and after the switching of the display, the resolution (display magnification) is the same, and an enlarged image of the portion at the same position of the observation body 19 is displayed.

  Further, at this time, when the user switches the spectroscopic instruction from the differential interference observation to the fluorescence observation, the display of the image on the monitor 5 is performed as shown in FIG. 11B by the processing from S156 to S160. It switches from what was imaged by observation to the microscope image imaged by fluorescence observation. Then, in the microscope images before and after the switching of the display, the resolution (display magnification) is the same, and an enlarged image of the portion at the same position of the observation body 19 is displayed.

  As described above, in the above-described microscope image reproduction display processing, when the microscopic method is switched, the microscope image at the same magnification and the same position of the observation body 19 is immediately displayed, so that the observation body is actually observed with a microscope. With the same operability, the highly reliable virtual observation that can faithfully reproduce the position information of the observation object becomes possible.

  As described above, in the microscope system according to the present embodiment, in the so-called virtual microscope system that reconstructs the image of the observation body by joining together the microscope images obtained by imaging the observation body, the observation body is actually a microscope. The microscopic method can be switched by the same operability as in the case of observation with.

  In this embodiment, three spectroscopic methods of bright field observation, differential interference observation, and fluorescence observation are illustrated and described as switching them. Of course, from the viewpoint of switching the spectroscopic methods, 3 The present invention is not limited only to the type switching, and a number of microscopic methods may be switched.

  Further, in the present embodiment, the coordinate alignment between each microscopic method was realized by 20 origin sensors of the electric stage and its initialization operation, but instead, for example, it was imprinted on a plate for an observation object. There may be one that realizes the alignment of the coordinates between the spectroscopic methods by detecting the marking. Further, from the viewpoint of matching the coordinates of images between different spectroscopic methods, a known method such as matching by image recognition may be used.

  Further, in the microscope image data acquisition process, the imaging of the high-resolution microscope image for one microscopic method is completed for all the meshes, and then the high-resolution microscopic image for the other microscopic method is performed. However, instead of taking all high-resolution microscope images for each specified spectroscopic method for one mesh and repeating this imaging for each mesh, a high-resolution microscope image is obtained. Also good.

  FIG. 12 shows a second example of the configuration of a microscope system that implements the present invention. In addition, the same code | symbol is attached | subjected about the component same as the 1st example shown in FIG. 1 in the figure, and detailed description is abbreviate | omitted.

  The configuration shown in FIG. 12 is different from the configuration shown in FIG. 1 in that an image composition unit 34 is inserted between the host system 2 and the monitor 5. In response to an instruction from the host system 2, the image composition unit 34 provides a function of superimposing and synthesizing two images related to the instruction and displaying them on the monitor 5.

Next, the operation of the microscope system shown in FIG. 12 will be described.
First, a microscope image acquisition operation is the same as that of the first embodiment. The host system 2 performs the microscope image data acquisition process shown in FIGS. 2A and 2B to acquire a microscope image. Is done.

  Here, as a spectroscopic method in the observation of the observation body 19, a case where the B excitation observation and the G excitation observation, which are fluorescence observations having different wavelengths, are instructed as the spectroscopic method is taken as an example. A state of acquiring a microscope image by processing will be described.

When the user gives an instruction for the above-described microscopic method, the host system 2 acquires this instruction by the processing of S101 in FIG. 2A.
Then, the low resolution microscope image of the observation body 19 by B excitation observation is first obtained by the processing of S103 to S107, and then the low resolution microscope image under the B excitation observation is obtained by the processing from S108 to S110. On the other hand, an l × n mesh is defined, and a mesh to be picked up of a microscope image at a high resolution is determined from the mesh. Then, high resolution microscopic images for each mesh of the observation body 19 by B excitation observation are obtained by the processing from S112 to S116, and the meshes are combined by the processing of S117, and by B excitation observation as illustrated in FIG. A high-resolution microscope image of the observation body 19 is created. Then, the low resolution microscopic image and the high resolution microscopic image of the observation body 19 obtained by the B excitation observation are integrated by the process of S118 to create one image data file.

  Thereafter, a low-resolution microscopic image of the observation body 19 by G excitation observation is obtained by the processing from S102 to S107. At this time, since the mesh has already been defined for the low-resolution microscope image of the observation body 19 by the B excitation observation, the result of the determination process of S108 is No, and the B excitation observation is performed by the subsequent processes from S112 to S116. According to the definition of the mesh for the low-resolution microscope image according to, a high-resolution microscope image for each mesh of the observation body 19 by G excitation observation is obtained. Thereafter, the meshes are combined by the process of S117, and a high-resolution microscope image of the observation body 19 by G excitation observation as illustrated in FIG. 14 is created. Then, the low resolution microscope image and the high resolution microscope image of the observation body 19 by G excitation observation are integrated by the process of S118, and one image data file is created.

  As described above, when the host system 2 performs the above-described microscope image data acquisition processing, as shown in FIG. 15, the same observation body 19 is referred to as B excitation observation (layer 1) and G excitation observation (layer 2). Microscopic images from different microscopic methods are acquired. In addition, as can be seen by comparing the coordinates of the mesh a ′ (6, 4, 1) in FIG. 13 and the mesh b ′ (6, 4, 2) in FIG. The body 19 is located at the same coordinate in each image.

Next, a microscopic image reproduction / display operation will be described.
This reproduction display operation is basically the same as that of the first embodiment, and is realized by the host system 2 performing the microscope image reproduction display processing shown in FIGS. 7A and 7B. In the example, changes are made to the flowcharts of FIGS. 7A and 7B.

  Here, FIG. 16 will be described. This figure shows a changed part in the present embodiment regarding the microscope image reproduction display processing shown in FIGS. 7A and 7B. The flowchart in FIG. 16 is executed when the result of the determination process in S163 in FIG. 7A is No.

  If it is determined in S163 of FIG. 7A that an instruction to switch the selection contents of the objective lens 23 in the virtual observation of the observation body 19 is not acquired, the process proceeds to FIG. Processing for determining whether or not an instruction to superimpose and display a microscope image captured by the method on a microscope image being displayed has been acquired is performed. If it is determined that the instruction has been acquired (when the determination result is Yes), the process proceeds to S202. On the other hand, when it is determined that the instruction has not been acquired (when the determination result is No), the process returns to S156 in FIG. 7A and the above-described process is repeated.

In S202, processing for obtaining the resolution and display position (enlarged position in the macro image of the enlarged image being displayed) of the microscope image (enlarged image) currently displayed on the monitor 5 is performed.
In S203, among the image data files recorded in the data recording unit 4, a microscope image to be synthesized according to the instruction acquired by the process in S201 (microscope image captured by a microscopic method different from the displayed one) A process of reading out the integrated data is performed.

  In S204, among the microscope images integrated into the image data file read out in S203, those having the resolution acquired in S202, that is, the microscope image (enlarged image) currently displayed on the monitor 5 A process of acquiring the same resolution and temporarily storing it in a predetermined working storage area of the host system 2 is performed.

  In S205, an instruction is given to the image composition unit 34, and among the microscopic images acquired by the processing in S204, a partial image in a range corresponding to the magnification of the objective lens 23 currently selected in the virtual observation, and in S202. A process of superimposing and displaying the same position as the display position acquired by the process on the microscope image (enlarged image) currently displayed on the monitor 5 is performed, and then the process returns to S156 in FIG. 7A. The above-described processing is repeated. Note that in the processing of S205, the image composition unit 34 is also caused to superimpose and display a macro image.

By performing the above processing in the host system 2, it is possible to perform the superimposed composite display of different microscopic images of the same observation body 19 in the microscopic method with the microscope system of FIG. 12.
Here, taking as an example a case where an image data file in which microscope images captured by the respective microscopic methods of the B excitation observation and the G excitation observation described above are integrated is recorded in the data recording unit 4. A state of superimposing and displaying a microscope image by the microscope image reproduction display process will be described.

  First, for example, when the user instructs virtual observation by B excitation observation, a macro image of the observation body 19 as illustrated on the left side of FIG. 17 is displayed on the monitor 5 by the processing of S151 to S155 of FIG. An enlarged image as if a part of the macro image is enlarged is displayed as illustrated on the right side of FIG.

  Here, when the user switches the spectroscopic instruction from the B excitation observation to the G excitation observation, the display of the image on the monitor 5 is illustrated in FIG. 18 by the processing from S156 in FIG. 7A to S160 in FIG. 7B. As described above, the image is switched from the image captured by the B excitation observation to the microscope image captured by the G excitation observation. Then, in the microscope images before and after the switching of the display, the enlarged images representing the same position portion of the observation body 19 are displayed with the same resolution (display magnification).

  Further, at this time, when the user instructs to superimpose and display the microscope image by the B excitation observation with respect to the microscope image by the G excitation observation being displayed on the monitor 5, the process from S201 to S205 in FIG. As shown in FIG. 19, the display of the image is switched to a microscope image in which the image captured by the G excitation observation and the image captured by the B excitation observation are superimposed and synthesized. The microscope images before and after the display switching are the same resolution (display magnification) and are combined enlarged images of the same position portion of the observation body 19.

  As described above, in the microscope system according to the present embodiment, since the microscope images at the same magnification and the same position of the observation body 19 imaged by different spectroscopic methods are combined and displayed, the observation body is actually observed with a microscope. With the same operability as in the above case, it is possible to perform highly reliable virtual observation that can faithfully reproduce the position information of the observation body.

  In the present embodiment, the microscope images at the same magnification and the same position for the observation body 19 imaged by different spectroscopic methods are superimposed and displayed, but instead, the purpose of virtual observation Accordingly, the microscope images at the same magnification and the same position of the observation body 19 imaged by such different spectroscopic methods may be displayed side by side on the monitor 5.

  Further, in the present embodiment, as in the first embodiment, it is realized by the 20 origin sensors of the electric stage and its initialization operation, but further, fluorescent cubes (cube unit 25) in the B excitation observation and the G excitation observation. ) May be acquired in advance, and the shift may be corrected from the acquired image.

  In addition, in the microscope image data acquisition process, the imaging of high-resolution microscope images for one microscopic method (for example, B excitation observation) is completed for all meshes, and then the other microscopic method (for example, G excitation observation) is performed. However, instead of taking a high-resolution microscopic image of each of the meshes, the high-resolution microscopic image is taken for each mesh, and this imaging is repeated for each mesh. A high-resolution microscope image may be obtained by performing this.

  In this embodiment, two spectroscopic methods of B excitation observation and G excitation observation are illustrated and described as switching between them. Of course, two types of switching are performed from the viewpoint of switching the spectroscopic methods. However, the present invention is not limited only to this, and a number of microscopic methods may be switched.

  FIG. 20 shows a third example of the configuration of a microscope system that implements the present invention. In addition, the same code | symbol is attached | subjected about the component same as the 2nd example shown in FIG. 12 in the same figure, and detailed description is abbreviate | omitted.

  The configuration shown in FIG. 20 is different from the configuration shown in FIG. 12 in that the coordinate conversion unit 35 is inserted between the host system 2 and the data recording unit 34. In response to an instruction from the host system 2, the coordinate conversion unit 35 provides a function of rotationally converting the coordinates of each pixel constituting the image related to the instruction.

Next, the operation of the microscope system shown in FIG. 20 will be described.
First, the microscope image acquisition operation is the same as that of the second embodiment. The host system 2 performs the microscope image data acquisition process shown in FIGS. 2A and 2B to acquire a microscope image. Is done.

  Here, as a spectroscopic method in the observation of the observation body 19, a case where the B excitation observation and the G excitation observation, which are fluorescence observations having different wavelengths, are instructed as the spectroscopic method is taken as an example. A state of acquiring a microscope image by processing will be described.

When the user gives an instruction for the above-described microscopic method, the host system 2 acquires this instruction by the processing of S101 in FIG. 2A.
Then, the low resolution microscope image of the observation body 19 by B excitation observation is first obtained by the processing of S103 to S107, and then the low resolution microscope image under the B excitation observation is obtained by the processing from S108 to S110. On the other hand, an l × n mesh is defined, and a mesh to be picked up of a microscope image at a high resolution is determined from the mesh. Then, the high resolution microscopic image for each mesh of the observation body 19 by B excitation observation is obtained by the processing from S112 to S116, and the meshes are combined by the processing of S117, and the B excitation observation as illustrated in FIG. 21 is performed. A high-resolution microscope image of the observation body 19 is created. Then, the low resolution microscopic image and the high resolution microscopic image of the observation body 19 obtained by the B excitation observation are integrated by the process of S118 to create one image data file.

  Thereafter, a low-resolution microscopic image of the observation body 19 by G excitation observation is obtained by the processing from S102 to S107. At this time, since the mesh has already been defined for the low-resolution microscope image of the observation body 19 by the B excitation observation, the result of the determination process of S108 is No, and the B excitation observation is performed by the subsequent processes from S112 to S116. According to the definition of the mesh for the low-resolution microscope image according to, a high-resolution microscope image for each mesh of the observation body 19 by G excitation observation is obtained. Thereafter, the meshes are combined by the process of S117, and a high-resolution microscope image of the observation body 19 by G excitation observation as illustrated in FIG. 22 is created. Then, the low resolution microscope image and the high resolution microscope image of the observation body 19 by G excitation observation are integrated by the process of S118, and one image data file is created.

  As described above, when the host system 2 performs the above-described microscope image data acquisition processing, as shown in FIG. 23, the same observation body 19 is referred to as B excitation observation (layer 1) and G excitation observation (layer 2). Microscopic images from different microscopic methods are acquired.

Next, a microscopic image reproduction / display operation will be described.
This reproduction display operation is basically the same as the operation of the second embodiment, and is realized by the host system 2 performing the microscope image reproduction display processing shown in FIGS. 7A, 7B, and 16. However, in this embodiment, changes are made to the flowcharts shown in these drawings.

  Here, FIG. 24A will be described. This figure shows a first change in the present embodiment regarding the microscope image reproduction display processing shown in FIGS. 7A, 7B, and 16. FIG. The flowchart in FIG. 24A is executed when the result of the determination process in S201 in FIG.

  If it is determined in S201 in FIG. 16 that an instruction to superimpose and display the microscope image of the observation body 19 captured by another spectroscopic method on the displayed microscope image is not acquired, the process is performed. Proceeding to FIG. 24A, in S301, a process of determining whether or not the host system 2 has detected a rotation operation by the user, that is, an operation for rotating the microscope image being observed on the monitor 5, is performed. If it is determined that the rotation operation has been detected (when the determination result is Yes), the process proceeds to S302. On the other hand, when it is determined that the rotation operation is not detected (when the determination result is No), the process returns to S156 in FIG. 7A and the above-described process is repeated.

  In S302, an instruction is given to the coordinate conversion unit 35, and a process of rotating and converting the coordinates of each pixel constituting the microscope image currently displayed on the monitor 5 at the rotation angle indicated by the rotation operation by the user is performed. Is called.

  In subsequent S303, a process of switching and displaying the microscope image composed of the pixels after the rotation conversion by the process in the previous step is performed on the monitor 5, and thereafter, the process returns to S156 of FIG. 7A and the above-described process is repeated. .

By performing the above processing in the host system 2, the microscope image of the observation body 19 being displayed on the monitor 5 is rotated in accordance with an instruction from the user.
Next, FIG. 24B will be described. This figure shows a second modification in the present embodiment regarding the microscope image reproduction display processing shown in FIGS. 7A, 7B, and 16. FIG. The flowchart in FIG. 24B is executed in place of the process from S157 in FIG. 7A to S160 in FIG. 7B when the result of the determination process in S156 in FIG. 7A is Yes.

  If it is determined in S156 of FIG. 7A that an instruction to switch the spectroscopic method in the virtual observation of the observation body 19 is acquired, the process proceeds to FIG. 24B, and the resolution of the microscopic image currently displayed on the monitor 5 is determined in S311. And the process which acquires a display position and the rotation angle of the microscope image in the display is performed. At this time, when the displayed microscopic image is not rotated, the rotation angle is “0 °”.

  In S312, the image data file recorded in the data recording unit 4 is read and read with the integrated microscope image captured by the switched microscopic method related to the instruction obtained in S156. Among the microscope images integrated in the output image data file, a process of switching and displaying the lowest resolution image on the monitor 5 as a new macro image is performed.

  In S313, among the microscopic images integrated in the image data file read out in the process of S312, those having the resolution acquired in the process of S311 are acquired and temporarily stored in a predetermined work storage area of the host system 2. The process of saving is performed.

  In S314, an instruction is given to the coordinate conversion unit 35, and a process of rotating and converting the coordinates of each pixel constituting the microscope image currently displayed on the monitor 5 at the rotation angle acquired in the process of S311 is performed.

  In S315, a process of switching and displaying the microscope image composed of the pixels after the rotation conversion by the process in the previous step is performed on the monitor 5, and then the process returns to S156 of FIG. 7A and the above-described process is repeated.

  When the host system 2 performs the above processing, the display of the image on the monitor 5 is switched, and is a partial image of a microscope image captured by the microscopic method according to the switching instruction, and the display portion before switching The partial image representing the part of the observation body 19 at the same position as that represented in the image at the same resolution as the display partial image before the switching is rotated in the same manner as the display partial image before the switching. It will be displayed after letting.

  Here, taking as an example a case where an image data file in which microscope images captured by the respective microscopic methods of the B excitation observation and the G excitation observation described above are integrated is recorded in the data recording unit 4. A state of superimposing and displaying a microscope image by the microscope image reproduction display process will be described.

  First, for example, when the user instructs virtual observation by B excitation observation, a macro image of the observation body 19 as illustrated on the left side of FIG. 25 is displayed on the monitor 5 by the processing of S151 to S155 of FIG. An enlarged image as if a part of the macro image is enlarged is displayed as illustrated on the right side of FIG.

  Here, when the user performs a rotation operation (in particular, a clockwise movement operation here), the display of the microscope image on the monitor 5 is observed as illustrated in FIG. 26 by the processing from S301 to S303 in FIG. 24A. The display of the body 19 is switched from the display of FIG. 25 to the display of the part rotated clockwise.

  At this time, if the user performs a movement operation of the XY position (especially, a movement operation in the X ′ direction, which is the lateral direction after the rotation described above), the monitor 5 is processed by the processing of S161 and S162 in FIG. 7A. As shown in FIG. 27, the display of the enlarged image is switched from the display of FIG. 26 on the observation body 19 to the display of the portion moved in the X ′ direction.

  Here, when the user switches the spectroscopic instruction from the B excitation observation to the G excitation observation, the display of the image on the monitor 5 is shown in FIG. 28 by the process from S156 in FIG. 7A and S311 to S315 in FIG. 24B. As illustrated, the image is switched from the image captured by the B excitation observation to the microscope image captured by the G excitation observation. The microscopic images before and after the switching of the display have the same resolution (display magnification), are enlarged images of the same position portion of the observation body 19, and are displayed with the same rotation. Has been.

  As described above, in the microscope system according to the present embodiment, since the microscope images at the same magnification and the same position for the observation body 19 imaged by different spectroscopic methods are displayed with the same rotation, the observation is performed. With the same operability as when the body is actually observed with a microscope, highly reliable virtual observation that can faithfully reproduce the position information of the observation body becomes possible.

  As described above, in the microscope system according to the present embodiment, in the so-called virtual microscope system that reconstructs the image of the observation body by joining together the microscope images obtained by imaging the observation body, the observation body is actually a microscope. Rotation of the microscope image and switching of the microscopic method can be performed by the same operability as in the case of observing.

  In this embodiment, two spectroscopic methods of B excitation observation and G excitation observation are illustrated and described as switching between them. Of course, two types of switching are performed from the viewpoint of switching the spectroscopic methods. However, the present invention is not limited only to this, and a number of microscopic methods may be switched.

  In the microscope system according to the present embodiment, the contents of the microscope image data acquisition process are different from those shown in FIGS. 2A and 2B, and the other operations and configurations may be the first embodiment (or the second or third embodiment). ).

  In the microscope image data acquisition process shown in FIG. 2A and FIG. 2B, imaging of the high-resolution microscope image for one microscopic method is completed for all meshes, and then imaging of the high-resolution microscopic image for the other microscopic method is performed. However, in the microscopic image data acquisition processing according to the present embodiment, all the high-resolution microscopic images are captured for each mesh specified by each spectroscopic method, and this imaging is performed for each mesh. A high-resolution microscope image is obtained by repeating the above.

  29A and 29B are flowcharts showing the processing contents of the microscope image data acquisition processing according to the present embodiment. This process is also realized and started by the CPU of the host system 2 executing a predetermined control program.

  First, in S401 of FIG. 29A, a process of obtaining an instruction for a microscopic method in observation of the observation body 19 from the user is performed. In the present embodiment, as an example, it is assumed that instructions for three different microscopic methods such as the first microscopic method, the second microscopic method, and the third microscopic method are acquired.

  In S <b> 402, an instruction is given to the microscope controller 31 to change the setting of the microscope apparatus 1 to a setting for capturing a microscope image in the first spectroscopic method. In response to this instruction, the microscope controller 31 controls the operation of each component of the microscope apparatus 1 to obtain a state for performing imaging with the first spectroscopic method. At this time, the coordinate system of the observation body 19 is set by the origin sensor of the electric stage 20 and its initialization operation.

In subsequent S403 to S406 and S407 to S409, the same processing as S104 to S107 and S109 to S111 in FIG. 2A is performed, and thus the description thereof is omitted here.
In the subsequent S410, it is determined whether or not the meshes that have not yet been subjected to the high-resolution imaging in each spectroscopic method acquired in the process of S401 remain among the meshes of the high-resolution imaging target determined in the process of S408. A determination process is performed. If the determination result is Yes, the process proceeds to S411. If the determination result is No, the process proceeds to S417 (FIG. 29B).

When the determination in S410 is Yes, in the subsequent S411 to S414, the same processing as S112 to S116 in FIG. 2A is performed, and thus the description thereof is omitted here.
In the subsequent S415, whether or not the microscopic image acquired by the processing in S401 has not yet been picked up for the microscopic image of the portion of the observation body 19 positioned immediately below the current objective lens 23b is left. A process for determining is performed. If the determination result is Yes, the process proceeds to S416. If the determination result is No, the process returns to S410 and the above-described process is repeated.

After S416, the process returns to S412 and the above process is repeated.
As described above, the processes of S412 to S416 are repeated until the determination of S416 becomes No, so that the portion of the observation body 19 located immediately below the objective lens 23b is under the first to third spectroscopic methods. Three microscopic images that are imaged and different in the microscopic method are obtained. Then, by repeating the processing of S410 to S416 until the determination of S410 becomes No, three microscopic images having different spectroscopic methods are obtained for each portion of the observation body 19 in the mesh of the high resolution imaging target.

  If the determination in S415 is Yes, in S416, an instruction is given to the microscope controller 31, and the setting of the microscope apparatus 1 is set for the observation body 19 positioned immediately below the current objective lens 23b by the microscopic method for which imaging has not yet been performed. A process for changing to a setting for capturing a microscopic image of a part is performed. In response to this instruction, the microscope controller 31 controls the operation of each component of the microscope apparatus 1 to obtain a state for performing imaging with the microscopic method.

  On the other hand, when the determination in S410 is No, in S417 (FIG. 29B), among the spectroscopic methods acquired by the processing in S401, whether or not a high-resolution microscope image for each mesh has not yet been combined is left. Processing for determining whether or not. If the determination result is Yes, the process proceeds to S418. If the determination result is No, the microscope image data acquisition process ends.

  When the determination in S417 is Yes, in S418, the entire high-resolution object 19 is represented by combining the remaining high-resolution microscopic images captured for each mesh under one microscopic method. A process for creating a microscopic image is performed. In this process, a high-resolution microscope image representing the entire observation body 19 is created by connecting the high-resolution microscope images of adjacent meshes captured under the microscopic method.

  In S419, a low-resolution microscope image of the observation object 19 captured in the host system 2 by the process of S406 (FIG. 29A) and the entire observation object 19 created by the process of S418 are represented. Are integrated into a single image data file.

  In S420, a process of recording the image data file obtained by the process of the previous step in the data recording unit 4 is performed, and then the process returns to S417 and the above-described process is repeated.

  As described above, S417 to S420 are repeated until the determination of S417 is No, whereby an image data file including an image obtained by combining the high-resolution microscope images captured under the first microscopic method, and the second An image data file including an image combined with a high-resolution microscopic image captured under the microscopic method and an image including an image combined with the high-resolution microscopic image captured under the third microscopic method The data file is recorded in the recording unit 4.

The above processing is the microscope image data acquisition processing according to the present embodiment.
Here, as a spectroscopic method in the observation of the observation body 19, the differential interference observation (first spectroscopic method), the B excitation fluorescence observation (second speculum method), and the G excitation fluorescence observation (third). The microscopic image acquisition process by the microscopic image data acquisition process will be described as an example.

  First, a low-resolution microscopic image of the observation body 19 by differential interference observation is obtained by the processing of S402 to S406, and then the processing of S407 to S408 is performed with respect to the low-resolution microscopic image under the differential interference observation. A mesh that is a target for imaging a microscopic image at a resolution is determined. Then, according to the processing of S409 to S416, according to the definition of the mesh for the low resolution microscope image by differential interference observation, for each mesh, a high resolution microscope image by differential interference observation, a high resolution microscope image by B excitation fluorescence observation, and G A high-resolution microscope image obtained by excitation fluorescence observation is obtained. Furthermore, by the processing of S417 to 420, an image data file in which an image obtained by combining high-resolution microscope images by differential interference observation and a low-resolution microscope image by differential interference observation is integrated, and a high-resolution microscope image by B excitation fluorescence observation Image data file that combines images combined with low resolution microscopic images by differential interference observation, and image that combines high resolution microscopic images by G excitation fluorescence observation and low resolution microscopic images by differential interference observation The image data file thus recorded is recorded in the data recording unit 4.

  As described above, according to the present embodiment, the XY coordinates of the high-resolution microscope images acquired under different spectroscopic methods are the same, so that the reproducibility of the XY coordinates is improved. Moreover, since it is not necessary to move the electric stage 20 in the XY directions for each imaging, the time required for the microscope image data acquisition process can be shortened.

  In the microscope image data acquisition process according to the present embodiment, since the process returns to S412 after S416, the focusing operation is performed for each microscopic method on one mesh. For example, S413 is performed after S416. It is also possible to perform the focusing operation only once for each mesh so that the process returns to step S2. Thereby, the time required for the microscope image data acquisition process can be further shortened. Further, in the case where the fluorescence observation is included in the spectroscopic methods other than the first spectroscopic method in the spectroscopic methods instructed in S401, it is possible to prevent fading during the fluorescent observation.

  In addition, in the microscope image data acquisition process according to the present embodiment, a low-resolution microscope image is acquired only under the first microscopic method. For example, low-resolution microscopic images obtained by other microscopic methods are also acquired. You may make it do. In this case, the image data file can be integrated with the low resolution microscope image and the image obtained by combining the high resolution microscope image obtained under the same microscopic method.

  In the present embodiment, the first spectroscopic method is not limited to the partial interference observation, and may be various well-known spectroscopic methods such as bright field observation, dark field observation, and phase difference observation. Also good. Further, the second and third microscopic methods are not limited to the fluorescence observation, and similarly, various known microscopic methods may be used. Further, the number of spectroscopic methods to be instructed is not limited to three, and may be two, or four or more.

  The microscope system according to the present embodiment is the same as that of the microscope system according to the second embodiment, and further performs a desired detection in the superimposed and synthesized image (hereinafter referred to as “superimposed synthesized image”) displayed by the processing shown in FIG. A display condition changing function is provided that enables changing the display conditions of the microscope image by the mirror method.

  According to this display condition changing function, when the superimposed composite image (for example, the superimposed composite macro image and enlarged image shown in FIG. 19) is displayed by the process of S205 of FIG. When a predetermined instruction is given via the input unit shown in the figure, a display window is displayed on the monitor 5 to allow the user to input a microscope image display condition by a desired microscopic method in the superimposed composite image.

FIG. 30 is an example of the display window.
As shown in the figure, in the display window, a superposed and synthesized macro image (for example, the superposed and synthesized macro image shown on the left side of FIG. 19) 36 displayed on the monitor 5 and a superimposed synthesized image are configured. A slider 37 (37a, 37b) that enables input of brightness for a microscope image obtained by each microscopic method is displayed. Note that, in the superimposed and synthesized macro image 36 in the display window, the background portion is displayed in black in consideration of ease of observation.

  In this example, the superimposed composite image is an image in which a microscope image by G excitation observation and a microscope image by B excitation observation are superimposed. The slider 37a can input the brightness with respect to the microscope image by the G excitation observation, and the slider 37b can input the brightness with respect to the microscope image by the B excitation observation. Each slider is configured to be movable up and down by operating an input unit (not shown) of the host system 2 (for example, a mouse), and the brightness level can be input higher as the slider is moved upward. The brightness level can be lowered as the position is moved to.

  When such a display window is displayed, for example, if the user moves the slider 37a upward, the image is moved with respect to the microscope image obtained by the G excitation observation constituting the superimposed composite image. Image processing is performed so as to obtain an image represented by brightness according to the position. And the process which replaces the microscope image by G excitation observation which comprises the superimposed superimposition image displayed by the image after the image processing is performed. As a result, in the display window, as shown in FIG. 31, the microscope image obtained by the G excitation observation in the superposed and synthesized macro image 36 is displayed as an image represented with brightness according to the position of the slider 37a after the movement. That is, it is displayed as an image with increased brightness. Similarly, in the superimposed and synthesized macro image and the enlarged image (for example, the macro image and the enlarged image shown in FIG. 19) displayed on the monitor 5, the microscope image obtained by the G excitation observation in the superimposed synthesized image is moved. The brightness is displayed according to the position of the subsequent slider 37a.

  As described above, according to the present embodiment, the user can freely change the display conditions for the desired microscopic image when the microscopic images obtained by the respective microscopic methods are superimposed and displayed. The observation site can be easily recognized.

  In the present embodiment, two examples of the microscope image constituting the superimposed composite image are shown, but there may be three or more. In this case, as many sliders as the number of microscope images constituting the superimposed composite image are displayed on the display window.

  In this embodiment, the display condition is described as brightness. However, for example, contrast, α correction control, color balance, or the like, or gain, contrast, gamma correction, or gain and contrast may be used. It may be gamma correction.

In this embodiment, the display condition is input by moving each slider. However, for example, it may be directly input as a numerical value.
2A, 2B, FIG. 7A, FIG. 7B, FIG. 16, FIG. 24A, FIG. 24B, FIG. 29A, and FIG. It is also possible to implement the present invention by creating a control program to be executed and recording it on a computer-readable recording medium, reading the program from the recording medium into a computer and executing it by the CPU. .

  As a recording medium from which the recorded control program can be read by a computer, for example, a storage device such as a ROM or a hard disk device provided as an internal or external accessory device in the computer, or a medium driving device provided in the computer is inserted. A portable recording medium such as a flexible disk, MO (magneto-optical disk), CD-ROM, DVD-ROM, or the like from which the control program recorded can be read out can be used.

  Further, the recording medium may be a storage device provided in a computer system functioning as a program server connected to a computer via a communication line. In this case, a transmission signal obtained by modulating a carrier wave with a data signal representing a control program is transmitted from the program server to a computer through a communication line as a transmission medium, and the computer demodulates the received transmission signal. By replaying the control program, the control program can be executed by the CPU of the computer.

  In this embodiment, the image acquisition means is a video camera, but it can be replaced with known image acquisition means such as a CCD or a line sensor. The focusing operation is so-called video AF, but it may be active AF or other well-known AF means, and the accuracy of AF may be further increased by an aberration lens.

As mentioned above, although embodiment of this invention was described, this invention is not limited to each embodiment mentioned above, A various improvement and change are possible within the range which does not deviate from the summary of this invention.
For example, in the microscope system according to each of the above-described embodiments, an upright microscope apparatus is employed as the microscope apparatus 1, but an inverted microscope apparatus can naturally be employed instead. It is also possible to apply this embodiment to various systems such as a line apparatus incorporating the above.

  Further, for example, in each of the above-described embodiments, the microscope image captured by the microscope system is reproduced and displayed by the same microscope system. Instead, the microscope system is individually installed at a remote location. The image data file of the microscope image generated by one microscope system is transmitted to the other microscope system using a communication line, and the microscope image represented by the image data file is reproduced and displayed in the other microscope system. It is also possible to perform.

It is a figure which shows the 1st example of a structure of the microscope system which implements this invention. It is a flowchart (the 1) which shows the processing content of a microscope image data acquisition process. It is a flowchart (the 2) which shows the processing content of a microscope image data acquisition process. It is a figure which shows the example of the high-resolution microscope image of the observation body imaged by bright field observation. It is a figure which shows the example of the high-resolution microscope image of the observation body imaged by differential interference observation. It is a figure which shows the example of the high-resolution microscope image of the observation body imaged by fluorescence observation. It is a figure which shows the relationship of the image shown in each figure of FIG.3, FIG4 and FIG.5. It is a flowchart (the 1) which shows the processing content of a microscope image reproduction | regeneration display process. It is a flowchart (the 2) which shows the processing content of a microscope image reproduction | regeneration display process. It is a figure which shows the example of a display of a microscope image when the virtual observation by bright field observation is instruct | indicated. It is a figure which shows the example of a display of a microscope image when the movement operation of XY position is performed when the display of FIG. 8 is performed. It is a figure which shows the example of a display of a microscope image when the instruction | indication which switches the selection of an objective lens to a high magnification thing is performed when the display of FIG. 9 is performed. It is a figure which shows the example of a display of a microscope image when the virtual observation by differential interference observation is instruct | indicated when the display of FIG. 10 is displayed. It is a figure which shows the example of a display of a microscope image when the virtual observation by fluorescence observation is instruct | indicated when the display of FIG. 11A is performed. It is a figure which shows the 2nd example of a structure of the microscope system which implements this invention. It is a figure which shows the 1st example of the high-resolution microscope image of the observation body by B excitation observation. It is a figure which shows the 1st example of the high-resolution microscope image of the observation body by G excitation observation. It is a figure which shows the relationship of the image shown in each figure of FIG.13 and FIG.14. It is a figure which shows the change part in Example 2 about a microscope image reproduction | regeneration display process. It is a figure which shows the 1st example of a display of a microscope image when the virtual observation by B excitation observation is instruct | indicated. It is a figure which shows the example of a display of a microscope image when the virtual observation by G excitation observation is instruct | indicated when the display of FIG. 17 is performed. It is a figure which shows the example of a screen display when the superimposition synthetic | combination display of the microscope image by B excitation observation is supported when the display of FIG. 18 is performed. It is a figure which shows the 3rd example of a structure of the microscope system which implements this invention. It is a figure which shows the 2nd example of the high-resolution microscope image of the observation body by B excitation observation. It is a figure which shows the 2nd example of the high-resolution microscope image of the observation body by G excitation observation. It is a figure which shows the relationship of the image shown in each figure of FIG.21 and FIG.22. It is a figure which shows the 1st change part in Example 3 about a microscope image reproduction | regeneration display process. It is a figure which shows the 2nd change part in Example 3 about a microscope image reproduction | regeneration display process. It is a figure which shows the 2nd example of a display of a microscope image when the virtual observation by B excitation observation is instruct | indicated. It is a figure which shows the example of a display of a microscope image when rotation operation is performed when the display of FIG. 25 is performed. FIG. 27 is a diagram illustrating a display example of a microscope image when an operation of moving the XY position is performed while the display of FIG. 26 is being performed. It is a figure which shows the example of a display of a microscope image when the virtual observation by G excitation observation is instruct | indicated when the display of FIG. 27 is performed. 12 is a flowchart (part 1) illustrating processing contents of a microscope image data acquisition process according to the fourth embodiment. 12 is a flowchart (part 2) illustrating the processing content of a microscope image data acquisition process according to the fourth embodiment. It is a figure which shows an example of a display window. It is a figure which shows an example of the display window after a slider movement.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Microscope apparatus 2 Host system 3 Video camera 4 Data recording part 5 Monitor 6 Light source for transmission illumination 7 Collector lens 8 Filter unit for transmission 9 Transmission field stop 10 Transmission aperture stop 11 Condenser optical element unit 12 Top lens unit 13 Light source for epi-illumination DESCRIPTION OF SYMBOLS 14 Collector lens 15 Epi-illumination filter unit 16 Epi-illumination shutter 17 Epi-illumination field stop 18 Epi-illumination aperture stop 19 Observation body 20 Electric stage 21 Stage XY drive control part 22 Stage Z drive control part 23a, 23b Objective lens 24 Revolver 25 Cube unit 26 Eyepiece 27 Beam splitter 28 Polarizer 29 DIC prism 30 Analyzer 31 Microscope controller 32 Video board 33 Camera controller 34 Image composition unit 35 Coordinate conversion unit 36 Macro image superimposed and combined 37 Slider

Claims (6)

An imaging means for capturing a microscopic image of the observation body under a predetermined microscopic method;
An imaging control unit that controls the imaging unit to capture a microscope image of the same observation body at each of a plurality of preset resolutions;
Microscopic method switching means for switching the microscopic method;
Have
The imaging control means includes
First imaging control means for causing the imaging means to perform imaging of the observation body at a first resolution controlled in advance;
Defining means for defining a plurality of subdivisions for dividing the first microscope image imaged by the imaging means under the control of the first imaging control means;
Let the imaging unit perform imaging of a portion corresponding to the small section of the observation body at the second resolution that is set in advance and is higher than the first resolution. Second imaging control means;
The microscopic images for each of the small sections captured by the imaging unit under the control of the second imaging control unit are combined to generate a second microscopic image that is the second resolution of the observation body. Image combining means;
Image storage means for storing the combined microscopic images captured by a plurality of microscopic methods for each observation body;
A microscope apparatus comprising:
Display means for displaying a microscope image captured under the microscopic method stored in the image storage means;
First display control means for causing the display means to display a first partial image which is a partial image of a microscope image captured under the microscopic method stored in the image storage means and having a specified resolution; ,
Microscopic method switching instruction acquisition means for acquiring an instruction for switching the microscopic method;
A partial image of a microscopic image captured by the microscopic method according to the instruction by switching the display of the first partial image by the display unit in response to acquisition of the instruction for switching the microscopic method, The second partial image captured by the switched spectroscopic method representing the portion of the observation body at the same position as that represented in the partial image at the same resolution as the first partial image. Second display control means for displaying the partial image on the display means;
Further microscope apparatus you, comprising a. A composite display instruction acquisition means for acquiring a composite display instruction;
Third display control means for causing the display means to display a composite image that is an image obtained by superimposing and combining the first partial image and the second partial image in response to acquisition of the composite display instruction;
The microscope apparatus according to claim 1 , further comprising: Rotation instruction acquisition means for acquiring an instruction to rotate the image displayed on the display means;
A fourth display control means for rotating the image displayed on the display means and displaying the image on the display means in response to the rotation instruction;
Further comprising
The second display control means, when the first partial image displayed by the display means at the time of obtaining the switching instruction is displayed in a rotated state, for the second partial image The same rotation as the first partial image is displayed on the display means.
The microscope apparatus according to claim 1 or 2 , characterized in that: An imaging means for capturing a microscopic image of the observation body under a predetermined microscopic method;
Image storage means for storing an image captured by the first spectroscopic method and an image captured by the second spectroscopic method;
Display means for displaying an image captured under the microscopic method stored in the image storage means;
Causing the display means to display a first partial image that is a partial image of an image that has been picked up by the first spectroscopic method and has a specified resolution among the images stored by the image storage means. First display control means;
Microscopic method switching instruction acquisition means for acquiring an instruction to switch between the first microscopic method and the second microscopic method;
The display unit switches the display of the first partial image according to the instruction for switching the microscopic method, and is a partial image of the image captured by the microscopic method according to the instruction, and is displayed on the first partial image. The portion of the observation body that is in the same position as the one that has been displayed is represented with the same resolution as the first partial image, and the second partial image that is the partial image captured by the microscopic method after switching is displayed. Second display control means for displaying on the means;
A microscope apparatus characterized by comprising: A composite display instruction acquisition means for acquiring a composite display instruction;
Third display control means for causing the display means to display a composite image that is an image obtained by superimposing and combining the first partial image and the second partial image in response to acquisition of the composite display instruction;
The microscope apparatus according to claim 4 , further comprising: Rotation instruction acquisition means for acquiring an instruction to rotate the image displayed on the display means;
A fourth display control means for rotating the image displayed on the display means and displaying the image on the display means in response to the rotation instruction;
Further comprising
The second display control means, when the first partial image displayed by the display means at the time of obtaining the switching instruction is displayed in a rotated state, for the second partial image The same rotation as the first partial image is displayed on the display means.
The microscope apparatus according to claim 4 or 5 , wherein