JP2010085463A - Microscope apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a microscope apparatus which easily searches an image. <P>SOLUTION: A microscope body 101 acquires a plurality of kinds of images of a sample 106 at the same position, which are acquired in different methods. The arithmetic operation part 201 of a controller 102 obtains a representative image representing the image of the sample 106 from one of the plurality of images acquired by the microscope body 101. A plurality of image files including the representative image and the plurality of images of the sample 106 as image data and further including image kind information showing the kind of each of the plurality of images are preserved in a storage part 203. Furthermore, the arithmetic operation part 201 performs list display of the representative images in the respective image files preserved in the storage part 203, and also performs display of the image kind information of each of the plurality of images of the sample 106 included in the image files on the monitor screen 141 of a display device 104 by associating the image kind information with the representative images subjected to the list display. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a microscope technique, and more particularly to a microscope technique for acquiring various images with different acquisition methods for a sample at the same position.

  Conventionally, as one of microscope apparatuses capable of acquiring an image of a sample at the same position (in this application, the sample at the same position is referred to as “the same position sample”) by at least two types of acquisition methods, for example, There is a confocal microscope. The confocal microscope can obtain a confocal image or a non-confocal image. A confocal image is an image with a shallow depth of focus of a subject that is obtained by detecting with a photodetector the intensity of reflected light from the subject that has passed through the confocal stop when the subject that is the sample is illuminated. It is. In addition, the non-confocal image is obtained by detecting the intensity of the reflected light from the subject that has not passed through the confocal stop when the subject is illuminated with the photodetector. It is a deep image. In addition to this, the confocal microscope can obtain a bright-field image, a dark-field image, a differential interference image, etc. by using a CCD (charge coupled device) video camera or the like. The data can be processed to obtain a three-dimensional image, an omnifocal image, or the like. For example, Patent Document 1 discloses such a confocal microscope.

  Another example of such a microscope apparatus is a fluorescence microscope. The fluorescence microscope acquires an image of fluorescence emitted from a sample when the sample dyed with a fluorescent dye is irradiated with excitation light. A fluorescence microscope can also obtain different fluorescence images by acquiring fluorescence emitted from the sample when the sample is irradiated with excitation light with a different excitation wavelength. Furthermore, as with a confocal microscope In addition, a bright field image, a dark field image, or the like can be acquired.

In such a microscope apparatus, a plurality of images acquired with respect to the same position sample are associated with each other, and image data representing these images is referred to as, for example, one image data file (hereinafter referred to as “image file”). ) To save as. As such an image display method, for example, a list of image data names, so-called thumbnail images, and the like for images whose image data is included in an image file are displayed as a list on the display device. When an instruction for selecting a desired image is acquired from this list, there is a method of displaying the desired image. For example, Patent Literature 2 discloses an apparatus that displays a list of thumbnail images of a plurality of images.
JP 2005-173580 A JP 2002-202463 A

  As described above, the confocal microscope selects the spectroscopic method (confocal observation, non-confocal observation, dark field observation, bright field observation, differential interference observation, etc.), correction of the acquired image (noise removal, γ correction, etc.) ) And processing (generation of a three-dimensional image, a two-dimensional omnifocal image, etc.), etc. And the image data of the image acquired about the same position sample is preserve | saved as one image file.

  Here, in order to search for a desired image, when a list of image data names is displayed, the image is searched from this list. However, by simply displaying a list of image data names, the operator cannot recognize what microscopic method each image has been acquired and what kind of correction / processing has been performed. Here, if each image is actually displayed and its acquisition method is confirmed, a large amount of work is required until a desired image is found.

  In addition, when displaying the acquired image or an image obtained by correcting or processing the acquired image as it is or when displaying the thumbnail image after reducing it, a large amount of images (or thumbnail images) should be displayed on the display device. become. For this purpose, a large display area is required for image display, and if a large number of similar images of the same position sample are displayed, it may be difficult to find a desired image.

  The present invention has been made in view of the above-described problems, and a problem to be solved is to provide a microscope apparatus that can easily search for an image.

  A microscope apparatus according to one aspect of the present invention includes an image acquisition unit that acquires a plurality of types of images with different acquisition methods for the same-position sample, and a plurality of the same-position sample acquired by the image acquisition unit. Representative image acquisition means for obtaining a representative image representative of an image of the same-position sample from one of the images, the representative image for the same-position sample, and the same-position sample acquired by the image acquisition means A plurality of images as image data, and a plurality of image files that further include image type information indicating the type of each of the plurality of images, and stored in the image file storage unit In addition to displaying a list of the representative images for each image file, each of the plurality of images for the same-position sample included in each image file is displayed. The image type information you are, image file list display means for displaying in association with each representative image to be the list are those that have a, to solve the problems described above by this configuration.

  In the above-described microscope apparatus, the image file list display means displays a graphic indicating the image type information for each of the plurality of images included in each image file for each image file that displays the list. The image may be displayed so as to be superimposed on the representative image.

  In the microscope apparatus described above, the image file list display means displays a graphic indicating the image type information for each of the plurality of images included in each image file for each image file that performs the list display. The representative image may be displayed adjacent to the periphery of the representative image.

  Further, in the above-described microscope apparatus, the image file list display means includes, as the image type information for each of the plurality of images included in each of the image files, a color previously associated with the type of the image. A figure may be configured to be displayed in association with each representative image.

  Further, in the microscope apparatus described above, the image file list display means displays, as the image type information for each of the plurality of images included in each image file, characters previously associated with the image types. The image may be displayed in association with each representative image.

  Further, in the above-described microscope apparatus, the image file list display means is a representative selected from the list display of the representative image among the image type information for each of the plurality of images included in each image file. Only the image type information for each of the images included in the image file including the images may be displayed side by side in the representative image list display.

  In the microscope apparatus described above, the representative image acquisition unit creates a thumbnail image of the same-position sample as the representative image from one of a plurality of images of the same-position sample acquired by the image acquisition unit. You may comprise.

  In the above-described microscope apparatus, the microscope apparatus is a confocal microscope, and the image acquisition unit is obtained by capturing a confocal image of the same-position sample and an image of the same-position sample with a video camera. You may comprise so that a video image may be acquired at least.

  At this time, the image acquisition means is configured to be able to acquire at least one of a three-dimensional image and an extended image for the same-position sample based on a plurality of confocal images for the same-position sample. May be.

  According to the present invention, it is possible to easily search for an image by doing the above.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
FIG. 1 shows the configuration of a confocal laser microscope apparatus (LSM) for implementing the present invention. This microscope apparatus includes a microscope main body 101, a controller 102, an input device 103, a display device 104, and a sample stage 105.

  The microscope main body 101 includes an objective lens 111, a revolver 112, a Z moving mechanism 140, beam splitters 113, 118, and 128, an illumination lens 114, a collector lens 115, a white light source 116, an imaging lens 117, a quarter wavelength plate 119, Pupil projection lens 120, optical scanner 121, polarizing beam splitter 122, condensing lenses 123 and 127, laser light source 124, video camera lens 125, video image acquisition CCD camera 126, pinhole 129, confocal image acquisition detector 130 The non-confocal image acquisition detector 131 and the Z moving mechanism 140 are provided. Here, for example, a galvanometer mirror is used as the optical scanner 121, and a photomultiplier is used as the confocal image acquisition detector 130 and the non-confocal image acquisition detector 131, for example. In addition, as the white light source 116, for example, a white illumination fiber light source is used.

  When acquiring a confocal image and a non-confocal image, laser light (illumination light) emitted from a laser light source 124 is converted into a condensing lens 123, a polarizing beam splitter 122, an optical scanner 121, a pupil projection lens 120, 1 / The light is condensed on the sample 106 placed on the sample stage 105 through an optical path composed of the four-wavelength plate 119, the beam splitter 118, the imaging lens 117, the beam splitter 113, and the objective lens 111, and is spot light. Irradiate as Here, when the illumination light is two-dimensionally scanned by the optical scanner 121, the spot light on the sample 106 is in the XY directions that are two orthogonal directions on a plane perpendicular to the direction of the optical axis of the objective lens 111 (Z direction). Scan to. At this time, the reflected light from the sample 106 is guided in the reverse direction from the objective lens 111 to the polarizing beam splitter 122 in the optical path, and is guided toward the condenser lens 127 by the polarizing beam splitter 122. Then, the reflected light that has passed through the condenser lens 127 is split into two by the beam splitter 128, one of which is incident on the confocal image acquisition detector 130 via the pinhole 129, and the other is non-reflective. The light enters the confocal image acquisition detector 131.

  When acquiring a color video image, the illumination light emitted from the white light source 116 is illuminated through the optical path including the collector lens 115, the illumination lens 114, the beam splitter 113, and the objective lens 111. To do. At this time, the reflected light from the sample 106 enters the video image acquisition CCD camera 126 via the objective lens 111, the beam splitter 113, the imaging lens 117, the beam splitter 118, and the video camera lens 125.

  In the confocal optical system including the confocal image acquisition detector 130 and the non-confocal image acquisition detector 131, the confocal system into which the pinhole 129 is inserted and the non-confocal system without the pinhole 129 are used as a beam. It arrange | positions so that the reflected light after passing the splitter 128 may be detected simultaneously. Then, the output signals of the confocal image acquisition detector 130 and the non-confocal image acquisition detector 131 are sent to the controller 102 as a set of two channels of LSM output signals.

  On the other hand, in the video optical system including the video image acquisition CCD camera 126, a video image of the sample 106 illuminated by the illumination light from the white light source 116 is acquired. Then, a signal representing this video image is sent from the video image acquisition CCD camera 126 to the controller 102 as a video output signal.

As described above, the microscope main body 101 simultaneously outputs the video output signal and the two types of LSM output signals and transmits them to the controller 102.
The controller 102 constructs a confocal image and a non-confocal image for the sample 106 from the received set of LSM output signals and reproduces a video image of the sample 106 based on the received video output signal. Each image acquired at this time has the following characteristics.

  A confocal image is a monochromatic image having a high contrast and a shallow depth of focus, and is mainly used for measurement and observation applications. However, in the confocal image, it is difficult to focus on the sample 106 and specify (position) the observation position on the sample 106.

  The non-confocal image is a monochromatic image having a comparatively high contrast and a depth of focus similar to that of a normal optical microscope, and is used not only for observation purposes but also for focusing and positioning.

In addition, when a confocal image and a non-confocal image are used in combination, it is possible to perform comparative observation of an entire image (an image with a deep focal depth) and a partial image (an image with a deep focal depth).
The video image can be obtained as a normal microscope color image containing color information. Therefore, in addition to being used for observation purposes, it can also be used for focusing and positioning operations. It is possible to use a spectroscopic method such as dark field observation or differential interference observation.

In the following description, confocal images and non-confocal images are collectively referred to as “LSM images”.
The controller 102 includes an arithmetic unit 201, a control unit 202, and a storage unit 203. For example, an information processing apparatus such as a personal computer is used. Here, the arithmetic unit 201 includes an MPU (arithmetic processing unit) and a memory including a ROM (Read Only Memory) and a RAM (Random Access Memory). Here, a predetermined basic control program is recorded in the ROM in advance, and the MPU reads out and executes this basic control program when the arithmetic unit 201 is activated, thereby controlling the operation of each component of the arithmetic unit 201. Is possible. The RAM is used as a working storage area as necessary when the MPU executes various control programs. After the execution of the basic control program is completed, the MPU functions as the arithmetic unit 201 by reading and executing the entire LSM control program of FIG. 1 stored in a predetermined storage area of the storage unit 203.

  The calculation unit 201 includes a video camera CCD camera 126, a confocal image acquisition detector 130, a non-confocal image acquisition detector 131, an optical scanner 121, a laser light source 124, and the like of the LSM shown in FIG. Control of each component is performed via the control unit 202. In addition, the calculation unit 201 saves the LSM image and the video image acquired by the microscope main body 101 in the storage unit 203 and the display control for displaying these images being saved in the storage unit 203. Various control processes described later, such as processes, are performed.

  The input device 103 is, for example, a keyboard device, a pointing device such as a mouse device, a touch panel, or the like. The input device 103 constitutes a graphical user interface (GUI) in cooperation with an operation screen displayed on the monitor screen 141 of the display device 104, and an instruction and information input by the LSM user in FIG. Is obtained using this and passed to the controller 102.

  When the LSM image and the video image are simultaneously observed using the LSM of FIG. 1, the calculation unit 201 gives an instruction to the control unit 202 to turn off the laser light source 124 when one frame of the LSM image is captured. (OFF) and then one frame of the video image is taken. After that, the laser light source 124 is turned on (ON), and the next one frame of the LSM image is captured. Thereafter, the control unit 202 repeatedly performs similar control. The laser light source 124 may be turned on / off by opening / closing a power supply line to the laser light source 124, or by passing / blocking the laser light generated by the laser light source 124 by opening / closing a shutter or the like. Good. Further, the control unit 202 may control the intensity of laser light generated by the laser light source 124.

  The calculation unit 201 performs processing for constructing an LSM image from the LSM output signal sent from the microscope body 101 and displaying the LSM image on the monitor screen 141 of the display device 104. The calculation unit 201 also performs processing for reproducing an LSM image based on a video output signal sent from the microscope body 101 and displaying the LSM image on the monitor screen 141 of the display device 104. Further, the calculation unit 201 performs processing for reading out an image stored in the storage unit 203, displaying it on the monitor screen 141 of the display device 104, and outputting it.

  The calculation unit 201 also performs processing for constructing a three-dimensional image of the sample 106 based on the LSM output signal and displaying the three-dimensional image on the monitor screen 141 of the display device 104. For this purpose, the calculation unit 201 gives an instruction to the control unit 202 to control the Z moving mechanism 140 and move the revolver 112 up and down to move the relative position between the sample 106 and the objective lens 111 in the Z direction. Let At this time, the output signal of the confocal image acquisition detector 130 is monitored, and the Z coordinate at the position where the amount of reflected light from the sample 106 is the highest is detected as the height position of the sample 106. This detection is performed over the entire surface of the sample 106 with respect to XY, and the obtained height position is arranged on the three-dimensional coordinates, whereby a three-dimensional image of the sample 106 is constructed.

  The calculation unit 201 can also perform a process of constructing an extended image (two-dimensional omnifocal image) focused on the entire surface of the sample 106 and displaying the extended image on the monitor screen 141 of the display device 104. For this purpose, the calculation unit 201 first determines the maximum amount of reflected light from the sample 106 obtained by the confocal image acquisition detector 130 when the relative position between the sample 106 and the objective lens 111 is moved in the Z direction. A value is acquired for each XY coordinate. Then, an extended image (two-dimensional omnifocal image) in which all the pixels are in focus is constructed by allocating the maximum value as the luminance value of the pixel of the XY coordinate to configure the image.

  As described above, the LSM shown in FIG. 1 can acquire a confocal image, a non-confocal image, and a video color image of the sample 106, and generates a three-dimensional image and an extended image of the sample 106. You can also In addition, an image obtained by removing noise from each image or an image obtained by combining a confocal image and a video image can be constructed by the calculation unit 201. Further, the calculation unit 201 can measure the height of a desired position on the sample 106 using a three-dimensional image.

  Next, FIG. 2 will be described. FIG. 2 shows display examples of various images on the monitor screen 141 of the display device 104. In this display example, any three of the LSM images, video images, three-dimensional images, and extended images acquired / generated by the controller 102 as described above are displayed as image display windows 301, 302, and This is an example displayed in 303.

  When the user operates the input device 103 to give an instruction to select some of the images described above, the input device 103 sends this instruction to the calculation unit 201. When the calculation unit 201 acquires this instruction, the calculation unit 201 performs a process of displaying all the images related to the instruction (not limited to three as in the example of FIG. 2) side by side on the monitor screen 141. At this time, the calculation unit 201 also displays a save button 304 that is a display for GUI as shown in FIG. When the user operates the input device 103 to give an instruction to press the save button 304, the input device 103 sends this instruction to the calculation unit 201. When the calculation unit 201 obtains this instruction, the image data representing the images displayed side by side on the monitor screen 141 at that time is stored in the storage unit 203 as a single image file and stored. Perform the save process.

Here, FIG. 3 will be described. FIG. 3 is a flowchart showing the contents of the image storage process.
In FIG. 3, first, in S101, processing for generating a thumbnail image of the sample 106 from an image of a type designated in advance (for example, a video image) is performed. In this process, the image size of the video image of the sample 106 is reduced to a predetermined size, and image data representing the reduced image (thumbnail image) is generated.

  It should be noted that instead of specifying the original image for generating the thumbnail image as a video image, another image such as an LSM image may be specified. In addition, the user may specify the original image for generating the thumbnail image. In this case, when the user operates the input device 103 to give an instruction to select the type of image from which the thumbnail image is generated, the input device 103 sends this instruction to the calculation unit 201. When the calculation unit 201 acquires this instruction, the calculation unit 201 performs a process of generating a thumbnail image from the type of image selected by the instruction.

Here, a graphic image representing the relationship with the sample 106 may be generated instead of the thumbnail image.
Next, in S102, information (stored image type information) about the type of image to be stored and saved in the image file of the sample 106 to be generated (type of image acquisition method) is generated and used as header information of the image file. The storing process is performed.

Here, FIG. 4 will be described. FIG. 4 shows the data structure of the image file generated by the calculation unit 201.
This image file stores header information and image data for each image to be saved, including thumbnail images. Here, in the header information, the stored image type information is shown together with the creation date and creation time of the image file and information (file creator ID) specifying the creation instructor of the image file.

  For example, a confocal image, a non-confocal image, a three-dimensional image, an extended image, a color image (video image), and the like are defined as the image types indicated by the stored image type information. In addition, for example, an image on which noise removal processing has been performed, a composite image of an LSM image and a video image, a three-dimensional image for measuring the height of a desired location, and the like may be defined. Furthermore, the type of image processing, the type of measurement, etc. may be subdivided and defined.

Note that the calculation unit 201 uses the information specifying each image displayed on the monitor screen 141 when acquiring the instruction to press the save button 304 as stored image type information.
Next, in S103 of FIG. 3, a process of generating an image file having the data structure shown in FIG. Here, the calculation unit 201 displays the image data of the thumbnail image (or the graphic described above) generated in the process of S101, the image data of each image indicated by the stored image type information, and the stored image type in the process of S102. The header information storing the information is collected and stored in the image file.

When the process of S103 is completed, the image storage process of FIG. 3 ends.
Next, FIG. 5 will be described. FIG. 5 is a flowchart showing the contents of a first example of the stored image file list display process performed by the calculation unit 201. This process is a process of reading an image file stored in the storage unit 203 and displaying the thumbnail images (or the above-described graphics) included in each image file side by side on the monitor screen 141 of the display device 104.

  When the user operates the input device 103 to give an instruction to display a list of image files stored in the storage unit 203, the input device 103 sends this instruction to the calculation unit 201. When the calculation unit 201 acquires this instruction, the calculation unit 201 starts the process of FIG.

  In FIG. 5, first, in S201, all the image files stored in the storage unit 203 are read out, the stored image type information is extracted from the header information of each image file, and each image included in each image file is extracted. Processing to determine the type is performed.

  Next, in S202, processing for determining a display mode of information indicating the type of each image stored in the image file is performed. This display mode may be determined in advance, or a display mode selection instruction given by the user operating the input device 103 is acquired in advance, and the display mode is determined according to the selection instruction. You may do it.

  In S203, the thumbnail image (or the graphic described above) included in each image file read in S201 and the information on the type of image included in each image file are displayed on the monitor screen 141 of the display device 104. A list display process is performed. Here, the calculation unit 201 first reads out image data of thumbnail images (or the above-described graphics) arranged immediately after the header information in each image file, and displays a list of images represented by the image data. Perform the process. Next, a process of displaying a list of information indicating the type of image for each image file determined in the process of S201 in association with the images displayed as a list in the display mode determined in the process of S202 is performed.

When the processing of S203 is completed, the stored image file list display processing image of FIG. 5 ends.
Hereinafter, some display examples of list display of thumbnail images (or the above-described graphics) and information on the types of images included in each image file by the stored image file list display processing image will be described.

6A and 6B show a first example of a list display of saved image files. Here, FIG. 6B is an enlarged view of the portion indicated by the symbol “α” attached to the list display shown in FIG. 6A.
As can be seen from FIG. 6A, in this first example, the file names stored in the storage unit 203 are “001.ols”, “002.ols”,..., “009.ols” in total. A list of image files is displayed.

  When attention is paid to FIG. 6B, thumbnail images 401 and 402 are displayed. The thumbnail images 401 and 402 are displayed based on the image data included in each of the image files “001.ols” and “002.ols”. That is, in this first example, thumbnail images included in each image file are displayed as a list representative images representing the images included in the image file.

  Further, as can be seen from FIG. 6B, image type displays 403, 404, and 405 are displayed superimposed on the thumbnail image 401 at the bottom of the thumbnail image 401. Further, at the lower part of the thumbnail image 402, image type displays 406 and 407 are displayed superimposed on the thumbnail image 402. Here, in the image type displays 403, 404, and 405, the types of images included in the image file are respectively a three-dimensional image (display of “3”), an extended image (display of “2”), And a graphic indicating a color image (display of “T”). The image types 406 and 407 indicate that the types of images included in the image file are confocal images (“C” display) and non-confocal images (“F” display) in the LSM image, respectively. It is a figure showing that.

  That is, in this first example, as the display mode of the type of the image included in the image file, the image type display 403, 404, 405 displayed on the thumbnail images 401 and 402 representing the image file respectively. Reference numerals 406 and 407 display image types.

  Here, when the user operates the input device 103 to give an instruction to select a desired image file from the list display of the representative images, the input device 103 sends this instruction to the calculation unit 201. When the calculation unit 201 receives this instruction, the calculation unit 201 displays a list of various images represented by the image data included in the image file selected by the instruction on the monitor screen 141 of the display device 104. I do. For example, when the selection instruction for the thumbnail image 401 in FIG. 6B is received, the calculation unit 201 first extracts a three-dimensional image, an extended image, and a color image from the image file that includes the image data of the thumbnail image 401. The image data is extracted. Then, the three-dimensional image, the extended image, and the color image respectively represented by these image data are displayed on the monitor screen 141 as in the list display of the image display windows 301, 302, and 303 in the display example of FIG. Perform the process of displaying a list above.

  By performing the display of the first example as described above, when searching for a desired type of image from the images stored in the storage unit 203, the user can simply view the list display of the representative images and It is possible to recognize what kind of image is included in the image file. That is, it is possible to search for a desired type of image without displaying all the images included in each image file, so that the image search is facilitated.

  6A and 6, the image type displays 403, 404, 405, 406, and 407 are distinguished from each other by the display of one character shown therein. It was like that. Instead of this, the colors of this figure may be distinguished from each other. Of course, character discrimination and color discrimination may be used in combination.

  Furthermore, the graphic of the image type display 403, 404, 405, 406, and 407 may be made into another graphic having completely different forms so that the distinction can be facilitated. FIG. 7 is an example of such a figure.

  In FIG. 7, an image type display 501 is a graphic indicating that the type of image included in the image file is a confocal image, and an image type display 502 is an image of the image included in the image file. A figure indicating that the type is a color image (video image).

  Note that these graphics are GUI operation button graphics, icons, or names displayed on the display device 104 in order to obtain instructions for the confocal image and video image imaging operations in the LSM of FIG. It is convenient to keep the same. This is because the user can easily learn the correspondence between these figures and image types. In addition to this, for example, as a graphic for displaying the type of image subjected to noise removal processing, it may be the same as a GUI operation button, icon, or name for instructing noise removal processing. Good. Further, for example, as a graphic for displaying the type obtained by the synthesis process of the LSM image and the video image, it may be the same as a GUI operation button, icon, or name for instructing the image synthesis process. Further, for example, as a figure that displays the type of a three-dimensional image for measuring the height of a desired location, it may be the same as a GUI operation button, icon, or name for instructing image measurement processing. Good.

Next, FIG. 8A will be described. FIG. 8A shows a second example of a list display of stored image files, and shows a part of the list display in an enlarged manner, as in FIG. 6B.
In the display example shown in FIG. 8A, image type displays 603, 604, and 605 are displayed adjacent to the lower part of the thumbnail image 601 as display modes of the types of images included in the image file. Further, image type displays 606, 607, 608, and 609 are displayed adjacent to the lower part of the thumbnail image 602. These image type displays 603, 604, 605, 606, 607, 608, and 609 are graphics of different colors. Here, the image type displays 603, 604, and 605 indicate that the types of images included in the image file are a three-dimensional image, an extended image, and a color image, respectively. The image type displays 606 and 607 indicate that the types of images included in the image file are confocal images and non-confocal images in the LSM image, respectively. Further, the image type displays 608 and 609 indicate that the image file includes an image that has been subjected to image processing such as image noise removal and an image that includes measurement data such as height. .

  FIG. 8B illustrates the types of images represented by the colors in the image type displays 603, 604, 605, 606, 607, 608, and 609. 8A and 8B, the difference in color is expressed by the difference in screen tone.

  Here, when the user operates the input device 103 to give an instruction to select a desired image file from the list display of the representative images, the input device 103 sends this instruction to the calculation unit 201. When the calculation unit 201 receives this instruction, the calculation unit 201 displays a list of various images represented by the image data included in the image file selected by the instruction on the monitor screen 141 of the display device 104. I do. For example, when the selection instruction for the thumbnail image 601 in FIG. 8A is received, the calculation unit 201 first extracts a three-dimensional image, an extended image, and a color image from the image file that includes the image data of the thumbnail image 601. The image data is extracted. Then, the three-dimensional image, the extended image, and the color image respectively represented by these image data are displayed on the monitor screen 141 as in the list display of the image display windows 301, 302, and 303 in the display example of FIG. Perform the process of displaying a list above.

  By displaying such a second example, it is possible to search for a desired type of image without displaying all of the images included in each image file, as in the first example. Searching for images becomes easy. In addition, since the display indicating the type of image included in the image file is displayed adjacent to the periphery of the representative image without being superimposed on the representative image, the display of the representative image is not partially disturbed. The visibility of the image is improved. Furthermore, since the type of image included in the image file is indicated by the difference in display color of the image type, it is possible to know the type of image included in the image file simply by identifying the color. You can quickly search for images. In addition, since the type of the image included in the image file is indicated by the difference in the display color of the image type, the type of the image can be identified even if the display of the image type is reduced. Therefore, by reducing the display of the image type, more representative images can be displayed on the list display.

The display showing the relationship between the color and the image type shown in FIG. 8B may be displayed side by side in the list display of representative images.
Next, FIG. 9 will be described. FIG. 9 shows a third example of a list display of stored image files, and shows a part of the list display in an enlarged manner, as in FIG. 6B.

  In the display example shown in FIG. 9, explanations of correspondence between predetermined image types and characters are displayed on the upper part of the list display of representative images on the monitor screen 141 by explanation displays 702, 703, and 704. it's shown. A digital data name 705 indicating the type of image included in the image file including the thumbnail image 701 is displayed below the thumbnail image 701. Here, in the display “3D_E_C” that is the digital data name 705, the characters “3D”, “E”, and “C” indicate that the type of the image included in the image file is a three-dimensional image. , An extended image, and a color image. Correspondences between the characters and the image types are presented by explanation displays 702, 703, and 704.

  Here, when the user operates the input device 103 to give an instruction to select a desired image file from the list display of the representative images, the input device 103 sends this instruction to the calculation unit 201. When the calculation unit 201 receives this instruction, the calculation unit 201 displays a list of various images represented by the image data included in the image file selected by the instruction on the monitor screen 141 of the display device 104. I do. For example, when the selection instruction for the thumbnail image 701 in FIG. 9 is received, the calculation unit 201 firstly extracts a 3D image, an extended image, and a color image from the image file that includes the image data of the thumbnail image 701. The image data is extracted. Then, the three-dimensional image, the extended image, and the color image respectively represented by these image data are displayed on the monitor screen 141 as in the list display of the image display windows 301, 302, and 303 in the display example of FIG. Perform the process of displaying a list above.

  By performing the display of the third example like this, as the image type information for each image included in the image file, a character previously associated with the type of the image is associated with each representative image. Is displayed. Therefore, as in the first example, a desired type of image can be found without displaying all of the images included in each image file, so that the image search is facilitated. In this display example, as the display type of the image type included in the image file, the image type included in the image file is displayed in characters. Therefore, it is included in the image file simply by identifying the character. Since the type of the displayed image is known, a desired image can be searched quickly.

  Next, FIGS. 10A and 10B will be described. FIG. 10A and FIG. 10B both show a fourth example of a list display of stored image files, and shows a part of the list display in an enlarged manner, as in FIG. 6B.

  FIG. 10A shows a state in which the user operates the input device 103 to move the cursor frame 804 on the monitor screen 141 and give an instruction to select the thumbnail image 801. At this time, the calculation unit 201 displays the image type included in the image file including the thumbnail image 801 in the image type display column 803 arranged at the top of the thumbnail image list display side by side. Note that the image type display field 803 in FIG. 10A indicates that the image file including the thumbnail image 801 includes a three-dimensional image, an extended image, and a two-dimensional confocal LSM image by displaying in black. ing. Note that the white display indicates that the image associated with the display is not included in the image file including the thumbnail image 801.

  FIG. 10B shows a state in which the user operates the input device 103 to move the cursor frame 804 on the monitor screen 141 and give an instruction to select the thumbnail image 802, as in FIG. 10A. . At this time, the calculation unit 201 displays the image type included in the image file including the thumbnail image 802 in the image type display column 803 arranged at the top of the thumbnail image list display. The image type display field 803 in FIG. 10B indicates that the image file including the thumbnail image 802 includes a two-dimensional non-confocal LSM image by black display.

  Here, FIG. 11 will be described. FIG. 11 is a flowchart showing the contents of a second example of the stored image file list display process performed by the calculation unit 201. In this process, first, an image file stored in the storage unit 203 is read, and a thumbnail image (or the graphic described above) included in each image file is displayed side by side on the monitor screen 141 of the display device 104. Do. After that, as illustrated in FIGS. 10A and 10B, a process of displaying the type of the image included in the selected image file in the image type display field 803 is performed.

  When the user operates the input device 103 to give an instruction to display a list of image files stored in the storage unit 203, the input device 103 sends this instruction to the calculation unit 201. When the calculation unit 201 acquires this instruction, the calculation unit 201 starts the process of FIG.

  In FIG. 11, first, in step S301, all image files stored in the storage unit 203 are read out, image data of thumbnail images is acquired from each image file, and an image represented by the image data is displayed on the monitor screen 141. The process of displaying the list above is performed.

  Here, the user operates the mouse device as the input device 103 to give an instruction to select a thumbnail image. In S302, a process of acquiring the operation contents of the mouse device at this time and determining what the user has instructed to select from the list display of thumbnail images is performed.

  In S303, stored image type information is extracted from the header information of the image file including the thumbnail image determined in the process of S302, and processing for determining the type of each image included in the image file is performed.

  In S304, based on the determination result in S303, the image type included in the image file including the thumbnail image determined in S302 is displayed in the image type display field 803. Here, in the display in the image type display field 803, the square mark corresponding to the type of image included in the image file is painted black, and the square mark corresponding to the image type not included in the image file is white. Leave unplugged.

When the processing of S304 is completed, the stored image file list display processing image of FIG.
Thereafter, when the user further operates the input device 103 to give an instruction to select a desired image file from the list display of the representative image, the input device 103 sends this instruction to the calculation unit 201. Upon receiving this further instruction, the calculation unit 201 displays a list of various images represented by the image data included in the image file selected by the instruction on the monitor screen 141 of the display device 104. Perform the process. For example, when a further selection instruction for the thumbnail image 801 in FIG. 10A is received, the calculation unit 201 first extracts a 3D image, an extended image, and a 2D confocal LSM image from the image file including the thumbnail image 801. The image data is extracted. Then, the 3D image, the extended image, and the 2D confocal LSM image respectively represented by these image data are displayed as a list display of the image display windows 301, 302, and 303 in the display example of FIG. Then, a process of displaying a list on the monitor screen 141 is performed.

  By performing the display of the fourth example as described above, when searching for a desired type of image from the images stored in the storage unit 203, the user only has to view the list display of the representative images. It is possible to recognize what kind of image is included in the image file. That is, similarly to the display in the first example described above, it is possible to search for a desired type of image without displaying all of the images included in each image file. .

  Note that the image type display field 803 for displaying the type of image included in the image file may be configured as illustrated in FIG. In this aspect, several types of images are presented together in one group. In the example of FIG. 12, a three-dimensional image, an extended image, and a color image are collected as one group. Yes. Therefore, for example, when only one square mark corresponding to this group is displayed in black, the image file includes three types of images: a three-dimensional image, an extended image, and a color image. Will be shown.

  As described above, when some of the image types are grouped and shown in the image type display field 803, the display range of the image type display field 803 is reduced and the display efficiency is improved, so that more representative images can be obtained. Can be displayed as a list on the monitor screen 141.

As mentioned above, although embodiment of this invention was described, this invention is not limited to each embodiment mentioned above, A various improvement and change are possible within the range which does not deviate from the summary of this invention.
For example, although the above description is about the form which implements this invention with a confocal laser microscope apparatus, this invention can be implemented also with another kind of microscope. As such a microscope, for example, it is possible to irradiate the sample with excitation light by switching the excitation wavelength for the actual observation, analysis and analysis of the observation object, and switching between fluorescence observation, bright field observation and dark field observation is also possible. There is a fluorescence microscope that can acquire images of the same position sample by a plurality of microscopic methods.

It is a figure which shows the structure of the confocal laser microscope apparatus which implements this invention. It is a figure which shows the example of a display of the various images on the monitor screen of a display apparatus. It is the figure which showed the processing content of the image preservation | save process with the flowchart. It is a figure which shows the data structure of an image file. It is the figure which showed the processing content of the 1st example of a preservation | save image file list display process with the flowchart. FIG. 10 is a first diagram illustrating a first example of a list display of stored image files. FIG. 10 is a second diagram illustrating a first example of displaying a list of saved image files. It is a figure which shows the example of the figure of the image type display from which an aspect differs. It is a figure which shows the 2nd example of the list display of a preservation | save image file. It is a figure which shows the relationship between a color and the kind of image. It is a figure which shows the 3rd example of the list display of a preservation | save image file. It is FIG. (1) which shows the 4th example of a list display of a preservation | save image file. It is FIG. (2) which shows the 4th example of the list display of a preservation | save image file. It is the figure which showed the processing content of the 2nd example of a preservation | save image file list display process with the flowchart. It is a figure which shows the example of an image kind display column.

Explanation of symbols

DESCRIPTION OF SYMBOLS 101 Microscope main body 102 Controller 103 Input apparatus 104 Display apparatus 105 Sample stand 106 Sample 111 Objective lens 112 Revolver 113, 118, 128 Beam splitter 114 Illumination lens 115 Collector lens 116 White light source 117 Imaging lens 119 1/4 wavelength plate 120 Pupil projection Lens 121 Optical scanner 122 Polarizing beam splitter 123, 127 Condensing lens 124 Laser light source 125 Video camera lens 126 CCD camera for video image acquisition 129 Pinhole 130 Detector for acquiring confocal image 131 Detector for acquiring non-confocal image 140 Z Moving mechanism 141 Monitor screen 201 Arithmetic unit 202 Control unit 203 Storage unit 301, 302, 303 Image display window 304 Save button 401, 402, 601, 602, 01,801,802 thumbnail image 403,404,405,406,407,501,502,603,604,
605, 606, 607, 608, 609 Image type display 702, 703, 704 Description display 705 Digital data name 803 Image type display field 804 Cursor frame

Claims (9)

Image acquisition means for acquiring a plurality of types of images having different acquisition methods for the same position sample;
Representative image acquisition means for obtaining a representative image representing an image of the same-position sample from one of a plurality of images of the same-position sample acquired by the image acquisition means;
Image type information including the representative image of the same-position sample and a plurality of images of the same-position sample acquired by the image acquisition unit as image data, and indicating the type of each of the plurality of images Image file storage means for storing a plurality of image files further including:
The representative image list for each image file stored in the image file storage means is displayed, and the image type for each of the plurality of images for the same-position sample included in each image file Image file list display means for displaying information in association with each representative image for performing the list display;
A microscope apparatus characterized by comprising:   The image file list display means displays a graphic indicating the image type information for each of the plurality of images included in each image file, overlaid on the representative image for each image file for which the list display is performed. The microscope apparatus according to claim 1, wherein:   The image file list display means includes a graphic indicating the image type information for each of the plurality of images included in each image file adjacent to the periphery of the representative image for each image file for which the list display is performed. The microscope apparatus according to claim 1, wherein the display is performed.   The image file list display means corresponds to each representative image with a figure of color previously associated with the type of image as the image type information for each of the plurality of images included in each image file. The microscope apparatus according to claim 1, wherein the microscope apparatus is attached and displayed.   The image file list display means associates a character associated with the image type in advance with each representative image as the image type information for each of the plurality of images included in the image file. The microscope apparatus according to claim 1, wherein the microscope apparatus is displayed.   The image file list display means is included in an image file including a representative image selected from the list display of the representative image among the image type information for each of the plurality of images included in the image file. 2. The microscope apparatus according to claim 1, wherein only the image type information for each of the images being displayed is displayed side by side in the list display of the representative images.   The representative image acquisition unit creates a thumbnail image of the same-position sample as the representative image from one of a plurality of images of the same-position sample acquired by the image acquisition unit. The microscope apparatus according to 1. The microscope apparatus is a confocal microscope;
The image acquisition means acquires at least a confocal image of the same-position sample and a video image obtained by capturing an image of the same-position sample with a video camera.
The microscope apparatus according to any one of claims 1 to 7, characterized in that:   The image acquisition means can acquire at least one of a three-dimensional image and an extended image for the same-position sample based on a plurality of confocal images for the same-position sample. The microscope apparatus described.