JP2015219287A - Microscope system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a microscope system that can capture a correct three-dimensional (3D) image.SOLUTION: A microscope system 1 comprises: a focus operation unit 105 that causes a focusing unit 104 to relatively move in an orthogonal direction orthogonal to a loading surface where a sample SP is loaded in response to an external operation; a position detection unit 4 that detects an amount of operation relative to the focus operation unit 105 to thereby detect a position of the focusing unit 104 in the orthogonal direction; a microscope control device 7 that causes an imaging device 3 to generate a plurality of pieces of image data at prescribed timing, and acquires position information indicative of a position of the focusing unit 104 in the orthogonal direction, in which the position thereof is detected by the position detection unit 4 upon photographing of the imaging device 3; and a three-dimensional image generation unit 641 that generates a three-dimensional image using the plurality of pieces of image data generated by the imaging device 3 and the position information acquired by the microscope control device 7.

Description

  The present invention relates to a microscope system that generates image data by imaging a specimen placed on a stage and displays an image corresponding to the image data.

  In recent years, in a microscope system for observing a specimen, a stage on which the specimen is placed is moved along the optical axis direction of the objective lens by a focusing section, and the imaging section is sequentially imaged and a plurality of image data with different focal points. A technique for generating a three-dimensional image of a specimen (hereinafter referred to as “3D image”) or an omnifocal image using a plurality of these image data is known (see Patent Document 1). In this technique, a 3D image of a specimen is generated by an observer manually moving the focusing unit so as to follow a preset correspondence between the frame rate of the imaging unit and the moving speed of the focusing unit. .

JP 2006-337470 A

  However, in general, when the observer manually moves the focusing unit, variations in the moving speed of the focusing unit cannot be avoided. For this reason, in Patent Document 1 described above, it is difficult to generate a 3D image faithfully according to the correspondence, and it is difficult to obtain an accurate 3D image.

  The present invention has been made in view of the above, and an object thereof is to provide a microscope system capable of obtaining an accurate 3D image.

  In order to solve the above-described problems and achieve the object, a microscope system according to the present invention is a microscope system capable of observing the specimen through an objective lens that collects an observation image of the specimen. In accordance with an operation from the outside, a focusing unit that adjusts the distance between the stage and the objective lens, and a stage that is movable in an orthogonal direction orthogonal to a placement surface on which the specimen is placed An operation unit that moves the focusing unit in the orthogonal direction, a position detection unit that detects a position of the focusing unit in the orthogonal direction by detecting an operation amount with respect to the operation unit, and the objective lens. An imaging unit that captures the illuminated observation image of the specimen, generates image data of the specimen, and causes the imaging unit to capture an image at a predetermined timing, and is detected by the position detection unit during imaging of the imaging unit A three-dimensional image is obtained using a control unit that acquires position information indicating the position of the focusing unit in the orthogonal direction, a plurality of the image data generated by the imaging unit, and the position information acquired by the control unit. And an image processing device to be generated.

  In the microscope system according to the present invention, in the above invention, the control unit causes the imaging unit to capture an image each time the position detection unit detects the preset operation amount, and the position detection unit. The position information detected by is acquired.

  In the microscope system according to the present invention, in the above invention, the control unit causes the imaging unit to capture an image at a predetermined frame rate, and the position information detected by the position detection unit in one period at the frame rate is 1 It is characterized by acquiring more than once.

  The microscope system according to the present invention may further include an input unit that receives an input of an instruction signal that instructs the imaging unit to perform imaging, and the control unit receives the input of the instruction signal. In this case, the position information detected by the position detection unit is acquired by the image pickup unit.

  In the microscope system according to the present invention, in the above invention, the operation unit is provided to be rotatable around a predetermined axis, and the position detection unit detects the rotation amount of the operation unit. The position of the focusing part in the orthogonal direction is detected.

  In the microscope system according to the present invention, in the above invention, the position detection unit may calculate the rotation amount corresponding to the movement amount of the focusing unit set by the depth of focus of the objective lens or the magnification of the objective lens. The position of the focusing unit is detected by detection.

  The microscope system according to the present invention is characterized in that, in the above invention, the position detection unit is detachable from the operation unit.

  The microscope system according to the present invention is the microscope system according to the above aspect, wherein the image processing device acquires a display unit capable of displaying an image, an image corresponding to the image data generated by the imaging unit, and the control unit. A display control unit that associates position information with the display information and displays the position information on the display unit.

  According to the microscope system of the present invention, there is an effect that an accurate 3D image can be obtained.

FIG. 1 is a schematic diagram showing a schematic configuration of a microscope system according to Embodiment 1 of the present invention. FIG. 2 is a diagram illustrating an example of a display screen displayed by the display unit of FIG. FIG. 3 is a flowchart showing an outline of processing executed by the microscope system according to Embodiment 1 of the present invention. FIG. 4 is a diagram schematically showing the transition of the display screen displayed by the display unit of FIG. FIG. 5 is a flowchart showing an outline of processing executed by the microscope system according to Embodiment 2 of the present invention. FIG. 6 is a schematic diagram showing a schematic configuration of a microscope system according to Embodiment 3 of the present invention. FIG. 7 is a flowchart showing an outline of processing executed by the microscope system according to Embodiment 3 of the present invention.

  DESCRIPTION OF EMBODIMENTS Hereinafter, embodiments for carrying out the present invention (hereinafter referred to as “embodiments”) will be described with reference to the drawings. The present invention is not limited to the embodiments described below. The drawings referred to in the following description only schematically show the shape, size, and positional relationship so that the contents of the present invention can be understood. That is, the present invention is not limited only to the shape, size, and positional relationship illustrated in each drawing.

(Embodiment 1)
[Configuration of microscope system]
FIG. 1 is a schematic diagram showing a schematic configuration of a microscope system according to Embodiment 1 of the present invention. In FIG. 1, the plane on which the microscope system 1 is placed is described as an XY plane, and a direction perpendicular to the XY plane is described as a Z direction.

  A microscope system 1 shown in FIG. 1 includes a microscope apparatus 2 for observing a specimen SP, an imaging apparatus 3 for imaging the specimen SP through the microscope apparatus 2, and generating image data of the specimen SP, and focusing of the microscope apparatus 2. A position detection unit 4 that is attached to a focusing operation unit that moves the unit in the vertical direction and detects the position of the focusing unit by detecting the amount of rotation of the focusing operation unit, and inputs for various operations of the microscope apparatus 2 An image processing device 6 that receives an input of various operations of the microscope system 1, a microscope device 2, an imaging device 3, a position, and an image corresponding to the image data generated by the imaging device 3. And a microscope control device 7 that controls the detection unit 4, the operation unit 5, and the image processing device 6. The microscope device 2, the imaging device 3, the position detection unit 4, the operation unit 5, and the image processing device 6 are connected by wire or wireless so that data can be transmitted and received.

[Configuration of microscope device]
First, the configuration of the microscope apparatus 2 will be described.
The microscope apparatus 2 holds a substantially C-shaped main body portion 100, a stage 101 on which a specimen SP is placed, an objective lens 102 arranged to face the stage 101, and a plurality of objective lenses 102 having different magnifications. And a focusing unit 104 that adjusts the distance between the stage 101 and the objective lens 102 by moving the stage 101 in an orthogonal direction (Z-axis direction) orthogonal to the placement surface on which the specimen SP is placed, A focusing operation unit 105 that moves the focusing unit 104 in the vertical direction, an epi-illumination optical system 106 that irradiates the specimen SP with light, a trinocular tube unit 107 attached to the main body 100, and a trinocular tube unit 107 And an image forming lens unit 109 connected to the trinocular tube unit 107. The imaging device 3 is connected to the end of the imaging lens unit 109. In the first embodiment, the objective lens 102 and the imaging lens unit 109 function as an observation optical system. Further, in the first embodiment, the imaging device 3 may be connected to the main body unit 100 without providing the trinocular tube unit 107 in the main body unit 100.

  The stage 101 is movable in the horizontal direction within the XY plane, and is provided in the main body unit 100 via the focusing unit 104.

  As the objective lens 102, a plurality of objective lenses having different magnifications (for example, a 50 × objective lens 102 a and a 100 × objective lens 102 b) are detachably attached to the revolver 103.

  The revolver 103 is provided so as to be rotatable with respect to the main body 100, and the objective lens 102 is disposed above the specimen SP. The revolver 103 rotates to change the magnification of the image in the field of view by selectively switching the objective lens 102 used for observation of the specimen SP arranged on the observation optical path L.

  The focusing unit 104 is movable in an orthogonal direction orthogonal to the placement surface on which the specimen SP is placed, and adjusts the distance between the objective lens 102 and the stage 101. Specifically, the stage 101 is moved relative to the objective lens 102 in the orthogonal direction (Z direction) orthogonal to the placement surface on which the specimen SP is placed. The focusing unit 104 moves the stage 101 in the vertical direction in accordance with the operation of the focusing operation unit 105. The stage 101 is detachably connected to the focusing unit 104.

  The focusing operation unit 105 moves the focusing unit 104 in the orthogonal direction in accordance with an external operation. Specifically, the focusing operation unit 105 moves relative to the stage 101 in the orthogonal direction (Z direction) orthogonal to the placement surface on which the specimen SP is placed. More specifically, the focusing operation unit 105 is provided so as to be rotatable around a predetermined axis, and is moved by the observer to move the focusing unit 104 relative to the stage 101 in the Z direction. Let The focusing operation unit 105 includes a position detection unit 4 to be described later. In other words, the observer moves the focusing unit 104 in the Z direction by rotating the focusing operation unit 105 via the position detection unit 4. In the first embodiment, the focusing operation unit 105 functions as an operation unit.

  The epi-illumination optical system 106 includes an epi-illumination light source 106a that emits epi-illumination light, and various epi-illumination optical members 106b that collect the epi-illumination light emitted by the epi-illumination light source 106a and guide it in the direction of the observation optical path L. Have.

  The epi-illumination light source 106a includes a halogen lamp, a xenon lamp, an LED, or the like. The epi-illumination light source 106 a emits epi-illumination light under the control of the microscope control device 7.

  The epi-illumination optical member 106b is configured using a half mirror, a filter unit, a shutter, a field stop, an aperture stop, and the like.

  The trinocular tube unit 107 branches the observation light of the sample SP incident from the objective lens 102 into the direction of the imaging device 3 and the direction of the eyepiece unit 108.

  The eyepiece unit 108 is for an observer to observe the specimen SP. The eyepiece unit 108 is configured using a plurality of lenses that form an image of the observation light of the specimen SP.

  The imaging lens unit 109 includes a plurality of zoom lenses 109a and a zoom operation unit (not shown) that changes the positions of these zoom lenses 109a. The plurality of zoom lenses 109a enlarge or reduce the imaging target in the visual field region of the imaging device 3 by moving the position on the observation optical path L by the operation unit.

[Configuration of imaging device]
Next, the configuration of the imaging device 3 will be described.
The imaging device 3 converts the light into an electrical signal (analog signal) by receiving the observation image (observation light) of the specimen SP incident through the objective lens 102 and the imaging lens unit 109 and performing photoelectric conversion. An image sensor 31 such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor) having a plurality of pixels, and an electric signal output from the image sensor 31 is subjected to signal processing such as amplification (gain adjustment) A signal processing unit (not shown) that converts the image data of the digital specimen SP into an image processing device 6 by performing A / D conversion and outputs the image data to the image processing device 6. Under the control of the microscope control device 7, the imaging device 3 continuously generates image data of the specimen SP at a minute time interval and outputs it to the image processing device 6. The imaging device 3 generates image data at a predetermined frame rate, for example, 15 fps. In the first embodiment, the imaging device 3 functions as an imaging unit.

(Configuration of position detector)
Next, the configuration of the position detection unit 4 will be described.
The position detection unit 4 is configured using a rotary encoder. The position detection unit 4 is installed in the focusing operation unit 105 and detects the position of the focusing unit 104 in the Z direction (orthogonal direction) by detecting an operation amount with respect to the focusing operation unit 105. Specifically, the position detection unit 4 detects the rotation amount and the rotation direction of the focusing operation unit 105 that rotates according to the rotation operation of the observer, and the number of pulses corresponding to the detected rotation amount and rotation direction. Is generated. For example, in the position detection unit 4, when the focusing operation unit 105 is rotated once, the focusing unit 104 moves 100 μm in the Z direction. At this time, the position detection unit 4 generates 1000 pulses.

[Configuration of operation unit]
Next, the configuration of the operation unit 5 will be described.
The operation unit 5 is configured using a plurality of switches, joysticks, and the like, and accepts input of instruction signals for instructing various operations of the microscope system 1. The operation unit 5 may be configured using a touch panel or the like.

[Configuration of image processing apparatus]
Next, the configuration of the image processing device 6 will be described.
The image processing device 6 is configured using a personal computer, and is three-dimensional using a plurality of image data generated by the imaging device 3 and position information indicating the position of a focusing unit 104 acquired by a microscope control device 7 described later. Generate an image. The image processing device 6 includes a display unit 61 that displays an image corresponding to the image data generated by the imaging device 3, an input unit 62 that receives input of instruction signals for instructing various operations related to the microscope system 1, and an image processing device. 6 includes an image processing recording unit 63 that records various programs executed by the computer 6 and information, and an image processing control unit 64 that controls each unit of the image processing apparatus 6.

  The display unit 61 is configured using a display panel made of liquid crystal, organic EL (Electro Luminescence), or the like. The display unit 61 displays a position corresponding to the position information of the focusing unit 104 input via the microscope control device 7 and an image corresponding to the image data generated by the imaging device 3.

  FIG. 2 is a diagram illustrating an example of a display screen displayed by the display unit 61. As shown in FIG. 2, the display unit 61 displays a live image display area 611 that displays a live image corresponding to the image data continuously generated by the imaging device 3 and the position of the focusing unit 104 in the Z direction. Position display area 612, a 3D measurement start icon 613 that receives an input of a start signal that instructs the start of 3D measurement of the specimen SP, and a 3D measurement end icon that receives an input of an end instruction that instructs the end of 3D measurement of the specimen SP 614. The position display area 612 includes a mark 612a indicating the current position of the focusing unit 104, and image number information 612b indicating image data of the specimen SP associated with the position of the focusing unit 104 in the Z direction.

  The input unit 62 is configured using an input device such as a keyboard and a mouse, and outputs operation signals corresponding to operation inputs of various input devices to the microscope control device 7.

  The image processing recording unit 63 is configured using an SDRAM (Synchronous Dynamic Random Access Memory), a Flash memory, or the like, and various programs executed by the image processing device 6, data being processed, image data generated by the imaging device 3, and the like Record. Further, the image processing recording unit 63 may be configured using a memory card or the like that is detachable from the outside.

  The image processing control unit 64 is configured using a CPU (Central Processing Unit) or the like. The image processing control unit 64 controls the operation of the image processing device 6 by controlling each part of the image processing device 6. The image processing control unit 64 includes a 3D image generation unit 641 and a display control unit 642.

  The 3D image generation unit 641 has a plurality of pieces of image data obtained by imaging the sample SP at different positions of the focusing unit 104 by the imaging device 3 and the focus in the orthogonal direction detected by the position detection unit 4 acquired by the microscope control device 7 described later. Using the position information indicating the position of the quasi part 104, 3D image data of the specimen SP is generated. Specifically, the 3D image generation unit 641 is detected by the position detection unit 4 acquired by a plurality of image data obtained by imaging the specimen SP at different positions of the focusing unit 104 by the imaging device 3 and the microscope control device 7 described later. Using the position information indicating the position of the focusing unit 104 in the orthogonal direction, the focus state with respect to the sample SP is compared for each pixel of each of the plurality of images corresponding to the plurality of image data, and the focus on the sample SP is determined. The 3D image data of the specimen SP is generated by using the pixels that exist.

  The display control unit 642 controls the display mode of the display unit 61. Specifically, the display control unit 642 causes the display unit 61 to display a live image corresponding to the image data generated by the imaging device 3. Further, the display control unit 642 causes the display unit 61 to display a 3D image corresponding to the 3D image data generated by the 3D image generation unit 641. Furthermore, the display control unit 642 changes the display position of the mark 612 a based on the position information of the focusing unit 104 input from the microscope control device 7. Specifically, the display control unit 642 associates the image corresponding to the image data generated by the imaging device 3 with the position information indicating the position of the focusing unit 104 detected by the position detection unit 4, and the mark 612a and the image. Number information is displayed on the display unit 61.

[Configuration of Microscope Control Device]
Next, the configuration of the microscope control device 7 will be described.
The microscope control device 7 comprehensively controls the operation of each part constituting the microscope system 1. In addition, the microscope control device 7 causes the imaging device 3 to capture an image at a predetermined timing, and acquires position information indicating the position of the focusing unit 104 in the orthogonal direction detected by the position detection unit 4 during imaging of the imaging device 3. . Here, a detailed configuration of the microscope control device 7 will be described. The microscope control device 7 includes a microscope recording unit 71 that records various programs executed by the microscope system 1 and data being processed, and a microscope control unit 72 that controls the operation of each unit of the microscope device 2. In the first embodiment, the microscope control device 7 functions as a control unit.

  The microscope recording unit 71 is configured using SDRAM, ROM (Reed Only Memory), and the like, and records various programs executed by the microscope apparatus 2, data being processed, and the like.

  The microscope control unit 72 is configured using a CPU or the like, and based on an operation signal from the operation unit 5 or an operation signal from the image processing device 6, instructions and data transfer corresponding to each unit constituting the microscope system 1 are performed. To perform overall control of the operation of the microscope system 1. The microscope control unit 72 includes a position calculation unit 721 and an imaging control unit 722.

  The position calculation unit 721 is configured by using a counter, and position information indicating the position of the focusing unit 104 in the orthogonal direction by counting up / down the number of pulses corresponding to the rotation amount input from the position detection unit 4. Is calculated. Specifically, the position calculation unit 721 counts the number of pulses input from the position detection unit 4, and calculates position information indicating the position of the focusing unit 104 in the orthogonal direction based on the count value. In addition, the position calculation unit 721 acquires position information indicating the position of the focusing unit 104 in the orthogonal direction detected by the position detection unit 4 every time the position detection unit 4 detects a preset operation amount, and acquires a microscope. Recording (holding) in the recording unit 71. Specifically, the position calculation unit 721 records the position information of the focusing unit 104 in the orthogonal direction in the microscope recording unit 71 each time the position detection unit 4 detects the number of pulses set in advance according to the rotation amount. To do.

  The imaging control unit 722 causes the imaging device 3 to start a shooting operation based on the instruction signal input from the image processing device 6. Further, the imaging control unit 722 causes the imaging device 3 to capture an image of the same specimen SP at a timing when the focus of the objective lens 102 is different. Specifically, the imaging control unit 722 outputs an imaging trigger instructing imaging to the imaging device 3 based on the rotation amount input from the position detection unit 4. More specifically, the imaging control unit 722 outputs an imaging trigger to the imaging device 3 every time the position detection unit 4 detects the number of pulses corresponding to a preset rotation amount, thereby imaging the imaging device 3. Let Here, the preset rotation amount is set according to the focal depth or magnification of the objective lens 102.

[Microscope system processing]
Next, processing of the microscope system 1 executed by the above-described microscope system 1 will be described. FIG. 3 is a flowchart showing an outline of processing executed by the microscope system 1.

  As shown in FIG. 3, first, the microscope control unit 72 initializes an encoder counter recorded by the microscope recording unit 71 (step S101). Specifically, the microscope control unit 72 initializes the encoder counter j in the storage area of the microscope recording unit 71 calculated by the position calculation unit 721 (j = 0).

  Thereafter, the position calculation unit 721 acquires the rotation amount of the focusing operation unit 105 detected by the position detection unit 4 (step S102), and determines whether or not the rotation amount of the focusing operation unit 105 is greater than or equal to a threshold value TH. (Step S103). Here, the threshold value TH is a rotation amount corresponding to the movement amount of the focusing unit 104 set by the depth of focus of the objective lens 102 or the magnification. When the position calculation unit 721 determines that the rotation amount of the focusing operation unit 105 is greater than or equal to the threshold value TH (step S103: Yes), the microscope system 1 proceeds to step S104 described later. On the other hand, when the position calculation unit 721 determines that the rotation amount of the focusing operation unit 105 is not equal to or greater than the threshold value TH (step S103: No), the microscope system 1 proceeds to step S110 described later.

  In step S <b> 104, the position calculation unit 721 records the rotation amount of the focusing operation unit 105 detected by the position detection unit 4 in the microscope recording unit 71. Specifically, the position calculation unit 721 counts up the counter of the rotation amount detected by the position detection unit 4 and records it in the microscope recording unit 71 (j = j + 1). In this case, the position calculation unit 721 initializes the number of pulses input from the position detection unit 4.

  Subsequently, the position calculation unit 721 outputs the count value of the focusing operation unit 105 detected by the position detection unit 4 to the image processing device 6 (step S105).

  Thereafter, the imaging device 3 captures an image according to the imaging trigger (release signal) output from the imaging control unit 722 (step S106). Thereby, the imaging device 3 images the specimen SP, generates image data of the specimen SP, and outputs the image data to the image processing apparatus 6.

  Subsequently, based on the rotation amount of the focusing operation unit 105 detected by the position detection unit 4 input from the microscope control device 7, the display control unit 642 creates a new one corresponding to the position in the Z direction of the focusing unit 104. The image number is displayed on the display unit 61 (step S107). Specifically, as shown in FIG. 4, the display control unit 642 is based on the rotation amount of the focusing operation unit 105 detected by the position detection unit 4 input from the microscope control device 7. A new image number corresponding to the position in the Z direction is displayed on the display unit 61 (FIG. 4A → FIG. 4B). Accordingly, the user can intuitively grasp the position of the focusing unit 104 and the position of the image captured by the imaging device 3.

  Thereafter, when the 3D measurement end icon 614 is operated via the input unit 62 to end the 3D measurement of the sample SP (step S108: Yes), the 3D image generation unit 641 displays the sample recorded in the image processing recording unit 63. 3D image data of the specimen SP is generated using a plurality of image data captured at different positions with respect to the SP (step S109). After step S109, the microscope system 1 ends this process. In this case, the microscope system 1 may display the 3D image of the specimen SP generated by the 3D image generation unit 641 on the display unit 61 for a predetermined time, for example, 3 seconds, after the display control unit 642 ends this processing. Good.

  In step S108, when the 3D measurement end icon 614 is not operated via the input unit 62 and the 3D measurement of the specimen SP is not ended (step S108: No), the microscope system 1 returns to step S102.

  In step S110, when the 3D measurement end icon 614 is operated via the input unit 62 to end the 3D measurement of the specimen SP (step S110: Yes), the microscope system 1 proceeds to step S109. On the other hand, when the 3D measurement end icon 614 is not operated via the input unit 62 and the 3D measurement of the specimen SP is not ended (step S110: No), the microscope system 1 returns to step S102.

  According to the first embodiment of the present invention described above, every time the microscope control device 7 detects the rotation amount of the focusing operation unit 105 set in advance by the position detection unit 4, the imaging device 3 is caused to capture an image, Since the position information indicating the position of the focusing unit 104 detected by the detection unit 4 is output to the image processing device 6, the image of the specimen SP and the position of the focusing unit 104 in the orthogonal direction (Z direction) can be synchronized. An accurate 3D image can be obtained.

  Further, according to the first embodiment of the present invention, the position detector 4 is configured as a rotary encoder, so that a 3D image of the sample SP can be obtained from both directions (vertical directions) in the orthogonal direction (Z direction). Therefore, the start position of the 3D image of the specimen SP can be arbitrarily set.

  Further, according to Embodiment 1 of the present invention, the position detector 4 is configured by a rotary encoder, so that an accurate 3D image of the specimen SP can be generated with an inexpensive configuration.

  Further, according to the first embodiment of the present invention, the imaging device 3 captures an image according to the amount of movement of the focusing unit 104 even if the specimen SP has a large step in the orthogonal direction (Z direction). The unit 104 can be moved at a desired speed.

  In the first embodiment of the present invention, the microscope control device 7 outputs the imaging trigger to the image processing device 6 even when the focusing operation unit 105 is operated bidirectionally. The microscope control device 7 may output an imaging trigger to the image processing device 6 when the operation unit 105 is operated only in one direction, for example, upward.

  In Embodiment 1 of the present invention, when the rotation amount of the focusing operation unit 105 exceeds the frame rate of the imaging apparatus 3, the display control unit 642 has a fast rotation speed of the focusing operation unit 105 by the observer. Therefore, a warning that a 3D image of the specimen SP cannot be generated may be displayed on the display unit 61.

(Embodiment 2)
Next, a second embodiment of the present invention will be described. The microscope system according to the second embodiment has the same configuration as the microscope system 1 according to the above-described first embodiment, and the processing to be executed is different. Specifically, in the first embodiment described above, based on the rotation amount detected by the position detection unit 4, the microscope control device 7 causes the imaging device 3 to output an imaging trigger to image the specimen SP. In the second embodiment, the microscope control device 7 records the rotation amount detected by the position detection unit in synchronization with the frame rate of the imaging device. For this reason, below, the process which the microscope system which concerns on this Embodiment 2 performs is demonstrated. In addition, the same code | symbol is attached | subjected to the structure similar to the microscope system 1 which concerns on Embodiment 1 mentioned above, and description is abbreviate | omitted.

[Microscope system processing]
FIG. 5 is a flowchart showing an outline of processing executed by the microscope system 1 according to the second embodiment.

  In FIG. 5, step S201 corresponds to step S101 of FIG. 3 described above.

  Subsequently, the imaging device 3 images the specimen SP (step S202) and outputs an imaging trigger to the microscope control device 7 (step S203). In this case, the imaging device 3 outputs the image data to the image processing device 6.

  Thereafter, the position calculation unit 721 acquires the rotation amount of the position detection unit 4 (step S204), and records the rotation amount of the focusing operation unit 105 detected by the position detection unit 4 in the microscope recording unit 71 (step S205). . Specifically, the position calculation unit 721 counts up the counter of the rotation amount detected by the position detection unit 4 and records it in the microscope recording unit 71 (j = j + 1). In this case, the position calculation unit 721 initializes the number of pulses input from the position detection unit 4.

  Subsequently, the position calculation unit 721 outputs the counter value of the focusing operation unit 105 detected by the position detection unit 4 to the image processing device 6 (step S206).

  Steps S207 to S209 correspond to steps S107 to S109 described above, respectively.

  According to the second embodiment of the present invention described above, the position information indicating the position of the focusing unit 104 detected by the position detection unit 4 in synchronization with the imaging timing of the imaging device 3 by the microscope control device 7 is displayed on the image processing device. 6, since the image of the specimen SP and the position of the focusing unit 104 in the orthogonal direction (Z direction) can be synchronized, an accurate 3D image can be obtained.

  Further, according to the second embodiment of the present invention, since a 3D image of the specimen SP can be obtained at the imaging timing of the imaging apparatus 3, it is possible to reliably prevent an image from being missed from the specimen SP.

  In the second embodiment of the present invention, the microscope control device 7 outputs the position information of the focusing unit 104 to the image processing device 6 in synchronization with the imaging timing of the imaging device 3. When an instruction signal for instructing the generation of the SP 3D image is input, for example, a timer is provided in each of the imaging device 3 and the microscope control device 7, and the imaging of the sample SP and position detection by the imaging device 3 according to the count of the timer. The position information may be output by the unit 4.

  In Embodiment 2 of the present invention, when the number of images to be captured corresponding to the image data of the specimen SP used by the 3D image generator 641 for generating the 3D image of the specimen SP is insufficient, the display controller 642 A warning that a 3D image of the sample SP cannot be generated or that the number of images of the sample SP is insufficient may be displayed on the unit 61.

  In the second embodiment of the present invention, the contrast value at the focus position on the specimen SP is previously calibrated for the imaging apparatus 3, and the contrast value obtained by the calibration process is set as a threshold value, which exceeds the threshold value. Only in such a case, an imaging trigger may be output.

(Embodiment 3)
Next, a third embodiment of the present invention will be described. The microscope system according to the third embodiment has a configuration different from that of the microscope system 1 according to the first embodiment described above and a process to be executed. For this reason, below, after demonstrating the structure of the microscope system which concerns on this Embodiment 3, the process which the microscope system which concerns on this Embodiment 3 performs is demonstrated. In addition, the same code | symbol is attached | subjected to the structure same as the microscope system 1 which concerns on Embodiment 1 mentioned above, and description is abbreviate | omitted.

[Configuration of microscope system]
FIG. 6 is a schematic diagram illustrating a schematic configuration of the microscope system according to the third embodiment. In FIG. 6, the plane on which the microscope system 1a is placed is defined as an XY plane, and a direction perpendicular to the XY plane is defined as a Z direction.

  The microscope system 1a illustrated in FIG. 6 includes an imaging operation unit 8 in addition to the configuration of the microscope system 1 described above.

  The imaging operation unit 8 is configured using a plurality of switches, a touch panel, and the like, and receives an input of an instruction signal (release signal) that instructs the imaging device 3 to perform imaging.

[Microscope system processing]
Next, processing executed by the microscope system 1a described above will be described. FIG. 7 is a flowchart showing an outline of processing executed by the microscope system 1a.

  In FIG. 7, step S301 corresponds to the above-described step S101 of FIG.

  When the imaging operation unit 8 is operated in step S302 (step S302: Yes), the position calculation unit 721 acquires the rotation amount of the focusing operation unit 105 detected by the position detection unit 4 (step S303). On the other hand, when the imaging operation unit 8 is not operated (step S302: No), the microscope system 1 stands by until the imaging operation unit 8 is operated.

  Steps S304 to S310 correspond to the above-described steps S104 to S110 in FIG.

  According to the third embodiment of the present invention described above, when the imaging operation unit 8 is operated, the microscope control device 7 causes the imaging device 3 to perform imaging, and the position detection unit 4 synchronizes with the imaging timing of the imaging device 3. Since the position information indicating the position of the focusing unit 104 is output to the image processing device 6, the image of the specimen SP and the position of the focusing unit 104 in the Z direction can be synchronized, so that an accurate 3D image can be obtained. it can.

  Further, according to the third embodiment of the present invention, even when the specimen SP has a large step in the orthogonal direction (Z direction), the observer operates the imaging operation unit 8 on the mask of the specimen SP to focus. Since the 3D image of the sample SP can be acquired by operating the imaging operation unit 8 on the upper surface of the specimen SP after moving the part 104 greatly, it is necessary to move the focusing unit 104 at a constant speed. Therefore, an accurate 3D image of the specimen SP can be obtained.

  In the third embodiment of the present invention, the focusing operation unit 105 may be operated while pressing the imaging operation unit 8.

  In Embodiment 3 of the present invention, the imaging operation unit 8 is connected to the microscope control device 7, but may be connected to the image processing device 6.

(Other embodiments)
In the first to third embodiments described above, the position detection unit 4 is provided in the focusing operation unit 105. However, the position detection unit 4 may be detachable from the focusing operation unit 105, for example.

  In the first to third embodiments described above, the position detection unit 4 is configured using a rotary encoder, but may be configured using, for example, a linear encoder, a photo interrupter, or the like. In this case, the position detection unit 4 detects not only the rotation amount of the focusing operation unit 105 but also the operation amount and movement amount of the focusing operation unit 105 by the observer, so that the orthogonal direction (Z direction) or the horizontal direction is detected. You may detect the position of the focusing part 104 in (XY direction).

  In the first to third embodiments described above, the back crash amount of the focusing unit 104 may be corrected by performing a calibration process in advance. Thereby, a more accurate 3D image of the specimen SP can be obtained.

  In the first to third embodiments described above, when there are a plurality of image data generated by the imaging device 3 at the same position of the focusing unit 104 in the orthogonal direction, or image data having the same focal depth of the objective lens 102 with respect to the specimen SP. When there are a plurality of the 3D images, the 3D image generation unit 641 may generate a 3D image of the specimen SP using only the latest image data.

  In Embodiments 1 to 3 described above, an upright microscope apparatus has been described as an example of the microscope apparatus 2, but the present invention can be applied to an inverted microscope apparatus, for example.

  In Embodiments 1 to 3 described above, the example of the focusing unit 104 that moves the stage 101 relative to the objective lens 102 in the orthogonal direction (Z direction) has been described. The present invention can also be applied to a focusing unit that relatively moves the revolver 103 in the orthogonal direction (Z direction).

  In the present invention, the microscope system including the microscope apparatus, the imaging apparatus, the image processing apparatus, and the microscope control apparatus has been described as an example. For example, an objective lens for enlarging the specimen, and an imaging function for imaging the specimen via the objective lens The present invention can also be applied to an imaging device having a display function for displaying an image, such as a video microscope.

  In the description of the flowchart in the present specification, the context of the processing between steps is clearly indicated using expressions such as “first”, “after”, “follow”, etc., in order to implement the present invention. The order of processing required is not uniquely determined by their representation. That is, the order of processing in the flowcharts described in this specification can be changed within a consistent range.

  As described above, the present invention can include various embodiments not described herein, and various design changes and the like can be made within the scope of the technical idea specified by the claims. Is possible.

DESCRIPTION OF SYMBOLS 1,1a Microscope system 2 Microscope apparatus 3 Imaging apparatus 4 Position detection part 5 Operation part 6 Image processing apparatus 7 Microscope control apparatus 8 Imaging operation part 31 Imaging element 61 Display part 62 Input part 63 Image processing recording part 64 Image processing control part 71 Microscope recording unit 72 Microscope control unit 100 Body unit 101 Stage 102 Objective lens 103 Revolver 104 Focusing unit 105 Focusing operation unit 106 Epi-illumination optical system 106a Epi-illumination light source 106b Epi-illumination optical member 107 Trinocular tube unit 108 Eyepiece unit 109 Imaging lens unit 109a Zoom lens 641 3D image generation unit 642 Display control unit 721 Position calculation unit 722 Imaging control unit SP specimen

Claims (8)

In a microscope system capable of observing the specimen through an objective lens that collects an observation image of the specimen,
A stage on which the specimen is placed;
A focusing unit that is movable in an orthogonal direction orthogonal to a mounting surface on which the sample is mounted, and that adjusts a distance between the stage and the objective lens;
An operation unit that moves the focusing unit in the orthogonal direction in response to an operation from outside;
A position detection unit that detects a position of the focusing unit in the orthogonal direction by detecting an operation amount with respect to the operation unit;
An imaging unit that captures an observation image of the specimen collected by the objective lens and generates image data of the specimen;
A control unit that causes the imaging unit to capture an image at a predetermined timing, and acquires position information indicating a position of the focusing unit in the orthogonal direction detected by the position detection unit during imaging of the imaging unit;
An image processing device that generates a three-dimensional image using the plurality of image data generated by the imaging unit and the position information acquired by the control unit;
A microscope system comprising:   The control unit causes the imaging unit to capture an image and acquires the position information detected by the position detection unit each time the position detection unit detects the preset operation amount. The microscope system according to claim 1.   2. The control unit according to claim 1, wherein the control unit causes the imaging unit to capture an image at a predetermined frame rate, and acquires the position information detected by the position detection unit at least once in one period at the frame rate. Microscope system. An input unit that receives an input of an instruction signal that instructs the imaging unit to perform imaging;
2. The control unit according to claim 1, wherein when the input unit receives an input of the instruction signal, the control unit causes the imaging unit to capture an image and acquires the position information detected by the position detection unit. The described microscope system. The operation unit is provided to be rotatable around a predetermined axis,
The microscope according to claim 1, wherein the position detection unit detects a position of the focusing unit in the orthogonal direction by detecting a rotation amount of the operation unit. system.   The position detection unit detects the position of the focusing unit by detecting the rotation amount corresponding to the movement amount of the focusing unit set by the depth of focus of the objective lens or the magnification of the objective lens. The microscope system according to claim 5.   The microscope system according to claim 1, wherein the position detection unit is detachable from the operation unit. The image processing apparatus includes:
A display unit capable of displaying an image;
A display control unit that causes the display unit to display an image corresponding to the image data generated by the imaging unit and the position information acquired by the control unit in association with each other;
The microscope system according to claim 1, comprising:

Images