JP6300606B2 - Microscope system - Google Patents

Description

  The present invention relates to a microscope system that displays an image corresponding to image data generated by imaging a specimen placed on a stage.

  2. Description of the Related Art Conventionally, in a microscope system for observing a specimen, a technique for setting a moving amount of a stage on which a specimen is placed according to the field of view of an imaging device that images the specimen via an objective lens is known (see Patent Document 1). ). In this technique, the specimen is screened by moving the stage in a range including at least a part of the field of view currently captured by the imaging apparatus or in a range adjacent to the boundary of the field of view currently captured.

  In addition, when a sample is being screened while displaying an image corresponding to the image data of the sample generated by the imaging device via the objective lens on the display monitor, the display is displayed when the user changes the magnification of the objective lens. A technique is known in which the stage moving speed is set so that the image change on the monitor is the same before and after the objective lens is changed (see Patent Document 2). In this technique, the moving speed of the stage is set based on the magnification of the objective lens and the field of view of the imaging device.

JP 2010-169892 A JP 2012-27387 A

  By the way, in Patent Documents 1 and 2 described above, when moving the stage, the stage is moved by a movement amount corresponding to one field of view of the imaging apparatus. For this reason, in Patent Documents 1 and 2 described above, partial reading is performed on the image data captured by the imaging apparatus, and specimen screening is performed while an image corresponding to the partial read image data is displayed on the display monitor. In this case, the stage movement corresponding to one field of view of partial reading was not taken into account, and there was a problem that omission of observation of the specimen occurred.

  The present invention has been made in view of the above, and in the case where partial display is performed on image data generated by an imaging apparatus, when the specimen is screened while moving the stage, the observation of the specimen is omitted. An object of the present invention is to provide a microscope system that can prevent the above-described problem.

In order to solve the above-described problems and achieve the object, a microscope system according to the present invention includes a stage on which a specimen is placed and movable in a horizontal direction, a stage driving unit that moves the stage, and at least the stage An observation optical system for observing the specimen, a magnification detection unit for detecting the magnification of the observation optical system, and a plurality of pixels for performing photoelectric conversion in a two-dimensional form And an instruction signal for designating a partial region for partially displaying the image data obtained by the imaging device, and an imaging device having an imaging device that generates image data of the specimen via the observation optical system tables and input section, based on the instruction signal, and the partial region setting unit for setting a partial area, a partial image corresponding to the partial region in which the partial region setting unit has set for accepting input A display unit that, the pixel width of the image pickup device, wherein on the basis of the magnification ratio detecting unit detects and the partial area where the partial region setting unit has set, the moving amount of the stage driving unit moves the stage A movement amount calculation unit that calculates a movement direction, and a stage control unit that drives the stage driving unit based on the movement amount and movement direction calculated by the movement amount calculation unit, and the input unit includes: It is possible to accept an input of a visual field feed instruction signal instructing movement of the visual field of the imaging device in at least one of four directions of up, down, left, and right of the partial image, and the stage control unit includes: Each time an input of the visual field feed instruction signal is received, the movement amount calculation unit corresponds to the partial area based on the movement amount, the movement direction, and the partial area. The stage only fields of view is characterized in that to drive the stage driving unit to move.

  The microscope system according to the present invention is the imaging system according to the above invention, wherein at least a part of the field of view of the current imaging apparatus corresponding to the partial area set by the partial area setting unit moves the stage. A superimposing area setting unit for setting a superimposing area remaining in the field of view of the apparatus is further provided.

  In the above invention, the microscope system according to the present invention is connected to the eyepiece unit that forms an observation image of the specimen via the observation optical system, the imaging device, and the eyepiece unit, respectively. An optical path switching unit that switches an optical path of an optical system to either the imaging device or the eyepiece unit, and the movement amount calculation unit detects a pixel width of the imaging element and the magnification detection unit The movement amount and the movement direction are calculated based on the magnification, the partial area set by the partial area setting unit, and the optical path switched by the optical path switching unit.

  The microscope system according to the present invention further includes a reversal instruction unit that drives the stage control unit in a direction opposite to the movement direction calculated by the movement amount calculation unit in the above invention, The stage driving unit is driven based on the optical path switched by the optical path switching unit in accordance with an instruction from an inversion instruction unit.

  According to the microscope system of the present invention, the movement amount calculation unit is based on the magnification of the observation optical system detected by the magnification detection unit and the region for reading image data from the imaging device of the imaging device set by the partial region setting unit. The stage drive unit calculates the amount and direction of movement for moving the stage, and the stage control unit drives the stage drive unit with the amount of movement calculated by the movement amount calculation unit to move the stage. In the case of partially displaying image data obtained by the element, there is an effect that omission of observation of the specimen can be prevented when the specimen is screened.

FIG. 1 is a schematic diagram schematically showing a configuration of a microscope system according to Embodiment 1 of the present invention. FIG. 2 is a diagram illustrating an example of a display screen displayed by the display unit of the microscope system according to Embodiment 1 of the present invention. FIG. 3 is a flowchart showing an outline of processing executed by the microscope system according to Embodiment 1 of the present invention. FIG. 4A is a diagram illustrating an example of an image of the entire visual field generated by the imaging device of the imaging apparatus in the microscope system according to Embodiment 1 of the present invention. FIG. 4B is a diagram schematically showing the region of the image sensor set by the field-of-view range setting unit of the microscope system according to Embodiment 1 of the present invention. FIG. 5A is a diagram showing an example of an image before the stage of the microscope system according to Embodiment 1 of the present invention moves. FIG. 5B is a diagram showing an example of an image after the stage of the microscope system according to Embodiment 1 of the present invention has moved. FIG. 5C is a diagram showing an example of an image after the stage has moved from the situation of FIG. 5B. FIG. 6 is a diagram showing an example of another image displayed by the display unit of the microscope system according to Embodiment 1 of the present invention. FIG. 7 is a schematic diagram schematically showing the configuration of the microscope system according to the second embodiment of the present invention. FIG. 8 is a flowchart showing an outline of processing executed by the microscope system according to Embodiment 2 of the present invention. FIG. 9A is a diagram illustrating an example of a superimposition region set by the superimposition region setting unit of the microscope system according to Embodiment 2 of the present invention. FIG. 9B is a diagram showing another example of the overlapping area set by the overlapping area setting unit of the microscope system according to Embodiment 2 of the present invention. FIG. 9C is a diagram showing another example of the overlapping area set by the overlapping area setting unit of the microscope system according to Embodiment 2 of the present invention. FIG. 10 is a schematic diagram schematically showing the configuration of the microscope system according to the third embodiment of the present invention. FIG. 11 is a flowchart showing an outline of processing executed by the microscope system according to Embodiment 3 of the present invention. FIG. 12 is a schematic diagram showing a schematic configuration of the input unit according to the first modification of the first to third embodiments of the present invention. FIG. 13 is a schematic diagram illustrating a schematic configuration of the input unit according to the second modification of the first to third embodiments of the present invention.

  DESCRIPTION OF EMBODIMENTS Hereinafter, embodiments for carrying out the present invention (hereinafter referred to as “embodiments”) will be described with reference to the drawings. The present invention is not limited to the embodiments described below. The drawings referred to in the following description only schematically show the shape, size, and positional relationship so that the contents of the present invention can be understood. That is, the present invention is not limited only to the shape, size, and positional relationship illustrated in each drawing.

(Embodiment 1)
FIG. 1 is a schematic diagram schematically showing a configuration of a microscope system according to Embodiment 1 of the present invention. In FIG. 1, the plane on which the microscope system 1 is placed is described as an XY plane, and a direction perpendicular to the XY plane is described as a Z direction.

  A microscope system 1 illustrated in FIG. 1 includes a microscope apparatus 2 that observes a specimen SP, an imaging apparatus 3 that images the specimen SP through the microscope apparatus 2, and generates image data of the specimen SP. An input unit 4 that receives an operation input, a display unit 5 that displays an image corresponding to the image data generated by the imaging device 3, and a microscope control device 6 that comprehensively controls each unit of the microscope system 1 are provided.

  First, the configuration of the microscope apparatus 2 will be described. The microscope apparatus 2 includes a substantially C-shaped main body part 100, a stage mechanism 101 attached to the main body part 100, an objective lens 102 arranged to face the stage mechanism 101, and a plurality of objective lenses 102 having different magnifications. , A transmission illumination optical system 104 for irradiating light that passes through the specimen SP, an epi-illumination optical system 105 for irradiating the specimen SP with light, and a trinocular tube unit 106 attached to the main body 100. The eyepiece unit 107 attached via the trinocular tube unit 106 and the adapter unit 108 attached via the trinocular tube unit 106 for connecting the imaging device 3 to the microscope apparatus 2 are provided. In the first embodiment, the objective lens 102 and the adapter unit 108 constitute an observation optical system. The adapter unit 108 may be provided directly on the main body 100 without providing the trinocular tube unit 106 on the main body 100.

  The stage mechanism 101 includes a stage 101a configured to be movable in the horizontal direction within the XY plane, a stage driving unit 101b that moves the stage 101a within the XY plane, a position detection unit 101c that detects the position of the stage 101a, A stage control unit 101d for controlling the driving of the stage drive unit 101b.

  The stage driving unit 101b is configured using a stepping motor, an ultrasonic motor, or the like. The stage drive unit 101b moves the observation location (observation region) of the specimen SP by moving the stage 101a in the XY plane under the control of the stage control unit 101d.

  The position detection unit 101c is configured using a linear scale, a glass scale, a photo interrupter, or the like. The position detection unit 101c detects a predetermined origin position in the XY plane by an XY position origin sensor (not shown), and uses the origin position as a reference to determine the position (XY coordinates) related to the X position and the Y position of the stage 101a. 6 is output.

  The stage control unit 101d is configured using a CPU (Central Processing Unit) or the like. The stage control unit 101d controls the movement of the stage 101a by controlling the drive of the stage drive unit 101b in accordance with an instruction signal input from the input unit 4 via the microscope control device 6. Further, the stage control unit 101d is set with the movement amount and movement direction of the stage 101a calculated by the movement amount calculation unit 623 of the microscope control device 6 to be described later, and based on this movement amount and movement direction, the input from the input unit 4 is performed. The stage 101a is moved by driving the stage drive unit 101b according to the instruction signal.

  As the objective lens 102, a plurality of objective lenses having different magnifications (for example, a 50 × objective lens 102 a and a 100 × objective lens 102 b) are detachably attached to the revolver 103.

  The revolver 103 is provided so as to be rotatable with respect to the main body 100, and the objective lens 102 is disposed above the specimen SP. The revolver 103 changes the magnification of the image in the field of view by selectively switching the objective lens 102 used for observation of the specimen SP arranged on the observation optical path L by rotating. The revolver 103 holds a plurality of objective lenses 102 and is rotatable, a holding unit 103a, a revolver detection unit 103b that detects the type and magnification of the objective lens 102 arranged on the observation optical path L, and a holding unit 103a. And a revolver driving unit 103c that rotates the revolver.

  The revolver detection unit 103 b detects the type and magnification of the objective lens 102 arranged on the observation optical path L, and outputs the detection result to the microscope control device 6. The type and magnification of the objective lens 102 can be detected by manually inputting the type and magnification of the objective lens 102 used by the user via the input unit 4 in addition to the method using the revolver detection unit 103b. good.

  The revolver driving unit 103c is configured using a stepping motor, a DC motor, or the like. The revolver driving unit 103 c rotates the holding unit 103 a under the control of the microscope control device 6.

  The transmitted illumination optical system 104 includes a transmitted illumination light source 104a that emits transmitted illumination light, and various transmitted optical members 104b that collect and transmit the transmitted illumination light emitted by the transmitted illumination light source 104a in the direction of the observation optical path L. Have.

  The transmitted illumination light source 104a is configured by a halogen lamp, a xenon lamp, an LED (Light Emitting Diode), or the like. The transmitted illumination light source 104 a emits transmitted illumination light under the control of the microscope control device 6.

  The transmission optical member 104b includes a mirror, a collector lens, a filter unit, a field stop, a shutter, an aperture stop, a condenser optical element unit, a top lens unit, and the like.

  The epi-illumination optical system 105 includes an epi-illumination light source 105a that emits epi-illumination light, and various epi-illumination optical members 105b that collect the epi-illumination light emitted by the epi-illumination light source 105a and guide it in the direction of the observation optical path L. Have.

  The epi-illumination light source 105a includes a halogen lamp, a xenon lamp, an LED, or the like. The epi-illumination light source 105 a emits epi-illumination light under the control of the microscope control device 6.

  The incident optical member 105b is configured using a half mirror, a filter unit, a shutter, a field stop, an aperture stop, and the like.

  The trinocular tube unit 106 branches the observation light of the specimen SP incident from the objective lens 102 into the direction of the imaging device 3 and the direction of the eyepiece unit 107.

  The eyepiece unit 107 is for the user to directly observe the specimen SP. The eyepiece unit 107 is configured using an imaging lens or the like, and forms an observation image of the specimen via the objective lens 102.

  The adapter unit 108 has the main body 100 connected to one side and the imaging device 3 connected to the other. A variable power lens is provided inside the adapter unit 108. The adapter unit 108 also has a zoom detection unit 108a that detects the magnification of the variable power lens. In the first embodiment, the zoom detection unit 108a and the revolver detection unit 103b function as a magnification detection unit.

  Next, the imaging device 3 will be described. The imaging device 3 receives the observation light of the sample SP incident through the adapter unit 108 and performs photoelectric conversion, thereby arranging a plurality of pixels that convert the light into an electrical signal (analog signal) in a two-dimensional manner. An image sensor 31 such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor) and an electric signal output from the image sensor 31 are subjected to signal processing such as amplification (gain) and then A / D conversion. And a signal processing unit (not shown) that converts the image data into digital sample SP image data and outputs the image data to the microscope control device 6. Under the control of the microscope control device 6, the imaging device 3 captures an observation image of the specimen SP that is a subject incident through the adapter unit 108 and continuously captures the image data of the specimen SP at a minute time interval. Generate.

  Next, the input unit 4 will be described. The input unit 4 is configured using input devices such as a keyboard, a mouse, and various switches. The input unit 4 outputs an operation signal corresponding to an operation received by various input devices to the microscope control device 6.

  Next, the display unit 5 will be described. The display unit 5 displays an image corresponding to the image data generated by the imaging device 3 via the microscope control device 6 and various operation information of the microscope system 1. The display unit 5 is configured using a display panel made of liquid crystal or organic EL (Electro Luminescence). A touch panel that detects a contact position of an object from the outside and outputs a detection signal corresponding to the detected position to the microscope control device 6 may be provided on the display screen of the display unit 5 in an overlapping manner.

  Here, the operation screen displayed on the display unit 5 will be described in detail. FIG. 2 is a diagram illustrating an example of an operation screen displayed on the display unit 5.

  As shown in FIG. 2, the operation screen W1 displayed by the display unit 5 includes a live image display area W11, a stage operating range display area W12, a shooting instruction area W13, an exposure change area W14, and a partial image display area W15. A setting area W16, an objective lens changing area W17, an observation method changing area W18, and a movement instruction area W19.

  The live image display area W11 sequentially displays live images (images corresponding to the entire visual field area of the imaging device 3) corresponding to the image data of the specimen SP continuously generated by the imaging device 3. Further, the live image display area W11 displays the live image LV1 by superimposing a frame R1 corresponding to an area in which the image data obtained by the image sensor 31 of the imaging device 3 is partially displayed.

  The stage operating range display area W12 displays a range in which the stage 101a can be operated, and displays a live image LV1 in an area corresponding to the current position of the stage 101a.

  The shooting instruction area W13 receives an input of an instruction signal that instructs the imaging device 3 to perform shooting. Specifically, in the shooting instruction area W13, when the user operates the mouse or the like of the input unit 4, the mouse pointer A1 is moved onto the snap W131 of the shooting instruction area W13 to perform a drag operation (hereinafter referred to as “drag operation”). The input of an instruction signal for instructing photographing is accepted. Note that the shooting instruction area W13 has an area for receiving input of instruction signals such as live shooting, focus adjustment, and moving image shooting.

  The exposure change area W14 receives an input of an instruction signal for changing the exposure of the imaging device 3. Specifically, when the user operates the mouse or the like of the input unit 4 to move the mouse pointer A1 onto the exposure change area W14 and perform the drag operation, the exposure time of the imaging device 3 or An input of an instruction signal for instructing a change in gain or the like is received. Note that the exposure change area W14 has an area for selecting an instruction to execute time lapse and an intermittent time lapse time.

  The partial image display area W15 generates a partial image LV2 in which the image data obtained by the imaging element 31 of the imaging device 3 is partially displayed.

  The area setting area W16 receives an input of an instruction signal for changing an area (resolution) for partially displaying image data obtained by the image sensor 31 of the imaging device 3. Specifically, when the user operates the mouse of the input unit 4 or the like, the mouse pointer A1 is moved onto the region setting region W16 and the region is selected by performing a drag operation, whereby the image sensor of the imaging device 3 is selected. An input of an instruction signal for setting an area for reading image data from 31 is received. Here, the region in which the image data obtained by the imaging device 31 of the imaging device 3 is partially displayed is a range in which image data obtained from a plurality of pixels constituting the imaging device 31 is partially displayed. .

  The objective lens changing area W17 receives an input of an instruction signal that instructs to change the magnification of the objective lens 102. Specifically, the user operates the mouse or the like of the input unit 4 to move the mouse pointer A1 onto the objective lens changing area W17 and perform a drag operation to select the magnification of the objective lens 102, thereby the objective. An instruction signal for instructing the change of the lens 102 is received.

  The observation method change area W18 receives an input of an instruction signal that instructs to change the observation method of the microscope apparatus 2. Specifically, the user operates the mouse or the like of the input unit 4 to move the mouse pointer A1 onto the observation method change area W18 and perform a drag operation to select an observation method. An instruction signal to change the observation method is received.

  The movement instruction area W19 receives an input of an instruction signal for instructing movement of the stage 101a. Specifically, when the user operates the mouse or the like of the input unit 4, the mouse pointer A1 is moved onto the movement direction screen W191 of the movement instruction area W19, and the drag operation is performed to select the stage 101a. An input of an instruction signal for instructing movement is received. Further, the movement instruction area W191 includes a normal movement area 191a that receives an input of an instruction signal instructing a normal movement of the stage 101a, and a high-speed movement that receives an input of an instruction signal instructing a higher-speed movement than the normal movement area switch 191a. And a region 191b. Furthermore, the movement instruction area W19 includes a field-of-view feeding area 193 that receives an instruction signal for instructing the field-of-view feeding of the imaging apparatus 3 by moving the stage 101a. In FIG. 2, the field-of-view feeding region 193 has only four directions in the vertical and horizontal directions, but may be eight directions including an oblique direction, for example.

  In the operation screen W1 configured as described above, the user operates the mouse or the like of the input unit 4 to move the mouse pointer A1 to a desired position, perform a drag operation, and select a desired operation. The microscope system 1 is operated.

Returning to FIG. 1, the description of the configuration of the microscope system 1 will be continued.
The microscope control device 6 includes a recording unit 61 that records various information related to the microscope system 1 and a control unit 62 that comprehensively controls the operation of each unit constituting the microscope system 1.

  The recording unit 61 is configured using a semiconductor memory such as a flash memory and a RAM (Random Access Memory). The recording unit 61 records various programs to be executed by the microscope system 1, various data used during the execution of the programs, and image data generated by the imaging device 3. The recording unit 61 temporarily records information being processed by the control unit 62.

  The control unit 62 is configured using a CPU or the like, and controls the operation of the microscope system 1 by transferring data, instructing, and the like corresponding to each unit constituting the microscope system 1 in accordance with an operation signal received by the input unit 4. Control.

  Here, a detailed configuration of the control unit 62 will be described. The control unit 62 includes a magnification calculation unit 621, a partial region setting unit 622, a movement amount calculation unit 623, a movement amount setting unit 624, and a display control unit 625.

  The magnification calculator 621 calculates the total magnification of the microscope apparatus 2 based on the magnification of the objective lens 102 detected by the revolver detector 103b and the magnification of the variable power lens of the adapter unit 108 detected by the zoom detector 108a.

  The partial area setting unit 622 sets an area for reading image data from the image sensor 31 based on the instruction signal input from the input unit 4. Specifically, the partial region setting unit 622 sets a region for reading image data (electrical signal) from a plurality of pixels constituting the image sensor 31 based on the instruction signal input from the input unit 4.

  The movement amount calculation unit 623 is based on the width (pixel pitch) of one pixel of the image sensor 31, the total magnification calculated by the magnification calculation unit 621, and the region of the image sensor 31 set by the partial region setting unit 622. The movement amount and movement direction of the stage 101a when the stage 101a is moved are calculated in response to one instruction signal from. In the following, the width of one pixel of the image sensor 31 is assumed to be 1: 1 in the aspect ratio.

Here, the movement amount calculated by the movement amount output unit 623 will be described in detail.
The movement amount calculated by the movement amount calculation unit 623 is as follows.
(1) When the optical path is not switched The number of pixels of the entire field of view of the image sensor 31 is 1000 × 800 (pixels), the pixel pitch of the image sensor 31 is 5 μm / pixel, and the magnification of the objective lens 102 is 10 times. When the magnification of the adapter unit 108 is 0.5 times, the total magnification is 10 × 0.5 = 5 times.

Next, when the overlap region is 20% in the horizontal direction and 20% in the vertical direction, the stage movement amount by the button operation in the entire visual field of the image sensor 31 is as follows.
Horizontal direction = number of horizontal pixels × pixel pitch / total magnification × (1−overlap region)
Vertical direction = number of vertical pixels × pixel pitch / total magnification × (1−overlap region)
Specifically:
<Button operation>
Lateral direction = 1000 × 5/5 × (1-0.2) = 800 μm
Longitudinal direction = 800 × 5/5 × (1-0.2) = 640 μm
As described above, the stage control unit 101d determines that when the upper direction button of the movement direction image W191 is clicked by one click, the upward direction is 640 μm, when the lower direction button is clicked by one, the downward direction is 640 μm, and the left direction button is one. When clicked, the stage 101 is controlled to move to the left and when the right button is clicked once, the stage 101 is moved to the right by 800 μm.

<Partial display size setting>
Set the partial display size as follows.
Partial display size: 800 x 600 (pixels)
Overlap area: 20% horizontal, 20% vertical
The amount of stage movement when the above setting is made is as follows.

<Button operation>
Horizontal direction: 800 × 5/5 × (1−0.2) = 640 μm
Horizontal direction * 600 × 5/5 × (1-0.2) = 480 μm

  As described above, the stage control unit 101d, when partially displayed, when the upper direction button of the moving direction image W191 is clicked once, 480 μm upward, and when the lower direction button is clicked one time, 480 μm downward. When the left button is clicked, the stage 101 is controlled to move 640 μm in the left direction, and when the right button is clicked, the stage 101 is controlled to move 640 μm in the right direction.

(2) When switching the optical path When the optical path is switched from the imaging device 3 to the eyepiece unit 107, the stage movement amount is switched to the movement amount for the eyepiece unit 107 (eyepiece). When the total field-of-view pixel number of the imaging device 3 is 1000 × 800 (pixels), the pixel pitch of the imaging device 31 is 5 μm / pixel, and the magnification of the objective lens 101 is 10 times, the optical path does not pass through the adapter unit 108. Therefore, the total magnification is 10 times the same as the magnification of the objective lens 102.

Next, when the overlap region is 20% in the horizontal direction and 20% in the vertical direction, the stage movement amount in the entire visual field of the image sensor 31 is as follows.
Horizontal direction = number of horizontal pixels × pixel pitch / total magnification × (1−overlap region)
Vertical direction = number of vertical pixels × pixel pitch / total magnification × (1−overlap region)
Specifically:
<Button operation>
Horizontal direction: 1000 × 5/10 × (1-0.2) = 400 μm
Longitudinal direction: 800 × 5/10 × (1-0.2) = 320 μm
As described above, the stage control unit 101d determines that when the upper direction button of the movement direction image W191 is clicked by one click, the upward direction is 320 μm, when the lower direction button is clicked by one, the downward direction is 320 μm, and the left direction button is one. When clicked, control is performed so that the stage 101 is moved by 400 μm in the left direction and when the right button is clicked once, the stage 101 is moved by 400 μm in the right direction.

Returning to FIG. 1, the description of the configuration of the microscope system 1 will be continued.
The movement amount setting unit 624 sets the movement amount and movement direction calculated by the movement amount calculation unit 623 in the stage control unit 101d.

  The display control unit 625 displays an image corresponding to the image data generated by the imaging device 3 on the display unit 5. In addition, the display control unit 625 causes the display unit 5 to display various information related to the microscope system 1 and the above-described operation screen W1 of FIG.

  Processing executed by the microscope system 1 having the above configuration will be described. FIG. 3 is a flowchart showing an outline of processing executed by the microscope system 1.

  As shown in FIG. 3, first, the magnification calculator 621 calculates the total magnification of the microscope apparatus 2 (step S101). Specifically, the magnification calculator 621 is configured to select a microscope based on the magnification of the objective lens 102 arranged on the observation optical path L detected by the revolver detector 103b and the magnification of the adapter unit 108 detected by the zoom detector 108a. The total magnification of the device 2 is calculated.

  Subsequently, when an instruction signal for instructing a change in the magnification of the objective lens 102 is input from the input unit 4 and the magnification of the objective lens 102 is changed (step S102: Yes), the microscope system 1 returns to step S101. On the other hand, when the instruction signal for instructing the change of the magnification of the objective lens 102 is not input from the input unit 4 (step S102: No), the microscope system 1 proceeds to step S103.

  In step S103, when an instruction signal for changing a region for reading image data from the image sensor 31 is input from the input unit 4 (step S103: Yes), the partial region setting unit 622 displays the image data obtained by the image sensor 31. An area for partially displaying is set (step S104). Specifically, as shown in FIGS. 4A and 4B, the partial region setting unit 622 is configured to input the input unit 4 when the region for displaying the image data obtained by the image sensor 31 is the entire range (full visual field range). When an area for partial display is designated, an area R1 for partially displaying image data obtained by the image sensor 31 is set in the designated area (FIG. 4A → FIG. 4B). As a result, the data area of the image data can be reduced compared to the case where the image data is displayed for the entire visual field range from the entire visual field range, so that the frame rate can be increased, and the display unit 5 The displayed image can be smoothed. Furthermore, compared with the case where image data is read from the entire visual field range and the entire visual field range is displayed, image data free from shading and curvature can be displayed, so that the specimen SP is screened with a clear image. be able to. After step S104, the microscope system 1 proceeds to step S105.

  In step S103, when the instruction signal for changing the partial capture region of the image sensor 31 is not input from the input unit 4 (step S103: No), the microscope system 1 proceeds to step S105.

  Subsequently, the movement amount calculation unit 623 takes an image from the image pickup device 31 set by the width of one pixel of the image pickup device 31 of the image pickup device 3, the total magnification of the microscope device 2 calculated by the magnification calculation unit 621 and the partial region setting unit 622. The amount of movement of the stage 101a is calculated based on the data reading area (step S105). Since the calculation method of the movement amount calculation unit 623 has been described in the above paragraphs [0056] to [0062], detailed description thereof will be omitted.

  Thereafter, the movement amount setting unit 624 sets the movement amount calculated by the movement amount calculation unit 623 in the stage control unit 101d (step S106).

  Subsequently, when an instruction signal for instructing the movement of the stage 101a is input from the input unit 4 (step S107: Yes), the stage control unit 101d performs the stage based on the movement amount set by the movement amount setting unit 624. The drive unit 101b is driven to move the stage 101a (step S108). Specifically, as illustrated in FIGS. 5A to 5C, the stage control unit 101 d drives the stage driving unit 101 b based on the movement amount and movement direction set by the movement amount setting unit 624, thereby increasing 1 Each time the operation is performed, the stage 101a is moved in the XY directions so that the areas for partially displaying the image data obtained by the image sensor 31 are adjacent (FIG. 5A → FIG. 5B → FIG. 5C). Thereby, when partially displaying the image data obtained by the image sensor 31, when the specimen SP is screened, the visual field range observed by the user is smoothly transitioned while the observation failure of the specimen SP is prevented. be able to. After step S108, the microscope system 1 proceeds to step S109.

  In step S107, when an instruction signal for instructing movement of the stage 101a is not input from the input unit 4 (step S107: No), the microscope system 1 proceeds to step S109.

  Subsequently, when an instruction signal for ending the observation of the specimen SP is input from the input unit 4 (step S109: Yes), the microscope system 1 ends this process. On the other hand, when the instruction signal for ending the observation of the specimen SP is not input from the input unit 4 (step S109: No), the microscope system 1 returns to step S101.

  According to the first embodiment of the present invention described above, the movement amount calculation unit 623 calculates the pixel width (pixel pitch) of the image sensor 31 of the imaging device 3 and the total magnification of the microscope apparatus 2 calculated by the magnification calculation unit 621. The movement amount calculation unit 623 calculates a movement amount and a movement direction for moving the stage 101a based on the region for displaying the image data obtained by the imaging element 31 of the imaging device 3 set by the partial region setting unit 622. The movement amount setting unit 624 sets the movement amount and the movement direction calculated by the movement amount calculation unit 623, and the stage control unit 101d sets the stage driving unit 101b in the movement amount and movement direction set by the movement amount setting unit 624. To move the stage 101a. As a result, in the case where the partial display of the image data obtained by the image sensor 31 of the imaging device 3 is performed, when the specimen SP is screened while moving the stage 101a, the observation failure of the specimen SP is surely prevented. be able to.

  In the first embodiment of the present invention, the image data obtained by the image sensor 31 is partially displayed. For example, as shown in FIG. 6, the image data corresponds to the image data generated by the image sensor 31. The present invention can be applied even when electronic zoom processing (trimming processing) is performed in an image. In this case, the display control unit 625 causes the area corresponding to the electronic zoom process to be superimposed and displayed on the live image LV1 corresponding to the image data generated by the imaging element 31 with the frame R2. Further, the movement amount calculation unit 623 is configured based on the total magnification of the microscope apparatus 2 calculated by the magnification calculation unit 621, the width of one pixel (pixel pitch) of the image sensor 31, and the electronic zoom magnification obtained by the electronic zoom process. The amount of movement and the direction of movement are calculated. Thereby, in the case where partial display is performed on an image captured by the imaging apparatus 3, when the stage 101a is moved, the stage 101a can be moved to an observation position desired by the user.

  In the first embodiment of the present invention, the image data obtained by the image sensor 31 is partially displayed. For example, the image data generated by the image sensor 31 is partially read to correspond to the image data. A partial image may be displayed.

  In Embodiment 1 of the present invention, when a joystick is used as the input unit 4, the stage control unit 101d may adjust the moving amount and moving direction of the stage 101a step by step according to the tilt angle of the joystick. . In this case, the stage control unit 101d may limit the amount of movement that can be received in one operation.

  In the first embodiment of the present invention, the vertical direction and the horizontal direction are described, but the same can be said even if the operation is performed in an oblique direction. With respect to the diagonal operation, the operational feeling is that the vertical direction and the horizontal direction are operated simultaneously.

(Embodiment 2)
Next, a second embodiment of the present invention will be described. In this Embodiment 2, the structure of the microscope control apparatus 6 of the microscope system 1 which concerns on Embodiment 1 mentioned above differs, and the process to perform differs. Specifically, in the microscope system according to the second embodiment, in the case where the stage moves, an area in which image data obtained by the current image sensor is partially displayed and the field of view of the imaging apparatus after the stage is moved The movement amount of the stage is set so that at least a part of the stage overlaps. For this reason, below, after demonstrating the structure of the microscope system which concerns on this Embodiment 2, the process which the microscope system which concerns on this Embodiment 2 performs is demonstrated. In addition, the same code | symbol is attached | subjected to the structure same as the microscope system 1 which concerns on Embodiment 1 mentioned above, and description is abbreviate | omitted.

  FIG. 7 is a schematic diagram schematically showing the configuration of the microscope system according to the second embodiment. A microscope system 1a illustrated in FIG. 7 includes a microscope device 2, an imaging device 3, an input unit 4, a display unit 5, and a microscope control device 6a that comprehensively controls each unit of the microscope system 1a.

  The microscope control device 6a includes a recording unit 61 and a control unit 62a that comprehensively controls each unit of the microscope system 1a.

  Here, a detailed configuration of the control unit 62a will be described. The control unit 62 a includes a magnification calculation unit 621, a partial region setting unit 622, a movement amount calculation unit 623, a movement amount setting unit 624, a display control unit 625, and a superimposition region setting unit 626.

  When the stage 101a is moved in accordance with the instruction signal input from the input unit 4, the overlapping area setting unit 626 overlaps areas where image data obtained by the image sensor 31 before and after the stage 101a is moved are displayed. Set the overlap area. Specifically, when the stage 101a moves, the overlapping area setting unit 626 has moved the stage 101a by at least a part of the current field of view of the imaging device 3 corresponding to the area set by the partial area setting unit 622. A superimposition region that remains in the field of view of the subsequent imaging device 3 is set.

  Processing executed by the microscope system 1a having the above configuration will be described. FIG. 8 is a flowchart showing an outline of processing executed by the microscope system 1a.

  In FIG. 8, steps S201 to S204 correspond to steps S101 to S104 in FIG.

  In step S205, when an instruction signal instructing a superimposition amount (overlap amount) is input from the input unit 4 (step S205: Yes), the superimposition region setting unit 626 responds to the instruction signal input from the input unit 4. Thus, before and after the stage 101a moves, an overlapping area is set in which areas where image data obtained by the image sensor 31 are displayed overlap each other (step S206). Specifically, the overlap region setting unit 626 moves the stage 101a by moving at least a part of the current field of view of the imaging device 3 corresponding to the region set by the partial region setting unit 622, for example, a range from the field of view is 20%. The range remaining in the field of view of the image pickup apparatus 3 after that is set. More specifically, as shown in FIG. 9A or 9B, a superimposition region K1 and a superimposition region K2 in which regions where image data obtained by the image sensor 31 are displayed overlap each other before and after the stage 101a moves are set. After step S206, the microscope system 1a proceeds to step S207.

  In step S205, when the instruction signal for instructing the superposition amount is not input from the input unit 4 (step S205: No), the microscope system 1a proceeds to step S207.

  Subsequently, the movement amount calculation unit 623 displays the image data obtained by the imaging device 31 set by the partial magnification setting unit 622 and the total magnification of the microscope apparatus 2 calculated by the magnification calculation unit 621. The moving amount and moving direction of the stage 101a are calculated based on the region to be performed and the overlapping amount set by the overlapping region setting unit 626 (step S207). Specifically, as shown in FIG. 9A, FIG. 9B, or FIG. 9C, the movement amount calculation unit 623 calculates the movement amount and movement direction of the stage 101a.

  For example, in FIG. 9A, the stage control unit 101d moves the stage 101 by 4 in the X direction and 3 by 3 in the Y direction every time the movement button is pressed by the user. This is because every time the right button is pressed, 4 is pushed in the right direction, every time the left button is pushed, 4 is pushed in the left direction, and every time the up button is pushed, 3 is pushed up, and the lower button is pushed. This is to control the stage 101 to move 3 downwards each time.

  In FIG. 9B, each time the movement button is pressed by the user, the stage control unit 101 moves 4 in the X direction and 1 in the Y direction.

  In FIG. 9C in the case of being vertically long, the stage control unit 101 moves the stage 101 by 1 in the X direction and 4 in the Y direction each time the movement button is pressed.

  In this way, the movement amount calculation unit 623 separately calculates the movement amount in the X and Y directions, and the stage control unit 101d determines the movement amount and movement direction of the stage 101 based on the calculation result by the movement amount calculation unit 623. Control. After step S207, the microscope system 1a proceeds to step S208.

  Steps S208 to S211 respectively correspond to steps S105 to S109 of FIG. 3 described above.

  According to the second embodiment of the present invention described above, by moving the stage 101a while superimposing the field of view of the image being partially displayed from the image data generated by the imaging device 3 before and after the movement of the stage 101a, Since the connection of the specimen SP before and after the movement of the stage 101a can be easily grasped, the operability when screening the specimen SP can be improved.

  Further, according to the second embodiment of the present invention, in the case where the partial display of the image data obtained by the imaging device 31 of the imaging device 3 is being performed, when the specimen SP is screened, the observation failure of the specimen SP is eliminated. It can be surely prevented.

(Embodiment 3)
Next, a third embodiment of the present invention will be described. In the third embodiment, the configuration of the microscope apparatus 2 and the microscope control apparatus 6 of the microscope system 1 according to the first embodiment described above is different, and the processing to be executed is different. Specifically, the microscope system according to the third embodiment moves the stage by inverting the moving direction of the stage according to the optical path. For this reason, below, after demonstrating the structure of the microscope system which concerns on this Embodiment 3, the process which the microscope system which concerns on this Embodiment 3 performs is demonstrated. In addition, the same code | symbol is attached | subjected to the structure same as the microscope system 1 which concerns on Embodiment 1 mentioned above, and description is abbreviate | omitted.

  FIG. 10 is a schematic diagram schematically showing the configuration of the microscope system according to the third embodiment. A microscope system 1b shown in FIG. 10 includes a microscope apparatus 2b for observing the specimen SP, an imaging apparatus 3, an imaging apparatus 7 for imaging the specimen SP through the microscope apparatus 2b, and generating image data of the specimen SP, and an input A unit 4, a display unit 5, and a microscope control device 6 b that comprehensively controls each unit of the microscope system 1 b are provided.

  First, the configuration of the microscope apparatus 2b will be described. The microscope apparatus 2b includes a main body 100, a stage mechanism 101, an objective lens 102, a revolver 103, a transmission illumination optical system 104, an epi-illumination optical system 105, an adapter unit 108, and an optical path of observation light of the specimen SP. Is provided with an optical path switching unit 109 that switches between the imaging device 3 and the imaging device 7 and an adapter unit 110 that is attached via the optical path switching unit 109 and connects the imaging device 7 to the microscope apparatus 2b.

  The optical path switching unit 109 switches the observation light of the specimen SP to either the imaging device 3 or the imaging device 7 under the control of the microscope control device 6b. Specifically, the optical path switching unit 109 transmits the observation light of the specimen SP to the imaging device 3 under the control of the microscope control device 6b. The optical path switching unit 109 reflects the observation light of the sample SP to the imaging device 7 under the control of the microscope control device 6b. The optical path switching unit 109 is configured using a drive unit such as a variable mirror or a motor.

  The adapter unit 110 is connected to the optical path switching unit 109 on one side and the imaging device 7 on the other side. A variable power lens is provided inside the adapter unit 110. The adapter unit 110 also includes a zoom detection unit 110a that detects the magnification of the variable power lens. In the first embodiment, the zoom detection unit 110a, the zoom detection unit 108a, and the revolver detection unit 103b function as a magnification detection unit.

  Next, the configuration of the imaging device 7 will be described. The imaging device 7 has the same configuration as the imaging device 3 described above, and includes an imaging element 71 that receives the observation light of the sample SP and performs photoelectric conversion to generate image data of the sample SP. The imaging device 7 images the sample SP and generates image data of the sample SP under the control of the microscope control device 6b.

  Next, the configuration of the microscope control device 6b will be described. The microscope control device 6b includes a recording unit 61 and a control unit 62b that comprehensively controls each unit of the microscope system 1b.

  The control unit 62b includes a magnification calculation unit 621, a partial region setting unit 622, a movement amount calculation unit 623, a movement amount setting unit 624, a display control unit 625, an optical path switching control unit 627, and an optical path determination unit 628. , An image reversing unit 629 and a reversal instructing unit 700.

  When an instruction signal for switching the observation optical path L of the microscope apparatus 2b is input from the input unit 4, the optical path switching control unit 627 drives the optical path switching unit 109 so that the observation light of the sample SP enters the imaging apparatus 3 or Switch to either one of the imaging devices 7.

  The optical path determination unit 628 determines the observation optical path L switched by the optical path switching control unit 627. For example, the optical path determination unit 628 determines the destination of the observation light of the sample SP by detecting the state of the variable mirror of the optical path switching unit 109.

  The image inversion unit 629 inverts an image corresponding to the image data generated by the imaging device 7 and causes the display unit 5 to display the image.

  The inversion instruction unit 700 drives the stage control unit 101d in the direction opposite to the movement direction instructed by the movement amount setting unit 624.

  Processing executed by the microscope system 1b having the above configuration will be described. FIG. 11 is a flowchart showing an outline of processing executed by the microscope system 1b.

  As shown in FIG. 11, first, the optical path determination unit 628 determines the optical path of the observation light of the sample SP (step S301).

  Subsequently, when an instruction signal for switching the optical path of the observation light of the sample SP is input from the input unit 4 (step S <b> 302: Yes), the optical path switching control unit 627 drives the optical path switching unit 109 to output from the input unit 4. The optical path is switched according to the input instruction signal (step S303). After step S303, the microscope system 1b returns to step S301.

  In step S302, when the instruction signal for switching the optical path of the observation light of the specimen SP is not input from the input unit 4 (step S302: No), the microscope system 1b proceeds to step S304.

  Steps S304 to S309 correspond to steps S101 to S106 of FIG. 3 described above, respectively.

  In step S410, when the image is reversed (step S410: Yes), the movement amount setting unit 624 sets the reversal of the movement direction with respect to the stage control unit 101d (step S411). After step S411, the microscope system 1b proceeds to step S412.

  In step S410, when the image is not reversed (step S410: No), the microscope system 1a proceeds to step S412.

  Steps S412 to S414 correspond to steps S107 to S109 of FIG. 3 described above, respectively.

  According to the third embodiment of the present invention described above, the moving amount setting unit 624 reverses the moving direction of the stage 101a according to the optical path and sets it to the stage control unit 101d, so that the image displayed on the display unit 5 is displayed. When operating the stage 101a through the input unit 4 while watching, the user can perform an intuitive operation.

  In the third embodiment of the present invention, the imaging device 3 and the imaging device 7 are connected to the optical path switching unit 109, respectively, but the present invention can be changed even if one is changed to an eyepiece (eyepiece unit 107). Can be applied.

(Other embodiments)
In the present invention, a microscope system including a microscope device, an imaging device, a display unit, an input unit, and a microscope control device has been described as an example. For example, an objective lens for enlarging a specimen, and an imaging function for imaging a specimen via the objective lens The present invention can also be applied to an imaging device having a display function for displaying an image, such as a video microscope.

  In the present invention, the upright microscope apparatus has been described as an example of the microscope apparatus, but the present invention can be applied to an inverted microscope apparatus, for example. Furthermore, the present invention can be applied to various systems such as a line apparatus incorporating a microscope apparatus.

  Moreover, in this invention, as shown in FIG. 12, the operation input part 4a comprised using various buttons as an operation input part may be sufficient. The user can move the stage by an intuitive operation by operating a desired button. The stage operation input unit 4a and the operation screen displayed on the display unit may be used in combination.

  In the present invention, as shown in FIG. 13, an operation input unit 4b such as a joystick or a jog dial may be used as the stage operation input unit. For example, in the case of a joystick, it is driven so as to limit the amount of movement when operated once, and in the case of a jog dial, it is driven so as to limit the amount of movement after one rotation. Further, when the field of view of the imaging apparatus is to be performed, the joystick lever is largely tilted in the direction in which the field of view is to be performed. Also, when moving the stage, the joystick lever is tilted slightly.

  In the present invention, the display unit, the input unit, and the microscope control device are separately configured. However, for example, a portable terminal in which the display unit, the input unit, and the microscope control device are integrally formed may be used.

  In the description of the flowchart in the present specification, the context of the processing between steps is clearly indicated using expressions such as “first”, “after”, “follow”, etc., in order to implement the present invention. The order of processing required is not uniquely determined by their representation. That is, the order of processing in the flowcharts described in this specification can be changed within a consistent range.

  As described above, the present invention can include various embodiments not described herein, and various design changes and the like can be made within the scope of the technical idea specified by the claims. Is possible.

1, 1a, 1b Microscope system 2, 2b Microscope device 3, 7 Imaging device 4 Input unit 5 Display unit 6, 6a, 6b Microscope control device 31, 71 Imaging device 61 Recording unit 62, 62a, 62b Control unit 100 Main body unit 101 Stage mechanism 101a Stage 101b Stage drive unit 101c Position information detection unit 101d Stage control unit 102 Objective lens 103 Revolver 103a Revolver holding unit 103b Revolver detection unit 104 Transmission illumination optical system 105 Incident illumination optical system 106 Trinocular tube unit 107 Eyepiece unit 108 , 110 Adapter unit 109 Optical path switching unit 621 Magnification calculating unit 622 Partial region setting unit 623 Movement amount calculating unit 624 Movement amount setting unit 625 Display control unit 626 Superimposition region setting unit 627 Optical path switching control unit 628 Optical path determination unit 6 9 image inversion section 700 inverted instruction unit SP specimen

Claims (4)

A stage on which a specimen can be placed and moved horizontally,
A stage drive for moving the stage;
An observation optical system for observing the specimen, having an objective lens arranged at least facing the stage;
A magnification detector for detecting the magnification of the observation optical system;
An imaging device having an imaging element in which a plurality of pixels that perform photoelectric conversion are arranged two-dimensionally and that generates image data of the sample via the observation optical system;
An input unit that receives an input of an instruction signal that designates a partial region in which the image data obtained by the image sensor is partially displayed;
Based on the instruction signal, and the partial region setting unit that sets the partial area,
A display unit for displaying a partial image corresponding to the partial region set by the partial region setting unit;
Based on the pixel width of the image sensor, the magnification detected by the magnification detection unit, and the partial area set by the partial area setting unit, the amount and direction of movement by which the stage drive unit moves the stage are calculated. A movement amount calculation unit to perform,
A stage control unit that drives the stage drive unit based on the movement amount and the movement direction calculated by the movement amount calculation unit;
Equipped with a,
The input unit is capable of receiving an input of a visual field feed instruction signal instructing movement of the visual field of the imaging device in at least one of four directions of up, down, left and right of the partial image;
The stage control unit responds to the partial area based on the movement amount, the movement direction, and the partial area calculated by the movement amount calculation unit each time the input unit receives the input of the visual field advance instruction signal. A microscope system , wherein the stage driving unit is driven so that the stage moves only for one visual field .   A superimposing region setting unit that sets a superimposing region that remains in the visual field of the imaging device after at least a part of the current visual field of the imaging device corresponding to the partial region set by the partial region setting unit is moved. The microscope system according to claim 1, further comprising: An eyepiece that forms an observation image of the specimen via the observation optical system;
An optical path switching unit that is connected to each of the imaging device and the eyepiece, and switches the optical path of the observation optical system to either the imaging device or the eyepiece;
Further comprising
The movement amount calculation unit is based on the pixel width of the image sensor, the magnification detected by the magnification detection unit, the partial region set by the partial region setting unit, and the optical path switched by the optical path switching unit. The microscope system according to claim 1, wherein the movement amount and the movement direction are calculated. A reversal instructing unit that drives the stage control unit in a direction opposite to the moving direction calculated by the moving amount calculating unit;
The microscope system according to claim 3, wherein the stage control unit drives the stage driving unit based on an instruction from the inversion instruction unit and the optical path switched by the optical path switching unit.

Images