US20120293864A1 - Microscope system - Google Patents

Microscope system Download PDF

Info

Publication number
US20120293864A1
US20120293864A1 US13/562,855 US201213562855A US2012293864A1 US 20120293864 A1 US20120293864 A1 US 20120293864A1 US 201213562855 A US201213562855 A US 201213562855A US 2012293864 A1 US2012293864 A1 US 2012293864A1
Authority
US
United States
Prior art keywords
image
sample
unit
switching
driving
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US13/562,855
Inventor
Hideyuki Kawanabe
Tetsuya Shirota
Yasuko Ishii
Takashi Yoneyama
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Olympus Corp
Original Assignee
Olympus Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from JP2008111538A external-priority patent/JP5305719B2/en
Application filed by Olympus Corp filed Critical Olympus Corp
Priority to US13/562,855 priority Critical patent/US20120293864A1/en
Publication of US20120293864A1 publication Critical patent/US20120293864A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/62Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
    • G01N21/63Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
    • G01N21/64Fluorescence; Phosphorescence
    • G01N21/645Specially adapted constructive features of fluorimeters
    • G01N21/6456Spatial resolved fluorescence measurements; Imaging
    • G01N21/6458Fluorescence microscopy
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/24Base structure
    • G02B21/241Devices for focusing
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/36Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements
    • G02B21/361Optical details, e.g. image relay to the camera or image sensor
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/36Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements
    • G02B21/365Control or image processing arrangements for digital or video microscopes

Definitions

  • the present invention relates to a microscope system that is capable of observing a minute specimen (sample) while magnifying various parts of the specimen, and more particularly, the present invention relates to a microscope system comprising an image capturing unit for capturing the observed image of the specimen, and a detection unit for detecting the driving status of various optical members for switching observation methods and the driving status of the stage for the specimen or the driving status of the objective lens.
  • microscopes have been used for research and tests in various fields including the industrial field as well as the field of biology.
  • Observation methods used in microscope apparatuses include a method for observing slight fluorescence emitted from a specimen (hereinafter, the method may be referred to simply as “fluorescence observation”).
  • the fluorescence observation generally utilizes a light source such as a mercury lamp or a xenon lamp.
  • the light from the source are collected and applied to the specimen.
  • the illumination light may have to be applied to the specimen intensely in some cases, since fluorescence emitted from some specimens is very weak. In such cases, however, the continued application of the intense illumination light to the specimen may result in a phenomenon called “discoloration”, in which the illuminated part of the specimen is damaged by the intense light and no longer emits the fluorescence.
  • Patent Document 1 Japanese Patent Application Publication No. 2005-195940 proposes a fluorescence microscope configured to be synchronized with the exposure time of a camera for capturing the images of specimens, and to turn the illumination light off when the camera is not capturing images.
  • Patent Document 2 Japanese Patent Application Publication No. 2005-331889) proposes a fluorescence microscope configured to automatically measure the duration of time in which the illumination light has been applied, and to issue an alert to the user when the duration exceeds a predetermined amount of time.
  • Patent Document 3 Japanese Patent Application Publication No.
  • Patent Document 4 Japanese Patent Application Publication No. 2000-66109 proposes a microscope that detects the amount of change of the image signal, and when the amount of change is below a predetermined amount, the intensity of the illumination light applied to the specimen is reduced to a level at which the amount of change of the image signal can be detected, and the image signal of the status immediately before the reduction of the light intensity is output to the monitor as a still image.
  • Patent Document 5 Japanese Patent Application Publication No. 2006-195274 proposes a microscope system configured, to switch off the power of the illumination unit when no operation has been done with the microscope for a predetermined period, for the purpose of power saving.
  • Patent Document 6 Japanese Patent No. 33219566 proposes a microscope control apparatus configured to, when a driving instruction is given to the electric revolver holding the objective lens, limit the amount of the light entering the objective lens from the illumination light source, for the purpose of preventing excess brightness when switching the objective lenses.
  • a system is a microscope system that is capable of changing a status of observation of a sample, comprising: an illumination unit for applying illumination light to the sample; a driving unit for driving one or more optical members including an objective lens; a position changing unit for changing a relative position of the sample and the objective lens; a detection unit for detecting whether or not any of the one or more optical members are being driven currently, and whether or not the relative position is being changed currently; and a control unit for controlling the illumination light for the sample to be applied, cut off or reduced.
  • a system is a microscope system that is capable of changing a status of observation of a sample, comprising: an illumination unit for applying illumination light to the sample; an image capturing unit for capturing an observed image of the sample; and an automatic focus adjustment unit for performing focusing of the observed image automatically in accordance with an output from the image capturing unit; and a control unit for controlling the illumination light for the sample to be applied, cut off or reduced.
  • the image capturing unit captures the observed image as a still image
  • the control unit controls the illumination light for the sample to be cut off or reduced.
  • a system is a microscope system that is capable of changing a status of observation of a sample, comprising: an illumination unit for applying illumination light to the sample; a driving unit for driving one or more optical members including an objective lens; a position changing unit for changing a relative position of the sample and the objective lens; a control unit for controlling the illumination light for the sample to be applied, cut off or reduced; an instruction unit for giving instruction for driving the one or more optical members or for the changing of the relative positions; an image capturing unit for capturing an observed image of the sample as a still image or a live image; and a display unit for displaying the still image or live image captured by the image capturing unit.
  • the order for performing operations is changed in accordance with the instruction from the instruction unit, the operations including an operation of driving the one or more optical members or changing the relative position; an operation of switching the illumination light for the sample from being cut-off or reduced to being applied; and an operation of switching the image displayed in the display unit from the still image to the live image.
  • FIG. 1 is a diagram showing a configuration example of a microscope system according to a first embodiment.
  • FIG. 2 is a diagram showing an example of a control application GUI for controlling a microscope, displayed on a screen of a monitor.
  • FIG. 3 is a flowchart showing operation example 1 of the microscope system according to the first embodiment.
  • FIG. 4 is a flowchart showing operation example 2 of the microscope system according to the first embodiment.
  • FIG. 5 is a flowchart showing a variation example in which the operation example 1 and the operation example 2 are combined.
  • FIG. 6 is a flowchart showing a variation example of the operation example 2.
  • FIG. 7 is a flowchart showing an operation example of a microscope system according to a second embodiment.
  • FIG. 8 is a flowchart showing an operation example of a microscope system according to a third embodiment.
  • FIG. 1 is a diagram showing a configuration example of a microscope system according to a first embodiment of the present invention.
  • a microscope apparatus 2 is equipped with, as an optical system for epi-observation, an epi-illumination light source 3 , a collector lens 4 for collecting the light from the epi-illumination light source 3 , an epi-light shutter 5 for passing/cutting off the light from the epi-illumination light source 3 , an ND filter 6 for adjusting the amount of light, and a cube turret 7 provided with a plurality of cubes having a dichroic mirror that has reflection/transmission characteristics for different wavelengths, the cube turret 7 being capable of inserting one of the cubes into the observation light path selectively.
  • the ND filter 6 can be inserted/withdrawn to/from the illumination light path by a microscope controller 15 (to be described later), and is not inserted in the illumination light path in the normal status.
  • a sample 8 is mounted on a stage 9 that can move freely in the direction (hereinafter, referred to as a “Z direction”) along the observation optical axis (shown with a dotted line in the vertical direction in FIG. 1 ), and on the plane (hereinafter, referred to as an “XY plane”) vertical to the observation optical axis.
  • the movement of the stage 9 is controlled by a stage X-Y drive control unit 10 and a stage Z drive control unit 11 .
  • the stage X-Y drive control unit 10 controls the movement of the stage 9 on the XY plane through drive control of a motor 24 .
  • the stage Z drive control unit 11 controls the movement of the stage 9 in the Z direction through drive control of a motor 25 .
  • the stage 9 has origin detection function using an origin sensor (not shown in the drawings), enabling the control of the movement to be done by coordinate detection and coordinate specification on the sample 8 mounted on the stage 9 .
  • a revolver 13 which is attached a plurality of objective lenses 12 a , 12 b , . . . (hereinafter, collectively called as “objective lens 12 ” when needed) for selecting one of the objective lenses to be used for the observation by rotating movement, and a zoom optical system 14 for zooming in/out the observed image in a continuous manner, are provided on the observation optical axis.
  • objective lens 12 a plurality of objective lenses 12 a , 12 b , . . .
  • zoom optical system 14 for zooming in/out the observed image in a continuous manner
  • the microscope controller 15 is connected to a host system 16 and has function to control the overall operation of the microscope apparatus 2 , in accordance with a control signal from the host system 16 , switching of observation methods (also called micrographic method), control of the light from the epi-illumination light source 3 , and reporting of the current observation status (also called micrographic status) to the host system 16 .
  • the microscope controller 15 is also connected to the stage X-Y drive control unit 10 and the stage Z drive control unit 11 , so that the stage 9 can be controlled by host system 16 as well.
  • a microscope operation unit 17 is a hand switch comprising various input units to input, as well as the host system 16 , instructions for the movements of the microscope apparatus 2 .
  • the stage 9 can be operated also by a joystick, an encoder or a button (not shown in the drawings) provided in the microscope operation unit 17 .
  • the host system 16 imports the microscopically-observed image of the sample 8 captured by a digital camera 18 via a video board 19 .
  • the settings of the digital camera 18 including ON/OFF of automatic gain control, gain setting, ON/OFF of automatic exposure control and exposure-time setting, can be adjusted by the host system 16 through a camera controller 20 .
  • the host system 16 can also direct a monitor 22 (a display unit) to display the microscopically-observed image of the sample transmitted from the digital camera 18 , and direct a data recording unit 21 to store the microscopically-observed image as a moving image data file or a still image data file.
  • the moving image data or the still image data can be read out by the host system 16 and displayed on the monitor 22 .
  • the host system 16 is a computer having very standard configuration, and comprises a CPU (not shown in the drawings) for control the overall operation of the microscope system 1 ; a maim memory (not shown in the drawings) to be used by the CPU as a work memory as needed; an input unit 23 for obtaining various instructions from the user, the input unit 23 being a mouse, a keyboard, a joystick, or a JOG dial etc.; and an interface unit (not shown in the drawings) for managing reception/transmission of various data between the individual members of the microscope system 1 .
  • FIG. 2 is a diagram showing an example of a control application GUI (Graphical User Interface) displayed on the screen of the monitor 22 for controlling the microscope apparatus 2 .
  • GUI Graphic User Interface
  • the control application GUI can be displayed on the screen of the monitor 22 through a control program performed by the host system 16 .
  • the observed image of the sample 8 captured with the digital camera 18 is displayed in an observed image display area 31 on the screen.
  • instruction for the movement of the stage 9 in the XY direction can be performed by drag operation using a mouse.
  • Objective lens switching buttons 32 a , 32 b and 32 c operate with the revolver 13 , being capable of switching the objective lens 12 to be inserted to the observation optical axis, depending on which button has been tapped.
  • the objective lens switching button 32 a when the objective lens switching button 32 a is tapped, the objective lens with the lowest magnification (in this example, an objective lens with 4 ⁇ magnification) is inserted to the observation optical axis.
  • the objective lens with the middle magnification in this example, an objective lens with 20 ⁇ magnification
  • the objective lens switching button 32 c is tapped, the objective lens with the highest magnification (in this example, an objective lens with 60 ⁇ magnification) is inserted into the observation optical axis.
  • a magnification switching slide bar 32 e operates with the zoom optical system 14 , being capable of changing the magnification for observation in accordance with the change of the position of the magnification switching slide bar 32 e .
  • the change of the position of the magnification switching slide bar 32 e can be made, for example, by dragging the magnification switching slide bar 32 e using a mouse, or tapping a magnification switching slide bar moving button 32 d or 32 f .
  • the magnification switching slide bar moving button 32 d is tapped, the magnification switching slide bar 32 e moves to the left by a predetermined amount. Synchronized with the movement, the zoom optical system 14 moves toward the direction by the predetermined amount, to lower the magnification for the observation.
  • magnification switching slide bar moving button 32 f When the magnification switching slide bar moving button 32 f is tapped, the magnification switching slide bar 32 e moves to the right by the predetermined amount. Synchronized with the movement, the zoom optical system 14 moves towards the direction by the predetermined amount, to increase the magnification. While the zoom optical system 14 is moving, the observed image display area 31 displays the zooming in/out of the target area.
  • Observation method switching buttons 33 a , 33 b and 33 c operate with the cube turret 7 , being capable of switching the cube to be inserted to the observation optical axis, depending on which button has been tapped.
  • the observation method switching button 33 a when the observation method switching button 33 a is tapped, the cube that can observe green (G) fluorescence is inserted to the observation optical axis.
  • the observation method switching button 33 b is tapped, the cube that can observe blue (B) fluorescence is inserted to the observation optical axis.
  • the observation method switching button 33 c is tapped, the cube that can observe red fluorescence (R) is inserted to the observation optical axis.
  • the observation method for observing the sample can be selected as described above.
  • a focus slide bar 34 b operates for the movement of the stage 9 in the Z direction (vertical direction), being capable of bringing the observed image into focus in accordance of the change of the position of the focus slide bar 34 b .
  • the change of the position of the focus slide bar 34 b can be made, for example, by dragging the focus slide bar 34 b using a mouse, or tapping a focus slide bar moving button 34 a or 34 c .
  • the focus slide bar moving button 34 a is tapped, the focus slide bar 34 b moves upward by a predetermined amount. Synchronized with the movement, the stage 9 moves upward by the predetermined amount.
  • the focus slide bar moving button 34 c is tapped, the focus slide bar 34 b moves downward by the predetermined amount. Synchronized with the movement, stage 9 moves downward by the predetermined amount.
  • Stage operation buttons 35 a , 35 b , 35 c , 35 d , 35 e , 35 f , 35 g , 35 h operate for the movement of the stage 9 in the eight directions on the XY plane, being capable of moving the stage 9 in the corresponding direction by a predetermined amount.
  • the moving speed of the stage 9 in the Z direction can be adjusted by switching between coarse movement and fine movement using a course/fine movement switching button 36 .
  • the moving speed of the stage 9 in the XY direction can be adjusted by switching between coarse movement and fine movement using a course/fine movement switching button 37 .
  • a live observation notification unit 38 shows whether or not the image displayed in the observed image display area 31 is the live-observed image (hereinafter, the live-observed image may be called simply as a “live image”) of the sample that is being captured by the digital camera 18 in real time, by displaying the word “LIVE” when the observed image display area 31 displays a live image, and not displaying the word “LIVE” at other times.
  • the operation example to be described is assumed as an operation performed while the screen of the monitor 22 displays the control application GUI for controlling the microscope apparatus 2 shown in FIG. 2 .
  • FIG. 3 is a flowchart showing an operation example 1 of the microscope system 1 .
  • the operation example 1 shows an operation starting, for example, upon the completion of the flow shown in FIG. 4 (to be described later), i.e. when the illumination light from the epi-illumination light source 3 is applied to the sample 8 while the observed image through the digital camera 18 is displayed in the observed image display area 31 on the screen of the monitor 22 in real time, and the user is moving the stage 9 to search for the desired part to be observed in the sample 8 , by operating one of stage operation buttons 35 a - 35 h . It is assumed that at the starting point of this operation, a timer described later has been reset. The timer is provided, for example, in the host system 16 .
  • drivable units that are to the object of the judgment in S 1 are the epi-illumination light source 3 , the epi-light shutter 5 , the cube turret 7 , the zoom optical system 14 , the revolver 13 and the stage 9 .
  • the epi-illumination light source 3 , the epi-light shutter 5 , the cube turret 7 (cube), the zoom optical system 14 , the revolver 13 (objective lens 12 ) and the stage 9 are examples of optical members.
  • the user is moving the stage 9 by operating one of the stage operation buttons 35 a - 35 h , making the judgment result in S 1 Yes and causing the timer reset (S 2 ).
  • S 2 is completed, the operation returns to S 1 , and S 1 and S 2 are repeated until the judgment result in S 1 becomes No.
  • the timer reset refers to the operation to clear the value showing the amount of time that has been measured and to stop the measurement.
  • the judgment result in S 1 described above is No, followed by judgment as to whether or not the timer has been reset (S 3 ).
  • the judgment result is Yes, the measurement by the timer starts (S 4 ).
  • S 4 is skipped.
  • the predetermined amount time is set to be an estimated period of time after the stop of the driven unit, during which the user finds the desired part in the sample 8 .
  • the amount of time can be arbitrarily set by the user, to be, for example, around 5-60 seconds.
  • the timer is reset (S 6 ); the currently-observed image is captured by the digital camera 18 as a still image (S 7 ); and the image capturing conditions (such as the exposure time, bining and gain) are stored in the data recording unit 21 in the format that enables the conditions to be read out later (S 8 ).
  • the flow is completed by cutting off the illumination light to the sample 8 through the control to turn off the epi-illumination light source 3 (S 9 ) and by displaying the still image of the observed image captured in S 7 in the observed image display area 31 on the screen of the monitor 22 (S 10 ).
  • the operation example 1 described above makes it possible to capture the still image and to cut off the illumination light automatically, when a predetermined about of time has passed after the user found the desired part to be observed in the sample 8 and stopped the operation to move the stage 9 . Furthermore, the image in the observed image display area 31 can be switched from a live image to the captured still image.
  • FIG. 4 is a flowchart showing an operation example 2 of the microscope system 1 .
  • the operation example 2 shows an operation starting, for example, upon the completion of the flow shown in FIG. 3 described above, i.e., when the still image of the observed image is displayed in the observed image display area 31 on the screen of the monitor 22 , and, the illumination light to the sample 8 is being cut off.
  • the drive instruction for a drivable unit refers to a drive instruction given by, for example, clicking a button on the control application GUI displayed on the screen of the monitor 22 ; or an instruction for moving the stage 9 in the XY direction given by drag operation using a mouse in the observed image display area 31 ; or drive instructions given by operations such as joystick operation, jog dial turning operation and button operation in the microscope control unit 17 or in the input unit 23 .
  • the illumination light is applied to the sample 8 through control to turn on the epi-illumination light source 3 (S 22 ); the latest image capturing conditions stored in the data recording unit 21 in S 8 in FIG. 3 are read out and set in the digital cameral 18 (S 23 ); live-image capturing for live-image display is started (S 24 ); and the display of the live image is started in the observed image display area 31 on the screen of the monitor 22 (S 25 ).
  • S 24 is for retrieving the image capturing conditions for capturing the live image that was displayed immediately before the display of the still image in the observed image display area 31 on the screen of the monitor 22 and for starting the image capturing under the retrieved the image capturing conditions.
  • S 25 the image displayed in the observed image display area 31 is switched from the still image to the live image.
  • the operation example 2 described above makes it possible, for example, when the user wishes to resume the search for a desired part to be observed in sample 8 , to automatically apply the illumination light to the sample 8 and to switch the image displayed in the observed image display area 31 from a still image to a live image, by simply giving a drive instruction to drive the stage 9 through, for example, operation of the stage operation buttons 35 a - 35 h.
  • the microscope system is capable of, when the user is searching for a desired part to be observed while viewing the observed image in real time, applying the illumination light to the sample 8 and displaying a live image in the observed image display area 31 during the search.
  • the illumination light to the sample 8 can be cut off while the still image of the latest-searched and observed part is displayed in the observed image display area 31 . Therefore, the user can continue the observation of the desired part, while avoiding unnecessary damage caused to the sample 8 .
  • the embodiment realizes excellent operability as the application/cut off of the illumination light to the sample 8 and switching of the images displayed in the observed image display area 31 are performed automatically.
  • the operation of the microscope system according to the embodiment may be modified, for example, as described below.
  • FIG. 5 is a diagram showing a variation example in which above-described operation example 1 and operation example 2 are combined.
  • the variation example shows an operation starting while the illumination light to the sample 8 is being cut off. It is assumed that at the starting point of this operation, the timer has been reset.
  • the image capturing conditions set in the digital camera 18 in S 33 are the latest image capturing conditions stored in the data recording unit 21 in S 45 described later, or, when no condition has been stored, image capturing conditions provided as initial values are set in the digital camera 18 .
  • the image capturing conditions provided as initial values are, for example, stored in an internal ROM in the host system 16 .
  • the variation example described above makes it possible, when the first drive instruction (the drive instruction to be the object of the judgment in S 31 ) is issued, to perform the application of the illumination light to the sample 8 and display of the live image in the observed image display area 31 without actually carrying out the drive operation.
  • the second drive instruction (the drive instruction to be the object of the judgment in S 36 ) is issued during a predetermined period of time after the first instruction, the actual drive operation is performed, preventing the drivable unit from being driven (from moving) before the application of the illumination becomes relatively stable.
  • FIG. 6 is a flowchart showing a variation example of the operation example 2.
  • the variation example descried above makes it possible, when the first drive instruction is issued, to shift the status of the microscope apparatus 2 to the drive-ready status without actually performing the drive operation.
  • the second drive instruction is issued during a predetermined period of time after the first instruction, the application of the illumination light to the sample 8 , the display of the live image in the observed image display area 31 and the actual drive operation are performed.
  • a microscope system according to the second embodiment of the present invention has the basically same configuration as the microscope system according to the first embodiment but operates in a different way.
  • Video AF is a method for performing AF (autofocus) by moving the stage 9 to the focus position in the Z direction, on the basis of the image captured by the digital camera 18 . While the video AF is performed, the illumination light is applied to the sample 8 , and when the video AF is completed, the cut off of the illumination light to the sample 8 and the display of the still image in the observed image display area 31 are performed.
  • FIG. 7 is a flowchart showing an operation example of a microscope system according to the embodiment.
  • the AF start instruction can be given by, for example, operating the microscope operation unit 17 or the input unit 23 .
  • the focus-part control refers to the control to move the stage 9 to the focus point in the Z direction in accordance with the image captured by the digital camera 18 , on order to bring the observed image into focus.
  • the microscope system is capable of, when observing a part while utilizing video AF, applying the illumination light to the sample 8 while the video AF is performed.
  • the cut of the illumination light to the sample 8 and the display of the still image in the observed image display area 31 can be performed, avoiding unnecessary damage caused to the sample 8 .
  • a microscope system according to the embodiment of the present invention has the basically same configuration as the microscope system according to the first embodiment but operates in a different way.
  • FIG. 8 is a flowchart showing an operation example of a microscope system in accordance with the present embodiment.
  • the example shows an operation starting, for example, upon the completion of the flow shown in FIG. 3 , when the still image of the observed image is displayed in the observed image display area 31 on the screen of the monitor 22 and the illumination light to the sample 8 is being cut off.
  • image capturing conditions in accordance with the driven objective lens 12 are set in the digital camera 18 (S 95 ); image capturing for the live-image display is started (S 96 ); and live-image display in the observed image display area 31 on the screen of the monitor 22 is started (S 97 ), completing the flow.
  • the drivable unit specified by the drive instruction is the stage 9 that changes the relative position of the sample 8 and the objective lens 12 or the zoom optical system 14
  • processes are performed in the following order: application of the illumination light to the sample 8 ; display of the live image in the observed image display area 31 on the screen of the monitor 22 ; and driving of the stage 9 in accordance with the drive instruction.
  • the driving of the stage 9 or the zoom optical system 14 starts after the image displayed in the observed image display area 31 is switched to the live image, the user can view the live image of the sample 8 from the beginning of the driving of the stage 9 or the zoom optical system 14 .
  • the processes are performed in the following order: driving of the objective lens 12 or the cube in accordance with the drive instruction; application of the illumination light to the sample 8 ; and display of the live image in the observed image display area 31 on the screen of the monitor 22 .
  • the application of the illumination light to the sample 8 and the display of the live image in the observed image display area 31 on the screen of the monitor 22 are performed after the driving of the objective lens 12 or the cube is completed, unnecessary application of the illumination light and unnecessary display of the live image can be avoided before the switch of the objective lens 12 or the cube is completed.
  • the microscope system according to the embodiment is capable of performing processes in appropriate orders depending on the drivable unit specified by the drive instruction, providing further excellent operability in addition to minimized damage to the sample 8 .
  • the cut off of the illumination is done through the control to turn off the epi-illumination light source 3 in each embodiment, the cut off of the illumination light to the sample 8 may be performed, also by shutting the epi-light shutter 5 .
  • the ND filter 6 can be inserted in to the illumination optical path, thereby reducing the amount of illumination light to the level at which the sample 8 would not be damaged.
  • each embodiment may be configured so that, instead of cutting off the illumination light through the control to turn off the epi-illumination light source 3 , the user can arbitrarily select and set, on the control application GUI for controlling the microscope apparatus 2 displayed on the screen of the monitor 22 , either to cut off the illumination light by shutting the epi-light shutter 5 ; or to reduce, by inserting the ND filter 6 into the illumination light path, the amount of the illumination light to the level at which the sample 8 would not be damaged; or to perform control to reduce the amount of light from the epi-illumination light source 3 .
  • the arbitrary selection and setting may be done by operating the microscope operation unit 17 .
  • each embodiment may be configured so that the various instructions can be given by operating the microscope operation unit 17 , instead of giving the instructions on the control application GUI for controlling the microscope apparatus 2 displayed on the screen of the monitor 22 .
  • the application/cutting off of the illumination light to the sample 8 is performed automatically in each embodiment, they can be performed manually, for example, on the control application GUI for controlling the microscope apparatus 2 displayed on the screen of the monitor 22 or by operating the microscope operation unit 17 .
  • each embodiment may be configured to comprise selectable operation modes, i.e., an automatic mode and a manual mode, so that one or more operations shown in FIG. 3-FIG . 8 described above are performed when the automatic mode is selected, and the operations such as the application/cutting of the illumination light to the sample 8 , capturing of the still image, display of the still image or the live image are performed manually, when the manual mode is selected.
  • selectable operation modes i.e., an automatic mode and a manual mode
  • the present invention makes it possible, when, for example, searching for a target part in a sample while viewing the observed image in real time, to minimize damage to the sample while realizing excellent operability.

Abstract

A microscope system that is capable of changing a status of observation of a sample comprises an instruction unit for giving instruction for driving one or more optical members including an objective lens or for changing a relative position of the sample and the objective lens; and an image capturing unit for capturing an observed image of the sample as a still image or a live image. The microscope system changes an order for performing operations in accordance with the instruction from the instruction unit, the operations including an operation of driving the one or more optical members or changing the relative position; an operation of switching the illumination light for the sample from being cut-off or reduced to being applied; and an operation of switching the image displayed in a display unit from the still image to the live image.

Description

    CROSS REFERENCE TO RELATED APPLICATIONS
  • This application is a Divisional of U.S. application Ser. No. 12/132,097, filed Jun. 3, 2008, which is based upon and claims the benefit of priority from the prior Japanese Patent Applications No. 2007-152010, filed Jun. 7, 2007 and No. 2008-111538, filed Apr. 22, 2008, the entire contents of all of which are incorporated herein by reference.
  • BACKGROUND OF THE INVENTION
  • 1. Field of the Invention
  • The present invention relates to a microscope system that is capable of observing a minute specimen (sample) while magnifying various parts of the specimen, and more particularly, the present invention relates to a microscope system comprising an image capturing unit for capturing the observed image of the specimen, and a detection unit for detecting the driving status of various optical members for switching observation methods and the driving status of the stage for the specimen or the driving status of the objective lens.
  • 2. Description of the Related Art
  • Recently, microscopes have been used for research and tests in various fields including the industrial field as well as the field of biology.
  • Observation methods used in microscope apparatuses include a method for observing slight fluorescence emitted from a specimen (hereinafter, the method may be referred to simply as “fluorescence observation”). The fluorescence observation generally utilizes a light source such as a mercury lamp or a xenon lamp. The light from the source are collected and applied to the specimen. The illumination light may have to be applied to the specimen intensely in some cases, since fluorescence emitted from some specimens is very weak. In such cases, however, the continued application of the intense illumination light to the specimen may result in a phenomenon called “discoloration”, in which the illuminated part of the specimen is damaged by the intense light and no longer emits the fluorescence.
  • Therefore, apparatuses configured to apply the illumination light only when required have been proposed to cope with the above problem. For example, Patent Document 1 (Japanese Patent Application Publication No. 2005-195940) proposes a fluorescence microscope configured to be synchronized with the exposure time of a camera for capturing the images of specimens, and to turn the illumination light off when the camera is not capturing images. Patent Document 2 (Japanese Patent Application Publication No. 2005-331889) proposes a fluorescence microscope configured to automatically measure the duration of time in which the illumination light has been applied, and to issue an alert to the user when the duration exceeds a predetermined amount of time. Patent Document 3 (Japanese Patent Application Publication No. 2000-66108) proposes a microscope that can be switched to an intermittent mode by use of a switch. During the intermittent mode, the intensity of the illumination applied to the specimen is intermittently-reduced, and the monitor can be updated by displaying, as a still image, an image signal of for the status immediately before the intensity becomes too low to show the specimen. Patent Document 4 (Japanese Patent Application Publication No. 2000-66109) proposes a microscope that detects the amount of change of the image signal, and when the amount of change is below a predetermined amount, the intensity of the illumination light applied to the specimen is reduced to a level at which the amount of change of the image signal can be detected, and the image signal of the status immediately before the reduction of the light intensity is output to the monitor as a still image.
  • Meanwhile, Patent Document 5 (Japanese Patent Application Publication No. 2006-195274) proposes a microscope system configured, to switch off the power of the illumination unit when no operation has been done with the microscope for a predetermined period, for the purpose of power saving. Patent Document 6 (Japanese Patent No. 3321956) proposes a microscope control apparatus configured to, when a driving instruction is given to the electric revolver holding the objective lens, limit the amount of the light entering the objective lens from the illumination light source, for the purpose of preventing excess brightness when switching the objective lenses.
  • SUMMARY OF THE INVENTION
  • A system according to an aspect of the present invention is a microscope system that is capable of changing a status of observation of a sample, comprising: an illumination unit for applying illumination light to the sample; a driving unit for driving one or more optical members including an objective lens; a position changing unit for changing a relative position of the sample and the objective lens; a detection unit for detecting whether or not any of the one or more optical members are being driven currently, and whether or not the relative position is being changed currently; and a control unit for controlling the illumination light for the sample to be applied, cut off or reduced.
  • A system according to another aspect of the present invention is a microscope system that is capable of changing a status of observation of a sample, comprising: an illumination unit for applying illumination light to the sample; an image capturing unit for capturing an observed image of the sample; and an automatic focus adjustment unit for performing focusing of the observed image automatically in accordance with an output from the image capturing unit; and a control unit for controlling the illumination light for the sample to be applied, cut off or reduced. When the focusing of the observed image is completed by the automatic focus adjustment unit, the image capturing unit captures the observed image as a still image, and the control unit controls the illumination light for the sample to be cut off or reduced.
  • A system according to a further aspect of the present invention is a microscope system that is capable of changing a status of observation of a sample, comprising: an illumination unit for applying illumination light to the sample; a driving unit for driving one or more optical members including an objective lens; a position changing unit for changing a relative position of the sample and the objective lens; a control unit for controlling the illumination light for the sample to be applied, cut off or reduced; an instruction unit for giving instruction for driving the one or more optical members or for the changing of the relative positions; an image capturing unit for capturing an observed image of the sample as a still image or a live image; and a display unit for displaying the still image or live image captured by the image capturing unit. The order for performing operations is changed in accordance with the instruction from the instruction unit, the operations including an operation of driving the one or more optical members or changing the relative position; an operation of switching the illumination light for the sample from being cut-off or reduced to being applied; and an operation of switching the image displayed in the display unit from the still image to the live image.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIG. 1 is a diagram showing a configuration example of a microscope system according to a first embodiment.
  • FIG. 2 is a diagram showing an example of a control application GUI for controlling a microscope, displayed on a screen of a monitor.
  • FIG. 3 is a flowchart showing operation example 1 of the microscope system according to the first embodiment.
  • FIG. 4 is a flowchart showing operation example 2 of the microscope system according to the first embodiment.
  • FIG. 5 is a flowchart showing a variation example in which the operation example 1 and the operation example 2 are combined.
  • FIG. 6 is a flowchart showing a variation example of the operation example 2.
  • FIG. 7 is a flowchart showing an operation example of a microscope system according to a second embodiment.
  • FIG. 8 is a flowchart showing an operation example of a microscope system according to a third embodiment.
  • DESCRIPTION OF THE PREFERRED EMBODIMENTS
  • Embodiments of the present invention are described below, referring to the drawings.
  • First Embodiment
  • FIG. 1 is a diagram showing a configuration example of a microscope system according to a first embodiment of the present invention.
  • As shown in FIG. 1, in a microscope system 1 according to the embodiment, a microscope apparatus 2 is equipped with, as an optical system for epi-observation, an epi-illumination light source 3, a collector lens 4 for collecting the light from the epi-illumination light source 3, an epi-light shutter 5 for passing/cutting off the light from the epi-illumination light source 3, an ND filter 6 for adjusting the amount of light, and a cube turret 7 provided with a plurality of cubes having a dichroic mirror that has reflection/transmission characteristics for different wavelengths, the cube turret 7 being capable of inserting one of the cubes into the observation light path selectively. The ND filter 6 can be inserted/withdrawn to/from the illumination light path by a microscope controller 15 (to be described later), and is not inserted in the illumination light path in the normal status.
  • A sample 8 is mounted on a stage 9 that can move freely in the direction (hereinafter, referred to as a “Z direction”) along the observation optical axis (shown with a dotted line in the vertical direction in FIG. 1), and on the plane (hereinafter, referred to as an “XY plane”) vertical to the observation optical axis. The movement of the stage 9 is controlled by a stage X-Y drive control unit 10 and a stage Z drive control unit 11. The stage X-Y drive control unit 10 controls the movement of the stage 9 on the XY plane through drive control of a motor 24. The stage Z drive control unit 11 controls the movement of the stage 9 in the Z direction through drive control of a motor 25. The stage 9 has origin detection function using an origin sensor (not shown in the drawings), enabling the control of the movement to be done by coordinate detection and coordinate specification on the sample 8 mounted on the stage 9.
  • Meanwhile, a revolver 13 which is attached a plurality of objective lenses 12 a, 12 b, . . . (hereinafter, collectively called as “objective lens 12” when needed) for selecting one of the objective lenses to be used for the observation by rotating movement, and a zoom optical system 14 for zooming in/out the observed image in a continuous manner, are provided on the observation optical axis. These units are electrically-driven, and the movements of the units are controlled by the microscope controller 15 (to be described later). For example, the movement of the zoom optical system 14 is controlled through drive control of a motor 26 in accordance with the control performed by the microscope controller 15.
  • The microscope controller 15 is connected to a host system 16 and has function to control the overall operation of the microscope apparatus 2, in accordance with a control signal from the host system 16, switching of observation methods (also called micrographic method), control of the light from the epi-illumination light source 3, and reporting of the current observation status (also called micrographic status) to the host system 16. The microscope controller 15 is also connected to the stage X-Y drive control unit 10 and the stage Z drive control unit 11, so that the stage 9 can be controlled by host system 16 as well. A microscope operation unit 17 is a hand switch comprising various input units to input, as well as the host system 16, instructions for the movements of the microscope apparatus 2. The stage 9 can be operated also by a joystick, an encoder or a button (not shown in the drawings) provided in the microscope operation unit 17.
  • The host system 16 imports the microscopically-observed image of the sample 8 captured by a digital camera 18 via a video board 19. The settings of the digital camera 18, including ON/OFF of automatic gain control, gain setting, ON/OFF of automatic exposure control and exposure-time setting, can be adjusted by the host system 16 through a camera controller 20. The host system 16 can also direct a monitor 22 (a display unit) to display the microscopically-observed image of the sample transmitted from the digital camera 18, and direct a data recording unit 21 to store the microscopically-observed image as a moving image data file or a still image data file. The moving image data or the still image data can be read out by the host system 16 and displayed on the monitor 22.
  • The host system 16 is a computer having very standard configuration, and comprises a CPU (not shown in the drawings) for control the overall operation of the microscope system 1; a maim memory (not shown in the drawings) to be used by the CPU as a work memory as needed; an input unit 23 for obtaining various instructions from the user, the input unit 23 being a mouse, a keyboard, a joystick, or a JOG dial etc.; and an interface unit (not shown in the drawings) for managing reception/transmission of various data between the individual members of the microscope system 1.
  • FIG. 2 is a diagram showing an example of a control application GUI (Graphical User Interface) displayed on the screen of the monitor 22 for controlling the microscope apparatus 2.
  • The control application GUI can be displayed on the screen of the monitor 22 through a control program performed by the host system 16.
  • As shown in FIG. 2, the observed image of the sample 8 captured with the digital camera 18 is displayed in an observed image display area 31 on the screen. In the observed-image display area 31, instruction for the movement of the stage 9 in the XY direction can be performed by drag operation using a mouse.
  • Objective lens switching buttons 32 a, 32 b and 32 c operate with the revolver 13, being capable of switching the objective lens 12 to be inserted to the observation optical axis, depending on which button has been tapped. For example, when the objective lens switching button 32 a is tapped, the objective lens with the lowest magnification (in this example, an objective lens with 4× magnification) is inserted to the observation optical axis. When the objective lens switching button 32 b is tapped, the objective lens with the middle magnification (in this example, an objective lens with 20× magnification) is inserted to the observation optical axis. When the objective lens switching button 32 c is tapped, the objective lens with the highest magnification (in this example, an objective lens with 60× magnification) is inserted into the observation optical axis.
  • A magnification switching slide bar 32 e operates with the zoom optical system 14, being capable of changing the magnification for observation in accordance with the change of the position of the magnification switching slide bar 32 e. The change of the position of the magnification switching slide bar 32 e can be made, for example, by dragging the magnification switching slide bar 32 e using a mouse, or tapping a magnification switching slide bar moving button 32 d or 32 f. When the magnification switching slide bar moving button 32 d is tapped, the magnification switching slide bar 32 e moves to the left by a predetermined amount. Synchronized with the movement, the zoom optical system 14 moves toward the direction by the predetermined amount, to lower the magnification for the observation. When the magnification switching slide bar moving button 32 f is tapped, the magnification switching slide bar 32 e moves to the right by the predetermined amount. Synchronized with the movement, the zoom optical system 14 moves towards the direction by the predetermined amount, to increase the magnification. While the zoom optical system 14 is moving, the observed image display area 31 displays the zooming in/out of the target area.
  • Observation method switching buttons 33 a, 33 b and 33 c operate with the cube turret 7, being capable of switching the cube to be inserted to the observation optical axis, depending on which button has been tapped. For example, when the observation method switching button 33 a is tapped, the cube that can observe green (G) fluorescence is inserted to the observation optical axis. When the observation method switching button 33 b is tapped, the cube that can observe blue (B) fluorescence is inserted to the observation optical axis. When the observation method switching button 33 c is tapped, the cube that can observe red fluorescence (R) is inserted to the observation optical axis. Thus, the observation method for observing the sample can be selected as described above.
  • A focus slide bar 34 b operates for the movement of the stage 9 in the Z direction (vertical direction), being capable of bringing the observed image into focus in accordance of the change of the position of the focus slide bar 34 b. The change of the position of the focus slide bar 34 b can be made, for example, by dragging the focus slide bar 34 b using a mouse, or tapping a focus slide bar moving button 34 a or 34 c. When the focus slide bar moving button 34 a is tapped, the focus slide bar 34 b moves upward by a predetermined amount. Synchronized with the movement, the stage 9 moves upward by the predetermined amount. When the focus slide bar moving button 34 c is tapped, the focus slide bar 34 b moves downward by the predetermined amount. Synchronized with the movement, stage 9 moves downward by the predetermined amount.
  • Stage operation buttons 35 a, 35 b, 35 c, 35 d, 35 e, 35 f, 35 g, 35 h operate for the movement of the stage 9 in the eight directions on the XY plane, being capable of moving the stage 9 in the corresponding direction by a predetermined amount.
  • The moving speed of the stage 9 in the Z direction can be adjusted by switching between coarse movement and fine movement using a course/fine movement switching button 36. The moving speed of the stage 9 in the XY direction can be adjusted by switching between coarse movement and fine movement using a course/fine movement switching button 37.
  • A live observation notification unit 38 shows whether or not the image displayed in the observed image display area 31 is the live-observed image (hereinafter, the live-observed image may be called simply as a “live image”) of the sample that is being captured by the digital camera 18 in real time, by displaying the word “LIVE” when the observed image display area 31 displays a live image, and not displaying the word “LIVE” at other times.
  • Next, an operation example of the microscope system 1 configured as described above is described.
  • The operation example to be described is assumed as an operation performed while the screen of the monitor 22 displays the control application GUI for controlling the microscope apparatus 2 shown in FIG. 2.
  • FIG. 3 is a flowchart showing an operation example 1 of the microscope system 1.
  • The operation example 1 shows an operation starting, for example, upon the completion of the flow shown in FIG. 4 (to be described later), i.e. when the illumination light from the epi-illumination light source 3 is applied to the sample 8 while the observed image through the digital camera 18 is displayed in the observed image display area 31 on the screen of the monitor 22 in real time, and the user is moving the stage 9 to search for the desired part to be observed in the sample 8, by operating one of stage operation buttons 35 a-35 h. It is assumed that at the starting point of this operation, a timer described later has been reset. The timer is provided, for example, in the host system 16.
  • As shown in FIG. 3, upon the start of the flow, judgment is performed as to whether or not any unit is being driven currently (S1).
  • In this embodiment, drivable units that are to the object of the judgment in S1 are the epi-illumination light source 3, the epi-light shutter 5, the cube turret 7, the zoom optical system 14, the revolver 13 and the stage 9. The epi-illumination light source 3, the epi-light shutter 5, the cube turret 7 (cube), the zoom optical system 14, the revolver 13 (objective lens 12) and the stage 9 are examples of optical members.
  • In this example, the user is moving the stage 9 by operating one of the stage operation buttons 35 a-35 h, making the judgment result in S1 Yes and causing the timer reset (S2). When S2 is completed, the operation returns to S1, and S1 and S2 are repeated until the judgment result in S1 becomes No. The timer reset refers to the operation to clear the value showing the amount of time that has been measured and to stop the measurement.
  • Next, it is assumed that the user has found the desired part to be observed in the sample 8, terminating the operation of the stage operation button 35 a-35 h to stop the movement of the stage 9.
  • In this case, the judgment result in S1 described above is No, followed by judgment as to whether or not the timer has been reset (S3). When the judgment result is Yes, the measurement by the timer starts (S4). When the judgment result is No, S4 is skipped.
  • Next, judgment is performed as to whether or not the amount of time measured by the timer has exceeded a preset, predetermined amount of time (S5). The predetermined amount time is set to be an estimated period of time after the stop of the driven unit, during which the user finds the desired part in the sample 8. The amount of time can be arbitrarily set by the user, to be, for example, around 5-60 seconds.
  • When the judgment result in S5 is No, the operation returns to S1 and the process described above is repeated.
  • Meanwhile, when the judgment result in S5 is Yes, the timer is reset (S6); the currently-observed image is captured by the digital camera 18 as a still image (S7); and the image capturing conditions (such as the exposure time, bining and gain) are stored in the data recording unit 21 in the format that enables the conditions to be read out later (S8).
  • Next, the flow is completed by cutting off the illumination light to the sample 8 through the control to turn off the epi-illumination light source 3 (S9) and by displaying the still image of the observed image captured in S7 in the observed image display area 31 on the screen of the monitor 22 (S10).
  • The operation example 1 described above makes it possible to capture the still image and to cut off the illumination light automatically, when a predetermined about of time has passed after the user found the desired part to be observed in the sample 8 and stopped the operation to move the stage 9. Furthermore, the image in the observed image display area 31 can be switched from a live image to the captured still image.
  • FIG. 4 is a flowchart showing an operation example 2 of the microscope system 1.
  • The operation example 2 shows an operation starting, for example, upon the completion of the flow shown in FIG. 3 described above, i.e., when the still image of the observed image is displayed in the observed image display area 31 on the screen of the monitor 22, and, the illumination light to the sample 8 is being cut off.
  • As shown in FIG. 4, upon the start of the flow, judgment is performed as to whether or not there is any drive instruction to drive a drivable unit (S21). The drive instruction for a drivable unit refers to a drive instruction given by, for example, clicking a button on the control application GUI displayed on the screen of the monitor 22; or an instruction for moving the stage 9 in the XY direction given by drag operation using a mouse in the observed image display area 31; or drive instructions given by operations such as joystick operation, jog dial turning operation and button operation in the microscope control unit 17 or in the input unit 23.
  • When the judgment result in S21 is No, the judgment is repeated.
  • Meanwhile, when the judgment result in S21 is Yes, the illumination light is applied to the sample 8 through control to turn on the epi-illumination light source 3 (S22); the latest image capturing conditions stored in the data recording unit 21 in S8 in FIG. 3 are read out and set in the digital cameral 18 (S23); live-image capturing for live-image display is started (S24); and the display of the live image is started in the observed image display area 31 on the screen of the monitor 22 (S25).
  • Thus, S24 is for retrieving the image capturing conditions for capturing the live image that was displayed immediately before the display of the still image in the observed image display area 31 on the screen of the monitor 22 and for starting the image capturing under the retrieved the image capturing conditions. In S25, the image displayed in the observed image display area 31 is switched from the still image to the live image.
  • The flow is completed by the start of drive operation of the drivable unit specified by the drive instruction corresponding to the judgment result Yes in S21 (S26).
  • The operation example 2 described above makes it possible, for example, when the user wishes to resume the search for a desired part to be observed in sample 8, to automatically apply the illumination light to the sample 8 and to switch the image displayed in the observed image display area 31 from a still image to a live image, by simply giving a drive instruction to drive the stage 9 through, for example, operation of the stage operation buttons 35 a-35 h.
  • Thus, the microscope system according to the present embodiment is capable of, when the user is searching for a desired part to be observed while viewing the observed image in real time, applying the illumination light to the sample 8 and displaying a live image in the observed image display area 31 during the search. When the user is only observing the image without the search, the illumination light to the sample 8 can be cut off while the still image of the latest-searched and observed part is displayed in the observed image display area 31. Therefore, the user can continue the observation of the desired part, while avoiding unnecessary damage caused to the sample 8.
  • In addition, the embodiment realizes excellent operability as the application/cut off of the illumination light to the sample 8 and switching of the images displayed in the observed image display area 31 are performed automatically.
  • Meanwhile, the operation of the microscope system according to the embodiment may be modified, for example, as described below.
  • FIG. 5 is a diagram showing a variation example in which above-described operation example 1 and operation example 2 are combined.
  • The variation example shows an operation starting while the illumination light to the sample 8 is being cut off. It is assumed that at the starting point of this operation, the timer has been reset.
  • As shown in FIG. 5, processes similar to those performed in S21-S25 in FIG. 4 are performed in S31-S35. However, the image capturing conditions set in the digital camera 18 in S33 are the latest image capturing conditions stored in the data recording unit 21 in S45 described later, or, when no condition has been stored, image capturing conditions provided as initial values are set in the digital camera 18. The image capturing conditions provided as initial values are, for example, stored in an internal ROM in the host system 16.
  • After the process in S35 is completed, judgment is performed again as to whether or not there is any drive instruction for a drivable unit (S36). When the judgment result is Yes, the process proceeds to S38 after the start of the driving operation of the specified drivable unit in accordance with the drive instruction (S37). When the judgment result is No, the process proceeds to S38 directly.
  • Next, processes similar to those performed in S1-S10 in FIG. 3 are performed in S38-S47. When the process in S47 is completed, the operation returns to S31.
  • The variation example described above makes it possible, when the first drive instruction (the drive instruction to be the object of the judgment in S31) is issued, to perform the application of the illumination light to the sample 8 and display of the live image in the observed image display area 31 without actually carrying out the drive operation. When the second drive instruction (the drive instruction to be the object of the judgment in S36) is issued during a predetermined period of time after the first instruction, the actual drive operation is performed, preventing the drivable unit from being driven (from moving) before the application of the illumination becomes relatively stable.
  • FIG. 6 is a flowchart showing a variation example of the operation example 2.
  • The variation example shows an operation starting, as well as the operation example 2, for example, upon the completion of the flow shown in FIG. 3 described above, i.e. when the still image of the observed image is displayed in the observed image display area 31 on the screen of the monitor 22 and the illumination light from the epi-illumination light source 3 to the sample 8 is being cut off. It is assumed that at the starting point of this operation, the microscope apparatus 2 is in the idle status (Status=Idle). Also, it is assumed that at the starting point of this operation, the timer has been reset, as well as in the operation example 2.
  • As shown in FIG. 6, upon the start of the flow, judgment is performed as to whether or not the time measured by the timer started in S56 (described later) has exceeded a predetermined amount of time (S51). When the judgment result is Yes, the timer is reset (S62), and the status of the microscope apparatus 2 is shifted to the idle status (Status=Idle) (S52). When the judgment result is No, S62 and S52 are skipped. However, the judgment result in S51 becomes No, when the timer is in the reset status.
  • Next, judgment is performed as to whether or not there is any drive instruction for a drivable unit (S53). When the judgment result is No, the process returns to S51. When the judgment result is Yes, judgment is performed as to whether or not the microscope apparatus 2 is in the drive-ready status (Status=Ready) (S54).
  • When the judgment result in S54 is No, the status of the microscope apparatus 2 is shifted to the drive-ready status (Status=Ready) (S55); the measurement by the timer is started (S56); and the process returns to S51.
  • Meanwhile, when the judgment result in S54 is Yes, the timer is reset (S63). Next, processes similar to those performed in S22-S26 in FIG. 4 are performed in S57-S61, completing the flow. In this case where the judgment result in S54 is Yes, the status of the microscope apparatus 2 is shifted to the idle status (Status-Idle).
  • The variation example descried above makes it possible, when the first drive instruction is issued, to shift the status of the microscope apparatus 2 to the drive-ready status without actually performing the drive operation. When the second drive instruction is issued during a predetermined period of time after the first instruction, the application of the illumination light to the sample 8, the display of the live image in the observed image display area 31 and the actual drive operation are performed.
  • Second Embodiment
  • A microscope system according to the second embodiment of the present invention has the basically same configuration as the microscope system according to the first embodiment but operates in a different way.
  • The microscope system according to the present embodiment is capable of performing video AF. Video AF is a method for performing AF (autofocus) by moving the stage 9 to the focus position in the Z direction, on the basis of the image captured by the digital camera 18. While the video AF is performed, the illumination light is applied to the sample 8, and when the video AF is completed, the cut off of the illumination light to the sample 8 and the display of the still image in the observed image display area 31 are performed.
  • FIG. 7 is a flowchart showing an operation example of a microscope system according to the embodiment.
  • As shown in FIG. 7, upon the start of the flow, judgment is performed as to whether or not there has been an AF start instruction (S71). The AF start instruction can be given by, for example, operating the microscope operation unit 17 or the input unit 23.
  • When the judgment result in S71 is No, the judgment is repeated. When the judgment result is Yes, the application of the illumination light to the sample 8 is started (S72). The display of the live image in the observed image display area 31 may be started at the same time.
  • Next, judgment is performed as to whether of not the focusing has been completed (whether or not the video AF is completed) (S73). When its judgment result is No, focus-part control is performed (S74), and the process returns to S73. The focus-part control refers to the control to move the stage 9 to the focus point in the Z direction in accordance with the image captured by the digital camera 18, on order to bring the observed image into focus.
  • Meanwhile, when the judgment result in S73 is Yes, the flow is terminated after the same process as in S7-S10 shown in FIG. 3 are performed in S75-S78. Meanwhile, the still image captured in S75 is used as the still image of the observed image after the focusing by the video AF.
  • Thus, the microscope system according to the present embodiment is capable of, when observing a part while utilizing video AF, applying the illumination light to the sample 8 while the video AF is performed. When the video AF is completed, the cut of the illumination light to the sample 8 and the display of the still image in the observed image display area 31 can be performed, avoiding unnecessary damage caused to the sample 8.
  • Third Embodiment
  • A microscope system according to the embodiment of the present invention has the basically same configuration as the microscope system according to the first embodiment but operates in a different way.
  • In the operation according to the first embodiment described above, in the status, for example, upon the completion of the flow shown in FIG. 3, when driving instruction for a drivable unit is issued while the still image of the observed image is displayed in the observed image display area 31 on the screen of the monitor 22 and the illumination light to the sample 8 is being cut off, the processes are performed in the same order, for example as shown in the flow in FIG. 4, regardless of the drivable unit specified to be driven by the drive instruction. By contrast, in the operation according to the present embodiment, when drive instruction for a drivable unit is issued, the order of the processes is changed depending on the specified drivable unit.
  • FIG. 8 is a flowchart showing an operation example of a microscope system in accordance with the present embodiment. As mentioned above, the example shows an operation starting, for example, upon the completion of the flow shown in FIG. 3, when the still image of the observed image is displayed in the observed image display area 31 on the screen of the monitor 22 and the illumination light to the sample 8 is being cut off.
  • As shown in FIG. 8, upon the start of the flow, judgment is performed as to whether or not there has been a drive instruction for a drivable unit (S81). The process performed in S81 is the same as the one performed in S21.
  • When the judgment result in S81 is No, the judgment is repeated. When the judgment result is Yes, the drivable unit specified by the drive instruction is detected next (S82).
  • When the stage 9 is detected as the specified drivable unit in S82 (S83), the same processes as in S22-S25 in FIG. 4 are performed in S84-S87. Next, judgment is performed as to whether or not switching of the image displayed in the observed image display area 31 on the screen of the monitor 22 from the still image to the live image has been completed (S88). When the judgment result is No, the judgment is repeated. When the judgment result is Yes, the instructed amount to drive the stage 9 is detected from the drive instruction corresponding to the judgment result Yes in S81 (S89), and the stage 9 is driven in accordance with the instructed drive amount (S90), completing the flow.
  • When the zoom optical system 14 is detected as the specified drivable unit in S82 (S105), the same processes as in S83-S88 described above are performed in S106-S110. When the judgment result in S110 is Yes, the instructed amount to drive the zoom optical unit 14 is detected from the drive instruction corresponding to the judgment result Yes in S81 (S111), and the zoom optical system 14 is driven in accordance with the instructed drive amount (S112), completing the flow.
  • When the objective lens 12 is detected as the specified drivable unit in S82 (S91), the drive (for switching) of the objective lens 12 is started in accordance with the drive instruction for the objective lens 12 corresponding to the judgment result Yes in S81 (S92), and then judgment is performed as to whether or not the driving of the objective lens 12 has been completed (S93). When the judgment result is No, the judgment is repeated. When the judgment result is Yes, the application of the illumination light to the sample 8 is started (S94). The process performed in S94 is similar to the one in S22 in FIG. 4. Next, image capturing conditions in accordance with the driven objective lens 12 are set in the digital camera 18 (S95); image capturing for the live-image display is started (S96); and live-image display in the observed image display area 31 on the screen of the monitor 22 is started (S97), completing the flow.
  • When a cube of the cube turret 7 is detected as the specified drivable unit in S82 (S98), the drive (for switching) of the cube is started in accordance with the drive instruction for the cube corresponding to the judgment result Yes in S81 (S99), and then judgment is performed as to whether or not the driving of the cube has been completed (S100). When the judgment result is No, the judgment is repeated. When the judgment result is Yes, similar processes as in S94-S97 are performed in S101-S104, completing the flow. However, in S102, image capturing conditions in accordance with the driven cube are set in the digital camera 18.
  • According to the operation example as described above, when the drivable unit specified by the drive instruction is the stage 9 that changes the relative position of the sample 8 and the objective lens 12 or the zoom optical system 14, processes are performed in the following order: application of the illumination light to the sample 8; display of the live image in the observed image display area 31 on the screen of the monitor 22; and driving of the stage 9 in accordance with the drive instruction. Thus, since the driving of the stage 9 or the zoom optical system 14 starts after the image displayed in the observed image display area 31 is switched to the live image, the user can view the live image of the sample 8 from the beginning of the driving of the stage 9 or the zoom optical system 14.
  • when the drivable unit specified by the drive instruction is the objective lens 12 or the cube, processes are performed in the following order: driving of the objective lens 12 or the cube in accordance with the drive instruction; application of the illumination light to the sample 8; and display of the live image in the observed image display area 31 on the screen of the monitor 22. Thus, since the application of the illumination light to the sample 8 and the display of the live image in the observed image display area 31 on the screen of the monitor 22 are performed after the driving of the objective lens 12 or the cube is completed, unnecessary application of the illumination light and unnecessary display of the live image can be avoided before the switch of the objective lens 12 or the cube is completed.
  • While the flow illustrates the examples when the drivable unit specified by the drive instruction is the stage 9, the zoom optical system 14, the objective lens 12 or the cube, similar processes can be performed for other drivable units, on the basis of the following idea. The same processes as when the specified drivable unit is the stage 9 (the processes in and after S83) can be performed with drive instruction for the specified unit, when it is desired to view the observed image of the sample 8 as the live image from the beginning of the driving of the unit. Alternatively, the same processes as when the specified drivable unit is the objective lens 12 or the cube (the processes in and after S91 or S98) with the drive instruction for the specified unit, when the application of the illumination light and the display of the live image are not required until the driving of the specified unit is completed.
  • As described above, the microscope system according to the embodiment is capable of performing processes in appropriate orders depending on the drivable unit specified by the drive instruction, providing further excellent operability in addition to minimized damage to the sample 8.
  • For the first to third embodiments described above, the following modifications may be made to each of them.
  • For example, while the cut off of the illumination is done through the control to turn off the epi-illumination light source 3 in each embodiment, the cut off of the illumination light to the sample 8 may be performed, also by shutting the epi-light shutter 5.
  • In addition, in each embodiment, instead of cutting of the illumination light to the sample 8, the ND filter 6 can be inserted in to the illumination optical path, thereby reducing the amount of illumination light to the level at which the sample 8 would not be damaged.
  • In addition, each embodiment may be configured so that, instead of cutting off the illumination light through the control to turn off the epi-illumination light source 3, the user can arbitrarily select and set, on the control application GUI for controlling the microscope apparatus 2 displayed on the screen of the monitor 22, either to cut off the illumination light by shutting the epi-light shutter 5; or to reduce, by inserting the ND filter 6 into the illumination light path, the amount of the illumination light to the level at which the sample 8 would not be damaged; or to perform control to reduce the amount of light from the epi-illumination light source 3. Alternatively, the arbitrary selection and setting may be done by operating the microscope operation unit 17.
  • In addition, each embodiment may be configured so that the various instructions can be given by operating the microscope operation unit 17, instead of giving the instructions on the control application GUI for controlling the microscope apparatus 2 displayed on the screen of the monitor 22.
  • In addition, while the application/cutting off of the illumination light to the sample 8 is performed automatically in each embodiment, they can be performed manually, for example, on the control application GUI for controlling the microscope apparatus 2 displayed on the screen of the monitor 22 or by operating the microscope operation unit 17.
  • In addition, each embodiment may be configured to comprise selectable operation modes, i.e., an automatic mode and a manual mode, so that one or more operations shown in FIG. 3-FIG. 8 described above are performed when the automatic mode is selected, and the operations such as the application/cutting of the illumination light to the sample 8, capturing of the still image, display of the still image or the live image are performed manually, when the manual mode is selected.
  • While the present invention has been described in detail above, the invention is not limited to the above embodiments, and various improvements and modifications can be made without departing from the spirit of the present invention.
  • As described above, the present invention makes it possible, when, for example, searching for a target part in a sample while viewing the observed image in real time, to minimize damage to the sample while realizing excellent operability.

Claims (9)

1. A microscope system that is capable of changing a status of observation of a sample, comprising:
an illumination unit for applying illumination light to the sample;
a driving unit for driving one or more optical members including an objective lens;
a position changing unit for changing a relative position of the sample and the objective lens;
a control unit for controlling the illumination light for the sample to be applied, cut off or reduced;
an instruction unit for giving instruction for driving any of the one or more optical members or for changing the relative position;
an image capturing unit for capturing an observed image of the sample as a still image or a live image; and
a display unit for displaying the still image or live image captured by the image capturing unit; wherein
an order for performing operations is changed in accordance with the instruction from the instruction unit, the operations including an operation of driving the one or more optical members or changing the relative position; an operation of switching the illumination light for the sample from being cut-off or reduced to being applied; and an operation of switching an image displayed in the display unit from the still image to the live image.
2. The microscope system according to claim 1, wherein
when the instruction from the instruction unit is for driving a zoom optical system or for changing the relative position, operations are performed in an order of: the operation of switching the illumination light for the sample from being cut-off or reduced to being applied; followed by the operation of switching the image displayed in the display unit from the still image to the live image; followed by the operation of driving the zoom optical system or changing the relative position.
3. The microscope system according to claim 2, wherein
the operation of driving the zoom optical system or changing the relative position starts after the operation of switching the image displayed in the display unit from the still image to the live image is completed.
4. The microscope system according to claim 2, further comprising an image capturing conditions storing unit for storing image capturing conditions under which the still image was captured, wherein
the live image displayed in accordance with the operation of switching the image displayed in the display unit from the still image to the live image is an image captured as the live image under the image capturing conditions stored in the image capturing condition storing unit.
5. The microscope system according to claim 1, wherein
when the instruction from the instruction unit is for driving the objective lens or a cube, operations are performed in an order of: the operation of driving the objective lens or the cube; followed by the operation of switching the illumination light for the sample from being cut-off or reduced to being applied; followed by the operation of switching the image displayed in the display unit from the still image to the live image.
6. The microscope system according to claim 5, wherein
the operation of switching the illumination light for the sample from being cut-off or reduced to being applied starts after the operation of driving the objective lens or the cube is completed.
7. A control method for controlling a microscope system that is capable of changing a status of observation of a sample, wherein
an order for performing operations is changed in accordance with an instruction for driving one or more optical members including an objective lens or for changing a relative position of the sample and the objective lens, the operations including an operation of driving the one or more optical members or changing the relative position; an operation of switching an illumination light for the sample from being cut-off or reduced to being applied; and an operation of switching an observed image of the sample to be captured and displayed as a live image instead of a still image.
8. The control method of a microscope system according to claim 7, wherein
in accordance with an instruction for driving a zoom optical system or for changing the relative position, operations are performed in an order of: the operation of switching an illumination light for the sample from being cut-off or reduced to being applied; followed by the operation of switching an observed image of the sample to be captured and displayed as a live image instead of a still image; followed by the operation of driving the zoom optical system or changing the relative position.
9. The control method of a microscope system according to claim 7, wherein
in accordance with an instruction for driving an objective lens or a cube, operations are performed in an order of: the operation of driving the objective lens or the cube; followed by the operation of switching an illumination light for the sample from being cut-off or reduced to being applied; followed by the operation of switching an observed image of the sample to be captured and displayed as a live image instead of a still image.
US13/562,855 2007-06-07 2012-07-31 Microscope system Abandoned US20120293864A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US13/562,855 US20120293864A1 (en) 2007-06-07 2012-07-31 Microscope system

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
JP2007152010 2007-06-07
JP2007-152010 2007-06-07
JP2008111538A JP5305719B2 (en) 2007-06-07 2008-04-22 Microscope system
JP2008-111538 2008-04-22
US12/132,097 US8264768B2 (en) 2007-06-07 2008-06-03 Microscope system
US13/562,855 US20120293864A1 (en) 2007-06-07 2012-07-31 Microscope system

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US12/132,097 Division US8264768B2 (en) 2007-06-07 2008-06-03 Microscope system

Publications (1)

Publication Number Publication Date
US20120293864A1 true US20120293864A1 (en) 2012-11-22

Family

ID=39705230

Family Applications (2)

Application Number Title Priority Date Filing Date
US12/132,097 Active 2031-05-30 US8264768B2 (en) 2007-06-07 2008-06-03 Microscope system
US13/562,855 Abandoned US20120293864A1 (en) 2007-06-07 2012-07-31 Microscope system

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US12/132,097 Active 2031-05-30 US8264768B2 (en) 2007-06-07 2008-06-03 Microscope system

Country Status (2)

Country Link
US (2) US8264768B2 (en)
EP (1) EP2000842B1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150220255A1 (en) * 2012-08-20 2015-08-06 Canon Kabushiki Kaisha Information processing apparatus, information processing method, and related program
US10705325B2 (en) 2014-02-24 2020-07-07 Olympus Corporation Focusing method, measuring method, principal point detecting method, focusing device, measuring device, and principal point detecting device
EP3901683A1 (en) * 2020-04-24 2021-10-27 Leica Microsystems CMS GmbH Method of controlling imaging of a sample by a microscope and corresponding microscope

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5499732B2 (en) * 2009-06-23 2014-05-21 ソニー株式会社 Biological sample image acquisition apparatus, biological sample image acquisition method, and biological sample image acquisition program
JP5510956B2 (en) * 2010-01-07 2014-06-04 パナソニックヘルスケア株式会社 Control unit, control program and control method for observation unit, and observation system
JP2011180442A (en) 2010-03-02 2011-09-15 Sony Corp Device, method and program for acquisition of sample image
JP2012013804A (en) * 2010-06-29 2012-01-19 Sony Corp Image processing apparatus, image processing system and image processing method, and program
JP5863357B2 (en) * 2011-09-21 2016-02-16 オリンパス株式会社 Magnification observation apparatus, and image display method and spectroscopic method switching method of magnification observation apparatus
TWI499309B (en) * 2012-03-28 2015-09-01 Albert Chang Image control system and method thereof
JP2014174185A (en) * 2013-03-06 2014-09-22 Sony Corp Control device, control method, and imaging apparatus
EP3418710B1 (en) * 2016-02-19 2022-08-24 Nikon Corporation Sample preparation method and sample preparation device
PL3623798T3 (en) * 2018-09-13 2022-03-28 Euroimmun Medizinische Labordiagnostika Ag Method and device for detecting and representing an immunofluorescence image of a biological sample

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5703714A (en) * 1995-02-02 1997-12-30 Olympus Optical Co., Ltd. Microscope system for controlling optical elements in interlock with a variation in observation conditions
US6384967B1 (en) * 1998-09-11 2002-05-07 Olympus Optical Co., Ltd. Illumination apparatus for a microscope
US20050046905A1 (en) * 2003-08-25 2005-03-03 Olympus Corporation Microscopic image capturing apparatus, microscopic image capturing method, and storage medium recording microscopic image capturing program
US20070058054A1 (en) * 2005-09-15 2007-03-15 Olympus Copporation Observation apparatus

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2925647B2 (en) * 1990-04-16 1999-07-28 オリンパス光学工業株式会社 Microscope magnification changer
JP3321956B2 (en) 1994-01-20 2002-09-09 株式会社ニコン Microscope control device
US5517353A (en) * 1993-05-28 1996-05-14 Nikon Corporation Illuminating apparatus for a microscope
US6400502B1 (en) * 1998-08-18 2002-06-04 Nikon Corporation Microscope
JP2000066108A (en) 1998-08-18 2000-03-03 Nikon Corp Microscope
JP4186264B2 (en) 1998-08-18 2008-11-26 株式会社ニコン microscope
US6917377B2 (en) * 2000-02-04 2005-07-12 Olympus Optical Co., Ltd. Microscope system
JP4819988B2 (en) * 2000-07-14 2011-11-24 オリンパス株式会社 Microscope system, microscope system operation control method, and recording medium recording operation control program
JP2004101871A (en) * 2002-09-10 2004-04-02 Olympus Corp Photographing apparatus for microscope image
JP4253482B2 (en) * 2002-09-19 2009-04-15 オリンパス株式会社 Microscope equipment
JP4546741B2 (en) 2004-01-08 2010-09-15 オリンパス株式会社 Fluorescence microscope
JP2005331889A (en) 2004-05-21 2005-12-02 Keyence Corp Fluorescence microscope and fluorescence observation method
JP2006195274A (en) 2005-01-14 2006-07-27 Nikon Corp Microscope system
JP4970869B2 (en) 2005-09-12 2012-07-11 オリンパス株式会社 Observation apparatus and observation method
DE102005047261A1 (en) 2005-10-01 2007-04-05 Carl Zeiss Jena Gmbh Display image production method, involves producing display image of display image sequence from subsequence of two recorded exposure images of exposure image sequence, where number of display images is less than number of exposure images
US7929738B2 (en) 2005-10-11 2011-04-19 Olympus Corporation Microscope apparatus and microscope system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5703714A (en) * 1995-02-02 1997-12-30 Olympus Optical Co., Ltd. Microscope system for controlling optical elements in interlock with a variation in observation conditions
US6384967B1 (en) * 1998-09-11 2002-05-07 Olympus Optical Co., Ltd. Illumination apparatus for a microscope
US20050046905A1 (en) * 2003-08-25 2005-03-03 Olympus Corporation Microscopic image capturing apparatus, microscopic image capturing method, and storage medium recording microscopic image capturing program
US20070058054A1 (en) * 2005-09-15 2007-03-15 Olympus Copporation Observation apparatus

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150220255A1 (en) * 2012-08-20 2015-08-06 Canon Kabushiki Kaisha Information processing apparatus, information processing method, and related program
US10705325B2 (en) 2014-02-24 2020-07-07 Olympus Corporation Focusing method, measuring method, principal point detecting method, focusing device, measuring device, and principal point detecting device
EP3901683A1 (en) * 2020-04-24 2021-10-27 Leica Microsystems CMS GmbH Method of controlling imaging of a sample by a microscope and corresponding microscope
US20210333535A1 (en) * 2020-04-24 2021-10-28 Leica Microsystems Cms Gmbh Method of controlling imaging of a sample by a microscope and corresponding microscope
US11635609B2 (en) * 2020-04-24 2023-04-25 Leica Microsystems Cms Gmbh Method of controlling imaging of a sample by a microscope and corresponding microscope

Also Published As

Publication number Publication date
US8264768B2 (en) 2012-09-11
EP2000842A1 (en) 2008-12-10
EP2000842B1 (en) 2012-12-12
US20080304147A1 (en) 2008-12-11

Similar Documents

Publication Publication Date Title
US8264768B2 (en) Microscope system
EP1691230B2 (en) Photo-micrographing device and its control method
EP2328009B1 (en) Microscope system, storage medium in which control program therefor is stored, and control method therefor
US7949161B2 (en) Microscope system and method for synthesizing microscopic images
JP2008052227A (en) Observation apparatus
JP2007114742A (en) Observation apparatus
JP5191333B2 (en) Microscope system, program, and method
JP5192965B2 (en) Microscope system, control program, and control method
JP2005114859A (en) Microscope
US8284246B2 (en) Microscope system, control method used for microscope system, and recording medium for reproducing a microscope state based on microscope operation history and a microscope operation item
JP3917952B2 (en) Microscope system
JP2008151865A (en) Microscope system
JP5305719B2 (en) Microscope system
JP2010020206A (en) Microscope apparatus
JP5532318B2 (en) Microscope device and recording medium
JP2009237267A (en) Microscope system, control method used for microscope system, and program
JP2008299027A (en) Microscope apparatus, its control program and control method
JP2008286871A (en) Optical microscope
JP2003185936A (en) Microscope system
JP5155673B2 (en) Microscope system
JP4820458B2 (en) Microscope system, microscope system operation control method, and recording medium recording operation control program
JP2003021790A (en) Image photographing device for microscope and image photographing method
JP2002277745A (en) Microscope device
JP2003167200A (en) Microscope apparatus, light controllable apparatus and light control method

Legal Events

Date Code Title Description
STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION