JP7060394B2 - Microscope system, display control method, and program - Google Patents

Description

The disclosure of the present specification relates to a microscope system, a display control method, and a program.

In the microscope system, the imaging position may be registered in advance and imaging may be performed at the registered imaging position. The registration of the shooting position is performed by first narrowing down the candidate area while observing a wide area with a low observation magnification, and then specifying the shooting position while observing the candidate area with a high observation magnification. Is common. However, when registering a large number of shooting positions by this procedure, the user must repeatedly switch the observation magnification between low magnification and high magnification.

To address such technical issues, a technique for displaying a wide-field image acquired in advance in addition to a live image and displaying a mark indicating an area (that is, a field of view) corresponding to the live image on the wide-field image. Has been proposed. According to this technique, it is not necessary to frequently switch the magnification between low magnification and high magnification, so that the operability of the microscope system at the time of registering the imaging position is greatly improved.

The wide-field image is an image corresponding to a wider area than the live image, for example, an image taken at a shooting magnification lower than that of the live image, and a plurality of images as described in Patent Document 1. Images generated by pasting together, etc.

Japanese Unexamined Patent Publication No. 2014-222320

By the way, there are times when you want to check the images of the already registered shooting positions in some detail. For example, there are cases where the number of registered shooting positions becomes too large during registration of shooting positions, or when it is desired to review the shooting positions.

However, in the prior art, in such a case, the field of view must be moved to the registered shooting position and the image at the shooting position must be displayed as a live image. Alternatively, the image at the shooting position must be confirmed with a small image displayed as part of the wide field image. In either case, it is not easy to check the image at the shooting position.

From the above circumstances, an object of the present invention is to provide a technique for easily confirming an image of a registered shooting position.

The microscope system according to one aspect of the present invention includes a microscope device, a shooting position list including information on at least one registered shooting position, a first image corresponding to the current field of view of the microscope device, and the field of view. A second image corresponding to a wider area and a control device for displaying a display screen including the display screen on the display device, wherein the control device is located on the second image at the at least one shooting position. A first mark indicating each of them and a second mark indicating the position of the current field of view in a display form distinguishable from the first mark are displayed on the display device and included in the shooting position list. When any of the information is selected by the user, the third image in which the shooting position corresponding to the selected information is taken before the user's selection is set to be larger than the display magnification of the second image. The display device is displayed at the same time as the first image and the second image at a high display magnification.

The display control method according to one aspect of the present invention includes a shooting position list including information on at least one registered shooting position, a first image corresponding to the current field of view of the microscope device, and a region wider than the field. The present is in a display form in which the second image corresponding to the above, the first mark indicating each of the at least one shooting position displayed on the second image, and the first mark can be distinguished from each other. A display screen including a second mark indicating the position of the field of view of the image is displayed, and when any information included in the shooting position list is selected by the user, the shooting position corresponding to the selected information is displayed. A computer performs a process of displaying a third image taken before the user's selection at a display magnification higher than the display magnification of the second image at the same time as the first image and the second image. Executes.

The program according to one aspect of the present invention corresponds to a shooting position list including information on at least one registered shooting position, a first image corresponding to the current field of view of the microscope device, and a region wider than the field. The current visual field in a display form in which the first mark indicating each of the second image and the at least one shooting position displayed on the second image and the first mark can be distinguished from each other. A display screen including a second mark indicating the position of is displayed, and when any information included in the shooting position list is selected by the user, the shooting position corresponding to the selected information is selected by the user. The process of displaying the third image taken before the selection of the first image and the second image at the same time as the first image and the second image at a display magnification higher than the display magnification of the second image is executed on the computer. Let me.

According to the above aspect, it is possible to provide a technique for easily confirming an image of a registered shooting position.

It is a figure which illustrated the structure of the microscope system 1 which concerns on 1st Embodiment. It is a figure exemplifying the hardware composition of the control device 20. It is a flowchart of the process performed by the microscope system 1. It is a figure for demonstrating the navigation image M2. It is a figure which showed the display screen G before registration of a shooting position. It is a flowchart of the imaging position registration process performed by the microscope system 1. It is a figure which showed the display screen G1 after the shooting position registration. It is a figure which showed the display screen G2 after selection of a shooting position. It is a flowchart of the imaging position enlargement display processing performed by the microscope system 1. It is a figure which showed the display screen G3 after selection of a shooting position. It is a figure which showed the display screen G4 after selection of a shooting position. It is a figure which showed the display screen G5 after selection of a shooting position. It is a flowchart of another imaging position enlargement display processing performed by the microscope system 1. It is a figure which showed the display screen G6 after selection of a shooting position. It is a figure which showed the display screen G7 after the shooting position registration. It is a figure which showed the display screen G8 after selection of a shooting position. It is a flowchart of the imaging position enlargement display processing performed by the microscope system which concerns on 2nd Embodiment.

[First Embodiment]
FIG. 1 is a diagram illustrating the configuration of the microscope system 1. FIG. 2 is a diagram illustrating a hardware configuration of the control device 20. Hereinafter, the configuration of the microscope system 1 will be described with reference to FIGS. 1 and 2.

As shown in FIG. 1, the microscope system 1 includes a microscope device 10 and a control device 20 connected to the microscope device 10. The microscope system 1 may further include a display device 30 and an input device (keyboard 41, mouse 42) connected to the control device 20, respectively.

The microscope device 10 is, for example, a fluorescence microscope, and is an imaging device 11, a fluorescence filter cube 12, a revolver 13, an objective lens (objective lens 14, objective lens 15), a stage 16, a condenser 17, and a light source ( A light source 18a and a light source 18b) are provided.

The microscope device included in the microscope system 1 is not limited to a fluorescence microscope. The microscope device may be industrial rather than biological. Further, the microscope device is not limited to the fluorescence observation method, and may be compatible with other microscopy methods such as a bright field observation method, a dark field observation method, a differential interference contrast observation method, and a phase contrast observation method. Further, the microscope device may be a laser scanning type microscope. Further, the microscope device is not limited to the upright microscope, and may be an inverted microscope.

The photographing apparatus 11 is, for example, a digital camera including an image sensor that converts incident observation light into an electric signal. The image sensor is, for example, a CCD (Charge Coupled Device), a CMOS (Complementary Metal Oxide Semiconductor), or the like. The photographing apparatus 11 photographs a sample S, which is a subject, and generates a microscope image. The microscope image is output from the photographing device 11 to the control device 20.

The microscope image is an image of the subject, for example, a live image, a still image, or the like. The live image is, in a broad sense, a microscope image acquired by the microscope device 10 at a specified frame rate. Further, in a narrow sense, it is the latest microscope image acquired by the microscope device 10 at a specified frame rate. On the other hand, the still image is a microscope image acquired by the microscope device 10 with a setting that emphasizes image quality.

The photographing device 11 executes a photographing operation in accordance with a command from the control device 20. The control device 20 can change the settings of the photographing device 11 such as the exposure time and the photographing sensitivity. Further, the photographing apparatus 11 may perform automatic exposure control. The ON / OFF of the automatic exposure control may be changed by a command from the control device 20. The photographing device 11 may change the photographing sensitivity by, for example, changing the amplification factor (gain) of the electric signal. The amplification factor to be changed may be the amplification factor of an analog signal or the amplification factor of a digital signal. The photographing device 11 may change the photographing sensitivity by, for example, binning.

The fluorescence filter cube 12 includes, for example, a dichroic mirror, an excitation filter, and an absorption filter. The fluorescent filter cube 12 may be freely inserted and removed from the optical path by a turret or a slider (not shown).

The revolver 13 is a device for switching the objective lens arranged on the optical path. The revolver 13 is, for example, an electric revolver, and the objective lens is switched by a command from the control device 20. A plurality of objective lenses (objective lens 14, objective lens 15, ...) Are mounted on the revolver 13.

The revolver 13 may move in the optical axis direction of the objective lens. That is, the revolver 13 may function as a focusing portion of the microscope device 10. The revolver 13 may be moved by driving a stepping motor (not shown) connected to a ball screw (not shown) by the control device 20. However, the actuator of the revolver 13 is not limited to the combination of the ball screw and the stepping motor. For example, an ultrasonic motor may be used instead of the stepping motor. Further, the actuator may be attached with an encoder for detecting the movement amount.

Each of the objective lens 14 and the objective lens 15 is a microscope objective lens. The objective lens 14 and the objective lens 15 are, for example, infinity correction type objective lenses, and may have different magnifications, that is, different focal lengths.

A specimen S is arranged on the stage 16. The stage 16 is, for example, an electric stage, and moves according to a command from the control device 20. The stage 16 moves by driving a stepping motor (not shown) connected to a ball screw (not shown) by the control device 20. However, the actuator of the stage 16 is not limited to the combination of the ball screw and the stepping motor. For example, an ultrasonic motor may be used instead of the stepping motor. Further, the actuator may be attached with an encoder for detecting the movement amount.

The stage 16 moves in a direction orthogonal to the optical axis of the objective lens (objective lens 14 in FIG. 1) arranged on the optical path. The stage 16 may move in the optical axis direction of the objective lens. That is, the stage 16 may function as a focusing portion of the microscope device 10. Further, the stage 16 may be a rotating stage that rotates around the optical axis of the objective lens.

The condenser 17 includes a condenser lens that irradiates the sample S with illumination light. The capacitor 17 may be, for example, a universal capacitor compatible with various microscopy methods. Further, the capacitor 17 may be a swing-out capacitor. Further, the capacitor 17 may be mounted on a turret (not shown). The capacitors arranged on the optical path may be selected from a plurality of capacitors mounted on the turret according to the microscopy and / or the illumination range.

The light source 18a is a light source for epi-illumination. The light source 18a is a lamp light source such as a mercury lamp or a xenon lamp. Further, the light source 18a may be replaced with a light guide light source. The light source 18b is a light source for transmitted illumination and is attached to the rear of the main body of the microscope device. The light source 18b is, for example, an LED light source, but may be a halogen light source. Each of the light source 18a and the light source 18b is not limited to a specific type of light source. When the microscope device 10 is a laser scanning microscope, each of the light source 18a and the light source 18b may be a laser light source. The light source 18a and the light source 18b emit illumination light according to a command from the control device 20. Further, the light source 18a and the light source 18b may change the emission amount of the illumination light by a command from the control device 20.

The control device 20 is, for example, a standard computer. As shown in FIG. 2, the control device 20 includes a processor 21, a memory 22, an I / O interface 23, a storage 24, a portable storage medium driving device 25 in which the portable storage medium 28 is housed, and a NW interface 26. These components are interconnected by a bus 27.

The processor 21 includes, for example, a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a DSP (Digital Signal Processor), and the like, and executes a program to perform programmed processing.

The memory 22 is, for example, a RAM (Random Access Memory). The memory 22 functions as a work memory for storing the program or data stored in the storage 24 or the portable storage medium 28 when the program is executed.

The I / O (Input / Output) interface 23 is, for example, a USB (Universal Serial Bus) interface circuit, an HDMI (registered trademark) (High-Definition Multimedia Interface) circuit, or the like. A microscope device 10, a display device 30, and an input device (keyboard 41, mouse 42) are connected to the I / O interface 23. The storage 24 is, for example, a hard disk or a flash memory, and is mainly used for storing various data and programs.

The portable storage medium driving device 25 accommodates a portable storage medium 28 such as an optical disk and a compact flash (registered trademark). The portable storage medium 28 has a role of assisting the storage 24. The memory 22, the storage 24, and the portable storage medium 28 are examples of non-transient computer-readable storage media that store programs, respectively.

The NW (Network) interface 26 is, for example, a LAN (Local Area Network) card or the like. The NW interface 26 may communicate with a device (not shown) via a network. Data may be received from an external device of the microscope system 1 via the NW interface 26, or data acquired by the microscope system 1 may be transmitted to the external device via the NW interface 26.

The display device 30 is, for example, a liquid crystal display, an organic EL (OLED) display, a CRT (Cathode Ray Tube) display, or the like. The display device 30 displays various screens based on the display signal input from the control device 20.

The input device (keyboard 41, mouse 42) is a device directly operated by the user of the microscope system 1, and outputs an operation signal corresponding to the user's operation to the control device 20. The microscope system 1 may include, in addition to or instead of a keyboard, a mouse, a joystick, a touch panel, a stylus, and the like.

The configuration shown in FIG. 2 is an example of the hardware configuration of the control device 20, and the control device 20 is not limited to this configuration. The control device 20 may be a dedicated device instead of a general-purpose device. For example, a specially designed electric circuit may be provided in place of or in addition to the processor 21 that reads and executes a software program.

FIG. 3 is a flowchart of the process performed by the microscope system 1. FIG. 4 is a diagram for explaining the navigation image M2. FIG. 5 is a diagram showing the display screen G before registering the shooting position. FIG. 6 is a flowchart of the photographing position registration process performed by the microscope system 1. FIG. 7 is a diagram showing the display screen G1 after the shooting position is registered. Hereinafter, the processing performed by the microscope system 1 will be described in detail with reference to FIGS. 3 to 7, taking as an example the case where the microscope system 1 performs time-lapse photography.

The process of FIG. 3 is started when the user of the microscope system 1 operates the input device and the processor 21 executes a predetermined application program.

First, the microscope system 1 constructs the navigation image M2 (step S10). The microscope system 1 constructs a navigation image M2 in order to easily grasp which range of the sample S the live image displayed on the display device 30 is, and the live image is displayed on the navigation image M2. A mark indicating the area (field of view) corresponding to is displayed. Here, the navigation image M2 is an image corresponding to a region wider than the field of view of the microscope device 10, and is also referred to as a second image. On the other hand, the live image is an image corresponding to the field of view of the microscope device 10, and is also called a first image.

As shown in FIG. 4, the navigation image M2 is generated by laminating a plurality of still images (E1 to E12) acquired by the microscope device 10. The regions corresponding to the still images E1 to E12 are determined so that adjacent regions partially overlap each other. This makes it possible to combine a plurality of still images in the correct positional relationship by using the image information of the overlapping area. In FIG. 4, the entire sample S is contained in the navigation image M2, but the navigation image M2 does not necessarily have to include the entire sample S. The navigation image M2 may be generated for an area designated by the user using the input device.

In step S10, the stage 16 sequentially moves to the positions corresponding to each of the still images E1 to E12, and the photographing apparatus 11 performs an imaging operation at each position. As a result, the microscope device 10 acquires the still images E1 to E12 and outputs the acquired still images E1 to E12 to the control device 20. The control device 20 stores the coordinate information in the storage 24 together with the still image received from the microscope device 10. The coordinate information is, for example, the coordinate information used by the control device 20 for instructing the microscope device 10 in order to move the stage 16. Further, the coordinate information may be coordinate information calculated by the control device 20 based on the output from the encoder (not shown) included in the stage 16.

In step S10, after that, the control device 20 performs an alignment process to determine the bonding position for the still images E1 to E12. The specific method of alignment processing is not particularly limited, but SAD (Sum of Absolute Differences), SSD (Sum of Squared Differences), NCC (Normalized Cross Correlation), or POC (Phase-Only Correlation) is an evaluation function. It is possible to use the matching technique described above.

In step S10, the control device 20 further bonds the still images E1 to E12 according to the determined bonding position. At this time, image processing may be performed so that the joints of the images are inconspicuous.

When step S10 is completed, the control device 20 causes the display device 30 to display the display screen G including the live image M1, the navigation image M2, and the shooting position list L1 as shown in FIG. In the shooting position list L1, information for shooting at the registered shooting position (hereinafter, simply referred to as shooting information) is listed. The shooting information is information for each registered shooting position, and information on the shooting position (XYZ coordinates) and other shooting conditions (for example, microscopy, shooting magnification, presence / absence of time-lapse shooting, shooting time interval, Z stack). Includes shooting presence / absence, Z stack range, presence / absence of multi-channel shooting, multiple fluorescent filter cubes used in multi-channel shooting). However, before the registration of the shooting position, as shown in FIG. 5, the shooting position list L1 does not include the shooting information. Further, on the navigation image M2, a rectangular mark L indicating an area (field of view) corresponding to the live image is displayed.

Next, the microscope system 1 registers the imaging position (step S20). The microscope system 1 accepts designation of a position for shooting in time-lapse shooting, and registers the designated position as a shooting position. Details of step S20 are shown in FIG.

In step S20, the control device 20 monitors whether or not the position registration button provided in the window W is pressed (step S21), and when it detects that the position registration button is pressed, the current microscope device 10 Acquire a still image corresponding to the field of view of (step S22). After that, the control device 20 adds a rectangular mark R indicating a registered shooting position at the same position as the rectangular mark L on the navigation image M2 (step S23). Further, the control device 20 updates the imaging position list L1 using the position information of the current field of view of the microscope device 10 (step S24). Specifically, the control device 20 adds the position information of the current field of view of the microscope device 10 as the information of the shooting position registered in the shooting position list L1, and uses the position of the current field of view of the microscope device 10 as the shooting position. to register. As a result, the control device 20 obtains the shooting position list L1 including the registered shooting position information, the live image M1 corresponding to the field of view of the control device 20, and the navigation image M2 corresponding to a region wider than the field of view. The display device 30 is displayed on the display screen including the display screen.

In step S20, the control device 20 repeats the above processes from step S21 to step S24 until all the registration of the photographing position is completed. The control device 20 ends the registration of the shooting position by, for example, pressing the shooting button in the window W (step S25YES).

FIG. 7 shows a display screen G1 displayed on the display device 30 after registering the four shooting positions. When the four shooting positions are registered, the control device 20 displays a display including a shooting position list L1 including four shooting information corresponding to the four registered shooting positions, a live image M1, and a navigation image M2. The screen G1 is displayed on the display device 30. Further, on the navigation image M2, in addition to the rectangular mark L indicating the area (field of view) corresponding to the live image, the rectangular mark R indicating the registered shooting position is displayed. Each of the four rectangular marks R is paired with each of the four shooting information included in the shooting position list L1.

Finally, the microscope system 1 photographs the imaging position (step S30). When the photographing button in the window W is pressed, the microscope system 1 photographs the registered imaging positions in order and acquires a still image. Specifically, the stage 16 moves to the registered shooting positions in order, and the shooting device 11 performs a shooting operation at each position. As a result, the microscope device 10 acquires a still image at each of the registered shooting positions, and outputs the acquired still image to the control device 20. The control device 20 stores the coordinate information in the storage 24 together with the still image received from the microscope device 10. As for the shooting position where time-lapse shooting is performed, shooting is repeated at time intervals included in the shooting information.

FIG. 8 is a diagram showing a display screen G2 after selecting a shooting position. FIG. 9 is a flowchart of the imaging position enlargement display process performed by the microscope system 1. Hereinafter, the imaging position enlargement display process performed by the microscope system 1 will be described in detail with reference to FIGS. 8 and 9.

The shooting position enlargement display process shown in FIG. 9 is an example of a display control method, and is performed by the control device 20 in a state where at least one shooting position is registered. First, the microscope system 1 determines whether or not the imaging information in the imaging position list L1 is selected (step S41).

In step S41, the control device 20 may determine that the shooting information included in the shooting position list L1 has been selected when the click event occurs in the shooting position list L1. Further, the control device 20 may determine that the shooting information included in the shooting position list L1 is selected when the mouseover event occurs in the shooting position list L1. Note that FIG. 8 shows that the second shooting information included in the shooting position list L1 is selected.

When the imaging information included in the imaging position list L1 is selected, the microscope system 1 displays an enlarged image M3 of the imaging position corresponding to the selected imaging information (step S42). The enlarged image M3 is an image taken before the selection of the shooting position corresponding to the selected shooting information, and is also referred to as a third image. The enlarged image M3 may be the image acquired in step S22 of FIG. That is, when the control device 20 registers the shooting position corresponding to the selected shooting information, the microscope device 10 may take a picture of the shooting position. Further, the enlarged image M3 may be a part of the navigation image M2.

In step S42, the control device 20 causes the display device 30 to display the enlarged image M3 at a display magnification higher than the display magnification of the navigation image M2. That is, the enlarged image M3 is displayed with a display size larger than the rectangular mark R on the navigation image M2. As a result, the user can confirm the shooting position included in the navigation image M2 with an image enlarged from the navigation image M2.

When the enlarged image M3 is an image acquired in step S22, the control device 20 may display the enlarged image M3 at the same magnification. That is, the enlarged image M3 may be displayed at the same display magnification as the shooting magnification. When the enlarged image M3 is a part of the navigation image M2, the control device 20 enlarges and displays a part of the navigation image M2. That is, the enlarged image M3 is displayed at a display magnification higher than the shooting magnification.

In the present specification, the display magnification is the size (dimension) of the image on the display screen / the actual size (dimension) of the area corresponding to the image. The photographing magnification is the magnification of the optical system of the microscope device 10 at the time of photographing.

In step S42, as shown in FIG. 8, it is desirable that the control device 20 causes the display device 30 to display the magnified image M3 in a state of being associated with the shooting position corresponding to the magnified image M3 included in the navigation image M2. As a result, the user can grasp which position in the sample S the selected imaging position is.

Further, as shown in FIG. 8, the control device 20 may display the enlarged image M3 on the display device 30 at a position that does not overlap with the live image M1. Thereby, the user can compare the live image M1 with the image of the registered shooting position (enlarged image M3).

Further, as shown in FIG. 8, the control device 20 may display the enlarged image M3 on the display device 30 at a position that does not overlap with the selected shooting information in the shooting position list L1. As a result, the user can confirm the shooting information while displaying the image (enlarged image M3) of the registered shooting position. The user can also edit the shooting information while viewing the image of the registered shooting position (enlarged image M3).

As described above, in the microscope system 1, the enlarged image M3 of the shooting position is displayed on the display screen G2 only by selecting arbitrary shooting information included in the shooting position list L1. Therefore, the image of the registered shooting position can be easily confirmed. Further, in the microscope system 1, the image acquired before the user's selection is displayed as the magnified image M3. Therefore, it is not necessary to move the field of view of the microscope device 10 in order to confirm the image at the imaging position. That is, no mechanical operation such as movement of the stage 16 is required, and the enlarged image M3 can be displayed immediately, so that the user can confirm the image at the shooting position at an early stage. Further, in the microscope system 1, it is not necessary to perform shooting for live image acquisition or still image acquisition every time the image at the shooting position is confirmed. Therefore, it is possible to suppress damage to the specimen S caused by imaging. In particular, when the microscope device 10 is a fluorescence microscope for observing fluorescence, it is particularly desirable because it can suppress the progress of fading of the fluorescent substance.

10 and 11 are modified examples of the display screen displayed by the microscope system 1. Note that FIG. 10 is a diagram showing the display screen G3 after the shooting position is selected. FIG. 11 is a diagram showing a display screen G4 after selecting a shooting position.

When the imaging information included in the imaging position list L1 is selected, the microscope system 1 may display the display screen G3 shown in FIG. 10 on the display device 30. That is, the control device 20 may display the enlarged image M3 on the display device 30 in a state of being associated with the selected information in the shooting position list L1. At that time, the shooting position corresponding to the selected information included in the navigation image M2 may be displayed separately from other shooting positions. For example, the shooting position may be distinguished from other shooting positions by changing the color of the rectangular mark R, the transmittance in the rectangular mark, and the like. The rectangular mark R at the shooting position may be highlighted.

Further, the microscope system 1 may display the display screen G4 shown in FIG. 11 on the display device 30 when the imaging information included in the imaging position list L1 is selected. That is, the control device 20 may cause the display device 30 to display the enlarged image M3 in the window W1 different from the window W including the live image M1, the navigation image M2, and the shooting position list L1.

As a result, the user moves the window W1 with respect to the window W to confirm the enlarged image M3 at the same time as any information desired by the user (live image M1, navigation image M2, shooting information, etc.). Can be done.

FIG. 12 is a diagram showing a display screen G5 after selecting a shooting position. FIG. 13 is a flowchart of another imaging position enlargement display process performed by the microscope system 1. Hereinafter, another imaging position enlargement display process performed by the microscope system 1 will be described in detail with reference to FIGS. 12 and 13.

The shooting position enlargement display process shown in FIG. 13 is an example of the display control method, and is performed by the control device 20 in a state where at least one shooting position is registered, as in the shooting position enlargement display process shown in FIG. Will be. First, the microscope system 1 determines whether or not the registered shooting position included in the navigation image M2 has been selected (step S51).

In step S51, the control device 20 may determine that the shooting position has been selected when a click event occurs at the registered shooting position included in the navigation image M2. Further, the control device 20 may determine that the shooting position is selected when the mouse over event occurs at the registered shooting position included in the navigation image M2. Note that FIG. 12 shows that the shooting position corresponding to the second shooting information included in the shooting position list L1 is selected.

When the imaging position is selected, the microscope system 1 displays an enlarged image M3 of the selected imaging position (step S52). The process of step S52 is the same as the process of step S42 of FIG. The enlarged image M3 is an image (third image) taken at the selected shooting position before the selection.

In step S52, as shown in FIG. 12, the control device 20 causes the display device 30 to display the enlarged image M3 in a state of being associated with the shooting position corresponding to the enlarged image M3 included in the navigation image M2. Further, as shown in FIG. 12, it is desirable that the control device 20 displays the shooting information corresponding to the shooting position in the shooting position list L1 separately from other shooting information. As a result, the user can grasp the shooting information of the shooting position corresponding to the enlarged image M3.

FIG. 14 is a modification of the display screen displayed by the microscope system 1, and is a diagram showing the display screen G6 after selecting the imaging position. When the imaging position is selected, the microscope system 1 may display the display screen G6 shown in FIG. 14 on the display device 30. That is, the control device 20 may display the enlarged image M3 on the display device 30 in a state of being associated with the shooting information corresponding to the selected shooting position.

[Second Embodiment]
The microscope system according to the present embodiment has the same configuration as the microscope system 1 shown in FIG. Therefore, the components included in the microscope system according to the present embodiment are referred to with the same reference numerals as the components included in the microscope system 1. The microscope system according to the present embodiment is different from the microscope system 1 in that it displays a plurality of navigation images having different areas (observation ranges).

FIG. 15 is a diagram showing the display screen G7 after the shooting position is registered. As shown in FIG. 15, the display screen G7 includes a region corresponding to the navigation image M2 in addition to the navigation image M2 corresponding to a region wider than the field of view of the microscope device 10, and is larger than the region corresponding to the navigation image M2. A navigation image M4 corresponding to a large area is included. Such a screen configuration is suitable, for example, when time-lapse photography is performed on a plurality of specimens.

FIG. 16 is a diagram showing a display screen G8 after selecting a shooting position. FIG. 17 is a flowchart of the imaging position enlargement display process performed by the microscope system according to the present embodiment. Hereinafter, the imaging position enlargement display process performed by the microscope system according to the present embodiment will be described in detail with reference to FIGS. 16 and 17.

The shooting position enlargement display process shown in FIG. 17 is an example of a display control method, and like the shooting position enlargement display process shown in FIGS. 9 and 13, the control device is in a state where at least one shooting position is registered. It is done by 20. The microscope system first determines whether or not the imaging information in the imaging position list L1 has been selected (step S61). This process is the same as step S41 in FIG.

When the imaging information included in the imaging position list L1 is selected, the microscope system determines whether or not the imaging position corresponding to the selected imaging information is included in the navigation image M2 (step S62). The navigation image M2 displayed on the display device 30 is usually an image including the field of view (region corresponding to the live image M1) of the microscope device 10. Therefore, when the shooting information corresponding to the shooting position far away from the field of view is selected, the shooting position corresponding to the selected shooting information may not be included in the navigation image M2.

When the navigation image M2 does not include the shooting position corresponding to the selected shooting information, the microscope system displays the navigation image M2 with an image including the shooting position and corresponding to a wider area than the live image M1. Update (step S63). FIG. 16 shows how the navigation image M2 is updated and the updated navigation image M2a is displayed.

Further, the microscope system displays the magnified image M3 of the imaging position corresponding to the selected imaging information (step S64). This process is the same as in step S42 of FIG.

On the other hand, when the navigation image M2 includes a shooting position corresponding to the selected shooting information, the microscope system displays the magnified image M3 without updating the navigation image M2 (step S64).

As described above, even in the microscope system according to the present embodiment, the point that the image of the registered shooting position can be easily confirmed, the point that the image of the shooting position can be confirmed at an early stage, and the occurrence occurs with the shooting. The point that damage to the specimen S can be suppressed is the same as that of the microscope system 1. Further, in the microscope system, even when a plurality of specimens are photographed, an arbitrary imaging position can be easily confirmed.

The above-described embodiments show specific examples for facilitating the understanding of the invention, and the embodiments of the present invention are not limited thereto. The microscope system, display control method, and program can be variously modified and modified without departing from the description of the claims.

In the above-described embodiment, an example in which a navigation image is generated by pasting still images is shown, but the navigation image may be generated by pasting live images. Further, the navigation image is not limited to the image generated by pasting a plurality of images. The navigation image may be an image corresponding to a region wider than the field of view of the microscope device 10 at the time of registering the imaging position. The navigation image may be an image acquired in advance using an objective lens having a lower magnification than the objective lens used when registering the shooting position.

The shooting position list L1 is not limited to a format that constantly displays a plurality of shooting information, such as a list view and a list box. For example, a plurality of shooting information may be displayed in a list as needed, such as a drop-down list.

1 ... Microscope system, 10 ... Microscope device, 11 ... Imaging device, 12 ... Fluorescent filter cube, 13 ... Revolver, 14, 15 ... Objective lens, 16 ... Stage, 17 ... Condenser, 18a, 18b ... Light source, 20 ... Control device, 21 ... Processor, 22 ... Memory, 23 ... I / O interface, 24 ... Storage, 25. ... Portable storage medium drive device, 26 ... NW interface, 27 ... Bus, 28 ... Portable storage medium, 30 ... Display device, 41 ... Keyboard, 42 ... Mouse, E1 to E12 ... Still image, G, G1 to G8 ... Display screen, L, R ... Rectangular mark, L1 ... Shooting position list, M1 ... Live image, M2, M2a, M4 ...・ ・ Navigation image, M3 ・ ・ ・ Enlarged image, S ・ ・ ・ Specimen, W, W1 ・ ・ ・ Window

Claims (13)

With a microscope device
Includes a shooting position list containing information on at least one registered shooting position, a first image corresponding to the current field of view of the microscope device, and a second image corresponding to a region wider than the field of view. It is equipped with a control device that displays the display screen on the display device.
The control device is
On the second image, a first mark indicating each of the at least one shooting position and a second mark indicating the position of the current visual field in a display form distinguishable from the first mark. , Is displayed on the display device.
When any information included in the shooting position list is selected by the user, a third image obtained by taking a shooting position corresponding to the selected information before the user's selection is taken as the second image. A microscope system characterized in that the first image and the second image are displayed on the display device at the same time as the first image and the second image at a display magnification higher than the display magnification of the image. In the microscope system according to claim 1,
The third image is a microscope system characterized in that the microscope device captures the imaging position when the control device registers the imaging position corresponding to the selected information. In the microscope system according to claim 1,
The microscope system, characterized in that the third image is a part of the second image. In the microscope system according to any one of claims 1 to 3.
The control device is an image that includes the imaging position and corresponds to a region wider than the field of view when the imaging position corresponding to the selected information is not included in the second image. A microscope system characterized by updating an image of. In the microscope system according to claim 4,
The display screen further includes a fourth image corresponding to a region corresponding to the second image and wider than the region corresponding to the second image. In the microscope system according to any one of claims 1 to 5.
The control device is a microscope system characterized in that the third image is displayed on the display device at a position that does not overlap with the first image. In the microscope system according to any one of claims 1 to 6.
The control device is a microscope system characterized in that the third image is displayed on the display device at a position that does not overlap with the selected information in the shooting position list. In the microscope system according to any one of claims 1 to 7 .
The control device is a microscope system characterized in that the display device displays the third image in a state associated with the selected information in the shooting position list. In the microscope system according to any one of claims 1 to 8 .
The control device is
When any one of the at least one shooting positions included in the second image is selected by the user, the third image is displayed at a display magnification higher than the display magnification of the second image. A microscope system characterized by displaying on a display device. In the microscope system according to any one of claims 1 to 9 .
The control device is a microscope system characterized in that a plurality of images acquired by the microscope device are bonded together to generate the second image. In the microscope system according to any one of claims 1 to 10 .
The microscope device is a microscope system including a fluorescence microscope. A shooting position list containing information on at least one registered shooting position, a first image corresponding to the current field of view of the microscope device, a second image corresponding to a region wider than the field of view, and the second image. A first mark indicating each of the at least one shooting position and a second mark indicating the position of the current visual field in a display form that can be distinguished from the first mark, which are displayed on the image of the above. Display the display screen including
When any information included in the shooting position list is selected by the user, the third image obtained by shooting the shooting position corresponding to the selected information before the user's selection is taken as the second image. A display control method characterized in that a computer executes a process of displaying at the same time as the first image and the second image at a display magnification higher than the display magnification of the image. A shooting position list containing information on at least one registered shooting position, a first image corresponding to the current field of view of the microscope device, a second image corresponding to a region wider than the field of view, and the second image. A first mark indicating each of the at least one shooting position and a second mark indicating the position of the current visual field in a display form that can be distinguished from the first mark, which are displayed on the image of the above. Display the display screen including
When any information included in the shooting position list is selected by the user, the third image obtained by shooting the shooting position corresponding to the selected information before the user's selection is taken as the second image. A program characterized in that a computer is made to execute a process of displaying at the same time as the first image and the second image at a display magnification higher than the display magnification of the image.

Images