WO2024053632A1 - Microscope system, superimposition unit, superimposition display method, and program - Google Patents

Abstract

A microscope system (1) comprises: an eyepiece lens (30); an observation optical system (100); a reading device (50); a superimposition device (25); and a control device (70). The observation optical system (100) forms a specimen image, using observation light from a specimen (S), on an image surface on the object side of the eyepiece lens (30). The reading device (50) reads identification information attached to the specimen (S). The superimposition device (25) superimposes, onto the image surface, specimen information obtained on the basis of the identification information. By controlling the superimposition device, the control device (70) switches the display position of the specimen information on the image surface when prescribed conditions are met.

Description

Microscope system, superimposition unit, superimposition display method, program

The disclosure of this specification relates to a microscope system, a superimposition unit, a superimposition display method, and a program.

In recent years, it is expected that AI (Artificial Intelligence) will support work performed under a microscope. An AR (Augmented Reality) microscope is known as a microscope that can provide such AI support.

In an AR microscope, by displaying auxiliary information on the image plane, it is possible to simultaneously observe the optical image of the specimen (hereinafter referred to simply as the specimen image) and the auxiliary information through the eyepiece. Auxiliary information is not necessarily limited to what is created using AI. For example, when used by a pathologist in pathological diagnosis, the auxiliary information is specimen information (mainly text information, such as the patient ID of the specimen, etc.) obtained by reading the code attached to the specimen. (patient name, date of birth, age, gender, organ, staining information, etc.).

Techniques related to such an AR microscope are described in, for example, Patent Document 1 and Patent Document 2.

Japanese Patent Application Publication No. 8-29694 Special Publication No. 2019-532352

By the way, if the specimen information is displayed overlapping the specimen image on the image plane, it becomes difficult to see both the specimen image and the specimen information. Therefore, it is conceivable to form a light-shielding area in which the specimen image is not projected within the field of view of the eyepiece, and to display specimen information in the light-shielding area.

However, if the light shielding area is provided near the center of the field of view, there is a risk that observation of the specimen image will be obstructed. On the other hand, if a light shielding area is provided at the periphery of the field of view, it becomes necessary to move the line of sight to confirm specimen information.

Based on the above circumstances, an object of one aspect of the present invention is to provide a technique that allows specimen information to be easily grasped without interfering with observation of specimen images.

A microscope system according to one aspect of the present invention includes an eyepiece, an observation optical system that forms a specimen image on an object-side image plane of the eyepiece using observation light from the specimen, and a reader that reads identification information attached to the specimen. a superimposing section that superimposes the specimen information acquired based on the identification information on the image plane; and a control section that controls the superimposing section, the controller controlling the display position of the specimen information on the image plane when a predetermined condition is satisfied. and a control unit for switching.

A superimposing unit according to one aspect of the present invention is a superimposing unit for a microscope system, and the superimposing unit is a superimposing unit for a microscope system, in which a specimen is placed on an image plane on which a specimen image is formed, which is an image plane located on the object side of an eyepiece included in the microscope system. The image forming apparatus includes a superimposing section that superimposes specimen information acquired based on identification information attached to the image, and a control section that switches the display position of the specimen information on the image plane when a predetermined condition is satisfied.

A superimposed display method according to one aspect of the present invention is a superimposed display method performed by a microscope system, in which an image plane located on the object side of an eyepiece included in the microscope system and on which a specimen image is formed. , the specimen information acquired based on the identification information attached to the specimen is superimposed, and the display position of the specimen information on the image plane is switched when a predetermined condition is satisfied.

A program according to one aspect of the present invention causes a computer of a microscope system to display an identification mark attached to a specimen on an image plane located on the object side of an eyepiece included in the microscope system and on which a specimen image is formed. Specimen information acquired based on the information is superimposed, and when a predetermined condition is satisfied, processing is executed to switch the display position of the specimen information on the image plane.

According to the above aspect, specimen information can be easily grasped without interfering with observation of specimen images.

FIG. 1 is a diagram showing the configuration of a microscope system according to a first embodiment. It is a figure which illustrated a specimen. FIG. 3 is a diagram illustrating the configuration of an optical system within the lens barrel device. FIG. 3 is a diagram illustrating an example of the positional relationship between a non-shading region and a light-shielding region. FIG. 3 is a diagram showing an example of switching display positions. FIG. 7 is a diagram showing another example of switching display positions. It is a figure showing still another example of switching of a display position. FIG. 7 is a diagram showing yet another example of switching display positions. It is a figure which illustrated the relationship between a display position and illumination light intensity. It is a figure which illustrated the relationship between a display position and projection light intensity. It is a figure showing still another example of switching of a display position. 3 is an example of a flowchart of display position switching processing according to the first embodiment. It is another example of the flowchart of the display position switching process according to the first embodiment. This is an example of the brightness distribution when there is no sample on the optical axis. This is an example of the brightness distribution when there is a sample on the optical axis. FIG. 2 is a diagram showing the configuration of a microscope system according to a second embodiment. FIG. 3 is a diagram for explaining the positional relationship between a stage position and an optical axis of an objective lens. 7 is an example of a flowchart of display position switching processing according to the second embodiment. It is another example of the flowchart of the display position switching process according to the second embodiment. It is a figure showing the composition of the microscope system concerning a 3rd embodiment. FIG. 3 is a diagram for explaining a predetermined range of the position of a focusing mechanism. It is an example of the flowchart of the display position switching process based on 3rd Embodiment. It is another example of the flowchart of the display position switching process according to the third embodiment. It is a figure showing the composition of the microscope system concerning a 4th embodiment. It is an example of the flowchart of the display position switching process based on 4th Embodiment. It is another example of the flowchart of the display position switching process according to the fourth embodiment. It is a figure showing the composition of the microscope system concerning a 5th embodiment. It is a figure showing the composition of the microscope system concerning a 6th embodiment. FIG. 2 is a diagram illustrating a hardware configuration of a computer for realizing a control device. FIG. 3 is a diagram for explaining the relationship between analysis results and display positions. It is an example of the flowchart of analysis result superimposition processing. FIG. 7 is a diagram showing another example of the positional relationship between a non-shaded area and a shaded area. FIG. 7 is a diagram showing still another example of the positional relationship between a non-shaded area and a shaded area. FIG. 7 is a diagram showing still another example of the positional relationship between a non-shaded area and a shaded area.

(First embodiment)
FIG. 1 is a diagram showing the configuration of a microscope system according to this embodiment. FIG. 2 is a diagram illustrating a specimen. A microscope system 1 shown in FIG. 1 is, for example, a microscope system used by a pathologist in pathological diagnosis. However, the use of the microscope system 1 is not limited to this. The microscope system 1 may be a biological microscope system for another purpose. The microscope system 1 is not limited to a biological microscope system, but may also be an industrial microscope system. Moreover, although an upright microscope is illustrated in FIG. 1, the microscope included in the microscope system 1 is not limited to an upright microscope, but may be an inverted microscope.

As shown in FIG. 1, the microscope system 1 includes an eyepiece 30, an observation optical system 100, a reading device 50, a superimposing device 25, and a control device 70. As shown in FIG. 1, the microscope system 1 supports both visual observation through the eyepiece 30 and imaging using the imaging device 40; It may also be possible to respond only to visual observation.

The observation optical system 100 forms a specimen image on the object-side image plane of the eyepiece 30 using observation light from the specimen S. The specimen S used in the microscope system 1 is, for example, a preparation fixed with a Kremmel 11a provided on a stage 11, as shown in FIG. However, the specimen S may be accommodated in a well plate, dish, flask, or the like. Further, the specimen S may be an industrial product such as a circuit board, and may be placed on the stage 11 without being housed in a container.

Identification information for identifying the specimen S is attached to the specimen S. As shown in FIG. 2, the identification information is, for example, information (code C) in which specimen information, which is information regarding the specimen S, is coded. In Figure 2, the identification information attached to the specimen S is a barcode, and an example of a one-dimensional code such as CODE128 (registered trademark) is shown, but the identification information is a barcode such as a QR code (registered trademark). It may be a two-dimensional code. Furthermore, the identification information is not limited to encoded information. The identification information attached to the specimen S may be information recorded on an IC tag attached to the specimen S, or may be handwritten character information (for example, an identification number).

The reading device 50 is an example of a reading unit that reads identification information attached to the specimen S. The reading device 50 is any reading device such as a barcode reader, an RFID reader, an imaging device, or the like. In the microscope system 1, specimen information is acquired based on the identification information read by the reading device 50.

The specimen information may be acquired by the reading device 50. For example, if the specimen information itself is encoded, the reading device 50, which is a barcode reader, may read the code C and acquire the specimen information that is the content of the code C. Further, the specimen information may be acquired by the control device 70 based on the identification information read by the reading device 50. The reading device 50, which is a barcode reader, reads the code C and outputs the contents of the code C (for example, the path of specimen information) to the control device 70, and the control device 70 acquires specimen information based on the contents of the code C. You may. Further, if the reading device 50 is an imaging device, the identification information may be an image, and the reading device 50 or the control device 70 may acquire the specimen information by performing character recognition on the image.

The superimposing device 25 is an example of a superimposing unit that superimposes specimen information acquired based on identification information on an image plane on which a specimen image is formed. The superimposition device 25 may be, for example, a projector that projects specimen information onto an image plane, or a display device placed on the image plane. The projector may be a display device such as a liquid crystal display or an organic EL display, or may be a MEMS such as a DMD. When the superimposing device 25 is a projector, the microscope system 1 further includes a projection optical system that guides the projection light from the superimposing device 25 to an image plane.

The control device 70 controls the superimposing device 25 to cause the superimposing device 25 to superimpose the sample information on the image plane. Thereby, the user can grasp the specimen information while observing the specimen image without taking his eyes off the eyepiece 30. Further, the control device 70 switches the display position of the specimen information on the image plane when a predetermined condition is satisfied. This predetermined condition is designed in advance in consideration of the user's work flow.

In the microscope system 1 configured as described above, by appropriately designing the predetermined conditions, for example, specimen information can be displayed at a position that does not overlap with the specimen image during a period when one should concentrate on observing the specimen image, and During the period when the specimen image is not observed, specimen information can be displayed in a position that is easier for the user to see (for example, near the center of the visual field). Therefore, according to the microscope system 1, specimen information can be easily grasped without interfering with observation of specimen images.

FIG. 3 is a diagram illustrating the configuration of the optical system within the lens barrel device. FIG. 4 is a diagram illustrating an example of the positional relationship between the non-shaded area and the shaded area. Hereinafter, the configuration of the microscope system 1 will be described in detail with reference to FIGS. 1 to 4.

As shown in FIG. 1, the microscope system 1 includes a microscope main body 10, a lens barrel device 20, an eyepiece 30, an imaging device 40, a reading device 50, a control box 60, and a control device 70. .

The microscope main body 10 includes a stage 11 on which the specimen S is placed, a stage handle 12 for operating the stage 11, and a light source 13 that emits illumination light to irradiate the specimen S. The microscope main body 10 further includes a condenser 14 that irradiates illumination light onto the specimen S placed on the stage 11, an objective lens 15 attached to a revolver, a focusing device 16 that moves the stage 11 up and down, and a focusing device 16 that moves the stage 11 up and down. A focusing handle 17 connected to the device 16 is provided.

The stage 11 includes an XY stage that moves in a direction perpendicular to the optical axis of the objective lens 15. By operating the stage handle 12, the stage 11 (XY stage) moves in a direction perpendicular to the optical axis of the objective lens 15. Further, by rotating the focusing handle 17, the focusing device 16 moves the stage 11, and as a result, the stage 11 moves in the optical axis direction of the objective lens 15. Note that the stage 11 is formed with an opening that is large enough to prevent the specimen S from falling through which the illumination light from the condenser 14 passes.

The lens barrel device 20 is attached to the microscope main body 10. The lens barrel device 20 is a trinocular barrel to which an eyepiece 30 and an imaging device 40 can be attached. Inside the lens barrel device 20, an imaging lens 24 and a superimposing device 25 are housed. Light from the sample S irradiated with the illumination light enters the lens barrel device 20 via the objective lens 15. The light incident on the lens barrel device 20 is split within the lens barrel device 20 into light that reaches the eyepiece 30 and light that reaches the imaging device 40 .

The lens barrel device 20 is further provided with three physical keys (physical key 21, physical key 22, and physical key 23) operated by the user. The physical key 21 is a power switch of the superimposing device 25, and is used to switch between a state in which projection light is emitted from the superimposing device 25 and a state in which it is not emitted. The physical key 22 is a dimming volume for adjusting the intensity of projection light. The physical key 23 is a changeover switch for changing the display position of specimen information, and is an example of an input unit through which the user inputs an instruction to change the display position. Note that the changeover switch for changing the display position of the specimen information may be two or more physical keys.

The eyepiece lens 30 is attached to an eyepiece sleeve provided on the lens barrel device 20. The eyepiece sleeve is provided at a rotating part that rotates in the tilting direction around a horizontal axis. The height of the eyepoint is adjusted by rotating the eyepiece lens 30 attached to the eyepiece sleeve together with the rotating portion.

The imaging device 40 is, for example, a digital camera equipped with an image sensor 41. The imaging device 40 images the specimen S to obtain an image of the specimen S. The image sensor 41 is a CCD, CMOS, or the like. The imaging device 40 and the image sensor 41 are mounted on the lens barrel device 20 and are provided on an imaging optical path that branches from the observation optical path that extends from the objective lens 15 to the eyepiece 30 via the imaging lens 24.

The reading device 50 is as described above. It is desirable that the reading device 50 be installed at a position where the code C attached to the specimen S can be read, for example, when the specimen S is placed on the stage 11.

The control box 60 is a device that controls the microscope main body 10 and is connected to the control device 70. The control box 60 controls the light emission of the light source 13, for example.

The control device 70 is a computer that controls the entire microscope system 1. The control device 70 controls the microscope main body 10 and the imaging device 40 in addition to controlling the superimposing device 25 described above. The control device 70 may perform the above-described light emission control, for example, by controlling the microscope main body 10 via the control box 60. Further, the control device 70 may perform imaging control by controlling the imaging device 40, for example.

The microscope system 1 includes an illumination optical system that is an optical system placed on the illumination optical path from the light source 13 to the specimen S. The illumination optical system includes a condenser 14. The illumination optical system irradiates the specimen S with illumination light from the light source 13, and illuminates the specimen S with even and uniform illumination intensity using, for example, Koehler illumination.

More specifically, the light source 13 is turned on by turning on a power switch (not shown) provided in the lamp house, and is turned off by turning off the power switch. The light source 13 is, for example, a halogen lamp or an LED, although it is not particularly limited. Illumination light emitted from the light source 13 is irradiated onto the sample S placed on the stage 11 via the condenser 14 that constitutes the illumination optical system.

The intensity of the illumination light irradiated onto the specimen S can be adjusted with a dial provided on the microscope main body 10. The amount of illumination light emitted from the light source 13 is controlled in accordance with the rotation of the dial. Further, the intensity of the illumination light irradiated onto the specimen S can be adjusted not only by dial operation but also by a command from the control device 70, which will be described later.

The microscope system 1 includes an imaging optical system that is an optical system placed on the optical path from the specimen S to the imaging device 40. The imaging optical system forms a specimen image on the imaging surface of the imaging device 40 using observation light from the specimen S. The specimen image taken by the imaging device 40 is displayed on a display device (not shown) connected to the control device 70, so that the user of the microscope can observe the specimen image taken by the imaging device 40.

In this example, the imaging optical system includes an objective lens 15, an imaging lens 24, and a splitter 101, as shown in FIGS. 1 and 3. The splitter 101 branches an imaging optical path from an observation optical path. The objective lens 15, the imaging lens 24, and the splitter 101 included in the imaging optical system are also included in the observation optical system 100, which will be described later. That is, the observation optical system 100 and the imaging optical system share at least some optical elements.

The microscope system 1 includes an observation optical system 100, which is an optical system placed on an observation optical path from the specimen S to the eyepiece 30. The observation optical system 100 forms a specimen image on the object-side image plane of the eyepiece 30 using observation light from the specimen S. A user of the microscope can visually observe the specimen image formed on the image plane by the observation optical system 100 by looking through the eyepiece 30.

In this example, as shown in FIGS. 1 and 3, the observation optical system 100 includes an objective lens 15, an imaging lens 24, a splitter 101, a mirror 102, a field stop 103, a mirror 104, and a relay lens. 105, a mirror 106, a mirror 107, a composite optical element 108, a mirror 109, a relay lens 110, a mirror 111, and a mirror 112.

In the observation optical system 100, the observation light converted into parallel light by the objective lens 15 is focused onto the field stop 103 by the imaging lens 24. As a result, a primary image of the specimen S is formed on the field stop 103. That is, the field stop 103 is arranged at the primary image plane where the primary image is formed.

The observation light from the primary image is once converted into parallel light by the relay lens 105, and then focused by the relay lens 110 onto the field stop 31 placed on the object side of the eyepiece lens 30. As a result, a secondary image of the specimen S is formed on the field stop 31. That is, the relay lens 105 and the relay lens 110 are a relay optical system that relays the primary image of the specimen S to the image plane, and the user can view the secondary image plane on which the secondary image is formed through the eyepiece lens 30. Observe.

The relationship between the field stop 103 and the field stop 31 is as shown in FIG. The aperture 31a indicates the size of the aperture of the field stop 31. The aperture image 103a indicates the size of the aperture image of the field stop 103 on the secondary image plane. As shown in FIG. 4, in the microscope system 1, the field stop 103 limits the field of view narrower than the field of view limited by the field stop 31. As an example, the field stop 31 corresponds to a field number of 26.5, and the field stop 103 corresponds to a field number of 22.

Note that the region R2 shown in FIG. 4, which corresponds to the field of view limited by the field stop 103, is a region in which observation light is not blocked by the field stop 103, and hence will be referred to as a non-shaded region R2. The non-light-shielding region R2 is, for example, a region corresponding to the field of view number 22, and is a region in which a specimen image is formed. On the other hand, since the region R1 shown in FIG. 4 is a region where observation light is blocked by the field stop 103, it will be hereinafter referred to as a light-blocking region R1. The light-shielding region R1 is, for example, a region corresponding to the number of fields of view 26 excluding the region corresponding to the number of fields of view 22. Note that the projection light emitted from the superimposing device 25 joins the observation optical path closer to the eyepiece lens 30 than the field stop 103, as will be described later. Therefore, the light-shielding region R1 is a region into which observation light does not enter, but projection light enters.

The microscope system 1 includes a projection optical system that is an optical system placed on a projection optical path from the superimposing device 25 to the eyepiece 30. The projection optical system uses projection light from the superimposing device 25 to form an image of the superimposing device 25 on the object-side image plane of the eyepiece 30 . In the microscope system 1, the superimposing device 25 displays the specimen information, so that the specimen information is displayed on the image plane. Thereby, the user can simultaneously observe the specimen image formed on the image plane by the observation optical system 100 and the specimen information by looking through the eyepiece 30.

In this example, as shown in FIG. 3, the projection optical system includes a projection lens 120, a composite optical element 108, a mirror 109, a relay lens 110, a mirror 111, and a mirror 112. The combining optical element 108, mirror 109, relay lens 110, mirror 111, and mirror 112 included in the projection optical system are also included in the observation optical system 100. That is, the observation optical system 100 and the projection optical system share at least some optical elements.

In the projection optical system, the projection light emitted from the superimposing device 25 is converted into parallel light by the projection lens 120, and then guided to the observation optical path by the combining optical element 108. Thereafter, the projection light is incident through a mirror 109 and is focused by a relay lens 110 onto a secondary image plane on which a field stop 31 is arranged. Thereby, the user can observe the specimen information displayed on the superimposing device 25 through the eyepiece 30.

Note that although one observation optical path is shown in FIG. 3 to simplify the explanation, the lens barrel device 20 may be formed with observation optical paths for the right eye and for the left eye, respectively.

5 to 8 and 11 are diagrams showing examples of switching display positions. FIG. 9 is a diagram illustrating the relationship between display position and illumination light intensity. FIG. 10 is a diagram illustrating the relationship between display position and projection light intensity. With reference to FIGS. 5 to 11, the switching control of the display position of specimen information performed by the control device 70 will be described.

In the following, an example will be described in which the display position is switched by the user inputting a switching instruction, that is, an example in which the control device 70 switches the display position in response to the switching instruction input to the input unit. However, the trigger for such a switching operation is not limited to an explicit switching instruction given by the user. This point will be discussed separately later.

As shown in FIGS. 5 to 8 and 11, the control device 70 controls at least a light-shielding region R1 where observation light is blocked by the field stop 103 and a non-light-shielding region R2 where observation light is not blocked by the field stop 103. It is desirable to switch the display position of the specimen information U1 between.

For example, as shown in FIG. 5, the control device 70 controls the superimposition device 25 to change the display position where the specimen information U1 is displayed to the light-shielding region R1 every time the hard key (physical key 23) is pressed. and the non-shading area R2. In addition, the control device 70 controls the superimposition device 25 so that, as shown in FIG. and the non-shading area R2. The software key may be pressed using an input device such as a mouse connected to the control device 70, for example. Two or more software keys may be displayed on the image plane. In this way, the control device 70 performs processing for controlling the superimposition device 25 to superimpose the specimen information U1 within the light-shielding region R1, and for superimposing the specimen information U1 in the non-shading area, for each input instruction explicitly input by the user. The process of controlling the superimposing device 25 so as to superimpose within the region R2 may be performed in order.

The control device 70 may change the display mode of the specimen information U1 according to switching of the display position, and may also change the display mode when the display position is within the light-shielding region R1 and when it is within the non-light-shielding region R2. good. For example, as shown in FIGS. 5 to 8 and 11, when displaying in the light-shielding region R1, the control device 70 wraps the character information included in the sample information U1 so that it fits in the ring-shaped light-shielding region R1. They may be aligned in the direction. On the other hand, for example, as shown in FIGS. 5 to 8 and 11, when displayed in the non-shading area R2, the control device 70 displays character information included in the specimen information U1 in the non-shading area R2 for each item. You can arrange them by starting a new line.

The control device 70 may change the parameters of the character information included in the specimen information U1 according to the switching of the display position, and may change the parameters of the character information included in the specimen information U1 depending on whether the display position is within the light-shielding region R1 or within the non-shading region R2. It may be different. This is because the brightness of the background is different between the light-shielding region R1 and the non-light-shielding region R2, so even the same character parameters may appear differently. For example, as shown in FIG. 7, the control device 70 may change the color, font, font size, etc. of the text when it is displayed in the light-shielding area R1 and when it is displayed in the non-shading area R2. , This makes it easier for the user to grasp the specimen information U1 in both the light-shielded region R1 and the non-shaded region R2.

As shown in FIGS. 8 and 9, the control device 70 may reduce the intensity of the illumination light irradiated onto the specimen S in response to switching the display position from within the light-shielding region R1 to within the non-shading region R2. Conversely, the intensity of the illumination light irradiated onto the specimen S may be increased in response to switching the display position from within the non-shading region R2 to within the light-shielding region R1. This is because if the non-shading area R2 is too bright, when the specimen information U1 is displayed within the non-shading area R2, it will be difficult to provide contrast and it will be difficult to see. The control device 70 may control the intensity of the illumination light emitted from the light source 13 or may control the intensity of the illumination light between the light source 13 and the condenser 14. This makes it easier for the user to grasp the specimen information U1 in both the light-blocking area R1 and the non-light-blocking area R2.

As shown in FIG. 10, the control device 70 may increase the intensity of the projection light in response to switching the display position from inside the light-shielding region R1 to inside the non-shading region R2, or conversely, change the display position from inside the light-shielding region R2 to the non-shading region R2. The intensity of the projection light may be weakened in response to switching from inside the region R2 to inside the light-blocking region R1. This is to display the specimen information U1 with sufficient contrast even when the specimen information U1 is displayed in the non-shading region R2 which is brighter than the shielding region R1. The control device 70 may control the intensity of the projection light emitted from the superimposing device 25. Thereby, the user can easily grasp the specimen information U1 in both the light-shielding region R1 and the non-light-shielding region R2.

Although FIGS. 5 to 8 show an example in which two display positions are switched, the control device 70 controls the superimposition device 25 to change the display position where the specimen information U1 is displayed to one of three or more display positions. The three or more display positions may include at least one inside the light-shielding region R1 and one inside the non-shading region R2. For example, as shown in FIG. 11, the display position may be switched every time a hard key (physical key 23) is pressed. Note that instead of the hard keys, the display position may be switched each time a software key as shown in FIG. 6 is pressed. As shown in FIG. 11, the three or more display positions may include the center of the visual field and positions deviating from the center of the visual field as display positions within the non-shading area R2.

The above describes an example in which the control device 70 switches the display position in response to the user inputting a switching instruction, but hereinafter, an example in which the control device 70 automatically switches the display position according to predetermined criteria will be described. do.

FIG. 12 is an example of a flowchart of the display position switching process according to the present embodiment performed by the microscope system 1. The process shown in FIG. 12 is started when the control device 70 executes a predetermined program. First, the microscope system 1 monitors reading of identification information (step S1). When the user causes the reading device 50 to read the code C attached to the specimen S, the reading device 50 acquires specimen information from the code C and outputs it to the control device 70. In response to this, the control device 70 detects that the identification information has been read.

When the identification information is read, the control device 70 controls the superimposition device 25 to superimpose the specimen information in the non-shading region R2, triggered by the reading of the identification information by the reading device 50. Specifically, the control device 70 first sets the non-shading area R2 as a display area for specimen information (step S2), and then starts superimposing the specimen information (step S3). Thereby, the control device 70 controls the superimposing device 25 to cause the superimposing device 25 to superimpose the sample information on the non-shading region R2.

Thereafter, the control device 70 changes the display position from inside the non-shading region R2 to inside the light-shielding region R1 based on the elapsed time from reading the identification information. Specifically, the control device 70 determines whether or not a predetermined time or more has elapsed since the identification information was read (step S4), and if it is determined that the predetermined time or more has elapsed (step S4 YES), A light shielding area R1 is set as a display area for specimen information (step S5). Thereby, the control device 70 controls the superimposing device 25 to cause the superimposing device 25 to superimpose the sample information on the light-shielding region R1.

As described above, when the microscope system 1 executes the process shown in FIG. 12, specimen information is displayed in the non-shading area R2 for a predetermined time after the identification information is read, and thereafter, the specimen information is displayed in the non-shading area R1. Information will be displayed. Such automatic switching of display positions is desirable in light of the user's work flow. This point will be explained below.

In order to prevent the specimen S from being mixed up, the user usually performs an operation to cause the reading device 50 to read the identification information of the specimen S at the beginning of observation. Thereafter, the user moves the stage 11 to adjust the position of interest within the sample S to be located on the optical axis of the objective lens 15. It can be considered that the specimen S is not substantially observed by the user during the period from reading the identification information to locating the target position of the specimen S on the optical axis. Therefore, immediately after reading the identification information, displaying the specimen information in the non-shading area R2 does not interfere with the user's observation of the specimen image. Rather, immediately after reading the identification information, the user needs to first confirm the specimen information, so it is desirable that the specimen information be displayed near the center of the visual field of the non-shading area R2. According to the process shown in FIG. 12, since the specimen information is displayed in the non-shading area R2 after the reading operation, it is possible for the user to reliably grasp the specimen information, which is desirable.

Furthermore, after a certain amount of time has passed since the identification information was read, the position of interest is positioned on the optical axis, and observation of the specimen image begins in earnest. The specimen information includes information used to confirm that the specimen S has not been mixed up, as well as information that contributes to various judgments during observation. Therefore, it is desirable that the specimen information be continuously displayed so that it can be checked as appropriate during observation. On the other hand, if specimen information that overlaps with the specimen image is displayed during observation, there is a risk that observation of the specimen image will be hindered. Therefore, while observing the specimen image, it is desirable that the specimen information be displayed at a position that does not overlap with the specimen image. According to the process shown in FIG. 12, the specimen information is displayed in the light-shielding region R1 after a predetermined period of time has elapsed since the reading operation, so that the specimen information does not interfere with the observation of the specimen image. Moreover, since it is displayed in the light-shielding area R1, the user can check the specimen information at the timing he wants to check without looking away from the eyepiece 30.

As described above, by the microscope system 1 executing the process shown in FIG. 12, the display position of the specimen information is automatically switched at an appropriate timing. Thereby, the specimen information can be easily and reliably grasped without interfering with the observation of the specimen image.

FIG. 13 is another example of a flowchart of the display position switching process according to this embodiment. FIG. 14 is an example of the brightness distribution when there is no sample on the optical axis. FIG. 15 is an example of the brightness distribution when there is a sample on the optical axis. The microscope system 1 may perform the process shown in FIG. 13 instead of the process shown in FIG. 12. The processing shown in FIG. 13 is similar to the processing shown in FIG. It is different from The process shown in FIG. 13 is also started when the control device 70 executes a predetermined program.

The processes from step S11 to step S14 in the process shown in FIG. 13 are similar to the processes from step S1 to step S4 in the process shown in FIG. That is, the microscope system 1 monitors the reading of the identification information, starts superimposing the specimen information on the non-shading area, and monitors the elapse of a predetermined time from the reading of the identification information.

Thereafter, when determining that a predetermined period of time has elapsed, the control device 70 performs brightness analysis (step S15). In the brightness analysis, in order to determine whether or not there is a specimen to be observed within the field of view, more specifically, for example, a cell in the case of a pathological specimen, the specimen image obtained by the image sensor 41 is The brightness distribution is analyzed. The brightness distribution may be, for example, a line profile P as shown in FIGS. 14 and 15. For example, when there are no cells or the like within the field of view, the brightness is almost uniform regardless of the position within the field of view, as shown in FIG. 14, and the line profile P shows almost no fluctuation. On the other hand, when cells or the like are present within the field of view, the brightness differs greatly between the positions where the cells are present and the positions where they are not, as shown in FIG. For this reason, large fluctuations are also seen in the line profile P. Therefore, it is possible to estimate whether the observation target is within the field of view based on the level of uniformity of brightness.

Therefore, the control device 70 uses the analysis result of step S15 to determine whether the uniformity of brightness is below the standard (step S16). Then, when it is determined that the brightness uniformity is below the standard, the control device 70 sets the light-shielding region R1 as the specimen information display region (step S17). Thereby, the control device 70 controls the superimposing device 25 to cause the superimposing device 25 to superimpose the sample information on the light-shielding region R1. That is, in the process of FIG. 13, the control device 70 is triggered when the conditions that the elapsed time is a predetermined time or more and the brightness uniformity calculated from the brightness distribution is below the standard are met. Then, the display position is changed from inside the light-shielding region R1 to inside the non-light-shielding region R2.

As described above, by executing the process shown in FIG. 13, the display position of the specimen information is automatically switched at an appropriate timing. Thereby, as in the case where the process shown in FIG. 12 is executed, specimen information can be easily and reliably grasped without interfering with observation of the specimen image. Furthermore, in the process shown in FIG. 13, the display position is switched using the luminance distribution within the visual field in addition to the elapsed time. Therefore, the display position can be switched by more accurately estimating the timing at which the user observes the specimen image.

(Second embodiment)
FIG. 16 is a diagram showing the configuration of the microscope system according to this embodiment. The microscope system 2 shown in FIG. 16 has the following features: the stage 11 is a motorized stage, and includes an input device 19a for operating the stage 11, and a sensor 11s for detecting the position of the stage 11. It is different from 1. The other points are the same as the microscope system 1. Note that the electric stage is driven and controlled by a control box 60. The position information of the stage 11 detected by the sensor 11s is position information in a direction perpendicular to the optical axis of the objective lens 15, is output to the control device 70, and is used for various controls performed by the control device 70. This point will be discussed later.

FIG. 17 is a diagram for explaining the positional relationship between the stage position and the optical axis of the objective lens. When the position of the specimen S on the stage 11 is determined in advance, such as when fixing the specimen S to the Kremmel 11a, once the position of the stage 11 is determined, the position of the optical axis of the specimen S and the objective lens 15 is determined. The relationship is also determined. In the microscope system 2, since the position of the stage 11 can be detected by the sensor 11s, the control device 70 can determine whether the microscope system 2 is in a state where the specimen S can be observed based on the position of the stage 11. Note that the position range of the stage 11 corresponding to the state in which the specimen S can be observed (hereinafter referred to as a predetermined range) may be arbitrarily set depending on the specimen S. Hereinafter, an example will be described in which the control device 70 automatically switches the display position according to a predetermined standard when the predetermined range is preset.

FIG. 18 is an example of a flowchart of the display position switching process according to the present embodiment. The process shown in FIG. 18 is started when the control device 70 executes a predetermined program. Note that the process shown in FIG. 18 differs from that shown in FIG. Processing is different.

The processes from step S21 to step S24 in the process shown in FIG. 18 are similar to the processes from step S1 to step S4 in the process shown in FIG. That is, the microscope system 2 monitors the reading of the identification information, starts superimposing the specimen information on the non-light-shielded area, and monitors the elapse of a predetermined time from the reading of the identification information.

Thereafter, when determining that a predetermined period of time has elapsed, the control device 70 acquires the stage position (step S25), and determines whether the stage position is within a predetermined range (step S26). The control device 70 acquires the stage position based on the output from the sensor 11s, and determines whether the acquired stage position is within a predetermined range set in advance as a range in which the specimen S can be observed.

When the user operates the input device 19a to move the stage 11 within the predetermined range, the control device 70 determines that the stage position is within the predetermined range (step S26), and then sets the stage 11 in a light-shielded area as the specimen information display area. A region R1 is set (step S27). Thereby, the control device 70 controls the superimposing device 25 to cause the superimposing device 25 to superimpose the sample information on the light-shielding region R1.

As described above, by executing the process shown in FIG. 18, the display position of the specimen information is automatically switched at an appropriate timing. Thereby, as in the case where the process shown in FIG. 12 is executed, specimen information can be easily and reliably grasped without interfering with observation of the specimen image. Furthermore, in the process shown in FIG. 18, the display position is switched using the stage position in addition to the elapsed time. Therefore, the display position can be switched by more accurately estimating the timing at which the user observes the specimen image.

FIG. 19 is another example of a flowchart of the display position switching process according to this embodiment. The microscope system 2 may perform the process shown in FIG. 19 instead of the process shown in FIG. In the process shown in FIG. 19, the control device 70 changes the display position from the non-shaded area R2 to the shaded area based on the luminance distribution of the specimen image acquired by the image sensor 41 in addition to the elapsed time and position information of the stage 11. The difference from the process shown in FIG. 18 is that the process is changed to within R1. The process shown in FIG. 19 is also started when the control device 70 executes a predetermined program.

The processing from step S31 to step S36 in the processing shown in FIG. 19 is similar to the processing from step S21 to step S26 in the processing shown in FIG. That is, the microscope system 2 monitors the reading of the identification information, starts superimposing the specimen information on the non-shading area, monitors the passage of a predetermined time from the reading of the identification information, and monitors the stage position after the predetermined time has elapsed. .

Thereafter, when determining that the stage position is within the predetermined range, the control device 70 performs brightness analysis (step S37) and determines whether the uniformity of brightness is below the standard (step S38). The processes in step S37 and step S38 in the process shown in FIG. 19 are similar to the processes in step S15 and step S16 in the process shown in FIG. Then, when it is determined that the brightness uniformity is below the standard, the control device 70 sets the light-shielding region R1 as the specimen information display region (step S39). Thereby, the control device 70 controls the superimposing device 25 to cause the superimposing device 25 to superimpose the sample information on the light-shielding region R1.

As described above, by executing the process shown in FIG. 19, the display position of the specimen information is automatically switched at an appropriate timing. Thereby, as in the case where the process shown in FIG. 18 is executed, specimen information can be easily and reliably grasped without interfering with observation of the specimen image. Furthermore, in the process shown in FIG. 19, the control device 70 satisfies the following conditions: the elapsed time is a predetermined time or more, the uniformity of brightness is below a standard, and the stage 11 is within a predetermined range. Taking this as an opportunity, the display position is changed from inside the non-shading area R2 to inside the shading area R1. Therefore, the timing at which the user observes the specimen image can be more accurately estimated and the display position can be switched more accurately than when the process shown in FIG. 18 is executed.

(Third embodiment)
FIG. 20 is a diagram showing the configuration of the microscope system according to this embodiment. The microscope system 3 shown in FIG. 20 differs from the microscope system 2 in that it includes an input device 19b for operating the focusing device 16 and a sensor 16s for detecting the position of the focusing device 16. ing. The other points are the same as the microscope system 2. Note that the focusing device 16 is driven and controlled by a control box 60. The position information of the focusing device 16 detected by the sensor 16s is output to the control device 70 and used for various controls performed by the control device 70. This point will be discussed later.

FIG. 21 is a diagram for explaining the predetermined range of the position of the focusing mechanism. The focusing device 16 is an example of a focusing unit that moves the focal position of the observation optical system 100 (objective lens 15) relative to the stage 11 in the optical axis direction of the observation optical system 100 (objective lens 15). . If the specimen S is a specimen whose thickness is limited to some extent, the positional relationship between the objective lens 15 and the specimen S in the optical axis direction is determined by the position of the focusing device 16. In the microscope system 3, since the position of the focusing device 16 can be detected by the sensor 16s, the control device 70 determines whether the microscope system 3 is focused on the specimen S based on the position of the focusing device 16. be able to.

Note that the position range of the focusing device 16 corresponding to the state in which the specimen S is in focus (hereinafter referred to as a predetermined range) may be arbitrarily set depending on the specimen S and the objective lens 15. Hereinafter, an example will be described in which the control device 70 automatically switches the display position according to a predetermined standard when the predetermined range is preset.

FIG. 22 is an example of a flowchart of display position switching processing according to this embodiment. The process shown in FIG. 22 differs from the process shown in FIG. 19 in that the control device 70 uses position information of the focusing device 16 instead of the position information of the stage 11. More specifically, as shown in FIG. 19, the control device 70 changes the display position from inside the non-shading area R2 to inside the shading area R1 based on the elapsed time, the brightness distribution, and the position information of the focusing device 16. This is different from the process shown. The process shown in FIG. 22 is also started when the control device 70 executes a predetermined program.

The processing from step S41 to step S44 in the processing shown in FIG. 22 is similar to the processing from step S31 to step S34 in FIG. 19. That is, the microscope system 3 monitors the reading of the identification information, starts superimposing the specimen information on the non-light-shielded area, and monitors the elapse of a predetermined time from the reading of the identification information.

After that, when determining that a predetermined time has elapsed, the control device 70 acquires the position of the focusing section (focusing device 16) (step S45), and determines whether the position of the focusing section (focusing device 16) is within a predetermined range. It is determined whether or not (step S46). The control device 70 acquires the position of the focusing section based on the output from the sensor 16s, and determines whether the acquired position of the focusing section is within a predetermined range set in advance as a focusing range.

When the user operates the input device 19b and the focusing device 16 moves within the predetermined range, the control device 70 determines that the position of the focusing section is within the predetermined range (step S46 YES). After that, the control device 70 performs a brightness analysis (step S47), and determines whether the brightness uniformity is below the standard (step S48). The processes in step S47 and step S48 in the process shown in FIG. 22 are similar to the processes in step S37 and step S38 in the process shown in FIG. Then, when it is determined that the brightness uniformity is below the standard, the control device 70 sets the light-shielding region R1 as the specimen information display region (step S49). Thereby, the control device 70 controls the superimposing device 25 to cause the superimposing device 25 to superimpose the sample information on the light-shielding region R1.

As described above, by executing the process shown in FIG. 22, the display position of the specimen information is automatically switched at an appropriate timing. Thereby, as in the case where the process shown in FIG. 19 is executed, specimen information can be easily and reliably grasped without interfering with observation of the specimen image. Furthermore, in the process shown in FIG. 22, the display position is switched using the position of the focusing part and the brightness distribution in addition to the elapsed time. Therefore, it is possible to check whether the object to be observed is within the field of view based on the brightness distribution, and also to check whether it is in focus. Therefore, it is possible to more accurately estimate the timing for observing the specimen image and switch the display position than in the process shown in FIG. 19.

FIG. 23 is another example of a flowchart of the display position switching process according to this embodiment. The microscope system 3 may perform the process shown in FIG. 23 instead of the process shown in FIG. 22. The process shown in FIG. 23 differs from the process shown in FIG. 22 in that the control device 70 uses position information of the stage 11 instead of the brightness distribution of the sample image acquired by the image sensor 41. More specifically, the control device 70 changes the display position from inside the non-shading area R2 to inside the shading area R1 based on the elapsed time, the position information of the focusing part, and the position information of the stage 11. This process is different from the process shown in FIG. The process shown in FIG. 23 is also started when the control device 70 executes a predetermined program.

The process shown in FIG. 23 is different from the process shown in FIG. 22 in that the process is performed based on the position of the stage 11 in steps S57 and S58 in FIG. This is different from the processing shown in . Other points are similar to the processing shown in FIG. 22.

The process based on the brightness distribution in steps S47 and S48 in FIG. 22 and the process based on the position of the stage 11 in steps S57 and S58 in FIG. This is a process performed to determine the , and has the same type of effect. Therefore, by executing the process shown in FIG. 23, the microscope system 3 can obtain the same effect as when executing the process shown in FIG. 22.

Note that in FIG. 22, the position information of the focusing device 16 is used instead of the position information of the stage 11, but the control device 70 displays the information using both the position information of the stage 11 and the position information of the focusing device 16. You may switch positions. That is, the control device 70 changes the display position from inside the non-shading area R2 to inside the shading area R1 based on the elapsed time, the brightness distribution, the stage position information, and the focusing part position information. Good too. More specifically, the control device 70 determines that the elapsed time is a predetermined time or more, the brightness uniformity calculated from the brightness distribution is below a standard, the position of the stage 11 is within a predetermined range, and the focus is on. When the condition that the position of the quasi-device 16 is within a predetermined range is satisfied, the display position may be changed from inside the non-shading region R2 to inside the light-shielding region R1. This makes it possible to recognize the start of specimen image observation with higher accuracy and switch the display position of specimen information at an appropriate timing.

(Fourth embodiment)
FIG. 24 is a diagram showing the configuration of the microscope system according to this embodiment. The microscope system 4 shown in FIG. 24 differs from the microscope system 3 in that it includes an input device 19c for operating the revolver 18 and a sensor 18s for detecting the position of the revolver 18. The other points are similar to the microscope system 3. The sensor 18s is, for example, a Hall sensor that detects a magnet attached to a revolver. Note that the position information of the revolver 18 detected by the sensor 18s is output to the control box 60 and used for various controls performed by the control device 70. This point will be discussed later.

The revolver 18 is an example of a switching device that switches the objective lens placed on the optical axis of the observation optical system 100. The revolver 18 is an electric revolver, and is provided with a plurality of holes for mounting a plurality of objective lenses. By using the input device 19c, the hole arranged on the optical axis of the observation optical system 100 can be switched. Furthermore, information indicating which objective lens is attached to which hole of the revolver 18 is registered in the control device 70. Therefore, the control device 70 can determine whether or not the objective lens is placed on the optical axis based on the position information output from the sensor 18s and acquired via the control box 60. Note that the position of the revolver 18 is not necessarily limited to a position where one of the holes is arranged on the optical axis. It may be located at a position where there is no hole on the optical axis.

FIG. 25 is an example of a flowchart of display position switching processing according to this embodiment. The process shown in FIG. 25 is also started when the control device 70 executes a predetermined program. When the program is executed, the control device 70 determines whether the objective lens is on the optical axis (step S61). When the objective lens is not on the optical axis, the control device 70 sets the non-shading area R2 as the specimen information display area (step S62), and when the objective lens is on the optical axis, the control device 70 sets the non-shading area R2 as the specimen information display area. A light shielding area R1 is set as a display area (step S63).

The microscope system 4 repeats the above processing until reading of the identification information is detected (step S64 YES). Then, when the identification information is read, the control device 70 starts superimposing the sample information (step S65).

After starting the superimposition, the same process is repeated until the power of the superimposition device 25 is turned off. That is, the control device 70 determines whether the objective lens is on the optical axis (step S66), and if the objective lens is not on the optical axis, sets the non-shading area R2 as the specimen information display area ( In step S67), if the objective lens is on the optical axis, a light shielding area R1 is set as the specimen information display area (step S68). Then, when the power of the superimposing device 25 is turned off (step S69 YES), the control device 70 ends the process.

Accordingly, after reading the identification information, the control device 70 controls the superimposition device 25 to superimpose the specimen information in the non-shading region R2 while the objective lens is not located on the optical axis, and the objective lens While located on the optical axis, the superimposing device 25 is controlled so as to superimpose the specimen information within the light-shielding region R1.

As described above, in the microscope system 4, by executing the process shown in FIG. 25, the auxiliary information is displayed in the non-shading area R2 while the objective lens is not placed on the optical axis. Since the specimen image is not projected onto the image plane when the objective lens is not placed on the optical axis, there is no problem in observing the specimen image even if the auxiliary information is displayed near the center of the field of view in the non-shading region R2. Therefore, before placing the objective lens on the optical axis, the user can check the specimen information displayed near the center of the field of view by having the reader 50 read the code C attached to the specimen S. Can be done. Furthermore, after that, when the objective lens is placed on the optical axis and full-scale observation begins, the specimen information is displayed in the light-blocking area R1, so the user can check the specimen information at any time thereafter. can do.

FIG. 26 is another example of a flowchart of the display position switching process according to this embodiment. The microscope system 4 may perform the process shown in FIG. 26 instead of the process shown in FIG. 25. The process shown in FIG. 26 is similar to the process shown in FIG. 25 in that the specimen information is displayed in the non-shading area until it is determined that the objective lens is on the optical axis after the start of superimposition. However, the difference is that after the objective lens is determined to be on the optical axis after the start of superimposition, one of the display position switching controls (step S78) described above in the first to third embodiments is performed. ing. That is, the specimen information is displayed in the non-shading area at least until a predetermined time has elapsed, and the display position is switched to the light-blocking area at the timing when other predetermined conditions are met. Other points are similar to the processing in FIG. 25.

By executing the process shown in FIG. 26, the microscope system 4 achieves the effects described in the first to fourth embodiments, and also when the objective lens is not on the optical axis and no specimen image is projected. , specimen information can be displayed near the center of the field of view.

(Fifth embodiment)
FIG. 27 is a diagram showing the configuration of the microscope system according to this embodiment. The microscope system 5 shown in FIG. 27 differs from the microscope system 1 in that a control device 70 is connected to a server 80 via a network. The server 80 is provided with a database that stores specimen information.

In the microscope system 5, when the reading device 50 reads the identification information, the control device 70 acquires specimen information from the server 80 based on the identification information. In this case, the identification information may be, for example, information for acquiring specimen information from the server. For example, it may be location information such as a path on a server, or it may be a search key for acquiring specimen information from a database.

In this way, by acquiring the specimen information from the server 80, the amount of information that can be treated as specimen information can be significantly increased compared to the case where identification information obtained by encoding the specimen information is attached to the specimen S. can. Furthermore, by centrally managing specimen information on a server, updating the information becomes easier.

(Sixth embodiment)
FIG. 28 is a diagram showing the configuration of the microscope system according to this embodiment. A microscope system 6 shown in FIG. 28 differs from the microscope system 1 in that it includes a lens barrel device 20a instead of the lens barrel device 20. The lens barrel device 20a is an example of a superimposing unit for a microscope system, and differs from the lens barrel device 20 in that it includes a superimposing device 25 and a control circuit 26 that controls the superimposing device 25.

In the microscope system 6, the superimposition device 25 is controlled not by the control device 70 but by the control circuit 26. That is, in the lens barrel device 20a, the control circuit 26 operates as a control unit that switches the display position of the specimen information on the image plane when a predetermined condition is satisfied. Additionally, information acquired by the reading device 50 is input to the control circuit 26 . With such a configuration, the superimposing device 25 can independently perform the AR display function of displaying specimen information on the image plane. Therefore, an AR display function can be added simply by attaching the lens barrel device 20a to the microscope main body 10, so it can be easily applied to an existing microscope system.

The embodiments described above are specific examples to facilitate understanding of the invention, and the present invention is not limited to these embodiments. Variations on the embodiments described above and alternatives to the embodiments described above may be included. In other words, the components of each embodiment can be modified without departing from the spirit and scope thereof. Further, new embodiments can be implemented by appropriately combining a plurality of components disclosed in one or more embodiments. Further, some components may be deleted from the components shown in each embodiment, or some components may be added to the components shown in the embodiments. Furthermore, the processing procedures shown in each embodiment may be performed in a different order as long as there is no contradiction. That is, the microscope system, superimposing unit, superimposing method, and program of the present invention can be variously modified and changed without departing from the scope of the claims.

FIG. 29 is a diagram illustrating the hardware configuration of the computer 1000 for realizing the above-described control device. The hardware configuration shown in FIG. 29 includes, for example, a processor 1001, a memory 1002, a storage device 1003, a reading device 1004, a communication interface 1006, and an input/output interface 1007. Note that the processor 1001, memory 1002, storage device 1003, reading device 1004, communication interface 1006, and input/output interface 1007 are connected to each other via a bus 1008, for example.

The processor 1001 is any electrical circuit, and may be a single processor, a multiprocessor, or a multicore processor, for example. The processor 1001 may operate as a control unit that controls the display position described above by reading and executing a program stored in the storage device 1003.

The memory 1002 is, for example, a semiconductor memory and may include a RAM area and a ROM area. The storage device 1003 is, for example, a hard disk, a semiconductor memory such as a flash memory, or an external storage device.

The reading device 1004 accesses the storage medium 1005 according to instructions from the processor 1001, for example. The storage medium 1005 is realized by, for example, a semiconductor device, a medium through which information is input/output by magnetic action, a medium through which information is input/output by optical action, or the like. Note that the semiconductor device is, for example, a USB (Universal Serial Bus) memory. Further, a medium in which information is input/output by magnetic action is, for example, a magnetic disk. Examples of media on which information is input and output by optical action include CD (Compact Disc)-ROM, DVD (Digital Versatile Disk), Blu-ray Disc (Blu-ray is a registered trademark), and the like.

The communication interface 1006 communicates with other devices, for example, according to instructions from the processor 1001. The input/output interface 1007 is, for example, an interface between an input device and an output device. The input device may be, for example, a device such as a keyboard, a mouse, or a touch panel that accepts instructions from a user. The output device is, for example, a display device such as a display, and an audio device such as a speaker.

A program executed by processor 1001 is provided to computer 1000 in the following format, for example.
(1) Installed in the storage device 1003 in advance.
(2) Provided by storage medium 1005.
(3) Provided by a server such as a program server.

Note that the hardware configuration of the computer 1000 for realizing the control device described with reference to FIG. 29 is an example, and the embodiment is not limited to this. For example, some of the configurations described above may be deleted, or new configurations may be added. In another embodiment, for example, part or all of the functions of the above-mentioned electric circuit can be implemented as FPGA (Field Programmable Gate Array), SoC (System-on-a-Chip), ASIC (Application Specific Integration). ed　Circuit), and It may be implemented as hardware such as a PLD (Programmable Logic Device).

FIG. 30 is a diagram for explaining the relationship between analysis results and display positions. FIG. 31 is an example of a flowchart of analysis result superimposition processing. In the embodiment described above, an example was shown in which the superimposing device 25 superimposes the specimen information on the image plane, but the superimposing device 25 may superimpose information other than the specimen information on the image plane. The superimposing device 25 may superimpose the analysis result A1 of the specimen image O1 acquired by the image sensor 41 on the image plane, as shown in FIG. 30. The analysis result A1 of the specimen image O1 is not particularly limited, but may be, for example, an analysis result performed by the control device 70 using an AI model. The AI model is not particularly limited, but may be a trained model obtained by deep learning, for example.

The analysis result A1 of the specimen image may indicate, for example, a region of interest (for example, a lesion) found in the specimen, and is preferably displayed over the specimen image O1. On the other hand, if the specimen information U1 is also displayed in the area where the specimen image O1 and the analysis result A1 overlap (non-shading area R2), the visibility deteriorates and it becomes difficult to distinguish and recognize these pieces of information. It may become difficult to do so. Therefore, in the microscope system according to the embodiment described above, the control device 70 may switch between displaying and non-displaying the analysis results in conjunction with switching the display position of the specimen information.

Specifically, as shown in FIG. 31, the control device 70 determines the display area (step S81), and when determining that the display area is the light-blocking area R1, superimposes the analysis result A1 on the image plane. (Step S82). On the other hand, if it is determined that the display area is the light-blocking area R1, the control device 70 does not need to superimpose the analysis result A1 on the image plane (step S83). Such control may be repeated until the power of the superimposing device 25 is turned off (step S84 YES). Thereby, as shown in FIG. 30, when the specimen information U1 is superimposed within the light-shielding region R1, the control device 70 controls the superimposing device to superimpose the analysis result A1 of the specimen image on the non-shading region R2. 25, the superimposing device 25 can be controlled so that the analysis result A1 of the specimen image O1 is not superimposed within the non-shading region R2 when the specimen information U1 is superimposed within the non-shading region R2.

FIGS. 32 to 34 are diagrams showing other examples of the positional relationship between the non-shaded area and the shaded area. In the embodiment described above, an example was shown in which the light-shielding region R1 has an annular shape, but the shape of the light-shielding region R1 is not limited to the annular shape, and is not limited to a shape that is symmetrical with respect to the center of the visual field. For example, a part of the outer circumferential area of the field of view of the eyepiece 30 may be used as a light-shielding region, like the light-shielding region R1 shown in FIGS. 32 to 34. The shape of such a light-shielding region R1 can be changed as appropriate by replacing the field stop 103. Therefore, the control device 70 may control the superimposition device 25 to display the specimen information at an appropriate position according to the change in the field stop 103.

1 to 6: microscope system, 11: stage, 11s, 16s, 18s: sensor, 13: light source, 15: objective lens, 16: focusing device, 18: revolver, 19a to 19c: input device, 20, 20a: mirror Cylinder device, 21 to 23: Physical key, 25: Superimposing device, 26: Control circuit, 30: Eyepiece, 31, 103: Field diaphragm, 31a, 103a: Aperture, 40: Imaging device, 41: Image sensor, 50: Reading device, 70: Control device, 100: Observation optical system, 105, 110: Relay lens, 1000: Computer, 1001: Processor, 1002: Memory, A1: Analysis result, C: Code, O1: Specimen image, P: Line Profile, R1: Shade area, R2: Non-shade area S: Specimen, U1: Specimen information

Claims (20)

1. eyepiece and
   an observation optical system that forms a specimen image on an object-side image plane of the eyepiece using observation light from the specimen;
   a reading unit that reads identification information attached to the specimen;
   a superimposition unit that superimposes specimen information acquired based on the identification information on the image plane;
   A microscope system comprising: a control section that controls the superimposing section, and switches the display position of the specimen information on the image plane when a predetermined condition is satisfied.
2. The microscope system according to claim 1, further comprising:
   The observation optical system is
   a relay optical system that relays a primary image of the specimen to the image plane;
   a field stop disposed on the primary image plane on which the primary image is formed;
   The control unit switches the display position at least between a light-blocking area where the observation light is blocked by the field diaphragm and a non-shading area where the observation light is not blocked by the field diaphragm. microscope system.
3. The microscope system according to claim 2,
   The control unit includes:
   Controlling the superimposing section so as to superimpose the specimen information in the non-shading area in response to reading of the identification information by the reading section;
   The microscope system is characterized in that the display position is changed from inside the non-shading area to inside the shading area based on the elapsed time from reading the identification information.
4. The microscope system according to claim 3, further comprising:
   comprising an image sensor disposed on an optical path branching from the optical path of the observation optical system,
   The microscope is characterized in that the control unit changes the display position from inside the non-shading area to inside the shading area based on the elapsed time and a brightness distribution of the specimen image acquired by the image sensor. system.
5. The microscope system according to claim 4,
   The control unit changes the display position when the elapsed time is a predetermined time or more and the brightness uniformity calculated from the brightness distribution is below a standard. A microscope system characterized by changing from inside the non-light-shielding area to inside the light-shielding area.
6. The microscope system according to claim 4, further comprising:
   comprising a stage that moves in a direction perpendicular to the optical axis of the observation optical system on which the specimen is placed;
   The microscope system is characterized in that the control unit changes the display position from inside the non-shading area to inside the shading area based on the elapsed time, the brightness distribution, and position information of the stage. .
7. The microscope system according to claim 6,
   The control unit satisfies the following conditions: the elapsed time is a predetermined time or more, the brightness uniformity calculated from the brightness distribution is below a standard, and the stage is within a predetermined range. Taking this as an opportunity, the microscope system changes the display position from inside the non-shading area to inside the shading area.
8. The microscope system according to claim 6, further comprising:
   comprising a focusing section that moves the focal position of the observation optical system relative to the stage in the optical axis direction of the observation optical system,
   The control unit changes the display position from inside the non-shading area to inside the shading area based on the elapsed time, the brightness distribution, position information of the stage, and position information of the focusing unit. A microscope system characterized by changes.
9. The microscope system according to claim 8,
   The control unit is configured such that the elapsed time is a predetermined time or more, the brightness uniformity calculated from the brightness distribution is below a standard, the position of the stage is within a predetermined range, and the focusing unit A microscope system characterized in that the display position is changed from inside the non-light-shielding area to inside the light-shielding area when a condition that the position of the object is within a predetermined range is satisfied.
10. The microscope system according to claim 3, further comprising:
    comprising a stage that moves in a direction perpendicular to the optical axis of the observation optical system on which the specimen is placed;
    The microscope system is characterized in that the control unit changes the display position from inside the non-shading area to inside the shading area based on the elapsed time and position information of the stage.
11. The microscope system according to claim 4, further comprising:
    a stage that moves in a direction perpendicular to the optical axis of the observation optical system, on which the specimen is placed;
    a focusing section that moves the focal point position of the observation optical system relative to the stage in the optical axis direction of the observation optical system,
    The control unit changes the display position from inside the non-shading area to inside the shading area based on the elapsed time, the brightness distribution, and position information of the focusing unit. Microscope system.
12. The microscope system according to any one of claims 2 to 11, further comprising:
    comprising a switching device for switching an objective lens arranged on the optical axis of the observation optical system,
    After the reading unit reads the identification information, the control unit controls the superimposing unit to superimpose the specimen information in the non-shading area while the objective lens is not located on the optical axis. A microscope system characterized by:
13. The microscope system according to claim 2, further comprising:
    comprising a switching device for switching an objective lens arranged on the optical axis of the observation optical system,
    After the reading unit reads the identification information, the control unit:
    controlling the superimposing unit to superimpose the specimen information in the non-shading area while the objective lens is not located on the optical axis;
    The microscope system is characterized in that, while the objective lens is located on the optical axis, the superimposing section is controlled so that the specimen information is superimposed within the light-blocking area.
14. The microscope system according to claim 2, further comprising:
    Equipped with a light source that emits illumination light,
    The microscope system is characterized in that the control unit reduces the intensity of the illumination light applied to the specimen in response to switching the display position from inside the light-shielding area to inside the non-shading area.
15. The microscope system according to claim 1,
    The specimen information includes character information,
    The microscope system is characterized in that the control unit changes parameters of the character information in response to switching of the display position.
16. The microscope system according to claim 1, further comprising:
    comprising an input section through which a user inputs an instruction to switch the display position,
    The microscope system is characterized in that the control unit switches the display position in response to the switching instruction input to the input unit.
17. The microscope system according to claim 1, further comprising:
    comprising an image sensor disposed on an optical path branching from the optical path of the observation optical system,
    The control unit includes:
    controlling the superimposing unit so as to superimpose an analysis result of a specimen image acquired by the image sensor in the non-shading area when the specimen information is superimposed within the light-shielding area;
    When the specimen information is superimposed within the non-shading area, the superimposing unit is controlled so as not to superimpose the analysis result of the specimen image acquired by the image sensor into the non-shading area. Microscope system.
18. A superimposition unit for a microscope system, comprising:
    Superimposition of superimposing specimen information acquired based on identification information attached to the specimen on the image surface located on the object side of the eyepiece included in the microscope system and on which the specimen image is formed. Department and
    A superimposition unit comprising: a control section that switches the display position of the specimen information on the image plane when a predetermined condition is satisfied.
19. A superimposed display method performed by a microscope system, the method comprising:
    superimposing specimen information acquired based on identification information attached to the specimen on the image surface located on the object side of the eyepiece included in the microscope system and on which the specimen image is formed;
    A superimposed display method comprising switching the display position of the specimen information on the image plane when a predetermined condition is satisfied.
20. to the microscope system computer.
    superimposing specimen information acquired based on identification information attached to the specimen on the image surface located on the object side of the eyepiece included in the microscope system and on which the specimen image is formed;
    switching the display position of the specimen information on the image plane when a predetermined condition is satisfied;
    A program characterized by executing processing.
    
    
    

Images