JP3321435B2 - Microscope still image observation system - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a microscope still image observation system which can easily manage and display images using still images.

[0002]

2. Description of the Related Art Conventionally, a plurality of microscope still images are captured,
A storage and management system has been proposed.

In a microscope TV observation system or a microscope remote observation system that manages a still image based on a parent-child relationship, a prepared macro image is displayed, and the macro image is divided into blocks as shown in FIG. A weakly magnified image of the microscope to be captured is captured, a region to be further enlarged and captured on an arbitrary weakly magnified image is designated, and a microscope enlarged image corresponding to the region is captured.

[0004] Here, an image including the user is referred to as a parent image, and an image included in the user is referred to as a child image. For example, when viewed from the image 202 in FIG. 12, the image 201 is a parent image, and the image 203 is a child image.

[0005]

However, in the system described above, the parent-child relationship between the images becomes complicated, and it becomes difficult to determine which image the observer is currently viewing as the number of images increases. In addition, it becomes difficult to display a desired image.

SUMMARY OF THE INVENTION The present invention has been made in view of the above problems, and has as its object to quickly and arbitrarily output an arbitrary image.
An object of the present invention is to facilitate selection and display, and to add various comments to a selected image to facilitate observation and subsequent creation of a report or the like.

[0007]

In order to achieve the above object, a microscope still image observing system according to the present invention comprises image capturing means capable of capturing a still image of a desired specimen at different magnifications. And displaying the still image captured by the image capturing means as an index image.
Display means, and an index displayed by the display means
Select an image to support the index image
Selecting means for displaying a still image to be displayed ;
And a comment input unit for inputting a comment corresponding to the still image selected by the unit.

Further, the display means of the microscope still image observation system of the present invention captures the image by the image capturing means.
The first still image to be captured and part of it
For the one or more second still images
The first still image is defined as a parent image, and the second still image is defined as a child image.
Based on parent-child relationship information between these still images
Preferably, the index image is displayed by a tree structure diagram .

Further, microscopic still image observation system of the present invention, a still image of the specimen to be desired, take to change the magnification
Image capturing means capable of capturing the image;
First still image captured by the means and a part thereof
One or more second stills captured at higher magnification
For the image, the first still image is a parent image, the second still image is
Parent between these still images when the still image of
Storage means for storing child relation information, and the stored parent and child information
Based on the relationship information, the parent-child relationship between the captured still images
Display means for displaying the staff in a tree structure diagram, and the display
The captured still image using the extracted tree structure diagram
Selecting means for selecting the still image, and the stationary state selected by the selecting means.
Comment input means for inputting comments corresponding to images
It is characterized by having .

That is, in the microscope still image observation system according to the present invention, after a still image of a desired specimen is captured by the image capturing means at a different magnification, the captured image information is acquired.
Is displayed as an index image by the display means. This
By selecting the index image, a comment corresponding to the selected image information can be input.

Further, the display means of the microscope still image observation system according to the present invention comprises an index of the captured still image.
Displaying images in a tree structure diagram based on parent-child relationship information
The rice in a state where the parent-child relationship of the still image is clearly understood
Can be entered.

Further, in the microscope still image observation system of the present invention, a still image of the specimen to be desired in image capture unit
After changing the magnification, capture the still image
Display means based on parent-child relationship information between still images
It is displayed by a tree structure diagram. This tree structure diagram
By selecting a still image using
It becomes possible to input a comment for.

[0013]

Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 is a block diagram of a microscope still image observation system according to the first embodiment of the present invention.

As shown in FIG. 1, the present system is provided with an information processing device 1 for performing overall control. The information processing device 1 includes a monitor 2, a keyboard 3, a mouse 4, a frame memory, and the like. 5, an electric XY stage 9 and an electric objective lens revolver 10 are connected respectively.

Further, a TV monitor 6 and a video signal switch 7 are connected to the frame memory 5, and the video signal switch 7 is connected to a TV camera 11 connected to the microscope 8 and a TV camera 12. ing. This TV
The camera 12 has a macro lens 13 and is installed on a stand 16 having an XY stage 14 and a light source 15.

In such a configuration, the information processing apparatus 1 performs overall control, and the monitor 2 displays a system state, an operation menu, and the like for an observer who operates the system. Then, the frame memory 5 converts the NTSC television (TV) signal to digital to generate digital image information, and the TV monitor 6 is photographed by one of the TV cameras 11 and 12 switched by the video signal switch 7. Display the observation image. Further, the mouse 4 is used by the observer to select a menu or specify an image area. Hereinafter, the detailed operation of the first embodiment will be described with reference to the flowchart of FIG.

When the operation starts (step S100),
The observer first sets the slide on the XY stage 14 and captures the macro image (step S10).
1) The macro image is displayed on the TV monitor 6, and divided into blocks each having a size corresponding to the angle of view of the objective lens having an appropriate low magnification (step S102).

Next, the slide is mounted on the XY stage 9 on the microscope side, and the microscope images corresponding to the designated blocks are sequentially taken in. These images are all stored in an external storage device attached to the information processing device 1 (step S103).

When the images corresponding to all the blocks are captured in this way, the information processing apparatus 1 creates the first tree structure diagram based on the number of blocks and displays it on the TV monitor 6 (step S104).

When displaying a tree structure diagram using an index image, the corresponding image is called from an external storage device, and the image is reduced by appropriately thinning out the pixels. For example, the size of the image is reduced by half in both the vertical and horizontal directions by representing an area corresponding to a 2 × 2 image of the original image with an appropriate pixel. In the present embodiment, a 16 × 16 pixel area is represented by one pixel, thereby creating an index image of 1/16 of the original image, which is used for the tree structure diagram.

By selecting an arbitrary block or index image in the tree structure diagram with the mouse 4,
The corresponding image is read from the external storage device and
It is reproduced and displayed on the monitor 6 (step S105).

After displaying an arbitrary image on the TV monitor 6, the observer can specify a region to be further enlarged and observed on the image using the mouse 4 and operate a menu to obtain a desired objective lens. Can be selected (step S106).

When these designations are completed, a control signal is issued from the information processing apparatus 1 (step S10).
7), the electric XY stage 9 moves to a predetermined position (step S108), and the electric objective lens revolver 10 rotates to switch to a predetermined objective lens (step S10).
9). Then, the focus and the aperture are adjusted (Step S)
110). Thereafter, the observer can capture the microscope image, and the newly captured image is stored in the external storage device (Step S111).

Then, it is determined whether or not all the images have been captured. If all the images have been captured, the next step S113
If not, the process returns to step S108 (step S112).

In step S113, the information processing apparatus 1 creates a new tree structure diagram including this image and displays it on the TV monitor 6. Next, select an image from the tree structure diagram,
It is displayed (step S114). Then, it is determined whether or not to end the observation (step S115). If the observation is not to be ended, the process returns to step S105, and if to be ended, the process proceeds to step S116.

In step S116, when the observation of the tree structure diagram is completed, it is determined whether or not to print an image. If the image is to be printed, printing is performed (step S117). (Step S11)
8). The first embodiment of the present invention has been described above. Next, a microscope still image observation system according to a second embodiment of the present invention will be described.

FIG. 3 is a block diagram of a microscope still image observation system according to a second embodiment of the present invention. As shown in the figure, the present system is roughly divided into a microscope terminal device 100 and an observation terminal device 101.

First, the microscope terminal device 100 is provided with an information processing device 1a for performing overall control.
The information processing apparatus 1a includes a monitor 2a, a keyboard 3
a, mouse 4a, frame memory 5a, motorized XY stage 9, motorized objective lens revolver 10, communication controller 17
a are respectively connected. Further, a TV monitor 6a and a video signal switch 7 are connected to the frame memory 5a, and the video signal switch 7 is connected to the TV cameras 11 and 12. The TV camera 12 includes a macro lens 13 and is set on a stand 16 having an XY stage 14 and a light source 15.

On the other hand, the observation terminal device 101 is provided with an information processing section 1b for controlling the entire observation terminal device 101. The information processing section 1b includes a monitor 2b, a keyboard 3b, a mouse 4b, and a frame memory 5.
b, the communication control unit 17b is connected to each other, and the frame memory 5b is connected to the TV monitor 6b.

[0030] Then, the communication control unit 17a, 17b are connected by a digital public line 19, the communication control unit 1
8a and 18b are connected by a digital public line 20
I have.

In such a configuration, the information processing apparatuses 1a and 1b control the whole of each terminal device, and the monitors 2a and 2b display a system state, an operation menu, and the like for an observer who operates the system. I do.

The frame memories 5a and 5b store N
TSC system television (TV) signals are converted to digital to generate digital image information, and TV monitors 6a and 6b
Is the TV switched by the video signal switch 7.
An observation image captured by one of the cameras 11 and 12 is displayed.

Further, the mice 4a and 4b are used by the observer
This is for selecting a menu and designating an image area.
Then, the communication control units 17 a and 17 b
Communicate, and the communication control units 18a and 18b
connect. Hereinafter, the detailed operation of the second embodiment will be described with reference to the flowcharts of FIGS.

When the operation is started (step S200), the microscope terminal device 100 takes in a macro image and a weakly enlarged image of a specimen, compresses the image, and stores it (step S20).
1), the image file is transmitted to the observation terminal device 101 (step S202).

Then, the observation terminal device 101 starts operation (step S300), receives and saves this image file (step S301), constructs a first tree structure diagram, and displays it on the TV monitor 6b (step S301). Step S30
2). At this time, the TV monitor 6 is also used in the microscope terminal device 100.
The same display is made on a.

Next, the observation terminal device 101 performs continuous observation of the consultation image (step S303), and transmits a command to the microscope terminal device 100. When the microscope terminal device 100 receives this command, the observation terminal device 10
1 and the same mouse pointer is displayed (step S204). Subsequently, the observation terminal device 101 selects and displays an image from the tree structure diagram, and transmits a command to the microscope terminal device 100 (step S3).
04). Upon receiving this command, the microscope terminal device 100 performs the same display as the observation terminal device 101 and displays the same mouse pointer (step S205).

Then, the observation terminal device 101 specifies a region to be observed at a higher magnification, a magnification, and an image compression ratio on the display image, and transmits the data to the microscope terminal device 100 (step S305).

Next, the observation terminal device 101 determines whether or not to end the specification (step S306). If the specification is not to be ended, the process returns to step S305 to perform the specification again. Proceed to the next step S307. In step S307, the observation terminal device 101 enters an image capture command transmission waiting time, and transmits a command to the microscope terminal device 100.

Upon receiving this command (step S207), the microscope terminal device 100 moves the stage to the designated position (step S208), changes the objective lens to the designated magnification (step S209), The aperture is adjusted (step S210), and the image is captured, compressed, and stored (step S211).

Then, it is determined whether or not all the images have been fetched. If not all the images have been fetched, the flow returns to step S208 to repeat the above steps. If all the images have been fetched, step S213 is performed.
Then, the image file is transmitted to the observation terminal device 101. Upon receiving and storing the image file (step S308), the observation terminal device 101 adds and displays the new image on the tree structure diagram (step S309). At this time, the same display as that of the observation terminal device 101 is also displayed on the microscope terminal device 100 (step S214). And
The observation terminal device 101 selects and displays an image from the tree structure diagram, and transmits a command to the microscope terminal device 100 (step S310). Upon receiving this command, the microscope terminal device 100 performs the same display as the observation terminal device 101, and displays the same mouse pointer (step S215).

In this way, the observation terminal device 101 diagnoses the observation result, and if a conclusion is reached, the next step S312
If no conclusion is reached, the process returns to step S304 to repeat the above operation (step S311).

In step S312, it is determined whether or not printing is to be performed. If printing is to be performed, the flow proceeds to step S313 to perform printing. If not to be printed, the flow proceeds to the next step S314, and an end code is transmitted to the microscope terminal device 100. And terminates all operations. Thus, when the microscope terminal device 100 receives this end code (step S21)
6), end all operations (step S217).

Here, the parent-child relationship between the images is determined by the TV monitor 6.
Are displayed as a tree structure diagram on the display screen of FIG. 6, and display examples thereof are as shown in FIGS. In each figure, a square frame is used to represent an image. However, as long as the image can be distinguished from an image, the image may be represented by a circle or ellipse pattern or other graphic patterns. Each image is connected by a line indicating a parent-child relationship.

First, FIG. 6 shows a first display example in which the parent-child relationship can be expressed according to the magnification of the objective lens of the microscope. As shown in the figure, there is a case where the screen cannot fit on one screen, but in such a case, the user can scroll as much as necessary. The numbers in the frames indicate the order in which the images were taken, and the time at which the images were taken can also be displayed.

Next, FIG. 7 shows a second display example in which the parent-child relationship of an image is expressed according to its depth. As shown in the figure, the magnification is displayed in a rectangular frame, and the number indicating the order of taking in is displayed below the magnification. Also in the present embodiment, items that cannot be displayed on one screen can be viewed by scrolling the screen.

FIG. 8 shows a third display example in which the first display example is made vertical. In the figure, a rectangular frame representing an image can be replaced with a reduced actual image, that is, an index image. When a mouse pointer is displayed on these screens and an arbitrary square is selected with a button, an image corresponding to the selected square is displayed on the TV monitor 6. Furthermore, the user can select an image number by inputting the number on the keyboard 3.

FIG. 9 is a diagram showing a fourth display example. As shown in the figure, when an image is selected by inputting an image number using the mouse 4 or the keyboard 3, a window for comment input is opened at the bottom of the screen. Furthermore, although the size of the window is several lines, the screen is automatically scrolled when inputting more than that. FIG. 10 is a fifth display example in which a tree structure diagram can be displayed using an index image obtained by reducing each image.

FIG. 11 shows a sixth display example. As shown in the figure, a diagram representing block division of a macro image can be simultaneously displayed on the TV monitor 6 in addition to the tree structure diagram. As a result, it was not possible to know where the currently displayed image was on the slide from the tree structure diagram alone, but the block view is also displayed, so the current viewing position can be checked at a glance Now you can.

In each of the display examples described above, the currently displayed image and the image with the comment are displayed in different colors on the tree structure diagram, that is, an embodiment of the index image is described. By making the edge thicker or changing the color of the edge, it is possible to make the system easier to use.

As described in detail above, according to the present invention, observation and subsequent creation of reports and the like can be facilitated by adding various comments and marks to each image.

[0051]

According to the present invention, an arbitrary image can be efficiently generated.
A microscope still image observation system that facilitates observation and subsequent creation of a report or the like can be provided by enabling selection and display and further adding various comments to the selected image.

[Brief description of the drawings]

FIG. 1 is a block diagram illustrating a configuration of a microscope still image observation system according to a first embodiment of the present invention.

FIG. 2 is a flowchart for describing a detailed operation of the first embodiment.

FIG. 3 is a block diagram showing a configuration of a microscope still image observation system according to a second embodiment of the present invention.

FIG. 4 is a flowchart for explaining the operation of the second embodiment.

FIG. 5 is a flowchart for explaining the operation of the second embodiment.

FIG. 6 is a diagram showing a first display example.

FIG. 7 is a diagram showing a second display example.

FIG. 8 is a diagram showing a third display example.

FIG. 9 is a diagram showing a fourth display example.

FIG. 10 is a diagram showing a fifth display example.

FIG. 11 is a diagram showing a sixth display example.

FIG. 12 is a diagram for explaining a definition of a parent-child relationship between microscope images.

[Explanation of symbols]

DESCRIPTION OF SYMBOLS 1 ... Information processing device, 2 ... Monitor, 3 ... Keyboard, 4 ...
Mouse 5 Frame memory 6 TV monitor 7 Video signal switch 8 Microscope 9 Motorized XY stage 10 Motorized objective lens revolver 11, 12 T
V camera, 13 macro lens, 14 XY stage, 15 light source, 16 microscope stand, 17 , 18 ...
Communication control unit, 19, 20: Digital public line.

──────────────────────────────────────────────────続 き Continuation of front page (56) References JP-A-64-20449 (JP, A) JP-A-4-194905 (JP, A) JP-A-63-45502 (JP, A) (58) Field (Int.Cl. ⁷ , DB name) G02B 19/00-21/00 G02B 21/06-21/36

Claims (3)

(57) [Claims] An image capturing means capable of capturing a still image of a desired specimen at a different magnification, and indexing the still image captured by the image capturing means.
And display means for displaying in hex image, selects an index image displayed by the display means
By doing so, the still image corresponding to the index image
Microscope still image observation system characterized by comprising a selection means for displaying the comment input means for inputting a comment corresponding to the still image selected by the selecting means. 2. The image processing apparatus according to claim 1, wherein the display unit is a first still image captured by the image capturing unit.
The image and one or more of its parts captured at higher magnification
For a number of second still images, the first still image
Image when the second still image is a child image.
By tree structure diagram based on parent-child relationship information between still images
The microscope still image observation system according to claim 1, wherein the index image is displayed . 3. A still image of a desired specimen is changed in magnification.
Capturing means that can be captured and captured, and a first still image captured by the image capturing means.
The image and one or more of its parts captured at higher magnification
For a number of second still images, the first still image
Image when the second still image is a child image.
A storage unit for storing parent-child relationship information between still images, and based on the stored parent-child relationship information,
A table that displays the parent-child relationship between still images in a tree structure diagram
Indicating means and the captured tree structure using the displayed tree structure diagram.
Selection means for selecting a still image, a comment corresponding to selected still image by the selecting means
It is characterized in that it includes a comment input means for inputting
Microscope still image observation system that.