JPH11211988A - Microscope image remote control system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To obtain a whole reference image which is closed to an original sample without using a dedicated stand for microscopy and a dedicated camera and to easily obtain a high-definition image, which has a position specified on a receiving device (pathologist) side in the center, in a short time. SOLUTION: The microscope image remote control system has means for acquiring the whole reference image of a sample 3 placed on the stage of a microscope 2 and sending it from the transmission side, receiving the sent whole reference image at a remote place, sending information on a gaze position in the received image from the reception side to the transmission side, requesting a transmit screen of the position, and sending an image signal complying with the request from the transmission side. In this case, while the stage 4 of the microscope 2 is controlled, divisional photographs of the sample 3 are repeatedly taken with specific magnification and connected without any contradiction in plane position relation among the obtained image group to generate a whole reference image, and a peripheral part of the gaze position information of the whole reference image as the center is expanded and obtained.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a system for acquiring a still image of a microscope image, and more particularly to a system for obtaining a whole reference image.
The present invention relates to a technology effective when applied to obtain a high-magnification still image centered on the gaze position by specifying a gaze position on the whole reference image at a remote place even from a remote place.

[0002]

2. Description of the Related Art Conventionally, as a means for obtaining a high-magnification still image at a position to be displayed by designating this kind of whole reference image, there is a technique disclosed in Japanese Patent Application No. 4-162715. In this technique, in order to grasp the whole image of the specimen, before setting the slide on the stage of the microscope, set it on a dedicated macro shooting stand, shoot as a whole reference image of a fixed size, and further, image with high magnification In this case, the entire reference image is divided into blocks, and the divided blocks are photographed at a high magnification.

[0003]

In the above prior art,
In order to acquire the entire reference image, a dedicated macro shooting stand and a dedicated camera were required. As a result, there is a problem that an economic burden is imposed for the purpose of acquiring the entire reference image.

[0004] Since the entire reference image is set as a fixed-size image by setting the preparation on a dedicated macro-photography stand, it is necessary to reset the preparation on the microscope stage, and it is necessary to set the preparation to be taken. There was a limit on the size.

[0005] As a result of resetting the slide from the dedicated macro photography stand to the microscope stage, the coordinates on the image taken and photographed on the dedicated macro photography stand and the image taken on the microscope stage are set. There is a problem in that it takes time and effort to take the correspondence with the coordinates, and requires skill.

Also, as a result of the limitation on the size of the sample, when the sample is large, it is not possible to photograph the entire predetermined area, and as a result, an entire reference image in which a necessary portion is not displayed may be created. When is small, the predetermined area becomes only a part of the entire reference image, and there is a problem that unnecessary parts may be taken in.

Further, since a high-definition still image is acquired while changing the magnification, in a pathological image in which a partial region including a similar image occurs at a plurality of places, particularly in any part of the whole reference image, It is very difficult for a pathologist to remember at what magnification the region has been acquired.

An object of the present invention is to enable efficient acquisition of a high-definition image of a necessary portion on a whole reference image of a predetermined region of a specimen placed on an automatic moving stage of a microscope even from a remote place. It is to provide various technologies.

It is another object of the present invention to provide a technique capable of acquiring an entire reference image close to an original sample without using a dedicated macro photography stand and a dedicated camera.

Another object of the present invention is to provide a technique capable of easily associating position information of an arbitrary position on an entire reference image with a stage control coordinate value.

Another object of the present invention is to provide a technique capable of acquiring whole reference images of various sizes.

Another object of the present invention is to provide a receiving apparatus (pathologist)
It is an object of the present invention to provide a technique capable of easily and quickly acquiring a high-definition image in which a position designated by a side is the center.

The above and other objects and novel features of the present invention will become apparent from the description of the present specification and the accompanying drawings.

[0014]

The outline of a typical invention among the inventions disclosed in the present application will be briefly described as follows.

(1) A transmitting device for acquiring and transmitting an entire reference image of a predetermined region of a specimen placed on an automatic movable stage of a microscope, and receiving the transmitted overall reference image at a remote location, and receiving the received image A microscope image remote control system having a receiving device that transmits information of a gaze position in an image to a transmitting device side and requests a next transmission screen based on the information of the gaze position, and a signal transmission path that transmits an image signal Means for repeating the divisional photographing of the sample at a predetermined magnification while controlling the automatic movable stage of the microscope, means for taking in a group of images obtained by the divisional photographing, and division on the memory Means for synthesizing the entire reference image by linking them so as not to cause inconsistency in the two-dimensional positional relationship of the group of photographed images; position coordinates and stage control coordinates of the synthesized overall reference image Means for taking the correspondence, and the gaze position information is designated by the coordinate values of the entire reference image, and the next transmission image is provided with means for enlarging and acquiring a peripheral portion around the gaze position. Features.

(2) In the microscope image remote control system of (1), there is provided a means for performing stage control so that there is an overlap area having a size necessary for image synthesis even if there is an error in the microscope stage control. It is characterized.

(3) In the microscope image remote control system of (2), there is provided means for calculating an error of the stage control according to the direction of the stage control of the microscope and optimizing the size of the overlapping area used for image synthesis. It is characterized.

(4) In the microscope image remote control system according to any one of the above (1) to (3), means for creating an entire reference image of a predetermined region of the specimen placed on the stage of the microscope with a line sensor is provided. It is characterized by having.

(5) In the microscope image remote control system according to any one of (1) to (4), the transmitting device adds (k1 * k2) plane coordinate values to the entire reference image and transmits the image. The apparatus further comprises means for designating the gaze position by the plane coordinate value.

(6) In the microscope image remote control system according to any one of (1) to (5), the receiving device displays a mark or information indicating the position of the received high-definition still image on the entire display device. It is characterized by having a means for displaying on the reference image and displaying the high-definition still image at a predetermined position on the entire reference image.

According to the above-described means, the sample is repeatedly photographed at a predetermined magnification while controlling the automatic moving stage of the microscope, and the image group obtained by the photographing is taken into the memory, and divided on the memory. Since the entire reference image is synthesized by joining the captured images so that there is no inconsistency in the planar positional relationship, a dedicated macro shooting stand and a dedicated camera are prepared, and the macro shooting stand is provided. The entire reference image can be captured without setting a slide. In addition, even if the specimen is too large or too small to obtain the entire reference image properly using the dedicated macro shooting stand, the entire reference image of the predetermined area can be obtained in an image of any size that is most suitable. Can be synthesized as

Further, since arbitrary coordinates of the synthesized overall reference image are associated with stage control coordinates,
Skill is not required for associating arbitrary coordinates of the entire reference image with the stage control coordinates of the microscope, and no effort is required.

Also, the gaze position information of the entire reference image is designated by the coordinate values of the whole reference image, and the next transmission image is obtained by enlarging the peripheral portion around the gaze position and acquiring the next transmission image. Specify the center position of the next transmission image,
The most efficient image acquisition can be performed.

[0024]

Embodiments of the present invention will be described below in detail with reference to the drawings.

(Embodiment 1) FIG. 1 is a block diagram showing a hardware configuration for realizing a microscope image remote control system of the present invention, wherein 1 is a CCD camera, 2 is a microscope,
3 is a specimen, 4 is an automatic moving stage (hereinafter simply referred to as a stage), 5 is a transmitting device (for example, using a personal computer:
5A is the display device of the transmitting device 5, 6A
Denotes a communication line, and 7 denotes a receiving device (for example, a personal computer or the like is used: a personal computer of a pathologist).

As shown in FIG. 1, the microscope image remote control system according to the first embodiment includes a transmitting device 5 and a CCD camera 1.
Are connected by a SCSI cable, and the transmission device 5 and the stage 4 are connected by an RS-232C cable. The transmitting device 5 and the receiving device 7 are connected by a communication circuit 6.
As the communication circuit 6, an optical cable line or the like can be used in addition to the ISDN line and the analog line.

The CCD camera 1 is an electronic imaging device for photographing a specimen 3 magnified by a microscope 2 as a still image.
The photographed still image is stored in the memory of the transmission device 5 via a communication interface such as SCSI.

The stage 4 includes a means for moving in the horizontal direction and a stage control coordinate which is a stationary coordinate system.
Means for automatically moving in a horizontal direction such that a reference point instructed by a transmission device 5 via a communication interface such as RS-232C comes to a designated point on stage control coordinates; Means for taking in the coordinate value of the position reference point in the stage control coordinates into the transmitting device 5 via a communication interface such as RS-232C.

The transmitting device 5 includes a means for taking a group of images taken by the CCD camera 1 into a memory, and the image group is connected to the memory so that there is no inconsistency in a planar positional relationship. Means for transmitting a still image on the memory to the receiving device 7 through the communication line 6; means for displaying a group of images taken by the CCD camera 1 and the entire reference image on the display device 5A; The communication device has means for starting communication with the device, means for ending communication from the transmitting device 5, and means for designating a control position of the stage 4.

The receiving device 7 includes a display device for displaying the still image transmitted from the transmitting device 5 on the display device 7A, a device for starting communication with the transmitting device 5, a device for specifying a gaze position, It has means for transmitting position information to the transmitting device 5 and means for ending communication with the transmitting device 5.

Although the communication line 6 may be connected during the diagnosis work, in the first embodiment, the communication between the transmission device 5 and the reception device 7 is performed so that the communication line 6 is connected only when data is transmitted. A means for starting and a means for ending communication will be utilized. The communication cost can be reduced by connecting the communication line 6 only when transmitting data.

FIG. 2 is a flowchart for explaining the operation of the microscope image remote control system according to the first embodiment. FIG. 3 is a stage control flowchart in the microscope image remote control system according to the first embodiment. 7 shows a flow of controlling the stage 4 with respect to a coordinate value of a range to be taken as a reference image.

The operation of the software in the transmitting device 5 and the receiving device 7 will be described below with reference to FIGS.

Preconditions necessary for explaining the first embodiment will be described. The specimen 3 is the whole placed on the preparation, and a partial area of the specimen 3 that is to be transmitted as a still image to the receiving device (pathologist side) 7 for diagnosis is referred to as a predetermined area. The reference image is an image used to acquire the next transmission image, and the entire reference image of the predetermined area is a reference image including a predetermined entirety. The gaze position is the position of the center of a region where a high-definition image is desired to be acquired.

In order to connect the CCD camera 1 to the microscope 2 and take an image enlarged by the microscope 2 with the CCD camera 1 and capture the image of the specimen 3 into the transmitting device 5, a relay lens is used instead of an eyepiece. use. Magnification of objective lens, magnification of relay lens, C when using those lenses
Table 1 shows an example of the relationship with the actual size of an image captured by the CD camera 1, and the following Example 1 will be described using this example.

[0036]

[Table 1]

Now, the stage control coordinates of the microscope 2 of the image captured by the CCD camera 1 are set to be the stage control coordinates at the center position of the image. The stage control coordinates of the microscope 1 are given in units of microns (μm). A vector P defined from the stage control coordinates at the upper left corner of the still image captured by the CCD camera 1 using the 1 × relay lens and the 4 × objective lens to the stage control coordinates at the center position is defined as P.

First, a method of dividing the sample 3 into an area which can be taken in by a low-magnification lens and taking it into the memory will be described. This method is divided into a means for taking in stage control coordinate values of a range to be taken in as a whole reference image into a memory, and a means for taking in an image while controlling a stage with respect to the stage control coordinate values taken in to memory. .

A description will now be given of a means for loading the stage control coordinate values of a range to be captured as the entire reference image into the memory.

The specimen 3 is set on the stage 4 of the microscope 2, and the objective lens is 4 times and the relay lens is 1 time. First, the stage control coordinates of the microscope 2 are fetched at a position where the upper left corner of the rectangular area including the range to be fetched as the entire reference image is lower right than the center of the fetchable area.

Next, the stage control coordinates of the microscope are fetched at such a position that the lower right corner of the rectangular area including the range to be fetched as the whole reference image is at the upper left from the center of the fetchable area. The capture of the upper left stage control coordinates and the lower right stage control coordinates of the entire reference image may be replaced with the capture of the upper right stage control coordinates and the lower left stage control coordinates.

With reference to FIGS. 2 and 3, a description will be given of a means for taking an image into the memory while controlling the stage with respect to the stage control coordinate values taken into the memory. The upper left stage control coordinate value is (x1, y1), and the lower right stage control coordinate value is (x2, y2). Where x1 <x2, y1
<Y2. The unit of x1, y1, x2, y2 is micron meter. | X1-x2 | / 2210 ≦
the smallest natural number k1 to be k1 and | y1-y2 | / 16
The minimum natural number k2 satisfying 50 ≦ k2 is calculated (S30).
1). When the center of the visual field of the microscope 2 is (x1,
Control is performed so that the stage control coordinate value becomes y1) + P (S302).

P is a relative coordinate from (x1, y1) indicating the center position of the image in one cycle of taking a still image into the memory. One P value is determined for each of the still images to be shot separately. One divided 3 at that position
The microscope image is fetched into the memory as a still image of 20 * 240 dots, and the stage control coordinate value (x1, y1) + P, which is the position of the center of the image captured at the same time, is recorded so as to correspond to each of the divided images (S201, S30
3).

The automatic movable stage 4 is controlled so as to move 2210 μm so that the area where the automatic movable stage 4 can be taken in becomes rightward (S 304), and the microscope image is 320 × 24.
A stage control coordinate value (x1 + 2210, y1) + P, which is the position of the center of the divided and photographed image, is captured as a 0-dot still image in a memory (S30).
7). When this is repeated (k1-1) times, the stage is controlled at 1650 μm so that the area where the stage can be taken is downward (S309), and similarly, 320 * 2
The image is taken into the memory as a 40-dot still image, and at the same time, the stage control coordinate value at the center position of the captured image is recorded (S312). Further, the stage is controlled at 2210 μm so that the area where the stage can be taken is in the left direction (S
313), the image is taken into the memory as a still image of 320 * 240 dots, and at the same time, the stage control coordinate value at the center position of the photographed image is recorded (S316). Similarly, the stage is controlled (S318), the (k1 * k2) still images are taken into the memory, and the stage control coordinate value of the center position of each still image is recorded (S202, S).
321).

Next, referring to FIG. 2, an entire reference image is created by connecting still image groups of 320 * 240 dots fetched into the memory so as not to cause inconsistency in a planar positional relationship on the memory. How to do it.

In order to create a whole reference image by connecting still image groups of 320 * 240 dots fetched into the memory so as not to cause inconsistency in a planar positional relationship on the memory, a divided still image is created. Then, the microscope stage control coordinate values recorded at the center position are converted to dot plane coordinate values (S203).

As a conversion method, the stage control coordinate value (xi, yi) (unit: micron meter) recorded at the center position is converted into the plane coordinate value ((xi−x1) /6.9+).
160, (yi-y1) /6.9+120) = (x,
y) (unit is dot) (6.9 = 320/2210). By employing this method, it is possible to convert the stage control coordinates of the microscope into plane coordinates in dot units indicating the position on the photographed image, and to change the plane coordinate value of the upper left corner of the image to (0, 0). ).

(K1 * k2) recorded on the memory
By arranging 320 * 240 still images in order on the plane coordinate axis based on the plane coordinate values recorded as the center position of each image, the images are joined to create an overall reference image (S204). Here, a seamless process may be performed to make the image easier to see, or an image process may be performed to eliminate luminance unevenness occurring in a 320 * 240 still image group.

A line is connected by means for starting communication with the receiving device 7. The plane coordinate value in dot unit is (k1 * k2)
The whole reference image recorded at the location is transmitted to the receiving device 7 (S205). When transmission of the entire reference image is completed, the line is disconnected by means for terminating communication with the personal computer of the receiving device 7.

The receiving device 7 receives the entire reference image in which the plane coordinate values in dot units are recorded at (k1 * k2) locations, and displays it on the display device (display) 7A.

Next, a method of designating the gaze position and obtaining the plane coordinate value of the designated gaze position will be described.

A gaze position at which a high-definition still image is to be obtained is designated on the received entire reference image in which the plane coordinate values in dot units are recorded. Since the plane coordinate value of the upper left corner of the entire reference image is (0, 0), the plane coordinate value of the designated gaze position in dot units is calculated. Alternatively, the distance between the plane coordinate value of the specified gaze position and the plane coordinate values recorded on the (k1 * k2) global reference images is calculated, and the distance value on the global reference image having the smallest distance value is calculated. The position and the plane coordinate value may be recognized, and how many dots away from the position may be calculated to obtain the plane coordinate value of the specified gaze position (S206).

After obtaining the plane coordinate value of the designated gaze position by the above method, the communication line 6 is connected by means for starting communication with the transmitting device 5 and the plane coordinate value of the designated gaze position in dot units is calculated. The data is transmitted to the transmitting device 5 (S207). When the coordinate value transmission is completed, the communication line 6 is disconnected by means for terminating the communication with the transmission device 5.

The received plane coordinate values are converted into the stage control coordinates on the microscope 2 in units of microns (S20).
8). As a conversion method, when a plane coordinate value in dot units is (x, y), a stage control coordinate value (xi, y) is used.
i) = ((x-160) * 6.9 + x1, (y-12)
0) * 6.9 + y1) is adopted. The conversion of the coordinate values may be performed before the coordinate data is transmitted by the receiving device 7, and the stage control coordinate values of the microscope 2 in units of microns may be transmitted to the transmitting device 5.

The coordinates of the stage control of the microscope 2 in units of microns may be transmitted to the transmitting device 5 before the coordinate data is transmitted by the receiving device 7.

In order for the gaze position designated by the receiving device 7 to be the center of the next transmission image, the stage control coordinate value is set to ((x
-160) * 6.9 + x1, (Y-120) * 6.9 +
The stage is controlled so as to satisfy y1) (S209).
With a high-magnification objective lens, a high-definition still image is captured in the memory.

After the high-resolution still image is stored in the memory, the communication line 6 is connected by means for starting communication with the receiving device 7. The high-definition still image is transmitted to the receiving device 7 (S210). When the transmission of the high-definition still image is completed, the communication line 6 is disconnected by means for ending the communication with the receiving device 7.

In the above description of the first embodiment, the description has been made on the assumption that the entire reference image is formed by a 4 × objective lens and that the relay lens is 1 ×. Of course, other magnifications may be used. . In that case, the calculation formula is recalculated from the actual size of the captured image when enlarged by the objective lens and the relay lens at that magnification.

Also, the embodiment in which the communication line 6 is disconnected at the time of data transmission and the communication line 6 is disconnected at the end of data transmission has been described, but the communication line 6 is connected as one of the transmitting device 5 and the receiving device 7. In this case, for example, a means may be provided for automatically disconnecting the communication line 6 if no data has been transmitted for 15 seconds or more.

A remote pathological diagnosis will be described as an application of the microscope image remote control system of the first embodiment.

First, the transmitting device (clinical side) 5 sets the specimen 3 on the stage 4 of the microscope 2 and quadruples the objective lens. A range to be acquired as the entire reference image is determined, and a rectangular area including the range is determined. The stage 4 is controlled so that the upper left corner of the rectangular area is lower right than the center of the capture area. The stage control coordinates of the microscope 2 at that position are taken. Further, the stage 4 is controlled such that the lower right corner of the rectangular area is located lower left than the center of the capture area. The stage control coordinates of the microscope at that position are acquired.

Based on the stage coordinate group, "means for capturing an image into the memory while controlling the stage 4" of the personal computer of the transmitting device (clinical side) 5 and "still image group captured in the memory on the memory" The means for creating an overall reference image by joining "works to create an overall reference image, and the display device 5
A is displayed.

The whole reference image is transmitted to the receiving device (pathologist side) 7. Change the objective lens to a higher magnification.

The receiving device 7 looks at the received entire reference image and designates the gaze position by clicking on the gaze position or the like. The “means for acquiring the plane coordinate value of the designated position” and the “means for transmitting the plane coordinate value of the designated position to the transmitting device” of the receiving device 7 work, and the planar coordinate value of the designated gaze position is transmitted to the transmitting device 5. Sent.

The transmitting device 5 receives the transmission and transmits the “means for converting the received plane coordinate values into the stage control coordinates” and “the stage control coordinate values at the center position of the image”. A means for controlling the stage so as to be the same as that described above works, and a high-resolution still image with high magnification is created and displayed on the display device 5A. The high-resolution still image is transmitted to the personal computer of the receiving device 7.

The receiving device 7 displays the high-definition still image on the display device 7A to make a diagnosis. When it is desired to acquire a high-definition still image at another gaze position, the gaze position is designated again on the entire reference image to acquire the same.

As can be seen from the above description, the present embodiment 1
According to the method, the divided photographing of the specimen 3 is repeated at a predetermined magnification while controlling the stage 4 of the microscope 2, the image group obtained by the divided photographing is stored in the memory, and the plane of the image group divided and photographed on the memory is read. Since the entire reference image is created by joining together so that there is no inconsistency in the basic positional relationship, a dedicated macro shooting stand and a dedicated camera are prepared, and the entire image can be set without setting the slide on the macro shooting stand. Reference images can be captured. Also,
Even if the entire reference image could not be acquired properly due to the sample being too large or too small when using the dedicated macro shooting stand, the entire reference image of the predetermined area is created as the image of the most suitable arbitrary size can do.

Further, since arbitrary coordinates of the created entire reference image are associated with stage control coordinates,
Skill is not required for associating arbitrary coordinates of the entire reference image with the stage control coordinates of the microscope, and no effort is required.

The gaze position information of the whole reference image is designated by the coordinate value of the whole reference image, and the next transmission image is obtained by enlarging the peripheral portion around the gaze position and acquiring the next transmission image. Specify the center position of the next transmission image,
The most efficient image acquisition can be performed.

(Second Embodiment) In the first embodiment, the transmitting device 5
The description has been given on the assumption that the stage control coordinate value specified on the personal computer of the receiving device 7 and the actual stage control coordinate value of the center position of the image captured in the memory completely match. The stage control coordinate value specified on the personal computer of the receiving device 7 may differ from the actual stage control coordinate value of the center position of the image fetched into the memory depending on the control accuracy. Therefore, when the entire reference image is created according to the first embodiment, there is a possibility that a partial image area that is not displayed on the entire reference image may occur in a predetermined area.

To solve the problem, the following is performed.

FIG. 4 is a diagram for explaining means for capturing an image while controlling the stage according to the second embodiment of the present invention.
In FIG. 4, solid-line squares indicate images captured by the CCD camera 1 and taken into the memory, and dotted-line squares represent images taken out of the solid-line squares to be taken into the memory to create an entire reference image.
Arrows indicate movement of the stage.

In the second embodiment as well, the specimen 3 is divided into areas which can be taken into the memory, and the stage 4 is controlled based on the division and taken into the memory in the same manner as the first embodiment. Further, a method is employed in which images taken into the memory are connected to create an entire reference image. However, in the second embodiment, unlike the first embodiment, as shown in FIG. 4, the stage 4 is controlled so that the images overlap, and the images are stored in the memory. Then, a method is adopted in which a difference between rectangular images of the same size in the overlapping area is determined, and a position at which the images are joined is determined so that the difference is further reduced.

The rectangular image is, for example, a rectangular partial area of an overlapping area of the first image captured in the memory and the image captured in the second memory, and the third image and the third image captured in the memory. A rectangular partial area of an overlapping area of an image before and after the stage 4 is controlled, such as a rectangular partial area of an overlapping area of an image fetched into the memory on the sheet. If there is no stage control error of the microscope 2 with respect to two adjacent images to be joined, an overlapped area is taken as an overlap area.

FIG. 5 is a view showing a small area in the overlapping area before the stage control, FIG. 6 is a flowchart showing a processing procedure for obtaining the size of the overlapping area of the adjacent image, and FIG. 9 is a flowchart showing a processing procedure for joining the relations so as not to cause inconsistency.

With reference to FIGS. 4, 5, 6, and 7, the operation of the software in the transmitting device 5 of the second embodiment will be described below.

In the second embodiment, it is assumed that the precision of the stage control of the microscope 2 is 10 μm or less. Further, the number of pixels on the shorter side of the overlapping rectangular partial image area of the two images necessary for joining the two images is appropriately determined. The larger the value, the higher the accuracy of splicing, but it takes longer to process,
When the numerical value is small, an appropriate numerical value is set in consideration of the fact that the time required for processing is short but the accuracy is reduced. In the second embodiment, the number is set to 20 dots.

The prerequisites such as the configuration and function of the device and the actual size of the image based on the magnification of the lens are the same as those in the first embodiment. In the following description, a 4 × objective lens and a 1 × relay lens are used for the entire reference image as in the first embodiment.

Referring to FIG. 6, the size of the shorter side of the overlapping area of the two images to be joined is determined in advance (S601). This is obtained by recalculating {(number of pixels required for joining) dots + (maximum error of stage control) dots × 2} in units of microns (S602). This depends on the magnification of the objective lens and the relay lens. This is because, when the stage control maximum error of 10 μm is enlarged at that magnification, the number of dots corresponding thereto changes.

When the magnification of the objective lens is 4 times and the relay lens is 1 time, the maximum error of the stage control is 10 microns, and the maximum error of the stage control is 2 dots from 10 * 320/2210 = 1.4. it can. {(Maximum error of stage control) dots × 2 + (number of pixels required for joining) dots} = 2 * 2 + 20 = 24, and 24
This results in the need for dots. 24 dots is 24 * 22
10/320 = 165.8. In this case, it can be calculated that the shorter side of the overlapping region of the two images needs 166 μm in the actual size of the sample 3 (S60).
3).

From the above calculation, the portion taken into the memory to create the whole reference image is 166/2 = 83 μm from the upper, lower, left and right ends of the image taken into the memory, and 2
One of 25 partial area images shifted up, down, left, and right with a maximum of 2 dots, which is the maximum error of the stage control, around the partial area obtained by removing 4/2 = 12 dots each. The size of the partial area image is 2210-166 = 204, as indicated by the dotted square in FIG.
4, 2044 * 148 from 1650-166 = 1484
4 (micron meters).

Next, a description will be given of a method of dividing a sample into a region which can be taken in by a low-magnification lens and taking the sample into a memory. In this method, means for taking in stage control coordinate values in a range to be taken in as an entire reference image into a memory, means for taking in stage control coordinate values in relation to stage control coordinate values taken in memory, and taking in memory And means for taking in an image into a memory while controlling the stage with respect to the stage control coordinate values.

The means for taking the stage control coordinate values of the range to be taken as the whole reference image into the memory is as described in the first embodiment.

Referring to FIG. 4, the function of taking an image into the memory while controlling the stage with respect to the stage control coordinate values taken into the memory will be described. Since this means is almost the same as the means of the first embodiment, only the differences from the first embodiment will be described.

The size of the partial area image to be taken into the memory is 2
Since 044 * 1484 (micron meters), k
The formula for calculating 1, k2 is (| x1-x2 |) / 204.
4 ≦ k1, (| y1-y2 |) / 1484 ≦ k2. The stage control coordinate value for controlling the stage first is (x1-83, y1-83) + P, and the control coordinate value for the stage to be recorded first is also (x1-83, y1-83).
+ P. For stage control, 2
044 μm, and downward 1484 μm.

Referring to FIG. 7, 320
A method of creating an entire reference image by connecting * 240 still image groups on a memory so as not to cause inconsistency in a planar positional relationship will be described. This method is divided into a method of designating a small area in an overlapping area before stage control, and a method of calculating a correlation coefficient to determine a combining position and joining images. Create

First, the first still image is fetched into the memory. The image to be captured is 296 * 21 which is obtained by removing 12 dots at the top, bottom, left and right of the image captured at 320 * 240.
The image of FIG.

A method for specifying a small area in the overlapping area before the stage control will be described with reference to FIG. An area of 24 dots from the end in the moving direction by the stage control is set as an overlapping area before the stage control (S701). When the stage is controlled left and right, it is a 24 * 240 still image, and when the stage is controlled downward, it is a 320 * 24 still image. Here, a case where the stage is controlled left and right will be described. 2 at both ends of 24 dots in x coordinate direction
A total of 4 dots, 4 dots each, and 2 dots at both ends of the 240 dots in the y coordinate direction, a total of 4 dots, may not be stored in the memory in consideration of the stage control error. The image A of 20 * 236 cut out by two dots from the end of the image is designated as a small area in the overlapping area before the stage control (S702).

A method of calculating a correlation coefficient to determine a synthesis position and joining images will be described. Consider a 24 * 240 still image B that is calculated to overlap the image before stage control in the still image after stage control (S70).
3). Among 24 * 240 still images, there are 25 possible 20 * 236 still images. These are arbitrarily B1
B25 (S704). N is a natural number of 1 to 25. F (i, j) is the pixel value of pixel (i, j) of image A,
Let GN (i, j) be the pixel value of pixel (i, j) of image BN. Here, the pixel value is a feature value of a pixel, which becomes the same value when compared with the same pixel of the same image, and shows a different value when comparing arbitrary pixels of different images. A vector from pixel (1, 1) of image B to pixel (1, 1) of image BN is represented by PN (PNx, PN).
y) (S705). The difference between the image A and the image BN is calculated. As a calculation formula, when f ≧ x is 0 and f (x) is 0 or more and monotonically increases, HN = ΣΣf (|
F (i, j) −GN (i, j) |) (i = 1, 2, 3,
., 20, j = 1, 2, 3,... 236) (S7)
06). For example, f (x) = x ² can be considered. H
The value of N that minimizes N is determined (S707). If N is not uniquely determined (S708), PN
(2, 2) is selected (S709).
If it is still not determined uniquely, a rule such as adopting the one with the smallest value of N is determined (S7).
10, S711). 2 such that the upper left pixel of the image after the stage control is (10 + PNx, 10 + PNy)
96 * 216 still images are taken into the memory (S71).
2). This is repeated (k1 * k2-1) times (k1 * k
2) An entire reference image is created by loading the still images into a memory.

The stage control coordinates of the microscope recorded at the center position of the still image are converted into dot plane coordinate values. As the conversion method, the stage control coordinate value (xi, yi) recorded at the center position is converted into the plane coordinate value ((xi−x1) /6.9+160, (yi) as in the first embodiment.
−y1) /6.9+120).

A line is connected by the function of starting communication with the personal computer of the receiving device (pathological side) 7. The whole reference image in which the plane coordinate values in dot units are recorded at (k1 * k2) locations is transmitted to the pathological side. When the transmission of the entire reference image is completed, the communication line 6 is disconnected by means for terminating the communication of the receiving device (pathological side) 7 with the personal computer.

The receiving device (pathological side) 7 receives the entire reference image in which the plane coordinate values in dot units are recorded at (k1 * k2) locations and displays it on the display device (display) 7A.

A method of designating a gaze position and obtaining plane coordinate values of the gaze position will be described. A gaze position at which a high-definition still image is to be acquired is designated on the entire reference image on which the received plane coordinate values in dot units are recorded. The position that minimizes the distance from the specified gaze position is (k
From the positions where 1 * k2) plane coordinate values are recorded, the number of dots away from the position is calculated, and the calculated values are combined with the plane coordinate values of the center position of the obtained still image and designated. Find the plane coordinate value of the gaze position.

After the plane coordinate value of the specified gaze position is obtained by the above method, the remaining description is the same as in the first embodiment.

In the second embodiment, the error of the stage control and the size of the overlapping rectangular partial image area of the two images necessary for joining the images are determined, and the images are overlapped in the memory according to the value. Take in. for that reason,
The effect is obtained that a partial area that is not displayed on the entire reference image does not occur in the predetermined area. Further, since the positions at which the images are connected are calculated and connected, an effect is obtained that an entire reference image that is the same as or close to the actual sample can be created.

Also, by transmitting (k1 * k2) plane coordinate values to the entire reference image and designating the gaze position by the plane coordinates, the stage control coordinates are obtained from the accuracy of the pixels of the still image. Condition that the accuracy of is better,
For example, when the accuracy of a pixel of a still image is 6.9 μm per dot and the accuracy of stage control coordinates is 1 μm, the target stage control coordinate value when the gaze position of the entire reference image is specified Can be obtained with higher accuracy.

If the (k1 * k2) plane coordinate values are not added, a subpixel error occurs during superposition. The error is superimposed when the superposition is repeated. The superimposed error is directly reflected on the stage control error when a position is designated on the overall reference image. On the other hand, in the method of the first embodiment, since (k1 * k2) plane coordinate values are added, it is specified whether the sub-pixel is shifted at the time of synthesis or the error is superimposed. Since the position information of the position is calculated as a distance from a value of the closest (k1 * k2) average coordinate values, a value close to the designated target stage control coordinate value can be obtained.

Thus, in creating the entire reference image,
Even if the position of each divided image is shifted, the center position of the divided image is integrally shifted with the divided image, so that the position of the gaze position calculated from the center position does not occur.

Third Embodiment In the second embodiment, the size of the overlapping area is calculated from the maximum value of the error of the microscope stage control, and the stage 4 of the microscope 2 is controlled. Therefore, when the entire reference image is created in accordance with the second embodiment, there are places where the overlapping area becomes unnecessarily large. To solve that problem, do the following:

As a feature of the error during the stage control, it can be said that the error when the control is performed in the same direction is small, and the error when the direction of the stage control is changed is large.
Therefore, in the third embodiment, unlike the second embodiment, the size of the shorter side of the overlap region of the two images to be connected is adjusted depending on whether the direction of the stage control has changed or not.

In the third embodiment, the maximum value of the error of the stage control of the microscope is 10 μm. If the direction of the stage control is the same as the direction of the immediately preceding stage control, the error of the stage control of the microscope in that case is obtained. The maximum value of is 5
It is determined to be micrometer.

Referring to FIG. 6, the size of the shorter side of the overlap region of two images to be joined is determined in advance. When the direction of the stage control is different from the direction of the immediately preceding stage control, the shorter side of the overlapping region of the two images can be calculated to be 166 μm in the actual size of the sample, as in the second embodiment.

The calculation is also performed when the direction of the stage control is the same as the direction of the immediately preceding stage control. 5 * 3
From 20/2210 = 0.7, the maximum error of the stage control is 1 dot. {(Maximum error of stage control) dot × 2 + (number of pixels required for joining)} = 1 * 2 +
20 = 22 (dots) is 22 * 2210/320 = 15
1.9 (micron meters), in which case it can be calculated that the shorter side of the overlap region of the two images requires 152 microns in the actual size of specimen 3.

According to the above calculation, the portion taken into the memory to create the entire reference image is 12 dots from the upper and lower ends of the image taken into the memory, and 12 or 11 dots from the left and right ends depending on the direction of the stage control. The image taken into the memory so that it overlaps by 166 μm, centering on each of the removed partial regions, is one of 25 partial region images shifted up, down, left, and right with the limit of 2 dots which is the stage maximum error. , 152 μm, is one of nine partial area images shifted up, down, left, and right with a limit of 1 dot, which is the maximum error of the stage.

FIG. 8 is a diagram for explaining a means for loading an image into the memory while controlling the stage. With reference to FIG. 8, a description will be given of a means for taking an image into the memory while controlling the stage with respect to the stage control coordinate values taken into the memory. | X1−x2 | ≦ 2210 * k1-166 * 2-
From 152 (k1-2), the formula for calculating k1 is k1 ≧
(| X1−x2 | +28) / 2058. The formula for calculating k2 does not change.

The method of designating the image A before controlling the stage 4 so as to overlap by 166 μm and the method of joining the image with the image after the stage control are the same as those in the second embodiment. A method of specifying the image A of the stage control when controlling the image by 152 μm, and a method of joining the image A with the image after the stage control will be described.

First, a method for specifying a small area in the overlapping area before the stage control will be described.

An area of 22 dots from the end in the moving direction by the stage control is set as an overlapping area before the stage control. Since the stage is controlled left and right, it is a 22 * 240 still image. Of the 22 dots in the x-coordinate direction, a total of 2 dots each at each end, and a total of 2 dots at each end of the 240 dots in the y-coordinate direction are taken into the memory in consideration of an error in stage control. Since there is a possibility that there is no image, a 20 * 238 image A obtained by cutting one dot at a time from the end of the 22 * 240 image is designated as a small area in the overlapping area before stage control.

A method of calculating a correlation coefficient to determine a combining position and joining images will be described. Consider a 22 * 240 still image that is calculated to overlap the image before stage control in the still image after stage control. 22 * 240
In this still image, nine types of 20 * 238 still images can be considered. These are arbitrarily designated as B1 to B9. N is 1-9
Is a natural number of. F (i, j), GN (i, j), P
N and HN are defined in the same manner as in the second embodiment. As in the second embodiment, the value of N at which HN is minimized is determined. If N is not uniquely determined, the one whose PN is closest to (1, 1) is selected. A 298 * 218 still image whose upper left pixel is (10 + PNx, 10 + PNy) in the image after the stage control is fetched into the memory. (K1 *
k2) An entire reference image is created by loading the still images into the memory.

In the third embodiment, the size of the overlapping rectangular partial image area of the two images to be applied is determined according to the direction of the stage control. Therefore, the number of images to be taken into the memory as still images is reduced, and the time required for taking can be reduced. In addition, since the overlapping area can be set small, the time required for combining two images can be shortened. Since both the time required for capturing and the time required for synthesizing the image can be reduced, the time required for creating the entire reference image can be significantly reduced.

(Embodiment 4) In Embodiments 1, 2, and 3 described above, an overall reference image is created by synthesizing a still image captured by the CCD camera 1. Therefore, when the whole reference image is created in accordance with the above-described first, second, and third embodiments, unevenness in luminance occurs. As a result, a place where the images are connected is conspicuous, and the whole reference image is different from an actual sample. There was a problem of being created.

In order to solve this problem, the following is performed. Since a still image is captured by the CCD camera 1, the brightness becomes uneven. Therefore, in the fourth embodiment, unlike the above-described first, second, and third embodiments, unevenness in luminance is reduced by using a line sensor camera to create an entire reference image.

FIG. 9 is a diagram for explaining means for creating an entire reference image according to the fourth embodiment of the present invention, and 1 is a line sensor camera.

In the fourth embodiment, depending on the specifications of the line sensor.
The number of pixels of the line sensor camera 1A is 1024 pixels,
It is assumed that one pixel size is 14 * 14 microns (μm). The maximum error of the stage control is 10 μm, and the number of pixels on the shorter side of the overlapping rectangular partial image area of the two images necessary for joining the two images is 20 dots.

Referring to FIG. 9, a description will be given of a means for creating an overall reference image with the line sensor while controlling the stage.
Referring to FIG. 6, the size of one shorter side of the overlap region of two images to be joined is determined in advance.
Since the maximum error of the stage control of 10 μm is 1 dot, it can be calculated that the size of the shorter side of the overlapping area of the two images is 22 dots, 22 * 14 = 308 μm. In the same manner as in the above-described first, second, and third embodiments, stage control coordinates in a range to be captured as the entire reference image are captured. | Y1-y2 | / 14028 ≦ k
The minimum natural number k2 that is 2 is calculated. Control is performed so that the stage control coordinate value at the top of the line captured by the line sensor camera 1A becomes (x1-154, y1-154). The stage is controlled rightward until the x coordinate value becomes (x2 + 154), the image is fetched into the memory, and the stage control coordinate value (x1-154, y1-154) is recorded at the upper left position. The size of the still image taken in the memory in the x coordinate direction is (x2−x1 + 308) / 14 dots. Control is performed so that the stage control coordinate value at the top of the line captured by the line sensor is (x1-154, y1 + 13874). Similarly, move the stage 4 rightward with the x coordinate value (x
2 + 154), the image is stored in the memory, and the stage control coordinate values (x1-154, y1
+13874) is recorded. This is repeated (k2-1) times, and the k2 still images are taken into the memory and the stage control coordinate value at the upper left position is recorded.

The first still image is fetched into the memory. The captured image is {(x2-x1 + 308) / 14} * 1024
This is a still image obtained by removing 11 dots in each of the upper, lower, left, and right portions of the image captured in step.

A method of designating a small area in an overlapping area with the next image will be described. The overlapping area with the next image is a portion corresponding to 22 dots from the lower end in the still image, ｛(x2-x
1 + 308) / 14｝ * 22, and the maximum error of the stage control is 1 dot. Therefore, when the calculation is performed in the same manner as in the first, second, and third embodiments, the small area A in the overlapping area is obtained.
Is [{(x2-x1 + 308) / 14} −2] * 20
Are cut out one dot at a time from the upper, lower, left, and right ends of.

A method of calculating a correlation coefficient to determine a combining position and joining images will be described.部分 (x2−x1 + 308) / 1, which is a portion corresponding to 22 dots from the upper end in the still image calculated to overlap the previous image in the next image
The still image of 4 * 22 is assumed to be an image B. In the image B, there are nine possible still images of [{(x2−x1 + 308) / 14} −2] * 20. These are optionally B1 to B9
The method of creating the entire reference image thereafter is described in the third embodiment.
Same as

According to the fourth embodiment, since one still image is larger than the still images obtained in the first, second and third embodiments, the number of whole reference images to be taken is small. As a result, the number of times of performing image synthesis can be reduced.
By reducing the number of times image synthesis is performed, the effect of shortening the time required for synthesis can be obtained,
The effect is obtained that the same overall reference image as the actual sample is easily created.

Further, the entire reference image of a predetermined region of the specimen placed on the stage of the microscope is scanned by a line sensor while controlling the stage of the microscope, and the image group is fetched into a memory. By means of combining by joining together so that there is no inconsistency in the positional relationship, it is possible to prepare a dedicated macro shooting stand and capture the entire reference image without setting a slide on the macro shooting stand. it can.

Further, in a CCD camera that captures a flat image, since the luminance is different between the center and the end of one still image in a single still image, the seam becomes conspicuous when the images are joined. As a result, a seam does not occur in the vertical direction when scanning horizontally, and a seam in the horizontal direction does not occur when scanning vertically, so that an image closer to the original sample 3 can be created. As a result, an effect is obtained in which an entire reference image can be created in which there is no portion where the synthesis position becomes noticeable due to luminance as frequently as in the first, second, and third embodiments.

(Embodiment 5) In Embodiment 1 described above, the receiving device (pathologist) 7 specifies a gaze position on the entire reference image, thereby obtaining a still image centered on the gaze position. However, especially in a pathological image in which a partial region including a similar image occurs at a plurality of locations, the pathologist remembers which partial region in the entire reference image has been acquired at what magnification. It is difficult to keep. for that reason,
A plurality of still images at the same gaze position may be acquired. In addition, there is a possibility that a still image whose most part overlaps with the obtained still image is obtained.

In order to solve this problem, the receiving device 7 retains the position information of the image obtained by the receiving device 7 and obtains an image at the same location or an image at a location where most of the images are identical. To prevent

In the fifth embodiment, a description will be given of a method for preventing the receiving apparatus 7 from acquiring the same image as an already acquired image or an image which is almost identical. It is assumed that the entire reference image is created with a 4 × objective lens.

The embodiment from when the receiving apparatus 7 acquires the entire reference image to when the gaze position is designated is the same as the above-described embodiments 1 to 4.

It is calculated in advance how many squares of the still image to be taken in as the whole reference image at the magnification when the objective lens is designated are in the whole reference image. For example, if a high-definition image is acquired with a 10 × objective lens, for example, according to Table 1, the actual size of the specimen 3 acquired will be 900 * 690 microns. 900
* 690 μm, 130 * 100 images are acquired as high-definition still images on the entire reference image. When the objective lens has a magnification of 20 times or 40 times, the same method is used to calculate in advance.

A method for visually displaying the position information of the still image of the image acquired by the receiving device 7 on the entire reference image will be described. First, the magnification of the objective lens for acquiring a high-definition still image is adjusted, and the magnification data is stored in a personal computer. In the fifth embodiment, the objective lens is 10 times. Objective lens 1
A magnification of 0 corresponds to a 130 * 100 still image on the entire reference image.

At the same time as the receiving device 7 specifies the gaze position, a 130 * 100 still image centered on the gaze position is surrounded by a square dotted line. If the partial area for acquiring the high-definition still image is at that position, for example, by giving a signal such as pressing the “acquire high-definition image” button, the dotted square displayed on the entire reference image is replaced with a solid square. Replace with Furthermore, the plane coordinate value of the gaze position is acquired in the same manner as in the above-described embodiment, and thereafter, similarly to the above-described first to fourth embodiments, the receiving device 7 acquires a desired high-definition still image.

Further, when obtaining a high-definition still image, the magnification of the objective lens for obtaining the high-definition still image is adjusted, and the magnification data is stored in a personal computer. Thereafter, similarly, a partial region for acquiring a high-definition still image is surrounded by a dotted line, it is confirmed whether or not the position is sufficient, the dotted-line square is replaced with a solid-line square, and the pathological side acquires a high-definition still image.

The magnification of the lens can be estimated based on the size of the square. For example, if the magnification of the objective lens is 4 times, it is indicated by a red dotted line, and if it is acquired as a high-definition still image, it is indicated by a solid red line. If a square is displayed, and if the magnification of the objective lens is 10 times, a blue dotted line is displayed, and if a high-definition still image is acquired, a square of a solid blue line is displayed, and the receiving device 7 performs color coding. When viewing the entire reference image, it is clear at a glance which partial region has been acquired as a high-resolution still image of the objective lens at what magnification.

In the fifth embodiment, since it is possible to acquire a high-definition still image while confirming whether or not an image of a partial region already acquired as a high-definition still image is acquired again as a high-definition still image, an improper image is obtained. An effect is obtained that the time for acquiring a necessary image can be reduced.

As described above, the invention made by the present inventors is described below.
Although the present invention has been described in detail with reference to the embodiment, the present invention is not limited to the embodiment, and it is needless to say that various changes can be made without departing from the scope of the invention.

[0133]

As described above, according to the present invention,
The following effects can be obtained.

(1) In addition to the conventional effect that the entire reference image can be obtained without using a dedicated macro photography stand and a dedicated camera, there is no need to move the slide over two stages. Therefore, it is possible to easily associate the position information of the predetermined position on the entire reference image with the stage control coordinate value.

(2) By specifying the range in which the whole reference image is created, the whole reference images of various sizes can be obtained efficiently.

(3) By specifying the gaze position on the entire reference image and automatically controlling the stage to the stage control coordinate value of the gaze position, the position specified by the receiving device (pathologist) becomes the center. Such a high-definition image can be obtained easily in a short time.

(4) By obtaining still images so as to overlap each other in consideration of errors in the microscope, an entire reference image closer to the original sample can be obtained.

(5) By obtaining a still image using a line sensor whose luminance difference does not become more remarkable, it is possible to obtain an entire reference image closer to the original sample.

(6) The location where the receiving device (pathologist) has acquired the high-definition still image is visually displayed on the entire reference image, so that the high-definition still image at the same location or most of the still image overlaps. By preventing the acquisition of a high-definition still image, a high-definition image of a necessary portion can be efficiently acquired.

[Brief description of the drawings]

FIG. 1 is a block diagram showing a hardware configuration for realizing a microscope image remote control system according to a first embodiment of the present invention.

FIG. 2 is a flowchart illustrating the operation of the microscope image remote control system according to the first embodiment.

FIG. 3 is a diagram illustrating a processing flow for realizing the microscope image remote control system according to the first embodiment;

FIG. 4 is a diagram for explaining a means for loading an image into a memory while controlling a stage according to the second embodiment of the present invention.

FIG. 5 is a diagram illustrating a small area in an overlapping area before stage control according to the second embodiment.

FIG. 6 is a flowchart of a processing procedure for obtaining a size of an overlapping area between two adjacent images according to the second embodiment;

FIG. 7 is a flowchart of a processing procedure for connecting the two-dimensional memory so that no inconsistency occurs in a planar positional relationship in the memory according to the second embodiment;

FIG. 8 is a diagram for explaining a means for loading an image into a memory while controlling a stage according to a third embodiment of the present invention.

FIG. 9 is a diagram for explaining a means for generating an entire reference image with a line sensor camera while controlling a stage according to a fourth embodiment of the present invention.

FIG. 10 is a diagram for explaining a means for displaying high-definition still image acquisition position information on an entire reference image according to a fifth embodiment of the present invention.

[Explanation of symbols]

DESCRIPTION OF SYMBOLS 1 ... CCD camera, 1A ... Line sensor camera, 2 ... Microscope, 3 ... Sample, 4 ... Automatic movable stage, 5 ... Transmission device (clinical computer), 5A ... Transmission device display device,
6. Communication line, 7 ... Receiving device (pathologist's personal computer).

 ──────────────────────────────────────────────────続 き Continuing on the front page (72) Inventor Yukihiro Kubota 3-19-2 Nishishinjuku, Shinjuku-ku, Tokyo Japan Telegraph and Telephone Corporation (72) Inventor Takashi Sakai 20-1 Sakuraokacho, Shibuya-ku, Tokyo NTITE Electronics Co., Ltd.

Claims (6)

[Claims] 1. A transmitting device for acquiring and transmitting an entire reference image of a predetermined region of a specimen placed on an automatic movable stage of a microscope, and a receiving device for receiving the transmitted overall reference image at a remote place, In the microscope image remote control system having a receiving device for transmitting the information of the gaze position in the transmission device side and requesting the next transmission screen based on the information of the gaze position, and a signal transmission path for transmitting the image signal. Means for repeating the divisional photographing of the sample at a predetermined magnification while controlling the automatic moving stage of the microscope, means for taking in a group of images obtained by the divisional photographing, and divisional photographing on the memory Means for creating the entire reference image by connecting the two or more image groups so as not to cause inconsistency in a planar positional relationship, and a pair of a position coordinate and a stage control coordinate of the created entire reference image. Response means, and the gaze position information is specified by the coordinate values of the entire reference image, and the next transmission image is obtained by enlarging and acquiring a peripheral portion around the gaze position. Microscope image remote control system. 2. The microscope image according to claim 1, further comprising means for performing stage control so that there is an overlap area having a size necessary for image synthesis even if there is an error in the stage control of the microscope. Remote control system. 3. The microscope remote control according to claim 2, further comprising means for calculating an error of the stage control according to a direction of the stage control of the microscope and optimizing a size of an overlap area used for image synthesis. Control system. 4. The apparatus according to claim 1, further comprising means for creating a whole reference image of a predetermined area of the specimen placed on the stage of the microscope with a line sensor camera. Microscope remote control system. 5. The transmitting apparatus according to claim 1, wherein (k1) is added to the entire reference image.
The microscope according to any one of claims 1 to 4, further comprising: means for adding and transmitting * k2) plane coordinate values, and specifying a gaze position by the plane coordinate values. Remote control system. 6. The receiving device displays a mark or information indicating a position of the received high-definition still image on an entire reference image on a display device, and displays the high-definition still image at a predetermined position on the entire reference image. The remote control system for a microscope according to any one of claims 1 to 5, further comprising means for displaying the information.