JP4231915B2 - Specimen inspection method and system - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a specimen inspection method and system in which a plurality of specialized departments jointly inspect specimens of human cells and tissues via a communication network.
[0002]
[Prior art]
In medical institutions such as hospitals and research laboratories in universities, specimen inspection of cells and tissues with a microscope is frequently performed. By the way, in specimen inspection of cells and tissues, it is necessary to first check for the presence of malignant cells. However, the specimen contains an enormous number of cells, and the examination area becomes very large because it is enlarged with a microscope. In order to examine individual cells sequentially, a great amount of labor and burden is required. Therefore, in specimen inspection of cells and tissues, in order to improve the overall efficiency of the inspection, the presence or absence of malignant cells is examined with a microscope or the like, and if malignant cells are found, the part is imaged. There is a division of labor between an inspection department specified by marking and the like and a diagnostic department that performs medical diagnosis on the specified part.
[0003]
In recent years, data transmission media such as public lines such as telephone lines and dedicated Internet lines have begun to be used as connections between divisional divisions, and sample images are converted into data using data transmission media. It comes to communicate with. For this reason, the applicant of the present application, for example, takes a sample of a cell or tissue magnified with a microscope as a line image with a line sensor as a method for converting the sample image into data, and the line image is processed by computer image processing. Means for quickly creating a clear captured image of an entire large area has been proposed (Japanese Patent Application Nos. 2002-097495, 2002-097497, 2002-097498, and 2002-097499). .
[0004]
[Problems to be solved by the invention]
When examining a cell or the like, it is often necessary to obtain detailed findings from the examination department that examined the cell or tissue. In addition, for cells that should be considered malignant, it is often necessary to re-image images with different specimen depths and magnifications. In such a case, if each department can see the detailed images taken for the entire specimen examination area and exchange opinions and discuss the detailed conditions of re-imaging, it is possible to perform specimen examination extremely accurately and quickly. become.
[0005]
However, in the invention according to the above-described application, although a clear image can be quickly created for a large imaging region, the image is a full-size image captured by a display device such as a monitor because the image has a large region. It is impossible to display all of. If the image is reduced, it is possible to display all the areas at once on the display device, but in the reduced image, the captured cells and tissues cannot be seen clearly and cannot be examined or diagnosed. Then, if each department tries to exchange opinions or have a meeting while looking at a display device such as a monitor at another point, only a part of the vast imaging area can be displayed on the display device, so the difference in the images to be displayed is displayed. May occur.
[0006]
Therefore, an object of the present invention is to easily and easily provide a predetermined plane area of an image having an imaging area larger than an area that can be displayed on an image display means (such as a monitor) by simply transmitting a condition with a small amount of data at a plurality of points. It is an object of the present invention to provide a specimen inspection method and system capable of prompt display.
[0007]
[Means for Solving the Problems]
In order to solve the above problems, the specimen inspection method according to the present invention is: In the image production department, image data captured for each of a plurality of layers having different specimen depths from the specimen are stored in advance in a storage section of the plurality of departments, and the above-described storage in the inspection department A display layer setting stage for setting a first condition for designating one layer image to be displayed on the specific terminal based on the image data; In the inspection department A display area setting stage for setting a second condition for designating a predetermined plane area to be extracted from the layer image designated by the first condition; In the inspection department A first image display stage for displaying a predetermined plane region extracted from the layer image on the specific terminal according to the first and second conditions; In the inspection department First and second conditions Of the above divisions other Departmental Condition sending stage sent to the terminal and other Departmental According to the first and second conditions sent to the terminal, this other Department storage above Based on pre-stored image data this other Departmental A second image display step of causing the terminal to display a corresponding plane area corresponding to the predetermined plane area.
[0008]
And also In the above inspection department An index display setting stage for setting a third condition representing an index indicating a specific portion of a predetermined plane area displayed on the specific terminal; In the inspection department A first indicator display stage for displaying an indicator on a predetermined plane area displayed on the specific terminal according to the third condition; In the inspection department 3rd condition other Departmental A second condition transmission stage to be transmitted to the terminal, and another Departmental According to the third condition sent to the terminal, this other Departmental It is preferable to include a second indicator display stage for causing the terminal to display a corresponding indicator corresponding to the indicator.
[0009]
DETAILED DESCRIPTION OF THE INVENTION
DESCRIPTION OF THE PREFERRED EMBODIMENTS Embodiments of the present invention will be described based on examples with reference to the drawings. The specimen inspection system shown in FIG. 1 is a cytological specimen inspection system provided with a terminal 605 of the image creation department 3, a terminal 41 of the examination department 4, and a terminal 51 of the diagnosis department 5. Each terminal can transmit and receive data through a data transmission medium such as a public line such as a telephone line or a dedicated Internet line. Here, in the image creation department 3, a cell or tissue as a specimen is magnified and imaged by the microscope device 6 to create an image, and the examination department 4 identifies malignant cells or cells that should be considered malignant from this image. In the diagnosis department 5, the identified cell is diagnosed. The terminals 605, 41, and 51 have storage units 653, 42, and 52, respectively. In these storage units, cells and tissues captured for each of the three layers having different specimen depths (focal positions) are stored. Image data 32a to 32c, 42a to 42c, and 52a to 52c are stored. The specimen depth here indicates a difference in focal position in the specimen depth direction when the microscope apparatus 6 images the specimen. That is, in the three layers described above, the layer 32a is the uppermost layer closest to the objective lens, the layer 32c is the lowermost layer farthest from the objective lens, and the layer 32b is an intermediate layer between the layers 32a and 32c. .
[0010]
Next, a procedure for creating image data of cells and tissues in the image creation department 3 will be described with reference to FIGS. First, the procedure for creating the image data will be outlined. The positions at which the three specimen depths of the cells and tissues of the specimen 601 are different from each other are imaged simultaneously on line sensors 631a, 631b, and 631c, which are electronic imaging devices arranged at different heights from the specimen 601. In the present embodiment, as shown in FIG. 4, the line sensors 631 a, 631 b, 631 c are arranged in a stepped manner to make the height different from that of the sample 601. The three line sensors 631a, 631b, and 631c read images having three different sample depths as line image data. Then, the specimen 601 is horizontally moved by the moving means 604 shown in FIGS. 2 to 4, and this line image data is stored in the storage unit 651 by the terminal 605 shown in FIG. Next, the arithmetic processing unit 651 in the image processing apparatus generates image data for each of the three layers having different specimen depths of the specimen 601 from the recorded line image. This will be described in detail below.
[0011]
First, an overall configuration of the microscope 602 will be outlined with reference to FIGS. 2 and 3. The microscope 602 used in the embodiment of the present invention is an optical microscope. In the examination of cells and tissues, it may be difficult to judge malignant cells only by looking at the in-focus part, and pay attention to the part that is blurred (not in focus). There are things to do. When an image is taken with a microscope 602 which is an optical microscope, this out-of-focus information can be left as image data, which is suitable for examination of cells and tissues. The microscope 602 includes an optical lens including a lens barrel 625, a visual observation eyepiece 623 attached to the lens barrel, a two-dimensional CCD sensor unit 627 that captures a certain two-dimensional extent of the sample 601, an objective lens 621, and the like. It has. The lens barrel 625 is supported by an L-shaped gantry 606 via a rack and pinion mechanism 661 that moves the lens barrel up and down. An optical fiber 607 for introducing light from a halogen lamp (not shown) provided outside is connected to the lower part of the L-shaped gantry 606 in order to irradiate the specimen 601 from the back surface.
[0012]
As shown in FIG. 4, the optical lens includes an objective lens 621 composed of a composite lens composed of two lenses 621a and 621b, and three line sensors 631a arranged parallel to each other at different heights. It is composed of three saddle-shaped aberration correction lenses 622a, 622b, and 622c installed for each of 631b and 631c. The aberration correction lenses 622a, 622b, and 622c are located at positions shifted from each other in the X-axis direction by the distance between the line sensor elements as shown by the broken line, the solid line, and the one-dot broken line in FIG. These layers (surface layer 601b, intermediate layer 601b, lower layer 601c) are formed in optical shapes so as to form images on line sensors 631a, 631b, and 631c, respectively. Note that three objective lenses 621 having different magnifications are attached to the revolver 624, and can be manually switched with each other.
[0013]
As shown in FIG. 4, the three line sensors 631a, 631b, 631c and the aberration correction lenses 622a, 622b, 622c are housed in a camera case 632, which is shown in FIG. In this manner, the microscope 602 is detachably attached to the tip of the lens barrel 625. In addition, the shape of this attachment part employ | adopts F mount which is the standard attachment shape of a single-lens reflex camera about a lens attachment part. The line sensor 631a and the like are configured by arranging 4000 charge coupled devices each having a side of 7 μm in a straight line. Accordingly, when the imaging magnification is 100 times, a range of 7 μm ÷ 100 = 0.07 μm in width and 7 μm × 4000 pieces / 100 = 0.28 mm in length can be captured at a time.
[0014]
A moving means 604 is installed on the horizontal portion of the L-shaped frame 606. The moving means 604 includes a tilting table 642 on which the specimen 601 is placed, and a linear motor 641 that horizontally moves the tilting table in the left-right and front-back directions. The linear motor 641 is a known technique in which an armature moves on a permanent magnet arranged in a strip shape, and can be driven at high speed, high responsiveness, and highly accurate positioning. The linear motor 641 is remotely controlled by a computer as will be described later, and moves the sample 601 to a predetermined position.
[0015]
The tilting table 642 is a flat table that is supported at three points by three ultrasonic motors 642a arranged so as to form an equilateral triangle in plan view and a vertical output shaft 642c of the ultrasonic motor. It is comprised from the part 642d and the fixing member 642b which fixes the mutual position of this ultrasonic motor. The tip of the vertical output shaft 642c is in contact with a recess formed on the back surface of the table portion 642d so that the horizontal positions of the vertical output shaft 642c do not shift.
[0016]
The ultrasonic motor 642a is a known technique, and an elastic member is placed on a piezoelectric ceramic that deforms when a voltage is applied, and a voltage in an ultrasonic region is applied to the piezoelectric ceramic to generate a bending vibration in the elastic member. This rotates the output shaft, and has characteristics such as high responsiveness and controllability and low operating noise. In the ultrasonic motor 642a used here, the output shaft 642c has a screw structure, and this output shaft rotates to move up and down. The tilting table 642 adjusts the inclination and focal length of the sample 601 according to instructions from the computer.
[0017]
The lamp unit 626 accommodates a halogen lamp (not shown), and the light from the halogen lamp is bent at a right angle along the optical axis of the microscope 602 by a half mirror and applied to the specimen 601. The reflected light from this specimen is enhanced to obtain a clear image. The lamp unit 626 that is the epi-illumination light source is used when the specimen 601 is a substance having low light transmittance. Further, an optical fiber 607 for introducing light from a halogen lamp (not shown) provided externally as a transmissive light source so as to be irradiated from the back surface of the specimen 601 is connected to the lower portion of the L-shaped frame 606. . When viewing a light-transmitting object such as a cell or tissue, the light source from here is often used as the main light source. In this embodiment, the light is irradiated from the back surface of the specimen 601.
[0018]
In the two-dimensional CCD sensor unit 627, a two-dimensional CCD sensor (not shown) capable of capturing a two-dimensional extent to some extent is provided. That is, in the cell examination, it may be necessary to display an image magnified by the microscope 602 directly on the display means and confirm a specific part or range where malignant cells are present while viewing this display screen. . However, when the image sensor is only the line sensor 631a or the like, the line image that can be captured at a time is extremely narrow, and therefore, while viewing the display screen of the narrow line image, the specific region or range where malignant cells are present can be determined. It is difficult to confirm. On the other hand, a two-dimensional CCD sensor that can image a two-dimensional extent to some extent is provided, and it is easy to confirm a specific part or range such as a cell or tissue while viewing the display screen. Therefore, by providing a two-dimensional CCD sensor, a specific part or range in the sample 601 can be easily confirmed.
[0019]
This two-dimensional CCD sensor is a flat-type arrangement of 600 × 600 = about 350,000 charge-coupled devices having a side of 21 μm, which is used in a general CCD camera. Is imaged through a half mirror.
[0020]
The terminal 605 uses a commercially available computer, a so-called personal computer, and includes an arithmetic processing unit 651, a display unit 652, and a storage unit 653 that stores line image data. The arithmetic processing unit 651 is provided in the image processing apparatus and, as will be described later, is a line based on the setting of the imaging region of the sample 601, the movement of the moving unit 604, and the amount of movement fed back from the encoder of the moving unit. An imaging execution instruction from the sensor 631a and the like, capturing of line image data captured by the line sensor, and synthesis of the line image data to create an overall planar image of the imaging region.
[0021]
Next, a procedure for creating cell and tissue image data 32a to 32c using the above-described components will be described. As shown in FIG. 2, first, a specimen 601 in which a cell or tissue piece to be examined is sandwiched between a slide glass and a cover glass is set on the upper surface of the table portion 642d of the tilting table 642 so as not to move. The sample is fixed to the table portion 642d by suction or the like by vacuum means or the like. Next, as shown in FIG. 7, the inspection area 611 of the sample 601 is set by input from the input means of the personal computer.
[0022]
The reason for setting the inspection area 611 is to set the start point 611a and the end point 611b of the line image picked up sequentially by the line sensor 631a and the like as will be described later. The setting of the inspection area 611 requires a picked-up image having a certain two-dimensional extent, so that picked-up data from the two-dimensional CCD sensor is displayed on the display means 652 of the terminal 605 and the display screen is displayed. While moving, the moving means 604 is moved and adjusted in the XY directions. Accordingly, the XY coordinates of the diagonal positions 611a and 611b are stored in the arithmetic processing unit 651 as information corresponding to the movement start point and end point position of the linear motor 641 of the moving unit 604. Therefore, as will be described later, when imaging is performed by the line sensor 631a or the like, the linear motor 641 is moved from the inner position 611a, which is the first imaging position, to the horizontal direction, which is the last imaging position, according to an instruction from the arithmetic processing unit 651. Move sequentially to position 611b.
[0023]
When setting the inspection region 611, the focal length and inclination of the sample 601 are adjusted simultaneously. That is, when setting the inspection area 611, first, at the start position 611a, while focusing on the surface layer 601a of the sample 601 while viewing the display image from the two-dimensional CCD sensor displayed on the display means 652, the linear motor 641 is moved in the X-axis direction to focus at the right end position of the inspection region 611. Then, the tilt in the X-axis direction is calculated from this focal position shift, and the tilt of the tilting table 642 is adjusted. Then, the focus is adjusted at the upper right position 611b of the inspection area 611 by the same means, and the inclination in the Y-axis direction is adjusted.
[0024]
Here, if the focal position of the two-dimensional CCD sensor and the focal position of the line sensor 631a for imaging the surface layer 601a of the sample 601 coincide with each other, the focal point of the line sensor 631a immediately follows the surface layer 601a of the sample. Can be combined. The other line sensors 631b and 631c are designed so that the aberration correction lenses 622a, 622b and 622c are focused on the respective focal depths simultaneously with the line sensor 631a. At the combined stage, all three line sensors are in focus.
[0025]
Next, a procedure for imaging the sample 601 with the line sensor 631a and the like will be described with reference to FIGS. This imaging is controlled by a program built in the arithmetic processing unit 651. First, the arithmetic processing unit 651 sets inspection positions j = 0 and k = 0 by the encoder, and recognizes the inspection positions as coordinates X = 0 and Y = 0. Then, the sample 601 is moved to the XY coordinate (0, 0) position by the linear motor 641. This XY coordinate (0, 0) position is the lower left corner 611a of the inspection area 611 shown in FIG. 7, and this point is the starting point for starting imaging. In FIG. 8, the line sensor 631a is located at the position (a) and overlaps the lower left corner 611a.
[0026]
When the start point of the imaging position is set at the position of the lower left corner 611a of the inspection area 611, the arithmetic processing unit 651 sets the movement amount dx on the X axis, and the line sensors 631a and 631b at the inspection position (0, 0). , 631c are stored in the storage unit 653, and the movement of the linear motor 641 is started at a constant speed in the X-axis direction. (FIGS. 8A to 8C) The moving amount of the moving unit 604 is measured by an encoder, and the data is sent to the arithmetic processing unit 651. Then, when the arithmetic processing unit 651 determines that the inspection area 611 has been moved in the X-axis direction by one measurement width such as the line sensor 631a by the moving unit 604, the second inspection position X = 1dx, Y = A line image from this line sensor at 0, that is, at coordinates (1dx, 0) is stored in the storage unit 653.
[0027]
Then, each time one line image is recorded, the arithmetic processing unit 651 adds 1 to k, the linear motor 642 moves in the X-axis direction at a constant speed, and the inspection position is in the inspection region 611 shown in FIG. Up to the lower right corner (corresponding to the movements of (d) to (f) in FIG. 8), the line image is sequentially stored in the storage unit 653 for the range of one column of the length L in the X-axis direction.
[0028]
When the capturing of the imaging at the bottom of the inspection area 611, that is, the Y-axis coordinate = 0 is completed, the arithmetic processing unit 651 sets j = 1 in the encoder, and the inspection position X = L, Y = 1dy, that is, the XY coordinate. The inspection position is moved by the linear motor 641 to the (L, 1dy) position. This position is a position which is right by L in the X-axis direction from the lower left corner 611a of the inspection region 611 shown in FIG. 7 and moved in the Y-axis direction by the length of the line sensor 631a and the like. Then, at the position of Y = 1dy, line images are sequentially captured from the right end to the left end of the inspection area 611.
[0029]
In this way, at the moment when the line sensor 631a or the like moves to a new imaging range while changing the scanning direction of the line sensor 631a or the like from right to left or from left to right, the arithmetic processing unit 651 The line images are sequentially recorded in the storage unit 653 along with the measurement coordinates. When J> n is reached, the arithmetic processing unit 651 determines that the entire region of the inspection region 611 has been imaged, and synthesizes the recorded line images to create three different sample depth layers 601a, 601b, The planar image data of all the inspection areas in 601c are stored as layer image data 32a, 32b, and 32c in the storage unit 653, respectively.
[0030]
Note that the arithmetic processing unit 651 adds the XY coordinates in the inspection region 611 and the sample depth, that is, the Z-axis coordinates, to each captured line image data when imaging with the line sensor 631a or the like. That is, as shown in FIG. 4, the layers 601a, 601b, and 601c having different sample depths simultaneously imaged by the line sensors 631a, 631b, and 631c are shifted from each other by the line sensor elements in the X-axis direction. When the line image captured by the line sensor 631a is used as a reference, the amount of X of the coordinates of the line image captured by the line sensor 631b is added to this amount, and the X coordinate value is added by shifting by one element. Is done. Further, the X value of the coordinates of the line image captured by the line sensor 631c is further shifted by one element. The layers 601a, 601b, and 601c are displaced from each other by the height at which the line sensor is provided in the Z-axis direction. This amount of deviation is determined by the line sensor 631b when the line image captured by the line sensor 631a is used as a reference. This shift amount is added to the Z value of the coordinates of the line image to be captured, and the Z coordinate value is added with a shift of one height. Further, the Z value of the coordinates of the line image picked up by the line sensor 631c is further shifted by one height. As described above, when each line image is captured by the arithmetic processing unit 651 of the terminal 605, the XYZ coordinates of the imaging positions in the entire examination region 611 of the sample 601 are added to the line image data.
[0031]
In addition, the line sensors 631a to 631c may be imaged by keeping all line sensors in the imaging state as described above, or corresponding to the end portions of the sample ((a) to (c) in FIG. 8). In FIG. 8A, the image is picked up by only the line sensor 631c, in FIG. 8B, the image is picked up by the line sensors 631c and 631b, and from FIG. 8C, the image is picked up by all the line sensors. At the other end of the specimen (corresponding to (d) to (f) in FIG. 8), all line sensors up to FIG. 8 (d) are imaged, and in FIG. 8 (e), the line sensor 631b is captured. And 631a, and in FIG. 8F, the arithmetic processing unit 651 may control the image so that only the line sensor 631a captures the image. That is, if the line sensor that captures the position where the sample does not exist is controlled so as not to capture the image, the image data of the place where the sample does not exist can be eliminated from the image data.
[0032]
Next, a method for displaying the image data 32a to 32c of all the inspection areas on the display means 652 will be described. A layer image to be displayed on the terminal 605, for example, 32a is selected. The arithmetic processing unit 651 of the terminal 605 displays thumbnails (reduced images) of the entire region of the selected layer image 32a on the display unit 652. When a desired plane area on which an image that is not reduced is to be displayed is designated on the thumbnail, the arithmetic processing unit 651 selects the layer image data 32a from the image data stored in the storage unit 653, and from there Extract image data corresponding to the specified plane area. Then, the arithmetic processing unit 651 extracts image data corresponding to the planar area at a position corresponding to the designated planar area from the other layer image data 32b and 32c. The arithmetic processing unit 651 stores the image data of each planar area extracted from each of the layer image data 32a to 32c as a group into an image storage memory in the image processing apparatus. Thereafter, the arithmetic processing unit 651 causes the display unit 652 to display an image of the designated plane area of the selected layer image 32a.
[0033]
In this way, the arithmetic processing unit 651 extracts each layer image data of the planar area displayed on the display unit 652 and stores it separately in the image storage memory, so that the operator can see the displayed layer image. If you want to focus on the part that is not in focus and blurry, or if you want to see another layer image of the sample depth that is in a different position from the displayed layer image, Other layer images can be displayed on the display device 652 without taking time using image data stored separately in the image storage memory. For this reason, the operator uses the terminal 605 alone and looks at the eyepiece 623 of the microscope 602, as if observing the sample depth at the three focal positions, and the arbitrary one designated on the display unit 652 An image of a planar area can be displayed. In other words, the image processing unit 651 stores each layer image data corresponding to the extracted plane area separately, so that the field of view viewed with the microscope can be virtually reproduced only by the terminal 605.
[0034]
As shown in FIG. 4, not only when the aberration correction lens 622a is provided for each line sensor 631a, etc., but also as shown in FIG. 5, the aberration correction has a plurality of (three in the embodiment) curvature radii. Layers 701a, 701b, and 701c having different specimen depths may be formed on the line sensors 731a, 731b, and 731c by the lens 722. Further, the configuration of the line sensor 631a and the like is not limited to the case where 4000 CCDs are arranged one by one, and several pieces may be arranged longer. Further, the smaller the size of each CCD constituting the line sensor 631a and the like, the better the resolution of the image. However, when a large size CCD is used, the resolution can be increased by increasing the imaging magnification. A good image can be taken.
[0035]
Further, the focus position and tilt adjustment of the specimen 601 are not automatically performed by the above-described manual operation, but by incorporating focusing means having laser projection means into the microscope 602 and moving the tilting table 642 based on instructions from the computer. It is also easy to do. Further, the number of line sensors 631a and the like is not limited to three as described above, and may be two or four or more, and simultaneously image an inspection region having a sample depth corresponding to each number. can do.
[0036]
Next, the cell inspection system will be described. First, the arithmetic processing unit 651 stores, in the storage unit 653 of the image creation department 3, the image data 32a to 32c of all the examination regions in the three sample depth layers 601a, 601b, and 601c, respectively stored in the storage unit 653. At the same time, it is recorded on a DVD which is a large capacity recording medium. This DVD is sent to the examination department 4 and the diagnosis department 5 and stored in the storage units 42 and 52 via the terminals 41 and 51, respectively. As a result, the same image data 42a to 42c and 52a to 52c of all examination regions in the layers 601a, 601b, and 601c having different specimen depths for the cells and tissues to be examined are the terminals 41 of the examination department 4 and the diagnosis department 5. , 51 also exist.
[0037]
Here, the reason is that the storage units 653, 42, and 52 are provided for each department, and the image data of all the imaging regions of the cells and tissues are recorded. This image data is an enormous amount of about 1 Gbyte or more for each specimen. This is because it becomes capacity. That is, a system in which this image data is recorded on one common server and accessed from a terminal of each department using a data transmission medium is also conceivable, but the data capacity of the image is too large. This is because at the current transmission rate, transmission / reception takes too much time and is not suitable for practical use.
[0038]
Therefore, the examination department 4 first displays an image of a predetermined plane area of a desired layer among the three layers of cells and tissues from the image data 42a to 42c stored in the storage unit 42, and displays malignant cells and Check for cells that should be considered malignant. Since the image data 42a to 42c is image data having an area larger than the area that can be displayed by the display means 41a as the first image display means of the terminal 41, the image data of a desired layer is displayed on the terminal 41. A predetermined plane area to be displayed is designated.
[0039]
If there are malignant cells or cells that should be considered malignant, the range is specified on the display screen. As the specifying method, there are prepared a method in which the range in which the cell can be seen on the display screen is divided by a frame line or color coding, and a method in which an arrow, a symbol, or a comment is inserted in the display image.
[0040]
When performing inspections in a plurality of departments at the same time, first, the inspection department 4, the diagnostic department 5, and the image creation department 3 are made communicable by a data transmission medium such as a public line such as a telephone line or a dedicated Internet line. . An operator of the inspection department 4 operates the terminal 41 to select a layer image to be displayed on the terminal 41, for example, 42a. The terminal 41 sets the sample depth information specifying the selected layer image as the first condition. Then, the terminal 41 displays the entire thumbnail (reduced image) of the set layer image 42a on the display means 41a.
[0041]
The operator selects a desired planar area from which an image that is not reduced is to be displayed. The terminal 41 sets coordinate information or the like specifying the selected plane area as the second condition. Then, the arithmetic processing unit of the terminal 41 extracts image data corresponding to the planar area at a position corresponding to the designated planar area from the other layer image data 42b and 42c. Then, the arithmetic processing unit stores the image data of each planar area extracted from each of the layer image data 42a to 42c as a group in an image storage memory in the image processing apparatus. Thereafter, the terminal 41 selects the layer image data 42a from the image data stored in the storage unit 42 using the first condition and the second condition, and extracts image data corresponding to the selected planar area from the layer data. Then, the image of the selected planar area is displayed on the display means 41a. Unlike the layer image data of the selected planar area, the first condition and the second condition have a very small amount of data, so that communication does not take time even if data is transmitted and received.
[0042]
At the same time, the terminal 41 transmits the first condition and the second condition to the terminals 605 and 51 of the image creation department 3 and the diagnosis department 5 through the data transmission medium by the transmission means. The terminals 605 and 51 use the received first condition and second condition to select the layer image data 32a and 52a from the corresponding image data stored in the storage units 653 and 52, and then select the plane area selected therefrom. Corresponding image data is extracted, and a corresponding image corresponding to the image displayed on the terminal 41 is displayed on the display means 652 and 51a as the second image display means. Of course, at this time, similarly to the terminal 41, the calculation processing units of the terminals 605 and 51 each have a plane corresponding to the plane area designated by the other layer image data 32b, 32c or 52b, 52c. Image data corresponding to the region is extracted. Each arithmetic processing unit stores the image data of each planar area extracted from each of the layer image data 32a to 32c or 52a to 52c as a group and stored in an image storage memory in the image processing apparatus.
[0043]
As described above, the same image is displayed on the terminal 41 of the examination department 4, the terminal 605 of the image creation department 3, and the terminal 51 of the diagnostic department 5 only by transmitting and receiving two conditions of the first condition and the second condition by the data transmission medium. Will be displayed.
[0044]
Then, an index for an operator of the examination department 4 to classify the image displayed on the terminal 41 by a frame line or color coding from an input device such as a mouse or a keyboard, or to insert an arrow, a symbol, or a comment in the display image Is displayed, the terminal 41 sets information indicating the type and coordinates of the index as the third condition. Similar to the first and second conditions, the third condition has a smaller data amount and does not take longer to communicate than the layer image data of the selected planar region. At the same time, the terminal 41 transmits the third condition to the terminal 605 of the image creation department 3 and the terminal 51 of the diagnosis department 5 via the data transmission medium by the transmission means. The terminals 605 and 51 display the indicator on the display means 652 and 51a using the received third condition. For this reason, the indicator corresponding to the indicator displayed on the terminal 41 is also displayed on the display means 652 and 51a of the terminals 605 and 51.
[0045]
Therefore, the examination plane 4, the image creation department 3, and the diagnosis department 5 only transmit and receive a small amount of data of the first to third conditions via the data transmission medium, and the same plane in an image having a vast imaging area. For example, the diagnosis department 5 does not need to search for malignant cells. In addition to malignant cells identified in the examination department 4 or cells other than those that should be considered malignant, cells that should be considered malignant in the diagnosis department 5 are required, or when high-magnification imaging data is required. If the operator of the diagnosis department 5 specifies the position on the display screen of the terminal 51 or adds an instruction for the imaging condition, the terminal 51 selects the data transmission medium in the same manner as described above for the terminal 41. The first to third conditions are transmitted to the terminals 605 and 41 of the examination department 4 and the image creation department 3, and the specific range, imaging conditions, etc. are immediately displayed, and processed promptly and accurately according to the displayed instructions. It becomes possible to do.
[0046]
Then, for example, the operator of the examination department 4 cannot determine whether it is a malignant cell only in a portion where the currently displayed image is in focus, and focus on a portion that is out of focus and is out of focus. When an operator wants to view a layer image of another sample depth, the operator designates the layer image of another sample depth in focus on the terminal 41, and the arithmetic processing unit of the terminal 41 displays the image. Since another layer image data corresponding to the plane area is stored in the image storage memory, it is possible to immediately change the first condition without having to extract a corresponding plane area from all the imaging areas. A layer image can be displayed. That is, when the worker wants to switch the display from the currently displayed layer image 42a to 42b, for example, when the worker selects the layer image 42b, the terminal 41 displays the sample depth information for designating the selected layer image. Are set as the first condition, and the extracted layer image 42b of the image storage memory is displayed on the display means 41a. Then, by transmitting only the changed first condition to the other terminals 605 and 51, the same modified layer image as the terminal 41 is extracted from the image storage memory and displayed immediately on the other terminals. become.
[0047]
In the above-described embodiment, the same image is simultaneously examined in three departments. However, the present invention is not limited to this, and the examination may be performed while viewing the same image only in two departments or in four or more departments. As described above, since information and opinions can be exchanged via the data transmission medium, it is possible to perform highly accurate specimen inspection efficiently as if each department met together. In addition, the present invention is not limited to cells and tissues, but can be used for specimen inspection of blood, bacteria, and the like. In the above embodiment, the extracted image of each layer is alternatively displayed on the display unit 652. However, the present invention is not limited to this, and a plurality of combinations of the extracted images of each layer are simultaneously displayed on the display unit 652. You may do it. For example, two or more extracted sample depth images may be superimposed and displayed, or the two or more extracted images may be displayed on the display unit 652 in parallel. In this case, two or more images can be displayed in parallel on the display means if the plane area is made half or less of the screen size. In this way, since two or more images are displayed on the display means 652, it is easy to recognize three-dimensionally and the inspection becomes easier. Further, the number of line sensors of the microscope apparatus is not limited to three, and may be one or more.
[0048]
【The invention's effect】
As described above, according to the present invention, it is possible to easily and quickly display a predetermined planar area of an image having a large imaging area at a plurality of points by simply transmitting a condition with a small amount of data.
[Brief description of the drawings]
FIG. 1 is an overall configuration diagram of a cell inspection system.
FIG. 2 is a configuration of a microscope apparatus.
FIG. 3 is another configuration diagram of the microscope apparatus.
FIG. 4 is a configuration diagram of an optical lens.
FIG. 5 is another configuration diagram of the optical lens.
FIG. 6 is an enlarged front view of a line sensor and an aberration correction lens.
FIG. 7 is an explanatory diagram of a procedure for capturing a line image.
FIG. 8 is an explanatory diagram relating to imaging of a line sensor.
[Explanation of symbols]
2 Data transmission media
3 Image creation department
32a-32c layer image data
4 inspection departments
41 terminal
41a Display means
42 Memory unit
42a-42c layer image data
5 diagnostic department
51 terminals
51a Display means
52 Memory unit
52a-52c layer image data
605 terminal
652 Display means
653 storage unit

Claims (4)

In the image production department, storing the image data captured for each of the plurality of layers having different specimen depths from the specimen in advance in a storage section of the plurality of departments;
A display layer setting stage for setting a first condition for designating one layer image to be displayed on the specific terminal based on the stored image data in the inspection department ;
A display area setting stage for setting a second condition for designating a predetermined plane area to be extracted from the layer image designated by the first condition in the inspection department ;
A first image display stage for displaying the predetermined plane area extracted from the layer image on the specific terminal according to the first and second conditions in the inspection department ;
A condition transmission stage for transmitting the first and second conditions to the terminals of other departments among the plurality of departments in the inspection department ;
According to the above other sectors of the transmitted said first and second condition to the terminal, the predetermined planar region to the other sectors of the terminal on the basis of the image data is previously stored in the storage unit of the other departments And a second image display step of displaying a corresponding plane area corresponding to the sample inspection method. In Claim 1, the indicator display setting step of setting a third condition representing an indicator indicating a specific portion of the predetermined plane area displayed on the specific terminal in the inspection department ,
A first indicator display stage for displaying the indicator on the planar area displayed on the specific terminal according to the third condition in the inspection department ;
A second condition transmission step of transmitting the third condition to the terminal of the other department in the inspection department ;
According to the above third condition transmitted to the other sectors of the terminal, the sample inspection method characterized by comprising a second index display step of displaying the corresponding index corresponding to the index in the other sectors of the terminal . Means for preliminarily storing the image data captured for each of the plurality of layers having different specimen depths from the specimen in the image production department in a storage unit of the plurality of departments;
Display layer setting means for setting a first condition for designating one layer image to be displayed on the specific terminal based on the stored image data in the inspection department ;
Display area setting means for setting a second condition for designating a predetermined plane area to be extracted from the layer image designated by the first condition in the inspection department ;
First image display means for displaying the predetermined plane area extracted from the layer image on the specific terminal according to the first and second conditions in the inspection department ;
Condition transmitting means for transmitting the first and second conditions to the terminals of other departments among the plurality of departments in the inspection department ;
According to the above other sectors of the transmitted said first and second condition to the terminal, to the other sectors of the terminal based on the corresponding image data that is in correspondence with the image data previously stored in the other sectors of the terminal A specimen inspection system comprising: a second image display means for displaying a corresponding plane area corresponding to the predetermined plane area. In Claim 3, The indicator display setting means which sets the 3rd condition showing the indicator which points out the specific part of the predetermined plane area displayed on the specific terminal in the inspection department ,
First indicator display means for displaying the indicator on the predetermined plane area displayed on the specific terminal according to the third condition in the inspection department ;
A second condition transmitting means for transmitting the third condition to the terminal of the other department in the inspection department ;
According to the above third condition transmitted to the other sectors of the terminal, the sample inspection system characterized by comprising a second index display means for displaying the corresponding index corresponding to the index in the other sectors of the terminal .

Images