JP4046161B2 - Sample image data processing method and sample inspection system - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a processing method and a specimen inspection system for specimen image data captured for each of a plurality of layers having different specimen depths.
[0002]
[Prior art]
In medical institutions such as hospitals and research laboratories in universities, specimen inspection of cells and tissues with a microscope is frequently performed. By the way, the specimen inspection requires a great amount of labor and burden since the inspection is performed in a state where a vast number of cells are enlarged by a microscope and become a vast inspection area. Therefore, in specimen inspection of cells and tissues, in order to improve the overall efficiency of the inspection, the presence or absence of malignant cells is examined with a microscope or the like, and if malignant cells are found, the part is imaged. There is a division of labor between an inspection department specified by marking and the like and a diagnostic department that performs medical diagnosis on the specified part. In recent years, data transmission media such as public lines such as telephone lines and dedicated Internet lines have begun to be used as connections between divisional divisions, and sample images are converted into data using data transmission media. It comes to communicate with. For this reason, the applicant of the present application, for example, takes a sample of a cell or tissue magnified with a microscope as a line image with a line sensor as a method for converting the sample image into data, and the line image is processed by computer image processing. Means for quickly creating a clear captured image of the entire large area has been proposed (Japanese Patent Application Nos. 2002-097495, 2002-097497, 2002-097498, and 2002-097499). .
[0003]
[Problems to be solved by the invention]
However, in specimen inspection of cells, tissues, etc., it is not always possible to determine malignant cells or cells that should be considered malignant by observing only the specimen depth plane at a certain focal position. In many cases, the cell shape cannot be determined without observing the shape of the cell. Therefore, in order to accurately inspect cells and tissues, it is important to inspect cells and tissues in three dimensions by changing the focal position of the microscope.
[0004]
However, in the invention according to the application described above, although a clear image can be quickly created for a large imaging region, the captured image is displayed on a display unit such as a monitor because the image has a large imaging region. It is impossible to display everything at full size. Also, when multiple images with different sample depths are prepared, one image has a vast imaging area, so it is difficult to quickly display an image with a large amount of image data and another sample depth. there were.
[0005]
Accordingly, an object of the present invention is to provide a sample image data processing method and a sample inspection system capable of quickly displaying image data of a plurality of layers having different sample depths.
[0006]
[Means for Solving the Problems]
In order to solve the above problems, a sample image data processing method according to the present invention includes: In specimen inspection that displays image data of multiple layers with different specimen depths and inspects cells, tissues, etc. three-dimensionally, In the specimen inspection area, plural Line images for multiple layers with different specimen depths via line sensors at the same time A step of imaging, a step of synthesizing the line images to generate and record the sample image data for each layer for the entire inspection region, a step of designating a plane region to be extracted from each sample image data, The image data for each layer in the designated plane area is extracted from the sample image data for each layer for the entire inspection area. As a group Memorizing process and The step of extracting the image of the selected layer of the plane area from the image data for each layer of the plane area stored as a unit and displaying it on the display means The sample image data processing method includes: Moreover, the specimen inspection system according to the present invention includes: A specimen inspection system that displays image data of a plurality of layers with different specimen depths and inspects cells, tissues, etc. in a three-dimensional manner, In the specimen inspection area, means for simultaneously capturing line images for a plurality of layers having different specimen depths via a plurality of line sensors, and the specimen for each layer for the entire inspection area by synthesizing the line images Means for generating and recording image data; means for designating a plane area to be extracted from each specimen image data; and image data for each layer of the designated plane area for the entire inspection area. Extracted from each sample image data As a group Means for storing and above Remembered as a unit Based on the image data for each layer of the planar region, the specimen inspection system includes an image processing apparatus that alternatively displays an image for each layer of the planar region or a combination thereof on the display means. . In addition, preferably, when displaying an image for each layer of the planar area, it is preferable that a plurality of selected extracted images can be displayed in parallel or superimposed.
[0007]
DETAILED DESCRIPTION OF THE INVENTION
DESCRIPTION OF THE PREFERRED EMBODIMENTS Embodiments of the present invention will be described based on examples with reference to the drawings. The specimen inspection system shown in FIG. 1 is a cytological specimen inspection system provided with a terminal 605 of the image creation department 3, a terminal 41 of the examination department 4, and a terminal 51 of the diagnosis department 5. Each terminal can transmit and receive data through a data transmission medium such as a public line such as a telephone line or a dedicated Internet line. Here, in the image creation department 3, a cell or tissue as a specimen is magnified and imaged by the microscope device 6 to create an image, and the examination department 4 identifies malignant cells or cells that should be considered malignant from this image. In the diagnosis department 5, the identified cell is diagnosed. The terminals 605, 41, and 51 have storage units 653, 42, and 52, respectively. In these storage units, cells and tissues captured for each of the three layers having different specimen depths (focal positions) are stored. Image data 32a to 32c, 42a to 42c, and 52a to 52c are stored. The specimen depth here indicates a difference in focal position in the specimen depth direction when the microscope apparatus 6 images the specimen. That is, in the three layers described above, the layer 32a is the uppermost layer closest to the objective lens, the layer 32c is the lowermost layer farthest from the objective lens, and the layer 32b is an intermediate layer between the layers 32a and 32c. .
[0008]
Next, a procedure for creating image data of cells and tissues in the image creation department 3 will be described with reference to FIGS. First, the procedure for creating the image data will be outlined. The positions at which the three specimen depths of the cells and tissues of the specimen 601 are different from each other are imaged simultaneously on line sensors 631a, 631b, and 631c, which are electronic imaging devices arranged at different heights from the specimen 601. In the present embodiment, as shown in FIG. 4, the line sensors 631 a, 631 b, 631 c are arranged in a stepped manner to make the height different from that of the sample 601. The three line sensors 631a, 631b, and 631c read images having three different sample depths as line image data. Then, the specimen 601 is horizontally moved by the moving means 604 shown in FIGS. 2 to 4, and this line image data is stored in the storage unit 651 by the terminal 605 shown in FIG. Next, the arithmetic processing unit 651 in the image processing apparatus generates image data for each of the three layers having different specimen depths of the specimen 601 from the recorded line image. This will be described in detail below.
[0009]
First, an overall configuration of the microscope 602 will be outlined with reference to FIGS. 2 and 3. The microscope 602 used in the embodiment of the present invention is an optical microscope. In the examination of cells and tissues, it may be difficult to judge malignant cells only by looking at the in-focus part, and pay attention to the part that is blurred (not in focus). There are things to do. When an image is taken with a microscope 602 which is an optical microscope, this out-of-focus information can be left as image data, which is suitable for examination of cells and tissues. The microscope 602 includes an optical lens including a lens barrel 625, a visual observation eyepiece 623 attached to the lens barrel, a two-dimensional CCD sensor unit 627 that captures a certain two-dimensional extent of the sample 601, an objective lens 621, and the like. It has. The lens barrel 625 is supported by an L-shaped gantry 606 via a rack and pinion mechanism 661 that moves the lens barrel up and down. An optical fiber 607 for introducing light from a halogen lamp (not shown) provided outside is connected to the lower part of the L-shaped gantry 606 in order to irradiate the specimen 601 from the back surface.
[0010]
As shown in FIG. 4, the optical lens includes an objective lens 621 composed of a composite lens composed of two lenses 621a and 621b, and three line sensors 631a arranged parallel to each other at different heights. It is composed of three saddle-shaped aberration correction lenses 622a, 622b, and 622c installed for each of 631b and 631c. The aberration correction lenses 622a, 622b, and 622c are located at positions shifted from each other in the X-axis direction by the distance between the line sensor elements as shown by the broken line, the solid line, and the one-dot broken line in FIG. These layers (surface layer 601b, intermediate layer 601b, lower layer 601c) are formed in optical shapes so as to form images on line sensors 631a, 631b, and 631c, respectively. Note that three objective lenses 621 having different magnifications are attached to the revolver 624, and can be manually switched with each other.
[0011]
As shown in FIG. 4, the three line sensors 631a, 631b, 631c and the aberration correction lenses 622a, 622b, 622c are housed in a camera case 632, which is shown in FIG. In this manner, the microscope 602 is detachably attached to the tip of the barrel 625. In addition, the shape of this attachment part employ | adopts F mount which is the standard attachment shape of a single-lens reflex camera about a lens attachment part. The line sensor 631a and the like are configured by arranging 4000 charge coupled devices each having a side of 7 μm in a straight line. Accordingly, when the imaging magnification is 100 times, a range of 7 μm ÷ 100 = 0.07 μm in width and 7 μm × 4000 pieces / 100 = 0.28 mm in length can be captured at a time.
[0012]
A moving means 604 is installed on the horizontal portion of the L-shaped frame 606. The moving means 604 includes a tilting table 642 on which the specimen 601 is placed, and a linear motor 641 that horizontally moves the tilting table in the left-right and front-back directions. The linear motor 641 is a known technique in which an armature moves on a permanent magnet arranged in a strip shape, and can be driven at high speed, high responsiveness, and highly accurate positioning. The linear motor 641 is remotely controlled by a computer as will be described later, and moves the sample 601 to a predetermined position.
[0013]
The tilting table 642 is a flat table that is supported at three points by three ultrasonic motors 642a arranged so as to form an equilateral triangle in plan view and a vertical output shaft 642c of the ultrasonic motor. It is comprised from the part 642d and the fixing member 642b which fixes the mutual position of this ultrasonic motor. The tip of the vertical output shaft 642c is in contact with a recess formed on the back surface of the table portion 642d so that the horizontal positions of the vertical output shaft 642c do not shift.
[0014]
The ultrasonic motor 642a is a known technique, and an elastic member is placed on a piezoelectric ceramic that deforms when a voltage is applied, and a voltage in an ultrasonic region is applied to the piezoelectric ceramic to generate a bending vibration in the elastic member. This rotates the output shaft, and has characteristics such as high responsiveness and controllability and low operating noise. In the ultrasonic motor 642a used here, the output shaft 642c has a screw structure, and this output shaft rotates to move up and down. The tilting table 642 adjusts the inclination and focal length of the sample 601 according to instructions from the computer.
[0015]
The lamp unit 626 accommodates a halogen lamp (not shown), and the light from the halogen lamp is bent at a right angle along the optical axis of the microscope 602 by a half mirror and applied to the specimen 601. The reflected light from this specimen is enhanced to obtain a clear image. The lamp unit 626 that is the epi-illumination light source is used when the specimen 601 is a substance having low light transmittance. Further, an optical fiber 607 for introducing light from a halogen lamp (not shown) provided externally as a transmissive light source so as to be irradiated from the back surface of the specimen 601 is connected to the lower portion of the L-shaped frame 606. . When viewing a light-transmitting object such as a cell or tissue, the light source from here is often used as the main light source. In this embodiment, the light is irradiated from the back surface of the specimen 601.
[0016]
In the two-dimensional CCD sensor unit 627, a two-dimensional CCD sensor (not shown) capable of capturing a two-dimensional extent to some extent is provided. That is, in the cell examination, it may be necessary to display an image magnified by the microscope 602 directly on the display means and confirm a specific part or range where malignant cells are present while viewing this display screen. . However, when the image sensor is only the line sensor 631a or the like, the line image that can be captured at a time is extremely narrow, and therefore, while viewing the display screen of the narrow line image, the specific region or range where malignant cells are present It is difficult to confirm. On the other hand, a two-dimensional CCD sensor that can image a two-dimensional extent to some extent is provided, and it is easy to confirm a specific part or range such as a cell or tissue while viewing the display screen. Therefore, by providing a two-dimensional CCD sensor, a specific part or range in the sample 601 can be easily confirmed.
[0017]
This two-dimensional CCD sensor is a flat-type arrangement of 600 × 600 = about 350,000 charge-coupled devices having a side of 21 μm, which is used in a general CCD camera. Is imaged through a half mirror.
[0018]
The terminal 605 uses a commercially available computer, a so-called personal computer, and includes an arithmetic processing unit 651, a display unit 652, and a storage unit 653 that stores line image data. The arithmetic processing unit 651 is provided in the image processing apparatus and, as will be described later, is a line based on the setting of the imaging region of the sample 601, the movement of the moving unit 604, and the amount of movement fed back from the encoder of the moving unit. An imaging execution instruction from the sensor 631a and the like, capturing of line image data captured by the line sensor, and synthesis of the line image data to create an overall planar image of the imaging region.
[0019]
Next, a procedure for creating cell and tissue image data 32a to 32c using the above-described components will be described. As shown in FIG. 2, first, a specimen 601 in which a cell or tissue piece to be examined is sandwiched between a slide glass and a cover glass is set on the upper surface of the table portion 642d of the tilting table 642 so as not to move. The sample is fixed to the table portion 642d by suction or the like by vacuum means or the like. Next, as shown in FIG. 7, the inspection area 611 of the sample 601 is set by input from the input means of the personal computer.
[0020]
The reason for setting the inspection area 611 is to set the start point 611a and the end point 611b of the line image picked up sequentially by the line sensor 631a and the like as will be described later. The setting of the inspection area 611 requires a picked-up image having a certain two-dimensional extent, so that picked-up data from the two-dimensional CCD sensor is displayed on the display means 652 of the terminal 605 and the display screen is displayed. While moving, the moving means 604 is moved and adjusted in the XY directions. Accordingly, the XY coordinates of the diagonal positions 611a and 611b are stored in the arithmetic processing unit 651 as information corresponding to the movement start point and end point position of the linear motor 641 of the moving unit 604. Therefore, as will be described later, when imaging is performed by the line sensor 631a or the like, the linear motor 641 is moved from the inner position 611a that is the first imaging position to the horizontal direction that is the last imaging position in accordance with an instruction from the arithmetic processing unit 651. Move sequentially to position 611b.
[0021]
When setting the inspection region 611, the focal length and inclination of the sample 601 are adjusted simultaneously. That is, when setting the inspection area 611, first, at the start position 611a, while focusing on the surface layer 601a of the sample 601 while viewing the display image from the two-dimensional CCD sensor displayed on the display means 652, the linear motor 641 is moved in the X-axis direction to focus at the right end position of the inspection region 611. Then, the tilt in the X-axis direction is calculated from this focal position shift, and the tilt of the tilting table 642 is adjusted. Then, the focus is adjusted at the upper right position 611b of the inspection area 611 by the same means, and the inclination in the Y-axis direction is adjusted.
[0022]
Here, if the focal position of the two-dimensional CCD sensor and the focal position of the line sensor 631a for imaging the surface layer 601a of the sample 601 coincide with each other, the focal point of the line sensor 631a immediately follows the surface layer 601a of the sample. Can be combined. The other line sensors 631b and 631c are designed so that the aberration correction lenses 622a, 622b and 622c are focused on the respective focal depths simultaneously with the line sensor 631a. At the combined stage, all three line sensors are in focus.
[0023]
Next, a procedure for imaging the sample 601 with the line sensor 631a and the like will be described with reference to FIGS. This imaging is controlled by a program built in the arithmetic processing unit 651. First, the arithmetic processing unit 651 sets inspection positions j = 0 and k = 0 by the encoder, and recognizes the inspection positions as coordinates X = 0 and Y = 0. Then, the sample 601 is moved to the XY coordinate (0, 0) position by the linear motor 641. This XY coordinate (0, 0) position is the lower left corner 611a of the inspection area 611 shown in FIG. 7, and this point is the starting point for starting imaging. In FIG. 8, the line sensor 631a is located at the position (a) and overlaps the lower left corner 611a.
[0024]
When the start point of the imaging position is set at the position of the lower left corner 611a of the inspection area 611, the arithmetic processing unit 651 sets the movement amount dx on the X axis, and the line sensors 631a and 631b at the inspection position (0, 0). , 631c are stored in the storage unit 653, and the movement of the linear motor 641 is started at a constant speed in the X-axis direction. (FIGS. 8A to 8C) The moving amount of the moving unit 604 is measured by an encoder, and the data is sent to the arithmetic processing unit 651. Then, when the arithmetic processing unit 651 determines that the inspection area 611 has been moved in the X-axis direction by one measurement width such as the line sensor 631a by the moving unit 604, the second inspection position X = 1dx, Y = A line image from this line sensor at 0, that is, at coordinates (1dx, 0) is stored in the storage unit 653.
[0025]
Then, each time one line image is recorded, the arithmetic processing unit 651 adds 1 to k, the linear motor 642 moves in the X-axis direction at a constant speed, and the inspection position is in the inspection region 611 shown in FIG. Up to the lower right corner (corresponding to the movements of (d) to (f) in FIG. 8), the line image is sequentially stored in the storage unit 653 for the range of one column of the length L in the X-axis direction.
[0026]
When the capturing of the imaging at the bottom of the inspection area 611, that is, the Y-axis coordinate = 0 is completed, the arithmetic processing unit 651 sets j = 1 in the encoder, and the inspection position X = L, Y = 1dy, that is, the XY coordinate. The inspection position is moved by the linear motor 641 to the (L, 1dy) position. This position is a position which is right by L in the X-axis direction from the lower left corner 611a of the inspection region 611 shown in FIG. 7 and moved in the Y-axis direction by the length of the line sensor 631a and the like. Then, at the position of Y = 1dy, line images are sequentially captured from the right end to the left end of the inspection area 611.
[0027]
In this way, at the moment when the line sensor 631a or the like moves to a new imaging range while changing the scanning direction of the line sensor 631a or the like from right to left or from left to right, the arithmetic processing unit 651 The line images are sequentially recorded in the storage unit 653 along with the measurement coordinates. When J> n is reached, the arithmetic processing unit 651 determines that the entire region of the inspection region 611 has been imaged, and synthesizes the recorded line images to create three different sample depth layers 601a, 601b, The planar image data of all the inspection areas in 601c are stored as layer image data 32a, 32b, and 32c in the storage unit 653, respectively.
[0028]
Note that the arithmetic processing unit 651 adds the XY coordinates in the inspection region 611 and the sample depth, that is, the Z-axis coordinates, to each captured line image data when imaging with the line sensor 631a or the like. That is, as shown in FIG. 4, the layers 601a, 601b, and 601c having different sample depths simultaneously imaged by the line sensors 631a, 631b, and 631c are shifted from each other by the line sensor elements in the X-axis direction. When the line image captured by the line sensor 631a is used as a reference, the amount of X of the coordinates of the line image captured by the line sensor 631b is added to this amount, and the X coordinate value is added by shifting by one element. Is done. Further, the X value of the coordinates of the line image captured by the line sensor 631c is further shifted by one element. The layers 601a, 601b, and 601c are displaced from each other by the height at which the line sensor is provided in the Z-axis direction. This amount of deviation is determined by the line sensor 631b when the line image captured by the line sensor 631a is used as a reference. This shift amount is added to the Z value of the coordinates of the line image to be captured, and the Z coordinate value is added with a shift of one height. Further, the Z value of the coordinates of the line image picked up by the line sensor 631c is further shifted by one height. As described above, when each line image is captured by the arithmetic processing unit 651 of the terminal 605, the XYZ coordinates of the imaging positions in the entire examination region 611 of the sample 601 are added to the line image data.
[0029]
In addition, the line sensors 631a to 631c may be imaged by keeping all line sensors in the imaging state as described above, or corresponding to the end portions of the sample ((a) to (c) in FIG. 8). In FIG. 8A, the image is picked up by only the line sensor 631c, in FIG. 8B, the image is picked up by the line sensors 631c and 631b, and from FIG. 8C, the image is picked up by all the line sensors. At the other end of the specimen (corresponding to (d) to (f) in FIG. 8), all line sensors up to FIG. 8 (d) are imaged, and in FIG. 8 (e), the line sensor 631b is captured. And 631a, and in FIG. 8F, the arithmetic processing unit 651 may control the image so that only the line sensor 631a captures the image. That is, if the line sensor that captures the position where the sample does not exist is controlled so as not to capture the image, the image data of the place where the sample does not exist can be eliminated from the image data.
[0030]
Next, a method for displaying the image data 32a to 32c of all the inspection areas on the display means 652 will be described. A layer image to be displayed on the terminal 605, for example, 32a is selected. The arithmetic processing unit 651 of the terminal 605 displays thumbnails (reduced images) of the entire region of the selected layer image 32a on the display unit 652. When a desired plane area on which an image that is not reduced is to be displayed is designated on the thumbnail, the arithmetic processing unit 651 selects the layer image data 32a from the image data stored in the storage unit 653, and from there Extract image data corresponding to the specified plane area. Then, the arithmetic processing unit 651 extracts image data corresponding to the planar area at a position corresponding to the designated planar area from the other layer image data 32b and 32c. The arithmetic processing unit 651 stores the image data of each planar area extracted from each of the layer image data 32a to 32c as a group into an image storage memory in the image processing apparatus. Thereafter, the arithmetic processing unit 651 causes the display unit 652 to display an image of the designated plane area of the selected layer image 32a.
[0031]
In this way, the arithmetic processing unit 651 extracts each layer image data of the planar area displayed on the display unit 652 and stores it separately in the image storage memory, so that the operator can see the displayed layer image. If you want to focus on the part that is not in focus and blurry, or if you want to see another layer image of the sample depth that is in a different position from the displayed layer image, Other layer images can be displayed on the display device 652 without taking time using image data stored separately in the image storage memory. For this reason, the operator uses the terminal 605 alone and looks at the eyepiece 623 of the microscope 602, as if observing the sample depth at the three focal positions, and the arbitrary one designated on the display unit 652 An image of a planar area can be displayed. In other words, the image processing unit 651 stores each layer image data corresponding to the extracted plane area separately, so that the field of view viewed with the microscope can be virtually reproduced only by the terminal 605.
[0032]
As shown in FIG. 4, not only when the aberration correction lens 622a is provided for each line sensor 631a, etc., but also as shown in FIG. 5, the aberration correction has a plurality of (three in the embodiment) curvature radii. Layers 701a, 701b, and 701c having different specimen depths may be formed on the line sensors 731a, 731b, and 731c by the lens 722. Further, the configuration of the line sensor 631a and the like is not limited to the case where 4000 CCDs are arranged one by one, and several pieces may be arranged longer. Further, the smaller the size of each CCD constituting the line sensor 631a and the like, the better the resolution of the image. However, when a large size CCD is used, the resolution can be increased by increasing the imaging magnification. A good image can be taken.
[0033]
The focus position and tilt adjustment of the specimen 601 is not manually performed as described above, but is automated by incorporating focusing means having laser projection means into the microscope 602 and moving the tilting table 642 based on instructions from the computer. It is also easy to do. Further, the number of line sensors 631a and the like is not limited to three as described above, and may be two or four or more, and simultaneously image an inspection region having a sample depth corresponding to each number. can do.
[0034]
Next, the cell inspection system will be described. First, the arithmetic processing unit 651 stores, in the storage unit 653 of the image creation department 3, the image data 32a to 32c of all the examination regions in the three sample depth layers 601a, 601b, and 601c, respectively stored in the storage unit 653. At the same time, it is recorded on a DVD which is a large capacity recording medium. This DVD is sent to the examination department 4 and the diagnosis department 5 and stored in the storage units 42 and 52 via the terminals 41 and 51, respectively. As a result, the same image data 42a to 42c and 52a to 52c of all examination regions in the layers 601a, 601b, and 601c having different specimen depths for the cells and tissues to be examined are the terminals 41 of the examination department 4 and the diagnosis department 5. , 51 also exist.
[0035]
Here, the reason is that the storage units 653, 42, and 52 are provided for each department, and the image data of all the imaging regions of the cells and tissues are recorded. This image data is an enormous amount of about 1 Gbyte or more for each specimen. This is because it becomes capacity. That is, a system in which this image data is recorded on one common server and accessed from a terminal of each department using a data transmission medium is also conceivable, but the data capacity of the image is too large. This is because at the current transmission rate, transmission / reception takes too much time and is not suitable for practical use.
[0036]
Therefore, the examination department 4 first displays an image of a predetermined plane area of a desired layer among the three layers of cells and tissues from the image data 42a to 42c stored in the storage unit 42, and displays malignant cells and Check for cells that should be considered malignant. Since the image data 42a to 42c is image data having an area larger than the area that can be displayed by the display means 41a as the first image display means of the terminal 41, the image data of a desired layer is displayed on the terminal 41. A predetermined plane area to be displayed is designated.
[0037]
If there are malignant cells or cells that should be considered malignant, the range is specified on the display screen. As the specifying method, there are prepared a method in which the range in which the cell can be seen on the display screen is divided by a frame line or color coding, and a method in which an arrow, a symbol, or a comment is inserted in the display image.
[0038]
When performing inspections in a plurality of departments at the same time, first, the inspection department 4, the diagnostic department 5, and the image creation department 3 are made communicable by a data transmission medium such as a public line such as a telephone line or a dedicated Internet line. . An operator of the inspection department 4 operates the terminal 41 to select a layer image to be displayed on the terminal 41, for example, 42a. The terminal 41 sets the sample depth information specifying the selected layer image as the first condition. Then, the terminal 41 displays the entire thumbnail (reduced image) of the set layer image 42a on the display means 41a.
[0039]
The operator selects a desired planar area from which an image that is not reduced is to be displayed. The terminal 41 sets coordinate information or the like specifying the selected plane area as the second condition. Then, the arithmetic processing unit of the terminal 41 extracts image data corresponding to the planar area at a position corresponding to the designated planar area from the other layer image data 42b and 42c. Then, the arithmetic processing unit stores the image data of each planar area extracted from each of the layer image data 42a to 42c as a group in an image storage memory in the image processing apparatus. Thereafter, the terminal 41 selects the layer image data 42a from the image data stored in the storage unit 42 using the first condition and the second condition, and extracts the image data corresponding to the selected planar area from there. Then, the image of the selected planar area is displayed on the display means 41a. Unlike the layer image data of the selected planar area, the first condition and the second condition have a very small amount of data, so that communication does not take time even if data is transmitted and received.
[0040]
At the same time, the terminal 41 transmits the first condition and the second condition to the terminals 605 and 51 of the image creation department 3 and the diagnosis department 5 through the data transmission medium by the transmission means. The terminals 605 and 51 use the received first condition and second condition to select the layer image data 32a and 52a from the corresponding image data stored in the storage units 653 and 52, and then select the plane area selected therefrom. Corresponding image data is extracted, and a corresponding image corresponding to the image displayed on the terminal 41 is displayed on the display means 652 and 51a as the second image display means. Of course, at this time, similarly to the terminal 41, the calculation processing units of the terminals 605 and 51 each have a plane corresponding to the plane area designated by the other layer image data 32b, 32c or 52b, 52c. Image data corresponding to the region is extracted. Each arithmetic processing unit stores the image data of each planar area extracted from each of the layer image data 32a to 32c or 52a to 52c as a group and stored in an image storage memory in the image processing apparatus.
[0041]
As described above, the same image is displayed on the terminal 41 of the examination department 4, the terminal 605 of the image creation department 3, and the terminal 51 of the diagnostic department 5 only by transmitting and receiving two conditions of the first condition and the second condition by the data transmission medium. Will be displayed.
[0042]
Then, an index for an operator of the inspection department 4 to classify the image displayed on the terminal 41 by a frame line or color coding from an input device such as a mouse or a keyboard, or to insert an arrow, a symbol, or a comment in the display image Is displayed, the terminal 41 sets information indicating the type and coordinates of the index as the third condition. Similar to the first and second conditions, the third condition has a smaller data amount and does not take longer to communicate than the layer image data of the selected planar region. At the same time, the terminal 41 transmits the third condition to the terminal 605 of the image creation department 3 and the terminal 51 of the diagnosis department 5 via the data transmission medium by the transmission means. The terminals 605 and 51 display the indicator on the display means 652 and 51a using the received third condition. For this reason, the indicator corresponding to the indicator displayed on the terminal 41 is also displayed on the display means 652 and 51a of the terminals 605 and 51.
[0043]
Therefore, the examination plane 4, the image creation department 3, and the diagnosis department 5 only transmit and receive a small amount of data of the first to third conditions via the data transmission medium, and the same plane in an image having a vast imaging area. For example, the diagnosis department 5 does not need to search for malignant cells. In addition to malignant cells identified in the examination department 4 or cells other than those that should be considered malignant, cells that should be considered malignant in the diagnosis department 5 are required, or when high-magnification imaging data is required. If the operator of the diagnosis department 5 specifies the position on the display screen of the terminal 51 or adds an instruction for the imaging condition, the terminal 51 selects the data transmission medium in the same manner as described above for the terminal 41. The first to third conditions are transmitted to the terminals 605 and 41 of the examination department 4 and the image creation department 3, and the specific range, imaging conditions, etc. are immediately displayed, and processed promptly and accurately according to the displayed instructions. It becomes possible to do.
[0044]
Then, for example, the operator of the examination department 4 cannot determine whether it is a malignant cell only in a portion where the currently displayed image is in focus, and focus on a portion that is out of focus and is out of focus. When an operator wants to view a layer image of another sample depth, the operator designates the layer image of another sample depth in focus on the terminal 41, and the arithmetic processing unit of the terminal 41 displays the image. Since another layer image data corresponding to the plane area is stored in the image storage memory, it is possible to immediately change the first condition without having to extract a corresponding plane area from all the imaging areas. A layer image can be displayed. That is, when the worker wants to switch the display from the currently displayed layer image 42a to 42b, for example, when the worker selects the layer image 42b, the terminal 41 displays the sample depth information for designating the selected layer image. Are set as the first condition, and the extracted layer image 42b of the image storage memory is displayed on the display means 41a. Then, by transmitting only the changed first condition to the other terminals 605 and 51, the same modified layer image as the terminal 41 is extracted from the image storage memory and displayed immediately on the other terminals. become.
[0045]
In the above-described embodiment, the same image is simultaneously examined in three departments. However, the present invention is not limited to this, and the examination may be performed while viewing the same image in only two departments or four or more departments. As described above, since information and opinions can be exchanged via the data transmission medium, it is possible to perform highly accurate specimen inspection efficiently as if each department met together. The present invention is not limited to cells and tissues, but can be used for specimen inspection of blood, bacteria, and the like. In the above embodiment, the extracted image of each layer is alternatively displayed on the display unit 652. However, the present invention is not limited to this, and a plurality of combinations of the extracted images of each layer are simultaneously displayed on the display unit 652. You may do it. For example, two or more extracted sample depth images may be superimposed and displayed, or the two or more extracted images may be displayed on the display unit 652 in parallel. In this case, two or more images can be displayed in parallel on the display means if the plane area is made half or less of the screen size. In this way, since two or more images are displayed on the display means 652, it is easy to recognize three-dimensionally and the inspection becomes easier. Further, the number of line sensors of the microscope apparatus is not limited to three, and may be one or more.
[0046]
【The invention's effect】
A plurality of layer image data having different sample depths can be quickly displayed on the display means. Further, if a plurality of images are displayed in parallel or superimposed, it becomes easier to recognize in three dimensions.
[Brief description of the drawings]
FIG. 1 is an overall configuration diagram of an inspection system.
FIG. 2 is a configuration of a microscope apparatus.
FIG. 3 is another configuration diagram of the microscope apparatus.
FIG. 4 is a configuration diagram of an optical lens.
FIG. 5 is another configuration diagram of the optical lens.
FIG. 6 is an enlarged front view of a line sensor and an aberration correction lens.
FIG. 7 is an explanatory diagram of a procedure for capturing a line image.
FIG. 8 is a diagram related to imaging of a line sensor.
[Explanation of symbols]
601 specimens
602 microscope
631 Line sensor (electronic imaging device)
651 arithmetic processing unit (image processing apparatus)
652 Display means
653 storage unit

Claims (5)

In specimen inspection that displays image data of multiple layers with different specimen depths and inspects cells, tissues, etc. three-dimensionally,
In the specimen inspection region, a step of simultaneously capturing line images for a plurality of layers having different specimen depths via a plurality of line sensors;
Synthesizing the line images to generate and record the sample image data for each layer for the entire inspection region; and
Designating a planar area to be extracted from each of the specimen image data,
Extracting the image data for each layer of the specified plane area from the sample image data for each layer for the entire inspection area, and storing the data as a unit ;
Image data for each layer of the planar area stored as a unit
A sample image data processing method including a step of extracting an image of a selected layer of the planar region and displaying it on a display means . 2. The specimen image data processing method according to claim 1, wherein the specimen is a cytological specimen. A specimen inspection system that displays image data of a plurality of layers with different specimen depths and inspects cells, tissues, etc. in a three-dimensional manner,
Means for simultaneously capturing line images of a plurality of layers having different sample depths via a plurality of line sensors in the specimen inspection region;
Means for synthesizing the line image to generate and record the sample image data for each layer for the entire inspection region;
Means for designating a planar region to be extracted from each specimen image data;
Means for extracting the image data for each layer of the specified plane area from the sample image data for each layer for the entire inspection area, and storing the data as a unit;
Based on the image data for each layer of the planar area stored as a group, the image processing for displaying the image for each layer of the planar area alternatively or a combination thereof on the display means A specimen inspection system comprising: The specimen inspection system according to claim 3, wherein the specimen is a cytological specimen. 5. The specimen inspection system according to claim 3, wherein when displaying an image for each layer of the planar area, a plurality of selected extracted images can be displayed in parallel or superimposed.

Images