JP2005283376A - Method and program for displaying specimen image - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a specimen image display method which facilitates the work of determining cell images again. <P>SOLUTION: The specimen image display method is provided with: a step for displaying an image display part for displaying a virtual slide (blood cell image) photographed at a magnification at which at least cell forms are recognizable on a client terminal 31 in such a way as to be scrolled; a step for matching a mouse cursor with a prescribed cell in the virtual slide displayed on the image display part through the use of a mouse 31a; and a step for storing at least locational information of the prescribed cell in the virtual slide on the basis of an instruction for storage by a button operation of the mouse 31a. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a specimen image display method and specimen image display program, and more particularly to a specimen image display method and specimen image display program for displaying a specimen image photographed at a magnification capable of recognizing cell morphology on a terminal device. About.

  Conventionally, in the examination of blood cells, a method called “microscopic examination” is employed in which a smear prepared by placing blood to be examined on a preparation is viewed with a microscope and visually inspected. In this microscopic examination, for example, while classifying a smear sample with a microscope, a dedicated classification counter in which a blood cell classification item is assigned to each key is used to classify white blood cells present in a predetermined area and If a cell (white blood cell) that is difficult to determine the abnormal morphology of erythrocytes or platelets or the classification item is found during the counting operation, the cell is imaged by a video camera or the like provided in a microscope. Then, the captured image of the blood cell is filed (saved) in the database of the image filing system together with the attribute information (the medical record number and the like) of the examination target. After the test, the result of the classification count is printed, and an image of the filed blood cell is printed as the test result as necessary.

  However, in the above method, the inspector needs to inspect at the place where the microscope is installed because the smear is inspected by visual observation through the microscope. For this reason, the inspector is disadvantageous in that it is subject to place restrictions.

On the other hand, conventionally, a technique for creating a virtual microscope slide (specimen image) by photographing a specimen for pathological cytodiagnosis with a microscope has also been proposed (for example, see Patent Document 1). In this patent document 1, since a virtual microscope slide (specimen image) can be distributed via the Internet, it is possible to observe the virtual microscope slide (specimen image) with a computer in which a predetermined program is installed. It is. Therefore, if the technique disclosed in Patent Document 1 is used, the inspector does not need to perform an inspection at the place where the microscope is installed, and thus the virtual microscope slide (specimen image) is used without being restricted by the place. Can be inspected.
JP-T-2002-514319

  However, Patent Document 1 does not describe a virtual microscope slide (specimen image) of a blood sample and does not describe filing of the examined blood cell image. Moreover, when the virtual microscope slide (specimen image) by patent document 1 is used as a virtual microscope slide (specimen image) of a blood sample, the following problems arise. In other words, when cells that are difficult to judge during the examination of blood cells appear, it is often the case that a superior is asked later, so a blood cell image is obtained using a virtual microscope slide (specimen image) of a blood sample. When filing is performed, a large number of blood cell images are filed. When determining the classification items of the filed blood cell image again, it is often necessary to not only view the cell image but also information such as a cell image around the cell image. However, in such a case, in Patent Document 1, it is necessary to visually find the cell again from the virtual microscope slide (specimen image) and confirm the information around the cell. There is a problem that the work for making the determination becomes complicated.

  The present invention has been made in order to solve the above-described problems, and one object of the present invention is to provide a specimen image display method capable of easily re-determining a cell image. It is to be.

Means for Solving the Problems and Effects of the Invention

  According to one aspect of the present invention, there is provided a method for displaying a specimen image, the step of displaying an image display section on a terminal device for scrollably displaying a specimen image photographed at a magnification capable of recognizing a cell form, and an image display section. The method includes a step of aligning a cursor with a predetermined cell in the specimen image displayed on the screen, and a step of storing at least position information of the predetermined cell in the specimen image based on a storage instruction.

  In the specimen image display method according to this one aspect, as described above, an image display unit that displays a specimen image captured at least at a magnification capable of recognizing a cell form is displayed, and a cursor is placed on a predetermined cell. In addition, by storing at least position information of a predetermined cell in the specimen image based on a storage instruction, the cell image can be easily searched (searched) based on the position information. The operation of re-determining the cell image can be easily performed.

  In the specimen image display method according to the above aspect, the terminal device preferably includes a pointing device, and the step of aligning the cursor includes the step of aligning the cursor with the predetermined cell using the pointing device, and the predetermined cell. The step of storing at least the position information includes a step of storing at least the position information of a predetermined cell by instructing a storage by operating a button of the pointing device. With this configuration, it is possible to easily store at least position information of a predetermined cell using a pointing device such as a mouse.

  In the specimen image display method according to the above aspect, preferably, the step of storing at least the position information of the predetermined cell includes the step of storing the cell image of the predetermined cell in addition to the position information of the cell based on an instruction to save. Storing. If comprised in this way, the cell which needs a redetermination based on a cell image and position information can be searched easily.

  The specimen image display method including the step of storing the cell image of the predetermined cell may further include a step of displaying a list of a plurality of stored cell images. If comprised in this way, the cell image which should be judged again can be easily searched from the cell images displayed as a list.

  In this case, preferably, by selecting a predetermined cell image from the plurality of cell images displayed in a list, the cell image is displayed on the image display unit based on the position information of the cells of the selected cell image. The method further includes the step of displaying the specimen image as described above. If comprised in this way, since the sample image containing the cell image which should be judged again and the cell image around the cell image can be displayed, the operation | work which judges the cell image again can be performed more correctly. it can.

  In the specimen image display method according to the above aspect, it is preferable that a position reference line serving as a reference for the position of the cell and characters indicating a region partitioned by the position reference line are displayed on the image display unit. If comprised in this way, when displaying the cell image on each of the terminal devices installed in the place distant from each other and exchanging opinions, the position of the cell is indicated by the position reference line and the partitioned area. Since it can be easily specified using letters, opinions can be exchanged smoothly.

  The specimen image display method according to the above aspect preferably further includes a step of displaying a classification count display unit for displaying a count value for each cell classification item on the terminal device on which the image display unit is displayed. The step of storing at least position information includes the step of storing at least position information of a predetermined cell in the sample image when performing classification counting using the classification count display unit. If comprised in this way, at least the positional information on the cell for which it is difficult to judge the classification item can be stored simultaneously with the classification counting operation.

  In the specimen image display method according to the above aspect, the step of displaying the image display unit preferably includes a predetermined step necessary for display on the image display unit from a database storing a plurality of partial images obtained by dividing the specimen image. Acquiring and displaying a plurality of partial images via a communication network. With this configuration, it is not necessary to receive large-size image data at a time, and it is only necessary to receive image data of partial images necessary for display with priority. can do. Thereby, communication stress can be reduced.

  In this case, in the step of displaying the image display unit, a partial image necessary for display due to the scroll operation is acquired from the database via the communication network and displayed in response to the display scroll operation on the terminal device. Including the steps of: With this configuration, it is not necessary to receive image data of a large size at the same time during the scrolling operation, and it is only necessary to preferentially receive the image data of the partial image necessary for display by the scrolling operation. Therefore, it is possible to suppress an increase in the time required for display. As a result, it is possible to suppress a delay in the scrolling operation caused by an increase in time required for display.

  In the specimen image display method according to the above aspect, the specimen image may be a blood specimen image. As described above, when the specimen image is a blood specimen image, even when there are many blood cell images that are difficult to judge, at least position information of the blood cell image can be stored. Blood cell images can be easily retrieved.

  When executing the specimen image display method according to the one aspect, it is preferable to use a specimen image display program for executing the specimen image display method according to the one aspect.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 1 is a diagram showing an overall configuration of a system for realizing a virtual slide (blood cell image) display method according to an embodiment of the present invention. In the present embodiment, an example in which the sample image display method of the present invention is applied to a blood cell image display method will be described. First, an overall configuration of a system for realizing a virtual slide (blood cell image) display method according to an embodiment of the present invention will be described with reference to FIG.

  As shown in FIG. 1, a system for realizing a virtual slide (blood cell image) display method according to this embodiment includes a virtual slide creation unit 1, a virtual slide division / management unit 2, and a virtual slide operation unit 3. It consists of and. The virtual slide creating unit 1 includes an optical microscope 11 having 20 × and 100 × objective lenses for checking a specimen slide, a 3CCD camera 12 for capturing an image, and position control of the optical microscope 11 in the XYZ directions. An automatic stage 13, a control unit 14 and a joystick 15 for controlling the automatic stage 13, and an automatic stage control terminal 16 for controlling the automatic stage 13 and performing focus synthesis and image tiling are provided. It has been. As the optical microscope 11, for example, Olympus BX-50 series is used, and as the automatic stage 13, for example, PRIOR H101BX is used. As the 3CCD camera 12, for example, KY-F70B manufactured by PICTOR is used. The automatic stage control terminal 16 is connected to the 3CCD camera 12 via an image signal transmission cable 17 and to the control unit 14 via a control unit control cable 18. The automatic stage control terminal 16 is connected to a LAN cable 4 as a network cable.

  The virtual slide dividing / managing unit 2 is provided with a server 21 for managing virtual slide data and dividing images. The server 21 also includes a database 21a for storing virtual slide data and classification count result data. The server 21 is connected to a LAN cable 4 as a network cable. Each virtual slide data is stored in the database 21a together with identification information such as a specimen number. The database 21a stores a table in which identification information and attribute information are associated with each other. Here, the attribute information includes patient number information such as patient number, patient name, gender, age, blood type, ward, department, medical name, medical history, doctor in charge, blood test date, request number, collection date, Sample attribute information such as sample type and sample comment. Further, the classification count result data stored in the database 21a of the server 21 includes cell images of cells that have been classified and counted, position information, classification names, classification dates and times, classifier names, and the like. Further, the virtual slide operation unit 3 is provided with a client terminal 31 for performing classification count using virtual slides. The client terminal 31 has a mouse 31a. The client terminal 31 and the mouse 31a are examples of the “terminal device” and the “pointing device” of the present invention, respectively. The client terminal 31 is connected to a LAN cable 4 as a network cable.

  FIG. 2 is a schematic diagram for explaining a method of creating a virtual slide (blood cell image) according to an embodiment of the present invention. FIG. 3 is a diagram of a virtual slide (blood cell image) according to an embodiment of the present invention. It is a flowchart for demonstrating a creation flow. Next, a method for creating a virtual slide (blood cell image) will be described with reference to FIGS. The virtual slide (blood cell image) is created in the virtual slide creation unit 1 shown in FIG. The virtual slide (blood cell image) creation flow includes a setting phase and a processing phase as shown in FIG. In the setting phase, first, as shown in step S1, a sample is set on the optical microscope 11 having the automatic stage 13 (see FIG. 1). As this specimen, as shown in FIG. 2, a specimen in which a smear 42 is spread over a predetermined area on the surface of the specimen slide glass 41 is used. Next, in step S2 shown in FIG. 3, the range (sample specimen area: distance in the X direction and Y direction) to be virtual-slided is set using the automatic stage control terminal 16. In step S3, the overlap ratio between continuous visual fields for image tiling is set using the automatic stage control terminal 16. This overlap ratio is preferably set to about 10% or more and about 40% or less. Thereafter, in step S4, using the automatic stage control terminal 16, a focal width (distance in the Z direction) and a step size for focus synthesis are set. The number of images to be captured in the same field of view is determined by setting the focal width and the step size. In the present embodiment, the focal width is set to about 1 mm or less, and the step width is set to about 0.1 μm. The setting phase of the creation flow of the virtual slide (blood cell image) is completed by the processing in steps S1 to S4 described above.

  Next, as a processing phase, first, in step S5, for the same field of view, as many images as determined in step S4 are taken into the automatic stage control terminal 16 via the 3CCD camera 12, and for automatic stage control. In the terminal 16, a focus composite image is created. Here, focus synthesis refers to a process of extracting a focused pixel from each image and creating a single focused image as a whole for images with different focal positions (same field of view). means. In this embodiment, this focus synthesis is performed on the captured image of the entire field of view, thereby creating a focus synthesis image with a resolution of 1360 dots × 1024 dots as shown in FIG. The TIF format is used as the image format of the focus composite image. Thereafter, in step S6 shown in FIG. 3, it is determined whether or not the focus composite image of the entire range set in step S2 has been created. If it is determined that it has not been created, the field of view is changed in step S7. After the movement, the focus composition in step S5 is performed again. This process is repeated until a focus composite image of the entire range set in step S2 can be created.

  When it is determined in step S6 that the entire range of the focus composite image has been created, the automatic stage control terminal 16 is used in step S8 in consideration of the overlapping rate set in step S3. As shown in FIG. 2, image tiling is performed between the focus composite images. At the time of this image tiling, overlapping portions of adjacent focus composite images are recognized so that the focus composite images are pasted together so that the joints are not conspicuous. In step S9, an image tiling process is performed on the entire range set in step S2, thereby completing a virtual slide (blood cell image) 50 as shown in FIG. The virtual slide (blood cell image) 50 is an example of the “specimen image” and “blood sample image” in the present invention. As an image format of the virtual slide (blood cell image) 50, a BMP format is used. The size of the virtual slide 50 created in step S9 is about 220,000 dots × 134,000 dots. The virtual slide (blood cell image) 50 created using the automatic stage control terminal 16 is stored in the server 21 via the LAN cable 4.

  FIG. 4 is a schematic diagram for explaining a method of dividing and managing a virtual slide (blood cell image), and FIG. 5 is a flowchart for explaining a dividing flow of the virtual slide (blood cell image). The virtual slide (blood cell image) is divided and managed in the server 21 of the virtual slide dividing / managing unit 2 shown in FIG. As a method for dividing a virtual slide (blood cell image), first, in step S11 shown in FIG. 5, a virtual slide 50 having a size of about 220,000 dots × 134,000 dots stored in the server 21 (see FIG. 4). The virtual slide 50 to be divided is selected from the above. In step S12, the division size is determined. In this embodiment, as shown in FIG. 4, it is divided into 500 dots × 500 dots / sheet. The division size is preferably 500 dots × 500 dots to 1300 dots × 1300 dots when the screen resolution of the client terminal 31 is SXGA (1280 × 1024). This division size is comprehensively determined by the screen resolution of the client terminal 31, the specifications of the terminal, and the communication line speed. In step S13, the virtual slide 50 is divided in accordance with the division size determined in step S12, thereby creating a divided image 51 as shown in FIG. The divided image 51 is an example of the “partial image” in the present invention. As an image format of the divided image 51, a JPEG format (a compression ratio of about 10 in Photoshop Version 7.0.1) is used.

  In step S14, the low magnification image 52 (see FIG. 4) is created. Specifically, as shown in FIG. 4, a wide-field image (low-magnification image 52) is created by connecting several individual images of the divided image 51 (four in this embodiment). Then, the file size is reduced by reducing the resolution of the generated wide-field image (low-magnification image 52). For example, as the low-magnification image 52, a low magnification of 60, 40, 20 and 10 times from the divided image 51 of the virtual slide 50 created using a 100 × objective lens of the optical microscope 11 (see FIG. 1). A work image 52 is created. The low-magnification image 52 is an example of the “partial image” in the present invention. As an image format of the low-magnification image 52, a JPEG format (a compression ratio of about 10 in Photoshop Version 7.0.1) is used.

  Thereafter, in step S15, the virtual slide 50 as the whole image image created in steps S11, S13 and S14, the divided image 51 as the partial image and the low magnification image 52 are stored in the database in the server 21 shown in FIG. In 21a, the specimen image of the same specimen (same patient) is stored together with the identification information of the specimen. In this case, the resolution of the virtual slide (blood cell image) 50 as the entire image image stored in the database 21a is reduced to about 650 dots × 250 dots. For example, a relational database is used as the database 21 a in the server 21 that stores the virtual slide 50, the divided image 51, and the low-magnification image 52.

  FIG. 6 is a flowchart for explaining the white blood cell classification / counting operation using a virtual slide (blood cell image) according to an embodiment of the present invention, and FIGS. 7 to 11 are white blood cells according to an embodiment of the present invention. FIG. 12 is a diagram showing a screen displayed on the client terminal during the classification counting operation, and FIG. 12 is a diagram for explaining classification count items at the time of white blood cell classification counting according to an embodiment of the present invention. Hereinafter, with reference to FIG. 1 to FIG. 4 and FIG. 6 to FIG. 12, a white blood cell classification count operation using a virtual slide (blood cell image) according to the present embodiment will be described. The white blood cell classification and counting operation according to the present embodiment is performed by the client terminal 31. In order to display a virtual slide partial image, which will be described later, on the client terminal 31, a recording medium such as an FD or CD storing a program for executing the virtual slide display method according to the present embodiment is used as the client terminal 31. Or a program must be installed in the client terminal 31 from the recording medium.

  When the white blood cell classification count according to the present embodiment is performed by the client terminal 31, first, in step S21 of the flowchart shown in FIG. 6, the image display function is activated. Specifically, by clicking an icon (not shown) for starting the image display function on the screen of the client terminal 31, as shown in FIG. 7, the user ID and password input screen is displayed on the client terminal 31. Is displayed. After inputting the user ID and password on this input screen, the user clicks “OK” using the mouse 31a to activate the image display function. Thereby, in step S22, the virtual slide selection screen shown in FIG. The file name on the virtual slide selection screen includes, for example, examination date (6 digits) -specimen number (7 digits) -staining method (2 or 3 letters of alphabet) so that the virtual slide can be specified. Use the file name. Next, in step S23, after selecting a file storing predetermined virtual slide data on the virtual slide selection screen shown in FIG. 8, "Open" is clicked using the mouse 31a. Thereby, in step S24, the window of the image display unit is displayed as shown in FIG. In this case, a partial image 20 times (weakly enlarged) of the selected virtual slide is displayed on the upper part of the image display unit in a scrollable manner. In the lower part of the image display unit, a partial image of the 100 × (strongly enlarged) virtual slide corresponding to the central portion of the 20 × virtual slide displayed on the upper part of the image display unit is displayed in a scrollable manner. .

  Here, in this embodiment, when displaying the partial image of the virtual slide on the client terminal 31, the server 21 receives the 100-fold divided image 51 (see FIG. 4) constituting the virtual slide and the 20-fold low magnification. The image data of the divided image 51 and the low-magnification image 52 necessary for displaying the partial image among the image 52 are distributed preferentially to the client terminal 31, and the distributed partial image 51 and the low-magnification image 52 are displayed. In the meantime, the remaining image data of the virtual slide is distributed in the background. In this case, the divided image 51 and the low-magnification image 52 in a range slightly wider than the range displayed in the window of the image display unit are preferentially received from the server 21 to the client terminal 31. Thus, when a predetermined scrolling operation (divided image 51 and low-magnification image 52) is displayed, when a slight scroll operation is performed, a new partial image (divided image 51 and low-magnification image 52 is displayed). ) From the server 21 via the LAN cable 4, it is only necessary to display the already acquired partial images (the divided image 51 and the low magnification image 52), so that the scrolling operation can be performed more smoothly. become.

  Further, when displaying the partial image of the virtual slide in step S24, the display is performed by dynamically tiling a plurality of divided images 51 (low magnification images 52). This dynamic tiling means that the individual images are dynamically pasted on the screen of the client terminal 31. In the case of performing this dynamic tiling, since the tiling is already performed at the time of creating the virtual slide 50 (see FIG. 2), and then the divided image 51 (low magnification image 52) is simply pasted again, There is no shift between adjacent images. Therefore, unlike dynamic image tiling at the time of creating a virtual slide in step S8 (see FIG. 3), it is not necessary to perform image recognition processing at the time of dynamic tiling, so that the tiling time can be shortened. In addition, since the divided image 51 (low-magnification image 52) necessary for displaying the partial image is preferentially downloaded to the client terminal 31, an increase in time required for display is suppressed.

  Note that the default magnification of the partial images of the virtual slide displayed on the upper and lower portions of the image display unit in step S24 shown in FIG. 6 can be arbitrarily selected from a plurality of preset magnifications. For example, the default enlargement ratio can be selected from 10, 20, 40, 60, and 100 times. In this embodiment, 20 times and 100 times are selected as the default enlargement ratios of the virtual slides displayed on the upper and lower parts of the image display unit, and thus created in step S14 (see FIG. 5), respectively. The 20 × low magnification image 52 and the 100 × divided image 51 created in step S13 are received and dynamically tiled for display. In the present embodiment, a cell image with a magnification of 100 times or the like is displayed at the top of the image display unit, and a cell image with a magnification of 20 or 40 times is displayed at the bottom of the image display unit. Also good.

  In addition, when scrolling (visual field movement processing) the partial image of the virtual slide displayed in step S24, scrolling (visual field movement) in an arbitrary direction is performed using the mouse 31a or the like. In this case, it is first determined whether or not the field of view has been moved outside the image range read in step S24. If it is determined that the field of view has been moved outside the read image range, the client terminal 31 accesses the database 21a of the server 21, and the server 21 performs a scroll operation from the server 21 to the client terminal 31 via the LAN cable 4. Thus, the individual partial images (the divided image 51 or the low-magnification image 52) corresponding to the visual field newly required for display are captured. Also in this case, the divided image 51 or the low-magnification image 52 having a slightly wider range than the range displayed on the screen (window) is received from the server 21 with priority to the client terminal 31. Thus, when the scroll operation is further performed after the scroll operation, a new partial image (the divided image 51 or the low-magnification image 52) is acquired from the server 21 via the LAN cable 4 without acquiring the new partial image. Since only the partial image (the divided image 51 or the low-magnification image 52) acquired at the time of the operation needs to be displayed, the scrolling operation can be performed more smoothly. The field of view changes while dynamically tiling.

  After displaying the partial image of the virtual slide in step S24 as described above, in step S25, it is determined whether the classification count function has been activated. If it is determined that it has not been activated, in step S26, Activate the classification count function. This classification count function is activated, for example, by selecting a classification count menu from a function list pop-up displayed by right-clicking the mouse 31a. As a result, as shown in FIG. 10, the classification count display unit is displayed as a separate window at a position adjacent to the window of the image display unit of FIG. In this classification count display section, the count number and ratio (%) of the 20 types of white blood cells, and the count number and ratio (%) of the 4 types of white blood cells (Class 1 to Class 4) are displayed. . This small classification is an example of “classification item”.

  Here, as shown in FIG. 12, the 20 types of white blood cells shown in FIG. 10 are classified into Blast (blast), Promyelo (promyelocyte), Myelo (myelocyte), Meta (post myelocyte), Band (rod-shaped nuclei), Seg (segmented nuclei), Eosino (eosinophil), Baso (basophil), Lymph (lymphocyte), A. Lymph (atypical lymphocyte), Mono (monocyte), EBL-Pro (pro-erythroblast), EBL-Bazo (basophilic erythroblast), EBL-Poly (polychromatic erythroblast), EBL-Orth (Positive erythroblasts), Plasma (plasma cells), Reticulum (reticulum cells), Must (mast cells), Mitosis (mitotic cells) and Other (others). In addition, the four major classifications of leukocytes shown in FIG. 10 are the Blast (blast), Promyelo (promyelocyte), Myelo (myelocyte), and Meta (posterior myelocyte) among the 20 minor classifications described above. ), Band (spine nuclei) and Seg (segmented nuclei) belong to Class 1 (myeloid), Eosino (eosinophils), Baso (basophils), Lymph (lymphocytes), A. Class2 (white blood cells other than myeloid) to which Lymph (atypical lymphocytes) and Mono (monocytes) belong, EBL-Pro (pro-erythroblasts), EBL-Baso (basophilic erythroblasts), EBL-Poly ( Class 3 (erythroblast system) to which EBL-Orth (positive dye erythroblast) belongs, Plasma (plasma cell), Reticulum (reticulum cell), Mas (mast cell), Mitosis (Threaded cells) and Class4 (other leukocytes) to which Other (others) belongs.

  When the laboratory technician or the examiner counts blood cells (white blood cells), since it determines which major category the cell belongs to, and considers the detailed minor category, the major and minor categories shown in FIG. Classification hierarchy is in line with the thought of counting.

  The classification count display unit displays attribute information such as examination date, request number, specimen number, patient name, date of birth, sex, age, blood type, specimen comment, etc. acquired from the database 21a of the server 21. . Further, it is also possible to input attribute information on this classification count display section. When inputting attribute information, an input screen (not shown) is displayed as a separate window by clicking the “sample attribute input” button. By inputting attribute information on this input screen, the input attribute information is displayed on the classification count display section. Also, in the Megakaryo (megakaryosphere) column of the classification count display section, it is possible to input and display whether there are many (+) or few (−) Megakaryo (megakaryosphere). The classification count display section also displays an M / E ratio (M / E ratio) and a total count (Total) indicating the ratio of the M system cells to the E system cells. Also, by clicking the “set” button in the category count display section, it is possible to set the item name of the minor category and to which major category the minor category belongs.

  The “save” button and “OK” button in the classification count display section are used when the classification result is stored in the client terminal 31. The “cancel” button is used when the classification result is not stored in the client terminal 31. Further, the “count DOWN” check box is used when correcting (editing) the classification result.

  After the above-described classification count function is activated, classification counting is performed on the virtual slide selected in step S22 in step S27. Note that the classification count in step S27 is also performed when it is determined in step S25 that the classification count function has been activated.

  Here, the classification counting method using the virtual slide in step S27 will be described in detail. In the present embodiment, a 100 times (strongly enlarged) virtual slide displayed at the bottom of the image display unit shown in FIG. 10 and a 20 times (weakly enlarged) virtual slide displayed at the top of the image display unit are used. Perform a classification count. Position reference lines 61 and 62 serving as a reference for the position of the cell image are displayed on the upper and lower portions of the image display section. Further, on the upper and lower upper ends and the left end of the image display section, alphabets (“A”, “B”) and numbers (“1”) indicating the areas defined by the position reference lines 61 and 62 are displayed. "And" 2 ") are displayed. The position reference lines 61 and 62 can be switched between display / non-display.

  When performing the classification count, the mouse cursor is first placed on the position (cell specific position) 63 of the cell to be classified in the virtual slide displayed at the top of the image display unit. Then, when the left button of the mouse 31a is pressed at this cell specifying position 63 and the mouse cursor is moved a little while the left button is pressed, the cell specifying position 63 is centered as shown in FIGS. Thus, the letters indicating the names of the 20 types of classified cells (small classification) of white blood cells are displayed in a pop-up, for example, in black so as to surround the circle. This character is displayed in a state where the background is watermarked so that the cell image of the region where the character is displayed can be visually recognized.

  Also, the four major classifications (Class 1 (myeloid) (67), Class 2 (white blood cells other than myeloid)) (68), Class 3 (red) that belong to the small circle displayed in a substantially circular shape so as to pass through the cell specifying position 63. Large classification division lines 64 and 65 that divide the blast system (69) and Class 4 (other white blood cells) (70)) are displayed. In the virtual slide, a square boundary defining line 66 that defines the boundary between the small classification selection area and the large classification selection area centered on the cell specifying position 63 is displayed. The boundary defining line 66 is displayed in red, for example, so that it can be easily seen.

  In such a state where the large classification and the small classification are displayed, the classification cell of the small classification to be selected is selected in the small classification selection area inside the boundary defining line 66 while maintaining the state where the left button of the mouse 31a is pressed. By moving the mouse cursor to a position corresponding to the character indicating the name, the selected subclassified classification cell name (for example, EBL-Orth (correctly dyed erythroblast)) is inverted from black to red. Thereby, a small classification is selected. If it is difficult to determine which small category the cell belongs to, the boundary is maintained while the left button of the mouse 31a is pressed while the major categories 67 to 70 and the minor category are displayed. By moving the mouse cursor to the large classification section area selected in the large classification selection area outside the regulation line 66, the classification cell names of all the small classifications belonging to the selected large classification are inverted from black to red. Thereby, the large classification is selected. In this way, the selection of the small classification or the large classification is performed. Thereafter, when the left button of the mouse 31a is released, the selected small category or major category is counted, and the items corresponding to the selected minor category or major category in the category count display section of FIG. The count value is displayed. Simultaneously with this count, the count value, the cell image of the counted cell, the position information, the classification name, the classification date and time, the classifier name, and the like are stored in the client terminal 31. In this case, the cell image is stored in 80 dots × 80 dots, JPEG format, full color, and (X, Y) position on the virtual slide is stored as position information.

  As described above, in this embodiment, since the cell image and position information of the counted cells are stored in the client terminal 31 simultaneously with the count of the classification, the cell image can be easily searched based on the stored position information. It is possible to do (search). Further, as described above, a pop-up menu including 20 types of small classifications of white blood cells is displayed on the image display unit of the client terminal 31 on which the virtual slide is displayed in a scrollable manner by operating the buttons of the mouse 31a. By selecting and displaying the count value corresponding to the selected small classification on the classification count display unit, not only the scroll operation of the virtual slide but also the classification counting operation such as selection of the small classification is performed using the mouse 31a. This makes it possible to improve the operability. This makes it possible to efficiently perform the classification counting work using the virtual slide. In addition, since it becomes possible to perform the classification counting work by one click operation (operation of pressing and releasing the button) with the mouse 31a, the operability is further improved.

  Note that, when the selected major classification is stored, the sounds at the time of storage may be different for the four major classifications. This makes it possible to recognize which major classification is stored not only visually but also auditorily, so when the major classification is selected by mistake, the misselection is not visually noticed. Even in this case, the erroneous selection can be audibly noticed. Thereby, it becomes possible to reduce erroneous selection at the time of classification counting.

  In the cell image in which the classification count is stored, a circular mark (described later) indicating that the cell has been classified and counted is displayed in red. In this way, the classification count in step S27 ends for one cell.

  Next, in step S28, it is determined whether or not the classification count of the preset count number has been completed for the selected virtual slide. If it is determined that it has not been completed, the process proceeds to step S27 described above. The classification count operation is repeated. The classification count is set to about 100 counts for peripheral blood, and is set to about 500 to 1000 counts for bone marrow blood. This count number is set by selecting from a plurality of count numbers displayed by clicking the tab 71 of the pull-down menu of the classification count display section shown in FIG. If it is determined in step S28 that the classification count of the preset count number has been completed for the selected virtual slide, whether or not to classify another specimen (virtual slide) in step S29. Judging.

  If it is determined in step S29 that another sample (virtual slide) is to be classified, the operations in steps S23 to S28 are repeated. Specifically, when it is determined that another sample (virtual slide) is to be classified, by clicking “File (F)” on the menu bar at the top of the screen shown in FIG. The menu list is displayed. Then, by clicking the “Open (O)” menu in the menu list with the mouse 31a, the virtual slide selection screen shown in FIG. 8 is displayed. From this state, the above-described operations of Step S23 to Step S28 are repeated, whereby the classification count for other specimens (virtual slides) is performed.

  If it is determined in step S29 that no other sample is classified, the classification count result in step S27 is uploaded to the server 21 (see FIG. 1) and registered in the database 21a in step S30. Specifically, the menu list is displayed on the screen by clicking “File (F)” on the menu bar at the top of the screen shown in FIG. 10 with the mouse 31a. Then, by clicking on the “final registration (O)” menu in the menu list with the mouse 31a, the classification count result so far stored in the client terminal 31 is registered in the server 21 (see FIG. 1).

  FIG. 13 is a flowchart for explaining the classification result confirmation operation (re-judgment operation), and FIG. 14 is a diagram showing a classification name display screen which is an example of a screen displayed when the classification result is confirmed. . FIG. 15 is a view showing a classified image reference screen (thumbnail screen), which is another example of the screen displayed when the classification result is confirmed. Next, with reference to FIGS. 13 to 15, the classification result confirmation operation (re-determination operation) will be described. When confirming the classification count, first, operations in steps S41 to S44 of the flowchart shown in FIG. 13 are performed. The operations of Steps S41 to S44 are the same as Steps S21 to S24 of the classification count operation shown in FIG. That is, first, in step S41, on the user ID and password input screen (see FIG. 7) displayed on the client terminal 31, by inputting the user ID and password and clicking “OK”, the image display function is activated. Start. Thereby, in step S42, a virtual slide selection screen (see FIG. 8) is displayed. Next, in step S43, a virtual slide for confirming (re-determining) the classification count result is selected on the virtual slide selection screen, and "Open" is clicked. As a result, in step S44, as shown in FIG. 9, partial images 20 times and 100 times the selected virtual slide are scrollably displayed on the upper and lower parts of the window of the image display unit, respectively.

  Next, in step S45, a method for confirming the classification count result is selected. Specifically, a method for confirming the classification count result is selected from among [Numerical Format] display, [Category Name Display Format] display, or [Category Image Reference Format] display displayed in the menu list by a predetermined operation. If [Numerical Format] display is selected in step S45, the classification count function is activated in step S46. Specifically, by selecting a classification count menu from a function list pop-up displayed by right-clicking the mouse 31a, as shown in FIG. 10, a classification count menu is displayed at a position adjacent to the window of the image display unit in FIG. The display unit is displayed as a separate window. In step S47, the classification count display unit confirms the classification count result in a numerical format.

  In addition, when [category name display format] display is selected in step S45, a category name display screen as shown in FIG. 14 is activated in step S48. On this classification name display screen, a classification name display section and a classification count display section are displayed. The classification name display unit shown in FIG. 14 displays the same cell image as the image display unit shown in FIG. 10 and displays the classification name of the small classification or the large classification in the vicinity of each cell image that has been classified and counted. Is done. Accordingly, it is possible to perform an operation of re-determining the cell image while viewing the cell image, the classification name counted for the cell image, and the peripheral image of the cell image. Further, in each cell image subjected to classification and counting, a circular mark 72 is displayed in red as an identification mark indicating that the cells are classified and counted. The classification name in the classification name display section and the circular mark 72 can be switched between display and non-display. In step S50, the classification count result is confirmed or re-determined based on the cell image displayed on the classification name display unit and the classification name corresponding to the cell image. In step S51, it is determined whether or not to correct (edit) the classification count.

  If it is determined in step S51 that the classification count is to be edited (corrected), the process proceeds to a classification result editing flow (step S61 in FIG. 16) in step S52. In step S61 in FIG. 16, the classification result is corrected. Specifically, first, in a state where the mouse cursor is put on the countdown (count DOWN) of the classification count display section (see FIG. 14) and checked, the red circular mark 72 of the cell image to be corrected is clicked. As a result, the classification count result of the cell image is deleted. Then, move the mouse cursor to the countdown (count DOWN) and remove the check. Then, the cell image to be corrected is newly classified and counted again by a method similar to the method at the time of classification shown in FIG. In step S62, it is determined whether the correction of the classification result is completed. If it is determined that the processing has been completed, in step S63, the corrected classification count result is uploaded to the server 21 (see FIG. 1) by the same method as in step S30 (see FIG. 6), and is stored in the database 21a. register. Thereby, the classification result editing operation on the classification name display screen is completed.

  If it is determined in step S51 in FIG. 13 that the classification result is not to be edited, it is determined in step S53 whether or not to confirm another classification count result. If it is determined in step S53 that no other classification count result is to be confirmed, the process ends as it is. If it is determined that confirmation is to be performed, the operations in and after step S43 are performed.

  In addition, when “classified image reference format” display is selected in step S45, a classified image reference screen (thumbnail screen) as shown in FIG. 15 is activated in step S49. On this classified image reference screen, a classified image list display part (thumbnail display part) and a classification count display part are displayed. The classification image list display section (thumbnail display section) displays a list of each cell image that has been counted and displays a classification name of a small classification or a large classification for each cell image. This makes it possible to easily search for a cell image to be determined (confirmed) again from the cell images displayed in a list. In step S50, the classification image list display unit confirms or re-determines the classification count result. Note that by clicking on the cell image to be judged again from the list, the classification name display part of FIG. 14 is displayed instead of the classification image list display part of FIG. 15, and based on the stored positional information of the cells. Thus, the cell corresponding to the clicked cell image is displayed at the center position on the virtual slide in the classification name display section. Thereby, since the sample image including the cell image to be determined again and the cell images around the cell image is displayed, it is possible to easily determine the cell image again. In step S51, it is determined whether or not to correct (edit) the classification count.

  If it is determined in step S51 that the classification count is to be edited (corrected), the process proceeds to the classification result editing flow in step S52 (step S61 in FIG. 16). In the case of correcting the classification result in the classified image list display section (thumbnail display section), first, after selecting the thumbnail image to be corrected, the deletion menu displayed by pressing the right button of the mouse 31a is selected. This eliminates the cell image classification count. Then, the cell image to be corrected is newly classified and counted again by the same mouse operation as the method for counting the classification shown in FIG. In other words, by moving the mouse cursor slightly while keeping the left mouse button pressed while aligning the mouse cursor with the position of the cell to be classified in the thumbnail image, characters indicating the classification cell name (small classification) were displayed. Thereafter, the classification cell name (small classification) is selected by further moving the mouse cursor within the small classification selection area. Thereafter, by releasing the left button of the mouse, a number is counted in the item corresponding to the selected small classification in the classification count display part of FIG. 15, and the cell image of the counted cell, position information, classification name, The classification count results such as the classification date and the classifier name are stored in the client terminal 31. If it is difficult to re-determine with only thumbnail images, the thumbnail image to be corrected is clicked to move to the position of the cell on the virtual slide, and then the classification counting method shown in FIG. The cell image to be corrected is newly classified and counted again by the same mouse operation. Thereafter, in step S62, it is determined whether or not the classification result has been corrected. If it is determined that the processing has been completed, in step S63, the corrected classification count result is uploaded to the server 21 (see FIG. 1) by the same method as in step S30 (see FIG. 6), and is stored in the database 21a. register. Thereby, the classification result editing operation in the classified image list display unit (thumbnail display unit) is completed.

  The operation in the case where it is determined not to edit the classification result in step S51 is the same as the operation in the above-described classification name display screen.

  Next, an example of the virtual slide data operation network will be described with reference to FIG. The operation network shown in FIG. 17 includes a server 21 including a database 21a in which virtual slides and classification count results are stored, and client terminals 31 of laboratory technicians, examiners, and clinicians. (Not shown). The virtual slide and the classification count result stored in the database 21a of the server 21 are configured to be browsed by each client terminal 31 of the laboratory technician, the examiner, and the clinician. Thereby, it is comprised so that an examination engineer, an examiner, and a clinician can exchange information via a network.

  Referring to FIG. 17, as a typical operational flow, first, a virtual slide to be classified and counted from the database 21 a of the server 21 is loaded into the laboratory technician's client terminal 31 or from the server 21 to the client terminal 31. Deliver virtual slides in real time. Then, the laboratory technician performs a classification count using the virtual slide displayed on the client terminal 31 having the mouse 31a. Further, the inspection engineer corrects (edits) the classification count result as necessary. Then, the laboratory technician stores the classification count result in the database 21a of the server 21 via the network. On the other hand, the examiner takes the classification count result stored in the database 21a of the server 21 into the client terminal 31 for confirmation and re-judgment, and corrects (edits) the classification count result as necessary. When the classification count result is corrected, the examiner uploads the corrected classification count result to the database 21a of the server 21. In addition, the examiner receives consultation (consultation) from the laboratory technician regarding the classification count result via the network, and gives guidance to the laboratory technician. In this case, by performing consultation and guidance in a state where the classification name display image shown in FIG. 14 is displayed on each of the client terminals 31 of the laboratory technician and the examining physician, the classification name display unit of the classification name display screen Since position reference lines 61 and 62 (see FIG. 14) serving as a reference for the position of the cell image and characters (alphabetic characters and numbers) indicating areas defined by the position reference lines 61 and 62 are displayed. The position of the cell can be easily specified by using 61 and 62 and characters indicating the partitioned area. As a result, it is possible to smoothly perform consultation and guidance between the examining physician and the laboratory technician.

  After confirming or editing the classification count result by the examiner, the clinician captures the classification count result from the database 21a of the server 21 via the network to the clinician's client terminal 31 for confirmation. Then, the clinician exchanges opinions (discussion) with the examiner regarding the classification count result via the network. In the discussion between the clinician and the examiner, the position reference lines 61 and 62 shown in FIG. 14 and the classification name display screen including the characters indicating the sectioned area are displayed to facilitate the cell position. Can be specified. Thereby, the discussion between the clinician and the examiner can be performed smoothly.

  In the present embodiment, as described above, the virtual slide photographed at a magnification capable of recognizing the cell morphology is displayed on the client terminal 31 in a scrollable manner, and at least the position of a predetermined cell in the virtual slide at the time of classification counting By storing the information, it is possible to easily search (search for) the cell image based on the position information, so that it is possible to easily determine the cell image again.

  Further, in this embodiment, the cell image and position information of the classified cells can be easily stored by storing the cell image and position information of the classified cells simultaneously with the classification count.

  In the present embodiment, as described above, of the partial images (the divided image 51 or the low-magnification image 52) stored in the database 21a of the server 21, a partial image (divided image) necessary for display on the client terminal 31 is used. 51 or the low-magnification image 52) is obtained from the server 21 via the LAN cable 4 and displayed with priority, so that it is necessary for the client terminal 31 to receive image data of a large size at a time for display. The image data of the partial image (the divided image 51 or the low-magnification image 52) necessary for display may be received preferentially, so that it is possible to suppress an increase in the time required for display. Thereby, communication stress can be reduced. In addition, when the partial image required for display due to the scroll operation is not yet distributed to the client terminal 31 in response to the display scroll operation on the client terminal 31, the necessary partial image is displayed. By preferentially acquiring and displaying from the server 21 via the LAN cable 4, it is not necessary to receive large-size image data for display at the time of scrolling operation. Since the image data of the image (the divided image 51 or the low-magnification image 52) has only to be received preferentially, it is possible to suppress a delay in the scrolling operation caused by an increase in the time required for display.

  The embodiment disclosed this time should be considered as illustrative in all points and not restrictive. The scope of the present invention is shown not by the above description of the embodiments but by the scope of claims for patent, and further includes all modifications within the meaning and scope equivalent to the scope of claims for patent.

  For example, in the above-described embodiment, an example in which the present invention is applied to a blood cell image display method has been described. However, the present invention is not limited to this, and can be similarly applied to a display method of a specimen image other than a blood cell image. is there.

  In the above-described embodiment, the cell position information and the cell image are stored using a mouse as an example of a pointing device. However, the present invention is not limited to this, and the cell position may be stored using another pointing device. Information and cell images may be stored. Other pointing devices include a trackball that moves the cursor by rotating the ball exposed on the operation surface by hand, a trackpad that moves the cursor by tracing a flat plastic plate with your finger, and a dedicated platform. And a tablet that moves a cursor by moving a small pointing device such as a pen.

  In the above embodiment, the classification of blood cells is performed using a mouse when performing classification counting. However, the present invention is not limited to this, and blood cells can be obtained by using a keyboard and a mouse together. The classification may be selected. For example, after selecting a major category using a keyboard, a minor category belonging to the major category may be displayed in a pop-up menu at the mouse cursor position, and the minor category may be selected from the popup menu by operating the mouse.

  Further, in the above embodiment, the mouse cursor is moved to a cell and the mouse cursor is moved a little while pressing the left button of the mouse so as to surround the position where the left button is pressed. However, the present invention is not limited to this, and after the mouse cursor is placed on the cell, the position where the mouse is pressed is simply pressed. May be displayed so as to surround the cell name (small classification). If comprised in this way, the operativity of classification | category count operation | movement can be improved more. In addition, when displaying the character indicating the classification cell name (small classification) so as to surround the position where the left button of the mouse is pressed, it may be displayed so as to be surrounded by a shape such as a quadrangle other than a circle.

  Further, in the above embodiment, when performing the classification count, the small classification or the large classification is selected by moving the mouse cursor to the position corresponding to the classification to be selected while the left button of the mouse is pressed. After that, the classification result is counted by releasing the left button of the mouse. However, the present invention is not limited to this, and the same classification result as the previous one is counted by simply clicking the mouse, or The same classification result as the previous one may be displayed on the screen. If comprised in this way, since the operation | work at the time of classifying and counting the cell which belongs to the same classification | category as the cell before one can be simplified, the classification | counting operation | work using a virtual slide can be performed more efficiently. it can.

  In the above embodiment, the case where the white blood cells are classified and counted has been described. However, the present invention is not limited to this, and the present invention is also applicable to the case where blood cells other than white blood cells are classified and counted.

  In the above embodiment, an example is shown in which the network is configured by connecting the terminal for automatic stage control, the server, and the client terminal to the LAN cable in the configuration shown in FIG. 1, but the present invention is not limited to this. It is also possible to use an Internet line or a dedicated line instead of the LAN cable.

  In the above-described embodiment, an example in which the created virtual slide is stored in the server after performing focus synthesis and image tiling on the automatic stage control terminal has been described. However, the present invention is not limited to this, and automatic stage control is performed. After performing the focus composition on the terminal, the focus composite image may be stored in the server, and the virtual slide may be created by performing image tiling on the server.

It is the figure which showed the whole structure of the system for implement | achieving the display method of the virtual slide (blood cell image) by one Embodiment of this invention. It is the schematic for demonstrating the creation method of the virtual slide (blood cell image) by one Embodiment of this invention. It is a flowchart for demonstrating the creation flow of the virtual slide (blood cell image) by one Embodiment of this invention. It is the schematic for demonstrating the division | segmentation and management method of the virtual slide (blood cell image) by one Embodiment of this invention. It is a flowchart for demonstrating the division | segmentation flow of the virtual slide (blood cell image) by one Embodiment of this invention. 5 is a flowchart for explaining a leukocyte classification count operation according to an embodiment of the present invention. It is the figure which showed the input screen of the user ID at the time of starting of the image display function by one Embodiment of this invention, and a password. It is the figure which showed the virtual slide selection screen by one Embodiment of this invention. It is the figure which showed the image display part by one Embodiment of this invention. It is the figure which showed the classification count screen containing the image display part and classification | category count display part by one Embodiment of this invention. It is the elements on larger scale of the upper part of the image display part shown in FIG. It is a figure for demonstrating the classification count item at the time of the white count classification count by one Embodiment of this invention. It is a flowchart for demonstrating the classification result confirmation operation | movement (re-judgment operation | movement) by one Embodiment of this invention. It is the figure which showed the classification name display screen in the classification result confirmation operation (re-judgment operation) by one Embodiment of this invention. It is the figure which showed the classification image reference screen (thumbnail screen) in the classification result confirmation operation (re-judgment operation) by one Embodiment of this invention. It is a flowchart for demonstrating the classification | category result edit (correction) operation | movement by one Embodiment of this invention. It is a figure for demonstrating an example of the operation network of virtual slide data by one Embodiment of this invention.

Explanation of symbols

4 LAN cable 21 Server 21a Database 31 Client terminal (terminal device)
31a Mouse (pointing device)
50 Virtual slide (specimen image, blood sample image)
51 Split images (partial images)
52 Low magnification image (partial image)
61, 62 Position reference line

Claims (11)

On the terminal device, displaying an image display unit that scrollably displays a sample image photographed at a magnification at which cell morphology can be recognized; and
Placing the cursor on a predetermined cell in the sample image displayed on the image display unit;
A method for displaying a specimen image, comprising: storing at least position information of the predetermined cell in the specimen image based on a storage instruction. The terminal device includes a pointing device,
The step of aligning the cursor includes the step of aligning the cursor with the predetermined cell using the pointing device,
The step of storing at least position information of the predetermined cell includes a step of storing at least position information of the predetermined cell by instructing the storage by operating a button of the pointing device. To display the specimen image.   The step of storing at least the position information of the predetermined cell includes a step of storing a cell image of the predetermined cell in addition to the position information of the cell based on the storage instruction. The display method of the sample image described in 2.   The specimen image display method according to claim 3, further comprising a step of displaying a list of a plurality of the stored cell images.   By selecting a predetermined cell image from among the plurality of cell images displayed in the list, the cell image is displayed on the image display unit based on the position information of the cell of the selected cell image. The specimen image display method according to claim 4, further comprising the step of displaying the specimen image as described above.   The position reference line used as the reference | standard of the position of the said cell and the character which shows the area | region divided by the said position reference line are displayed on the said image display part. Display method of specimen image. The terminal device on which the image display unit is displayed further includes a step of displaying a classification count display unit for displaying a count value for each classification item of the cell,
The step of storing at least the position information includes a step of storing the at least position information of the predetermined cell in the specimen image when performing a classification count using the classification count display unit. The specimen image display method according to any one of the preceding claims.   The step of displaying the image display unit acquires a plurality of predetermined partial images necessary for display on the image display unit from a database storing a plurality of partial images obtained by dividing the specimen image via a communication network. The display method of the sample image of any one of Claims 1-7 including the step displayed as follows.   In the step of displaying the image display unit, in response to a display scroll operation on the terminal device, a partial image required for display due to the scroll operation is acquired from a database via a communication network and displayed. The specimen image display method according to claim 8, further comprising:   The specimen image display method according to claim 1, wherein the specimen image is a blood specimen image.   A specimen image display program for executing the specimen image display method according to any one of claims 1 to 10.

Images