WO2021117466A1 - 病理診断サポートシステムおよび病理診断サポート装置 - Google Patents

病理診断サポートシステムおよび病理診断サポート装置 Download PDF

Info

Publication number
WO2021117466A1
WO2021117466A1 PCT/JP2020/043364 JP2020043364W WO2021117466A1 WO 2021117466 A1 WO2021117466 A1 WO 2021117466A1 JP 2020043364 W JP2020043364 W JP 2020043364W WO 2021117466 A1 WO2021117466 A1 WO 2021117466A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
pathological diagnosis
confirmation
frame
unit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2020/043364
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
恵 西
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
PHC Holdings Corp
Original Assignee
PHC Holdings Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by PHC Holdings Corp filed Critical PHC Holdings Corp
Priority to JP2021563828A priority Critical patent/JP7261319B2/ja
Priority to US17/767,700 priority patent/US12430753B2/en
Publication of WO2021117466A1 publication Critical patent/WO2021117466A1/ja
Anticipated expiration legal-status Critical
Priority to US19/318,784 priority patent/US20260004424A1/en
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H40/00—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
    • G16H40/60—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices
    • G16H40/67—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices for remote operation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/0002—Inspection of images, e.g. flaw detection
    • G06T7/0012—Biomedical image inspection
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N33/00—Investigating or analysing materials by specific methods not covered by groups G01N1/00 - G01N31/00
    • G01N33/48—Biological material, e.g. blood, urine; Haemocytometers
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N33/00—Investigating or analysing materials by specific methods not covered by groups G01N1/00 - G01N31/00
    • G01N33/48—Biological material, e.g. blood, urine; Haemocytometers
    • G01N33/483—Physical analysis of biological material
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T1/00—General purpose image data processing
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H30/00—ICT specially adapted for the handling or processing of medical images
    • G16H30/20—ICT specially adapted for the handling or processing of medical images for handling medical images, e.g. DICOM, HL7 or PACS
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H30/00—ICT specially adapted for the handling or processing of medical images
    • G16H30/40—ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
    • G16H50/20—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
    • G16H50/70—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for mining of medical data, e.g. analysing previous cases of other patients
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30004—Biomedical image processing
    • G06T2207/30096—Tumor; Lesion

Definitions

  • the present invention relates to, for example, a pathological diagnosis support system and a pathological diagnosis support device used for pathological diagnosis of cancer.
  • the pathological diagnosis of cancer is performed by a pathologist visually confirming a pathological diagnosis image obtained by scanning a pathological diagnosis specimen (a specimen prepared from a patient for the purpose of pathological diagnosis). ing. At this time, the pathologist enlarges and observes the suspicious area of the pathological diagnosis image to confirm the pathology. In other words, if the image is not enlarged, the pathologist may overlook the presence of small cancer cells, and the pathologist has to spend an extremely large amount of time on this pathological diagnosis.
  • the pathological diagnosis image is divided into a plurality of divided images, and the points of interest are colored and displayed on the display unit if there is a possibility of abnormality in each divided image.
  • a method has been proposed (as a similar prior document, for example, Patent Document 1 below).
  • the pathological diagnosis image displayed on the display unit is colored as a point of interest. Therefore, by paying attention to the colored portion, the pathologist can alleviate the tension state that the abnormal portion should not be overlooked, and thus the burden on the pathologist can be reduced.
  • the point of interest is an extremely small point in the image for pathological diagnosis, even if the point of interest is colored, it may be overlooked.
  • an object of the present invention is to provide a pathological diagnosis support system and a pathological diagnosis support device capable of reducing the burden on a pathologist.
  • an image diagnosis server that analyzes an image for pathology diagnosis and a pathologist terminal that communicates with the image diagnosis server.
  • the image diagnosis server has an image analysis unit that performs image analysis of an image for pathological diagnosis, and a first control unit to which the image analysis unit is connected.
  • the first control unit uses the image analysis unit to divide the image for pathological diagnosis into a plurality of divided images and calculates an abnormality score for each divided image, and a confirmation frame including the divided images in which the abnormality score exceeds the threshold value. Is set and a frame number is assigned to each confirmation frame, and the image for pathological diagnosis, the setting information of the confirmation frame, and the frame number of the confirmation frame are transmitted to the pathologist terminal.
  • the pathologist terminal has a display unit and a second control unit.
  • the second control unit displays the confirmation frame and the frame number of the confirmation frame in the pathological diagnosis image, and the confirmation frame is displayed outside the pathological diagnosis image.
  • the display unit is controlled so that the frame number is displayed.
  • the pathologist can immediately recognize that there is a point of interest to be confirmed in the pathological diagnosis image by looking at the frame number displayed on the outside of the pathological diagnosis image. Then, the pathologist can immediately grasp the position and size of the confirmation frame in the pathological diagnosis image by the frame number and the confirmation frame displayed in the pathological diagnosis image. Therefore, the pathologist can perform intensive confirmation on the confirmation frame corresponding to the frame number displayed on the outside of the pathological diagnosis image, so that the burden on the pathologist can be reduced.
  • the points of interest to be confirmed are given a frame number and a confirmation frame, it is possible to reduce the burden on the pathologist by gaining confidence and a sense of security in confirming without overlooking the points of interest. it can.
  • FIG. 1 The figure which shows the structure of the pathological diagnosis support system which concerns on Embodiment 1 of this invention.
  • A is a control block diagram showing the configuration of the personal computer of the clinical laboratory technician of FIG.
  • B is a control block diagram showing the configuration of the diagnostic imaging server of FIG.
  • C is a control block diagram showing the configuration of the personal computer of the pathologist of FIG.
  • the figure which shows the display example of the display part of the personal computer of the pathologist of FIG. The figure which shows the display example of the display part of the personal computer of the pathologist of FIG.
  • the figure which shows the display example of the display part of the personal computer of the pathologist of FIG. The figure which shows the display example of the display part of the personal computer of the pathologist of FIG.
  • the operation flowchart of the personal computer and the diagnostic imaging server of the clinical laboratory technician of FIG. The operation flowchart of the diagnostic imaging server of FIG. 1 and the personal computer of a pathologist.
  • the operation flowchart of the personal computer of the pathologist of FIG. The figure which shows the display example of the display part of the personal computer of the pathologist of FIG.
  • the figure which shows the display example of the display part of the personal computer of the pathologist of FIG. The figure which shows the display example of the display part of the personal computer of the pathologist of FIG.
  • the control block diagram which shows the structure of the personal computer of the pathologist which concerns on Embodiment 2 of this invention.
  • the figure which shows the display example of the display part of the personal computer of the pathologist of FIG. The figure which shows the display example of the display part of the personal computer of the pathologist of FIG.
  • FIG. 1 shows the configuration of the pathological diagnosis support system of the present embodiment.
  • the image scanner 1 is connected to a personal computer 2 of a clinical laboratory engineer, and scans a pathological diagnosis sample (a sample collected from a patient and created for the purpose of pathological diagnosis) to obtain a clinical image for pathological diagnosis. Send to the inspection engineer's personal computer 2.
  • a pathological diagnosis sample a sample collected from a patient and created for the purpose of pathological diagnosis
  • the personal computer 2 transmits the pathological diagnosis image obtained by the image scanner 1 to the image diagnosis server 3.
  • the image diagnosis server 3 transmits the analysis result obtained by analyzing the pathological diagnosis image and the pathological diagnosis image to the pathologist's personal computer 4 (an example of the pathologist terminal).
  • the pathologist makes a pathological diagnosis using the image for pathological diagnosis sent to the personal computer 4.
  • FIG. 2 is a control block diagram showing the configurations of a personal computer 2 for a clinical laboratory engineer, a diagnostic imaging server 3, and a personal computer 4 for a pathologist.
  • the personal computer 2 includes a control unit 5 to which the image scanner 1 is connected, a communication unit 6, a display unit 7, and a storage unit 8 connected to the control unit 5.
  • the image diagnosis server 3 includes a communication unit 9 that communicates with the communication unit 6 of the personal computer 2, a control unit (first control unit) 10 connected to the communication unit 9, and a storage unit 11 connected to the control unit 10. It is provided with an image analysis unit 12 that performs image analysis of an image for pathological diagnosis.
  • the control unit 10 controls each unit connected to the control unit 10.
  • a control program for causing the control unit 10 to execute various operations is stored in the storage unit 11.
  • the pathologist's personal computer 4 is connected to a communication unit 13 that communicates with the communication unit 9 of the diagnostic imaging server 3, a storage unit 14, a display unit 15, and an input unit 16 into which control commands such as display are input.
  • the control unit (second control unit) 17 is provided.
  • the control unit 17 controls each unit connected to the control unit 17.
  • a control program for causing the control unit 17 to execute various operations is stored in the storage unit 14.
  • FIG. 3 shows a display screen of a display unit 15 displaying a viewer unit 15a that occupies most of the screen and a guide unit 15b displayed on the right side of the viewer unit 15a.
  • the entire image for pathological diagnosis is displayed on the viewer unit 15a.
  • the guide unit 15b has a frame number indicating that there is a point of interest to be confirmed in the pathological diagnosis image described later, and examples of the reason for the abnormality include "3. Invasive cancer" and "2. Non-invasive cancer” 1. Benign ". Is displayed.
  • the pathological diagnosis image displayed on the viewer unit 15a is sent to the diagnostic imaging server 3, and has a size of, for example, 30 mm ⁇ 20 mm.
  • the state after the determination is made is displayed on the viewer unit 15a.
  • the diagnostic imaging server 3 calculates an abnormality score for each divided image, and forms a confirmation frame 18, a confirmation frame 19, and a confirmation frame 20 including the divided images in which the abnormality score exceeds the threshold value. Then, these confirmation frames 18, 19 and 20 are displayed together with the frame numbers "1", “2” and “3” in the image for pathological diagnosis. Further, the guide portion 15b provided on the right outer side of the image for pathological diagnosis corresponds to the frame numbers "1", "2", and "3" of the confirmation frames 18, 19, and 20, respectively. The reason for the abnormality is displayed.
  • the guide units 15b are assigned the frame numbers "1", “2", and “3".
  • the corresponding reason for abnormality is displayed, and the frame numbers "1", “2", “3” and the confirmation frames 18, 19, 20 are displayed on the viewer unit 15a. Therefore, the pathologist who sees the display unit 15 of the personal computer 4 should check the points of interest in the pathological diagnosis image by the frame numbers "1", "2", and "3" displayed on the guide unit 15b. It is possible to immediately recognize that there are three.
  • the confirmation frames 18 to 20 are arranged by the three frame numbers "1", “2", “3” and the three confirmation frames 18, 19, 20 displayed in the pathological diagnosis image of the viewer unit 15a.
  • the position, size, and positional relationship can be grasped immediately.
  • all the confirmation frames 18, 19 and 20 displayed on the viewer unit 15a only the frame lines are displayed and the inside of the frames is displayed in a visible state. As a result, the states of the three points of interest can be easily grasped.
  • the frame numbers are represented by numbers “1", “2", and "3", but the frame numbers may be any as long as the confirmation frames 18, 19, and 20 can be specified.
  • the frame number for example, instead of numbers, alphabets, Roman numerals, icons, or a combination thereof may be used.
  • the guide portion 15b is provided on the right outer side of the pathological diagnosis image of the viewer portion 15a, but the guide portion 15b is provided in the window by displaying a so-called window outside the pathological diagnosis image. You may be.
  • the personal computer 2 scans the pathological diagnosis specimen using the image scanner 1 by an operation by a clinical laboratory technician (step R1), acquires the pathological diagnosis image (step R2), and then obtains the pathological diagnosis image.
  • An image for pathological diagnosis is transmitted to the image diagnosis server 3 (step R3).
  • the control unit 10 of the image diagnosis server 3 receives the image for pathological diagnosis (step G1)
  • the image analysis unit 12 is used to generate m ⁇ n (3243 sections) divided images as described above.
  • the control unit 10 inputs each divided image into the trained abnormality detection model and calculates an abnormality score for each pixel of the divided image (step G3).
  • the learned abnormality detection model is stored in advance in the storage unit 11 of the diagnostic imaging server 3.
  • control unit 10 colors the pixels whose abnormal score exceeds the threshold value (step G4).
  • control unit 10 collects 3243 sections of the colored divided images and reconstructs the pathological diagnosis image (step G5).
  • the colored region indicates that the abnormality is detected by the image analysis unit 12 and is likely to include the lesion tissue.
  • the colored area indicates that it is a point of interest for the pathologist to perform intensive confirmation.
  • the image analysis unit 12 detects whether or not there are adjacent colored divided images in the pathological diagnosis image (step G6). Then, when there are adjacent objects, the square confirmation frames 18, 19, 20 are set in the integrated state, and the images in the confirmation frames 18, 19, 20 are cut out as lesion image, and each confirmation frame 18 is used. , 19, 20 are assigned frame numbers "1", "2", and "3" (step G7).
  • the diagnostic imaging server 3 inputs the lesion image into the trained classification color-coded model, and sets the lesion area of the lesion image as the reason for abnormality "benign", "invasive cancer", or "non-invasive cancer". In addition to determining "invasive cancer", the color of the confirmation frame is determined.
  • the confirmation frame for "benign” is red
  • the confirmation frame for “invasive cancer” is green
  • the confirmation frame for “non-invasive cancer” is black.
  • the reason for abnormality and the display color are assigned to each of the confirmation frames 18, 19 and 20 (step G8).
  • the image diagnosis server 3 contains pathological diagnosis data including the position information (example of setting information) of the confirmation frames 18, 19, and 20, the frame number, the reason for the abnormality, the display color, and the lesion image. Is created, and the pathological diagnosis image and the pathological diagnosis data are transmitted to the pathologist's personal computer 4 (step G9).
  • the control unit 17 of the pathologist's personal computer 4 controls the display unit 15 so as to display the guidance screen A shown in FIG. 3 based on the pathological diagnosis data received from the image diagnosis server 3 (steps S1 and S2). ).
  • the image for pathological diagnosis is displayed on the viewer unit 15a, and the confirmation frames 18, 19 and 20 are displayed together with the frame numbers "1", "2" and "3" in the image for pathological diagnosis.
  • the frame numbers "1", "2", and "3" of the confirmation frames 18, 19 and 20 are the reasons for abnormality "benign” and "non-benign". It is displayed together with "invasive cancer” and "invasive cancer”.
  • the confirmation frames 18 and 19 in the pathological diagnosis image are displayed as frames larger than the confirmation frame 20 because the images in the confirmation frames 18 and 19 are composed of a plurality of divided images. ..
  • the confirmation frame 20 is composed of only one divided image, it is displayed as a frame smaller than the confirmation frames 18 and 19.
  • the reason for the abnormality displayed on the guide unit 15b the reason for the abnormality in the small confirmation frame 20, the frame number "3", is "invasive cancer", and the reason for the abnormality is the large confirmation frame 19, the frame number "2".
  • the risk is higher than the reason for abnormality "non-invasive cancer” and the reason for abnormality "benign” in the frame number "1" which is a large confirmation frame 18.
  • the frame numbers and the reasons for the abnormalities are displayed on the guide unit 15b from the top to the bottom in descending order of risk. .. Therefore, in the guide unit 15b shown in FIG. 3, the frame number “3” of the confirmation frame 20 is displayed as the one with the highest risk.
  • the pathologist first selects the frame number “3” of the guide unit 15b having the highest risk according to the contents of the confirmation frame displayed on the guide unit 15b in descending order of risk. Specifically, the frame number "3" is selected by designating the character "3, invasive cancer" portion of the guide unit 15b by the operation of the input unit 16 by the pathologist. Then, the medical treatment screen B shown in FIG. 4 is displayed on the display unit 15 (steps S3 and S4 in FIG. 10).
  • the frame number “3” of the confirmation frame 20 On the medical treatment screen B shown in FIG. 4, the frame number “3” of the confirmation frame 20, the reason for abnormality “invasive cancer”, and a 40-fold enlarged view of the confirmation frame 20 are displayed on the guide unit 15b.
  • the pathologist can recognize the risk of the confirmation frame 20 portion to which the frame number “3” is assigned. Therefore, the pathologist operates the detail key 21 in order to perform intensive confirmation on the confirmation frame 20.
  • the confirmation frame 20 portion of the pathological diagnosis image is enlarged and displayed on the viewer unit 15a of the display unit 15 (steps S5 and S6 in FIG. 10). Therefore, the pathologist intensively confirms the pathological diagnosis image enlarged and displayed on the viewer unit 15a, and inputs the memo in the memo field 22. If the pathologist wants to erase the confirmation frame 20 and continue the confirmation, the pathologist operates the guide on / off key 23 to erase the confirmation frame 20 and continue the confirmation (steps S5 and S7 in FIG. 10).
  • the pathologist checks and inputs in the input field 24 (an example of the confirmation input button) to indicate that the confirmation given to the frame number "3" has been completed. (Confirmed input) is performed.
  • the check input to the input field 24 means that the confirmation of the confirmation frame 20 corresponding to the frame number "3" has been completed.
  • information indicating that the confirmed input has been made is given to the confirmation frame 20.
  • the confirmation frame 20 in which the confirmed input has been made is subsequently displayed as confirmed when it is displayed on the viewer unit 15a.
  • control unit 17 sets the inside of the confirmation frame 20 in an invisible state (filled in black), and controls the display unit 15 so that it can be seen that the confirmation has been completed (steps S5 and S8 in FIG. 10). Subsequently, the pathologist continues to confirm the confirmation frame 19 corresponding to the frame number "2" having the second highest risk, and the confirmation frame 18 corresponding to the frame number "1" having the third highest risk, and confirms the confirmation.
  • the final medical treatment screen C is displayed as shown in FIG.
  • step S9 it is determined whether or not a check has been entered in the input fields 24 corresponding to the respective confirmation frames 18, 19, and 20, that is, whether or not the confirmation of all the guidance information has been completed.
  • the final medical treatment screen C is displayed (step S10 in FIG. 11).
  • the control unit 17 can see that in the pathological diagnosis image displayed on the viewer unit 15a, the display unit 15 has confirmed all the confirmation frames input as confirmed. indicate. Therefore, in FIG. 7, in the viewer portion 15a, the confirmation frame 20, the confirmation frame 19, and the confirmation frame 18 are displayed in an invisible state (black fill) so that it can be seen that the confirmation has been completed. ..
  • step S9 of FIG. 11 determines whether all the confirmations have not been completed. If it is determined in step S9 of FIG. 11 that all the confirmations have not been completed, the process returns to step S2 of FIG. 10 and the processes after step S2 are repeated.
  • the invisible state this time, the inside of the frame is filled with black, but the invisible state may be a state in which the inside of the frame cannot be accurately recognized.
  • the inside of the frame may be made semi-transparent, or a diagonal line may be displayed in the frame so that the inside of the frame cannot be recognized accurately.
  • the guide unit 15b when the pathologist starts diagnosing the image for pathological diagnosis, the guide unit 15b has frame numbers "1" and "2" as shown in FIG. , "3" and the corresponding abnormal reason are displayed. Therefore, the pathologist can easily recognize that there are three points of interest to be confirmed in the pathological diagnosis image. Then, the frame numbers "1", “2", "3" displayed on the image for pathological diagnosis and the confirmation frames 18, 19, 20 respectively indicate the confirmation frames 18, 19, 20 in the image for pathological diagnosis. The position, size, and positional relationship can be grasped immediately. At this time, only the frame lines are displayed in the confirmation frames 18, 19 and 20, and the inside of the frame is displayed in a visible state, so that the state of the point of interest can be easily grasped.
  • the pathologist can consciously perform intensive confirmation on those confirmation frames 18, 19 and 20.
  • the confirmation frames 18, 19, 20 and the frame numbers "1", "2", and "3" are displayed at the points of interest to be confirmed, the risk of the pathologist overlooking these parts is reduced.
  • the burden on the pathologist can be reduced because the confidence and security of the confirmation can be obtained.
  • the pathologist confirms the parts other than the confirmation frames 18, 19 and 20 by using the viewer unit 15a so that the pathological diagnosis is complete.
  • the confirmation frames 18, 19 and 20 are displayed in an invisible state.
  • the pathologist can recognize the remaining parts to be confirmed (parts other than the confirmation frames 18, 19 and 20) at a glance, so that the burden on the pathologist can be further reduced.
  • the pathologist is suspicious except for the point displayed on the guide portion 15b while moving the line of sight in the horizontal direction from the upper side to the lower side as in the conventional case. If there are points, the enlargement confirmation work is executed at the corresponding positions.
  • the confirmation frame 18 enlarged and displayed on the display unit 15 is displayed in an invisible state indicating that the confirmation has already been completed.
  • the confirmation frame 18 for which the confirmation work is most required is displayed in an invisible state that it has already been confirmed. Therefore, the pathologist can be relieved that "the confirmation of this part has been surely completed". Then, in the other parts, the confirmation work can be smoothly executed in sequence with a normal mind, and the burden on the pathologist can be further reduced.
  • FIG. 6 shows a medical treatment screen B in the portion of the confirmation frame 19 with the frame number “2”.
  • a plurality of divided images exist in the confirmation frame 19 of the guide unit 15b, indicating that the area in which the abnormality is detected is large.
  • the confirmation frame 19 of the viewer unit 15a is displayed in a state where a plurality of divided images are present in the confirmation frame 19. Therefore, even when the area where the abnormality is detected is large, the confirmation frame 19 set in an appropriate range (size) is displayed on the viewer portion 15a, so that the pathologist can easily determine the position and range of the point of interest. Can be recognized.
  • the pathologist confirms the confirmation frame 19 while displaying the image for pathological diagnosis of the viewer portion 15a in an enlarged / reduced manner using, for example, an enlargement / reduction key (not shown).
  • FIG. 12 shows a medical treatment screen B of the confirmation frame 25.
  • a plurality of lesion areas specifically, a “benign” lesion area 25a, a “invasive cancer” lesion area 25b, and a “invasive cancer” lesion area 25c are displayed.
  • the image analysis unit 12 sets the abnormality reason of the confirmation frame 25 as the highest risk abnormality reason. That is, the image analysis unit 12 sets the reason for the abnormality in the confirmation frame 25 to "invasive cancer". Then, when the confirmation frame 25 including the plurality of divided images is displayed on the display unit 15 of the pathologist's personal computer 4, as shown in FIG. 12, the most abnormal reason for the divided images in the confirmation frame 25 is the most. The reason for the high-risk abnormality is displayed in the outer region (that is, the guide portion 15b) of the pathological diagnosis image.
  • the display is made in consideration of safety so that the pathologist does not easily overlook it, and from this point as well, the burden on the pathologist can be reduced.
  • 13 and 14 show a state in which many confirmation frames are present in the image for pathological diagnosis. Even if there are many confirmation frames in this way, the risk of the pathologist overlooking them can be reduced by assigning a frame number and the reason for the abnormality to each confirmation frame and providing confirmation guidance to the guide unit 15b. Can be done.
  • the image analysis unit 12 of the image diagnosis server 3 analyzes the image for pathological diagnosis.
  • the personal computer 4 pathological diagnosis support
  • An image analysis unit 26 may be provided in an example of the apparatus), and a pathologist's personal computer 4 may be configured to analyze an image for pathological diagnosis. That is, as shown in FIG. 15, the pathologist's personal computer 4 has an image analysis unit 26 that analyzes an image for pathological diagnosis and a control unit (third control unit) 17 to which the image analysis unit 26 is connected.
  • a communication unit 13, a storage unit 14, and a display unit 15 connected to the control unit 17 are provided.
  • the control unit 17 uses the image analysis unit 26 to divide the pathological diagnosis image into a plurality of divided images and calculate an abnormality score for each divided image, and a confirmation frame including the divided image in which the abnormality score exceeds the threshold value. Is set and a frame number is assigned to each confirmation frame. Then, when the pathological diagnosis image is displayed on the display unit 15, the control unit 17 displays a confirmation frame and a corresponding frame number on the pathological diagnosis image, and a confirmation frame outside the pathological diagnosis image. Display the frame number of.
  • the image analysis unit 26 when an image for pathological diagnosis is sent from the image diagnosis server 3 to the pathologist's personal computer 4, the image analysis unit 26 is the same as the image analysis unit 12 of the image diagnosis server 3 in the first embodiment. Performs the analysis operation of. That is, the image analysis unit 26 performs the analysis operations of steps G1 to G7 in FIG. 9 and steps G8 to G9 in FIG. After that, the personal computer 4 performs the same operation as that of the first embodiment.
  • FIGS. 16 and 17 are images displayed on the personal computer 4 when performing a cytodiagnosis of breast cancer, and an image of cells is displayed on the viewer portion 15a as an image for pathological diagnosis.
  • the image of this cell is an image acquired by depth-of-focus synthesis, and when the pathological diagnosis specimen was taken, the focal position was slightly shifted and multiple images were taken, and these multiple images were in focus.
  • the image is a composite of only the areas where it is.
  • the confirmation frame 27 corresponding to the frame number "1" is displayed together with the frame number "1"
  • the confirmation frame 28 corresponding to the frame number "2" is displayed together with the frame number "2". .. Therefore, the pathologist can easily recognize the positions of the confirmation frames 27 and 28, which are the points of interest, the range in which the abnormal cells exist, and the positional relationship. Further, in this case, since only the frame lines are displayed in the confirmation frames 27 and 28 and the inside of the frame is displayed in a visible state, the state in the frame can be easily grasped. That is, in the case of cytodiagnosis, the findings that the pathologist should examine are the state of the cell nucleus, the arrangement and color of the cells, and the like. Therefore, it can be easily recognized that such remarkable features (state of cell nucleus, cell arrangement and color) are in the confirmation frames 27 and 28.
  • the pathologist can intensively perform the pathological diagnosis on the confirmation frames 27 and 28 after grasping the state of the confirmation frames 27 and 28. After that, when the diagnosis of the point of interest is completed, the pathologist confirms the parts other than the confirmation frames 27 and 28 by using the viewer portion 15a so that the pathological diagnosis is complete. At this time, as shown in FIG. 17, in the pathological diagnosis image of the viewer unit 15a, all the confirmation frames 27 and 28 for which the confirmed input has been made are displayed in an invisible state.
  • the pathologist can recognize the remaining parts to be confirmed (parts other than the confirmation frames 27 and 28) at a glance, so that the burden on the pathologist can be reduced.
  • the present invention is expected to be utilized as, for example, a pathological diagnosis support system and a pathological diagnosis support device used for pathological diagnosis of cancer.

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Biomedical Technology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Primary Health Care (AREA)
  • Epidemiology (AREA)
  • Physics & Mathematics (AREA)
  • Pathology (AREA)
  • Data Mining & Analysis (AREA)
  • General Physics & Mathematics (AREA)
  • Chemical & Material Sciences (AREA)
  • Databases & Information Systems (AREA)
  • Radiology & Medical Imaging (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Theoretical Computer Science (AREA)
  • Urology & Nephrology (AREA)
  • Molecular Biology (AREA)
  • Biochemistry (AREA)
  • Analytical Chemistry (AREA)
  • Immunology (AREA)
  • Hematology (AREA)
  • Medicinal Chemistry (AREA)
  • Food Science & Technology (AREA)
  • Quality & Reliability (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Biophysics (AREA)
  • Business, Economics & Management (AREA)
  • General Business, Economics & Management (AREA)
  • Investigating Or Analysing Biological Materials (AREA)
  • Investigating Or Analysing Materials By Optical Means (AREA)
PCT/JP2020/043364 2019-12-10 2020-11-20 病理診断サポートシステムおよび病理診断サポート装置 Ceased WO2021117466A1 (ja)

Priority Applications (3)

Application Number Priority Date Filing Date Title
JP2021563828A JP7261319B2 (ja) 2019-12-10 2020-11-20 病理診断サポートシステムおよび病理診断サポート装置
US17/767,700 US12430753B2 (en) 2019-12-10 2020-11-20 Pathological diagnosis support system and pathological diagnosis support device
US19/318,784 US20260004424A1 (en) 2019-12-10 2025-09-04 Pathological diagnosis support device

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2019-222977 2019-12-10
JP2019222977 2019-12-10

Related Child Applications (2)

Application Number Title Priority Date Filing Date
US17/767,700 A-371-Of-International US12430753B2 (en) 2019-12-10 2020-11-20 Pathological diagnosis support system and pathological diagnosis support device
US19/318,784 Continuation US20260004424A1 (en) 2019-12-10 2025-09-04 Pathological diagnosis support device

Publications (1)

Publication Number Publication Date
WO2021117466A1 true WO2021117466A1 (ja) 2021-06-17

Family

ID=76329815

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2020/043364 Ceased WO2021117466A1 (ja) 2019-12-10 2020-11-20 病理診断サポートシステムおよび病理診断サポート装置

Country Status (3)

Country Link
US (2) US12430753B2 (https=)
JP (1) JP7261319B2 (https=)
WO (1) WO2021117466A1 (https=)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2023124159A (ja) * 2022-02-25 2023-09-06 株式会社アンドパッド 情報処理装置、情報処理方法、情報処理プログラム
JP2024025182A (ja) * 2022-08-10 2024-02-26 公益財団法人がん研究会 情報処理装置、情報処理方法、およびプログラム

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH06251038A (ja) * 1993-03-01 1994-09-09 Toshiba Corp 医用診断支援システム
WO2012105281A1 (ja) * 2011-01-31 2012-08-09 日本電気株式会社 情報処理システム、情報処理方法、情報処理装置及びその制御方法とその制御プログラムを格納した記憶媒体
JP2018000454A (ja) * 2016-06-30 2018-01-11 キヤノンマーケティングジャパン株式会社 医用画像診断装置、その制御方法、及びプログラム

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0616290B1 (en) 1993-03-01 2003-02-05 Kabushiki Kaisha Toshiba Medical information processing system for supporting diagnosis.
JP2005185565A (ja) * 2003-12-25 2005-07-14 Olympus Corp 医療情報処理システム
WO2012102069A1 (ja) * 2011-01-24 2012-08-02 日本電気株式会社 情報処理システム、情報処理方法、情報処理装置およびその制御方法とその制御プログラムを格納した記憶媒体
US9786047B2 (en) * 2011-05-18 2017-10-10 Nec Corporation Information processing system, method, and apparatus supporting a pathological diagnosis, and control method and control program thereof
JP5487157B2 (ja) 2011-05-26 2014-05-07 富士フイルム株式会社 画像処理装置および画像処理装置の作動方法並びに画像処理プログラム
KR20140055152A (ko) * 2012-10-30 2014-05-09 삼성전자주식회사 병변 진단 보조 장치 및 방법
JP7076698B2 (ja) 2017-11-17 2022-05-30 国立研究開発法人国立がん研究センター 画像解析方法、画像解析装置、プログラム、学習済み深層学習アルゴリズムの製造方法および学習済み深層学習アルゴリズム

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH06251038A (ja) * 1993-03-01 1994-09-09 Toshiba Corp 医用診断支援システム
WO2012105281A1 (ja) * 2011-01-31 2012-08-09 日本電気株式会社 情報処理システム、情報処理方法、情報処理装置及びその制御方法とその制御プログラムを格納した記憶媒体
JP2018000454A (ja) * 2016-06-30 2018-01-11 キヤノンマーケティングジャパン株式会社 医用画像診断装置、その制御方法、及びプログラム

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2023124159A (ja) * 2022-02-25 2023-09-06 株式会社アンドパッド 情報処理装置、情報処理方法、情報処理プログラム
JP2024025182A (ja) * 2022-08-10 2024-02-26 公益財団法人がん研究会 情報処理装置、情報処理方法、およびプログラム

Also Published As

Publication number Publication date
US20260004424A1 (en) 2026-01-01
JPWO2021117466A1 (https=) 2021-06-17
US20240119585A1 (en) 2024-04-11
JP7261319B2 (ja) 2023-04-19
US12430753B2 (en) 2025-09-30

Similar Documents

Publication Publication Date Title
US10782862B2 (en) Systems and methods for viewing medical images
EP2172902B1 (en) Image display apparatus, image display method, and image display program
US20260004424A1 (en) Pathological diagnosis support device
US6104828A (en) Ophthalmologic image processor
CN103654696A (zh) 诊断支持设备和诊断支持方法
JP2012073179A (ja) 病理診断支援装置、病理診断支援方法、病理診断支援のための制御プログラムおよび該制御プログラムを記録した記録媒体
JP2013103023A (ja) 画像診断支援装置および画像診断支援方法
US20230410981A1 (en) Medical image display system, medical image display method, and recording medium
JP2003190134A (ja) 医用画像処理装置、医用画像処理方法、プログラム、及び記憶媒体
JP2006187412A (ja) 医用画像診断支援装置
JP4691732B1 (ja) 組織抽出システム
US20230298178A1 (en) Medical image display system, medical image display method, and recording medium
JP4490225B2 (ja) 細胞画像表示方法、細胞画像表示システム、細胞画像表示装置、及びコンピュータプログラム
KR20160115269A (ko) 건강검진 정보 제공 애플리케이션 및 시스템
JP3885961B2 (ja) 医用画像表示装置
CN114170177A (zh) 一种手术路径分析方法及存储介质
JPWO2022075047A5 (https=)
CN116324572A (zh) 医疗图像处理装置及其工作方法
US20260017796A1 (en) Classification assisting device, classification assisting method, and recording medium
JP2024111693A (ja) 処理装置、処理プログラム、処理方法及び処理システム
JP2025036805A (ja) 病理診断支援システム、病理診断支援方法及びプログラム
JP2009125432A (ja) 眼科撮影装置及び眼科画像処理装置
US20220359061A1 (en) Diagnosis support program, diagnosis support system, and diagnosis support method
JP2025017451A (ja) 処理装置、処理プログラム、処理方法及び処理システム
KR20240079994A (ko) 민감도 설정이 가능한 인공지능 기반의 병변 검출 방법 및 장치

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20897659

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2021563828

Country of ref document: JP

Kind code of ref document: A

WWE Wipo information: entry into national phase

Ref document number: 17767700

Country of ref document: US

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20897659

Country of ref document: EP

Kind code of ref document: A1

WWG Wipo information: grant in national office

Ref document number: 17767700

Country of ref document: US