WO2021221008A1 - システム、制御方法及びプログラム - Google Patents

システム、制御方法及びプログラム Download PDF

Info

Publication number
WO2021221008A1
WO2021221008A1 PCT/JP2021/016601 JP2021016601W WO2021221008A1 WO 2021221008 A1 WO2021221008 A1 WO 2021221008A1 JP 2021016601 W JP2021016601 W JP 2021016601W WO 2021221008 A1 WO2021221008 A1 WO 2021221008A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
evaluation
image evaluation
evaluation system
environment
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2021/016601
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
裕紀 青山
航 笠井
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Splink Inc
Original Assignee
Splink Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Splink Inc filed Critical Splink Inc
Priority to JP2022518052A priority Critical patent/JP7764037B2/ja
Publication of WO2021221008A1 publication Critical patent/WO2021221008A1/ja
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/05—Detecting, measuring or recording for diagnosis by means of electric currents or magnetic fields; Measuring using microwaves or radio waves
    • A61B5/055—Detecting, measuring or recording for diagnosis by means of electric currents or magnetic fields; Measuring using microwaves or radio waves involving electronic [EMR] or nuclear [NMR] magnetic resonance, e.g. magnetic resonance imaging
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01T—MEASUREMENT OF NUCLEAR OR X-RADIATION
    • G01T1/00—Measuring X-radiation, gamma radiation, corpuscular radiation, or cosmic radiation
    • G01T1/16—Measuring radiation intensity
    • G01T1/161—Applications in the field of nuclear medicine, e.g. in vivo counting

Definitions

  • the present invention relates to a system that provides information for supporting diagnostic imaging.
  • the image processing apparatus disclosed in Document 1 includes an input unit for inputting a functional image of the subject's brain, an anatomical standardization unit for anatomically standardizing the functional image of the subject, and an anatomy assigned on the standard brain.
  • the ROI candidate presentation unit that reads the data of the anatomical region from the standard brain data storage unit that stores the data of the target region and presents the data of the anatomical region as ROI candidates, and the selection of the anatomical region are accepted.
  • the ROI setting unit that sets the ROI on the anatomically standardized subject's brain image based on one or more selected anatomical regions, and the evaluation value is calculated based on the pixel value in the ROI. It is provided with an evaluation value calculation unit and a display unit for displaying information on the calculated evaluation value.
  • One aspect of the present invention comprises a first access unit accessible to a first image evaluation system that statistically evaluates a first type of medical image that includes at least a portion of the subject's body as a target area.
  • a second access to a second image evaluation system that determines a subject's morbidity using a first model machine-trained to evaluate a first disease based on a first type of medical image. It is a system having a unit and a support unit that provides at least one of an evaluation target input and an evaluation result output to a first image evaluation system and a second image evaluation system via a common image evaluation environment.
  • the support unit provides a common image evaluation environment in which the first type of medical image of the subject contains a standardized evaluation image as an image that can be input and output to the first image evaluation system and the second image evaluation system. You may use it.
  • One of the other aspects of the present invention is a method of controlling a support system having the first access unit, the second access unit, and the support unit.
  • the method comprises at least one of the following steps: i)
  • the support unit shares the first result regarding the evaluation of the medical image acquired from the first image evaluation system and the second result regarding the evaluation of the medical image of the subject acquired from the second image evaluation system.
  • the support unit re-evaluates the first result regarding the evaluation of the medical image acquired from the first image evaluation system based on the judgment of the morbidity state of the second image evaluation system, and the result is a common image evaluation environment. To output via.
  • the support unit is emphasized in determining the morbidity of the first area and the second image evaluation system, which are emphasized by the first result regarding the evaluation of the medical image obtained from the first image evaluation system. To output the second area via a common image evaluation environment.
  • the support unit sets an image region including a first region, which is emphasized by the first result regarding the evaluation of the medical image acquired from the first image evaluation system, through the common image evaluation environment. Select as the evaluation target of the image evaluation system of.
  • the support unit sets an image region including a second region, which is emphasized in determining the morbidity of the second image evaluation system, as an evaluation target of the first image evaluation system via a common image evaluation environment. To choose.
  • One of the further different aspects of the present invention is a program for evaluating medical images by a computer.
  • the program (program product) is that the computer accesses the first image evaluation system that statistically evaluates the first type of medical image including at least a part of the subject's body as the target area, and the first. Access to a second image evaluation system that determines a subject's morbidity using a first model machine-trained to evaluate a first disease based on a type of medical image, and a first image. Providing at least one of the input of the evaluation target and the output of the evaluation result to the evaluation system and the second image evaluation system via a common image evaluation environment, and at least one of the steps i) to vi) above. Has an instruction to execute.
  • the program may be provided by recording on a computer-readable recording medium.
  • the figure which shows the outline of the information provision system for image diagnosis support The figure which shows the outline of the processing of the evaluation support system.
  • the figure which shows the process of standardization The figure which shows an example of the area of interest when the anatomically standardized image is used as the input of deep learning.
  • the figure which shows an example of an input process The figure which shows an example of the input process with partial extraction.
  • the figure which shows the deep learning model. The figure which shows the change of sensitivity and specificity.
  • the figure which shows the ROI of a deep learning model. The figure which shows the ROI by statistical processing.
  • FIG. 1 shows an outline of the system 1 that provides information for diagnostic imaging support.
  • the system 1 provides information on medical imaging support that includes the brain or part of the brain as a part of the subject's body as a target area for diagnostic imaging or evaluation.
  • the system 1 statistically evaluates the image database 52 storing the subject's brain image 53 and the brain image 53 as the first type of medical image including at least a part of the subject's body as the target area.
  • An image evaluation system 60, a second image evaluation system 70 that determines the morbidity of a subject using a first model machine-learned to evaluate a first disease based on a brain image 53, and an image evaluation support system. Includes 10 and.
  • the image evaluation support system (support system) 10 has a first access unit (interface) 11 accessible to the first image evaluation system 60 and a second access accessible to the second image evaluation system 70.
  • CT Computer Tomography
  • MRI Magnetic Resonance Imaging
  • PET PET
  • SPECT Single Photon
  • CT Computer Tomography
  • MRI Magnetic Resonance Imaging
  • PET PET
  • SPECT Single Photon
  • tomography equipment such as Emission Computed Tomography (Emission Computed Tomography) and PET-CT
  • these modality images are used for diagnosis of various diseases.
  • the modality image (medical image) 53 including the subject's brain as a target area for diagnosis or evaluation is used to acquire data related to the physical state of the subject's brain, such as dementia and Parkinson's disease. It is used for diagnosing diseases of.
  • Examples of medical image types are CT and MRI, which can reflect highly accurate morphological information.
  • the MRI image includes, for example, a T1-weighted image, a T2-weighted image, a diffusion-weighted image, a flare image, a diffusion tensor image, a QSM image, a pseudo PET image, a pseudo SPECT image, and the like.
  • QSM images Quantantitative Susceptibility Mapping
  • Other examples of types of medical images are PET and SPECT, which are obtained by administering a radiopharmaceutical into the subject's body, such as by intravenous injection, and imaging the radiation emitted by the drug in the body. , The image is generated.
  • a PET image is taken using a so-called Pittsburgh compound B as a radiopharmaceutical for PET (tracer), and the degree of accumulation of amyloid ⁇ protein in the brain is measured based on the captured PET image to obtain Alzheimer's disease. It can be useful for the differential diagnosis or early diagnosis of.
  • the pseudo PET image is a word used to distinguish it from the actual PET image, and is an image for estimating the actual PET image.
  • the pseudo PET image may be generated based on, for example, an MRI image.
  • the pseudo SPECT image is an image that estimates the actual SPECT image.
  • SPECT images there is an imaging method that visualizes the distribution of a dopamine transporter (DAT) called DatSCAN (Dopamine transporter SCAN) in a SPECT examination in which a radiopharmaceutical called 123I-Ioflupane is administered.
  • DAT dopamine transporter
  • the purpose of this imaging is to assist in early diagnosis of Parkinson's disease (PS) in Parkinson's disease (PD), assist in diagnosis of Lewy body dementia (DLB, Dementia with Lewy Bodies), and when there is dopaminergic nerve loss in the striatum.
  • PS Parkinson's disease
  • PD Parkinson's disease
  • DLB Lewy body dementia
  • Lewydova A type of medication decision called Lewydova can be mentioned.
  • This system 1 is a mapping system 55 that standardizes a medical image 53 of the first type of a subject into an image (standardized image) 50 that can be input and output to the first image evaluation system 60 and the second image evaluation system 70.
  • the support system 10 may include a third access unit (interface) 13 that can access the mapping system 55.
  • An example of the standardized image 50 is an anatomical standardized image, and the mapping system 55 may have a function as an anatomical standardization processing unit.
  • the mapping system 55 outputs a third result 56 regarding the evaluation of the standardization process of the brain image 53, including the reliability of the process in each voxel of anatomical standardization, and the support unit 30 via the access unit 13 As a result, 56 may be obtained.
  • the support unit 30 is provided with a common image evaluation environment that provides an evaluation for the image based on the standardized image 50, and the evaluation at the time of mapping or the third result 56 regarding the evaluation is obtained by the mapping system. It can be output in the same environment as 55, or can be used as input for processing in the support unit 30.
  • the support system 10 including the support unit 30 provides information for evaluating an image via a common image evaluation environment (common evaluation environment, user interface module, U / I module) 15 including a standardized evaluation image. It may be provided to medical personnel who are users. The user may access the support system 10 using access devices such as the display 16a and the touch panel 16b attached to the support system 10, or may access the support system 10 via the cloud (Internet) 17. ..
  • a common image evaluation environment common evaluation environment, user interface module, U / I module
  • the user may access the support system 10 using access devices such as the display 16a and the touch panel 16b attached to the support system 10, or may access the support system 10 via the cloud (Internet) 17. ..
  • a configuration range 8 including an image database 52, a first image evaluation system 60 and a second image evaluation system 70 may be provided via the cloud (Internet).
  • the configuration range 9 including the mapping system 55, the storage of the standardized image 50, the input 62 and the evaluation output 63 of the first image evaluation system 60, and the input 72 and the evaluation output 73 of the second image evaluation system 70 is included. It may be provided via the cloud.
  • the first image evaluation system 60 that statistically evaluates medical images may be provided as a system equipped with computer resources, and includes a processor 61 that performs statistical processing, and a library and a program for performing statistical processing.
  • the database 65 that stores the data may be provided.
  • the first image evaluation system 60 may output the first result 66 regarding the evaluation of the medical image to be processed, that is, the statistical evaluation.
  • the evaluation result 66 may be output (displayed) based on the standardized image 50 in the evaluation output function (display unit) 63 of the evaluation system 60.
  • the support unit 30 may acquire the result 66 via the access unit 11.
  • the support unit 30 uses a common image evaluation environment (common evaluation environment) 15 that provides an evaluation for an image based on the standardized image 50, and first obtains a first result 66 regarding the evaluation of statistical processing or the evaluation thereof. It can be output in the same environment as the image evaluation system 60, or can be used as an input for processing in the support unit 30.
  • the first result 66 may include information on a first region (region of interest, ROI) that is valued by statistical processing.
  • the first image evaluation system 60 may include an input function (selection unit) 62 for selecting an image to be statistically processed based on the standardized image 50 or a region in the image.
  • the control (input control information) 67 of the analysis target including the selection of the region to be statistically processed may be provided by the support unit 30.
  • the support unit 30 uses the common evaluation environment 15 to input or select information to be statistically processed based on the standardized image 50 via the same environment as the first image evaluation system 60. be able to.
  • the process of correcting the covariates of age or gender (or various biomarker values) as input to each voxel data of the standardized image 50 may also be executed via the common evaluation environment 15.
  • the second image evaluation system 70 that determines the diseased state based on the medical image may be provided as a system equipped with computer resources, and evaluates the disease state based on the processor 71 that performs processing by the learning model and the medical image.
  • a first model 74 machine-learned to do so and a database 75 storing a library and the like may be provided.
  • the second image evaluation system 70 determined the morbidity of the subject using the evaluation of the medical image to be processed, that is, the first model 74 machine-learned to evaluate the first disease based on the medical image.
  • the second result 76 regarding the matter may be output.
  • the evaluation result 76 may be output (displayed) based on the standardized image 50 in the evaluation output function (display unit) 73 of the evaluation system 70.
  • the support unit 30 may acquire the result 76 via the access unit 12.
  • the support unit 30 uses the common evaluation environment 15 based on the standardized image 50 to output an evaluation regarding the determination of the morbidity condition or a second result 76 regarding the evaluation via the same environment as the second image evaluation system 70. Alternatively, it can be used as an input for processing in the support unit 30.
  • the image evaluation system 70 of the above can be adopted, and the second result 76 regarding the determination of the morbidity state of the subject using the learning model 74 can be output.
  • the second result 76 shows the presence or absence of the first disease of interest, eg, the presence or absence of AD or DLB, and the advanced state, as well as the second area (region of interest, ROI) that was emphasized in determining the morbidity. Information may be included.
  • the support unit 30 is used by using the standardized image 50 via the common evaluation environment 15.
  • the ROI can be evaluated in the same environment as the second evaluation system 70.
  • the second image evaluation system 70 may include an input function (selection unit) 72 that selects an image or a region in the image to be determined by the learning model 74 based on the standardized image 50.
  • the control (input control information) 77 of the diagnosis target (discrimination target) including the selection of the region to be processed may be provided by the support unit 30.
  • the support unit 30 uses the common evaluation environment 15 to input or select information to be discriminated by the learning model 74 based on the standardized image 50 in the same environment as the second image evaluation system 70. can do. Also in this case, the process of correcting the covariates of age or gender (or various biomarker values) as input to each voxel data of the standardized image 50 is also executed via the common evaluation environment 15. You may.
  • the support system 10 may be provided as a device provided with computer resources such as a server that can access the cloud, and is a program 19 including a library required for various processes and an instruction for executing the process as the support system.
  • a database 18 that stores the above may be provided.
  • the service to the user using the common evaluation environment 15 may be provided as a service via the cloud (Software as a Service).
  • the support system 10 provides the common evaluation environment 15 using the standardized processed image 50, and the support unit 30 uses the common evaluation environment 15 to evaluate the evaluation result 66 of the first image evaluation system 60.
  • the evaluation result 76 of the second image evaluation system 70 can be seamlessly provided to the user in a state where they can mutually refer to each other.
  • the result 56 at the time of standardization can be provided to the user.
  • the method using gradCAM or the like for deep learning it is possible to visualize the region of interest that was important in the discrimination of deep learning. Further, if the input of discrimination by deep learning is a brain image mapped to the anatomical standard brain 50 provided in the common image environment 15 using the support system 10, the image is the same as the statistically calculated ROI. It can be visually recognized in comparison with the above (display switching and overlay).
  • a region of interest for deep learning is specified using the common image environment 15, statistical processing is performed on that region, values of brain volume and blood flow are calculated, and discrimination is performed. It is possible to present human-interpretable index values for the areas that were effective.
  • this support system 10 can be a tool function (system side) that can be considered in other businesses. For example, it can be applied to each analysis result, and it is possible to select an intervention method, select a drug prescription, etc., and guide additional tests if possible.
  • DLB can provide support for recommending DatSCAN / MIBG myocardial scintigraphy examinations and recommending examination institutions. By linking with the paper database, it is possible to provide research support, diagnostic support, and treatment support by displaying the related paper link when the mouse is over in the ROI area displayed in the common image environment 15.
  • the support unit 30 can provide some functions by using the common image environment 15.
  • One function is an input support function (input support unit) 37, which provides input control information 67 and 77 to the first image evaluation system 60 and / or the second image evaluation control system 70 via the support unit 30. By supplying it, the following functions can be provided.
  • the anatomical standardized image 50 is involved in the brain when it is input to the deep learning model 74 of the second image evaluation system 70.
  • the second image evaluation system 70 is controlled so as to determine whether or not it is a disease (assuming a disease that can be diagnosed from a brain image), or class determination such as its type and progression classification.
  • Each voxel data of the anatomical standardized image 50 is further corrected for the covariate of age or gender (or various biomarker values) as an input, and then selected as an input of the deep learning model 74.
  • the model When predicting the classes of the deep learning model 74, the model finally has the option of displaying a value of 0 to 1 in each class evaluated by the softmax function.
  • a classification related to a disease for example, in the case of a classification of dementia among brain diseases, a class such as NC (Normal Control), AD, or DLB can be assumed.
  • the first disease to be differentiated includes Alzheimer-type dementia (AD) and Lewy body dementias (DLB) and includes dementia
  • the first type of medical image 53 is MR. If it is an image, the target areas are the hippocampus, parahippocampal gyrus, dorsal side of the brain stem, medial temporal pole, and basal ganglia (shell, caudate nucleus, entorhinal cortex, parahippocampal gyrus, tonsillar, etc.)
  • Input control information 67 and 77 may be set to include at least one of.
  • the input control information 67 and 77 is set so that the area of interest includes at least one of the precuneus, occipital lobe, and dorsolateral prefrontal cortex of the brain. You may.
  • the support unit 30 has a first result 66 regarding the evaluation of the medical image acquired from the first image evaluation system 60 and a second result 76 regarding the evaluation of the medical image of the subject acquired from the second image evaluation system 70.
  • the evaluation (first result) 66 obtained by statistically processing the medical image and the evaluation (second result) 76 predicted by the deep learning model 74 from the medical image can be compared independently or. In this state, for example, it may be output in parallel or switched over via the standardized image 50.
  • the support unit 30 re-evaluates the first result 66 regarding the evaluation of the medical image acquired from the first image evaluation system 60 based on the determination of the morbidity state of the second image evaluation system 70, and obtains a common image. It may include a function (restatistical processing request unit) 32 that outputs via the evaluation environment 15. Statistical processing of images of subjects determined to have disease based on the determination of morbidity in the deep learning model 74, even if the results of the preceding statistical processing do not show a region of interest ROI for the disease. By reassessing the slight difference in the disease, it can be re-recognized as the ROI of the disease.
  • the support unit 30 describes the first region (ROI), which is emphasized by the first result 66 regarding the evaluation of the medical image obtained from the first image evaluation system 60, and the affected state of the second image evaluation system 70.
  • a function (overlap display (overlay) unit) 33 for superimposing and outputting the second region (ROI), which is regarded as important for determination, on the common image evaluation environment 15 may be included.
  • Information about the ROI may be obtained from systems 60 and 70, respectively, as part of information 66 and 76 about the evaluation results.
  • the deep learning model 74 predicts the class of disease
  • the region that the model 74 used for evaluation can be displayed on the brain image 50 after anatomical standardization.
  • the support unit 30 uses a common image evaluation environment 15 for an image area including a first area (ROI) that is emphasized by the first result 66 regarding the evaluation of the medical image acquired from the first image evaluation system 60.
  • a function (model input selection unit) 34 for selecting as an evaluation target of the second image evaluation system 70 may be included.
  • the standardized image 50 one or more anatomical parts are further input as a region of interest (ROI), and the image filtered by the anatomical part of the anatomical standardized image 50 is input to the deep learning model 74. You may make the selection.
  • the anatomical part is defined on the standardized brain coordinates, and the "region of interest" which is a set of coordinates with the same name is the first. It can be selected for the image evaluation system 60 and the second image evaluation system 70.
  • the support unit 30 uses the common image evaluation environment 15 to obtain an image region including a second region (ROI), which is important for determining the diseased state of the second image evaluation system 70, in the first image evaluation system. It may include a function (statistical processing input selection unit) 35 for selecting 60 as an evaluation target. By selecting the ROI that focuses on the determination of the morbidity of the deep learning 74 and performing statistical processing, it is possible to provide the interpretation and explanation to the medical staff who handles the result of the deep learning 74.
  • ROI second region
  • the support unit 30 is the first result regarding the evaluation of the medical image acquired from the first image evaluation system 60 based on the common image evaluation environment of the medical image of the subject, in this example, the reliability of the mapping to the standardized image 50. 66, or the function of controlling the output of the second result 76 regarding the evaluation of the medical image of the subject acquired from the second image evaluation system 70 to the standardized image 50 using the common image evaluation environment 15 (mapping evaluation). Unit) 36 may be included.
  • the deep learning model 74 using the anatomical standardized image 50 as an input predicts the disease class, it is possible to display the result of correction by reliability for each voxel value of the region ROI that the model 74 used for evaluation. ..
  • mapping accuracy there is a problem in the mapping accuracy to the standard brain image 50, there may be a problem in the reliability of the analysis result with the region with low mapping accuracy as the ROI.
  • By quantifying the mapping accuracy before analyzing the brain image providing ROI, performing differentiation, it is possible to apply an ROI filter so as to obtain an evaluation that does not use an image region with low reliability.
  • the support system 10 further evaluates the first disease, for example, AD or DLB by the learning model (first model) 74 based on the output of these evaluation results using the common image environment 15 of the support unit 30.
  • the unit 20 to be verified may be provided.
  • FIG. 2 shows a flowchart of an evaluation support method using the image evaluation support system 10.
  • the evaluation support system 10 can be provided as an information processing device including computer resources including a memory and a CPU, and this support method has instructions that can be executed as a control method of the system 10 or in a computer.
  • the program may be provided by recording it on a recording medium readable by a computer, or may be provided in a state where it can be downloaded from the Internet or the like.
  • step 81 the mapping system 55 maps the brain image 53 of the subject (user, examinee) to the standardized image (anatomical standardized image) 50.
  • the outline of the anatomical standardization process is shown in FIG. In addition, FIG. 4 shows the standardization process.
  • Anatomical standardization involves mapping an individual's functional image linearly or non-linearly onto a standard template.
  • Performing anatomical standardization processing has become a standard method for analyzing medical images as well as brain images by aligning the positions of brain regions between subjects.
  • VBM Vehicle-based morphometry
  • LDDMM differential common mode mapping
  • step 811 of FIG. 3 the horizontal axis is adjusted (ACPC conversion) for all the images (FIG. 4 (a)).
  • step 812 the images of each subject are segmented into gray matter (GM), white matter (WM) and cerebrospinal fluid portion (CSF) (FIG. 4 (b)).
  • step 813 the image divided into gray matter images is subjected to DARTEL processing using a template created only from the standard brain (FIG. 4 (c)).
  • step 814 further standardization to the MNI space is performed (FIG. 4 (d)).
  • the gray matter image may be further shaped for volume information by modulation and smoothed with an 8-mm wide Gaussian kernel. The smoothing width is not limited to 8 mm.
  • FIG. 5 shows an example of trying a visualization technique called SHAP when an image after anatomical standardization of a morphological MRI image is used as an input for deep learning.
  • SHAP a visualization technique
  • accuracy or sensitivity or specificity
  • FIG. 6 shows the process of performing anatomical standardization using a deep learning model in the mapping system 55.
  • an anatomical standardization process is performed using a deep learning model. Deep learning may be applied after anatomical standardization, but deep learning may be applied to the process of anatomical standardization.
  • anatomical standardization may use LDDMM for non-linear transformation, the problem of long processing time may occur. It is possible to learn this process with a neural network and introduce a method that is faster and more accurate than DARTEL.
  • the reliability of the mapping may be calculated by using the Bayesian Neuronal Network at the same time as increasing the speed.
  • the reliability evaluation result 56 may be used for correcting the region of interest (region of interest, ROI) in the first image evaluation system 60 and the second image evaluation system 70.
  • the support unit 30 may use the common image environment 15 to provide input control support to the first image evaluation system 60 and the second image evaluation system 70.
  • the anatomical standardized image 50 may be further corrected by inputting attributes such as age and gender and biomarkers, and the anatomical standardized image may be used for subsequent processing.
  • FIG. 7 shows the flow of processing when attributes and biomarkers are further input and used.
  • the common image environment 15 may be used to provide input control support to the second image evaluation system 70.
  • the second image evaluation system 70 a case where the deep learning model is directly determined and a case where the deep learning model is determined after filtering by the anatomical site may be selected.
  • FIG. 8 shows the flow of processing when performing site extraction.
  • step 84 when the support unit 30 needs to acquire the evaluation result of the statistical processing, the first access unit accessible to the first image evaluation system 60 in step 85.
  • the first evaluation result 66 regarding the statistical processing of the image of the first image evaluation system 60 is acquired via the (interface) 11.
  • a statistical comparative evaluation is performed between the brain image of the subject and the brain image of a healthy person.
  • VBM Vehicle Based Morphometry
  • a typical statistical process is to generate a Z-score map.
  • the data (normal standard brain) obtained by calculating the average value and standard deviation for each boxel from the MR image of the normal case that has undergone brain morphology standardization processing and creating the average image and standard deviation image. It is created by substituting the value and the value of the subject's image data (processed image) into the following formula for calculating the Z score.
  • z (M (x, y, z) -I (x, y, z)) / SD (x, y, z) M and SD represent the average image and the standard deviation image of the normal standard brain, and I represents the processed image.
  • a voxel in which the Z score map has a positive value indicates a region with atrophy as compared with a normal standard brain, and it can be interpreted that the larger the value, the larger the divergence statistically. For example, if the Z score is "2", it means that the average value exceeds twice the standard deviation, and it is evaluated that there is a statistically significant difference with a risk rate of about 5%.
  • M, SD and I may be calculated in the region of interest, respectively, and the average of all positive Z scores may be obtained.
  • the molecule of this formula indicates the sum of the SUVs of the four cerebral gray matter sites, namely the cortical regions of the cerebrum (frontal cortex, anterior and posterior zonal cortex, parietal lobe, and lateral temporal lobe), and the denominator indicates the SUV of the cerebellum. ..
  • BR Biting Ratio
  • C in the formula is the average value of DAT in each region of interest
  • Cspecific indicates the average value of the putamen and caudate nucleus in the brain
  • Cnonspecific indicates the average value of the occipital cortex in the brain.
  • ROI areas of interest
  • SPM Statistical Parametric Mapping
  • the disease groups were determined by two certified specialists of the Japan Society for Dementia as DLB or AD as the main neurological disease based on the DSM-5 diagnostic criteria. To exclude vascular disorders, subjects were recruited under conditions excluding subjects with progressive and acute white matter lesions. This is a group of subjects excluding those who were not diagnosed with dementia in the healthy group and suspected of having a disease of the central nervous system. This study was approved by the Institutional Review Board and was conducted in accordance with the guidelines at the participating institutions.
  • FIG. 9 shows the attributes of the subjects.
  • the DLB group consists of 50 women and 51 men with a mean and standard deviation of 73.25 ⁇ 8.05 years.
  • the AD group consists of 36 women and 33 men (similarly age 71.58 ⁇ 6.33 years).
  • the NC group consists of 28 women and 10 men (similarly age 71.03 ⁇ 6.28 years). There were no significant differences between any group of subjects of age and gender. All subjects underwent the MMSE test, with scores of 22.21 ⁇ 4.86, 21.32 ⁇ 3.95 and 28.21 ⁇ 1.26 in the DLB, AD and NC groups, respectively. There was no significant difference between the DLB and AD groups.
  • the subject's MRI data was captured by a total of 11 different scanners. It is a three-dimensional T1-weighted image obtained by Gapless imaging in the sagittal direction, and the PulseSequence of each MRI scanner is as shown in FIG. Each MRI image was converted into an anatomical standardized image 50 by the processing described above.
  • FIG. 12 shows the ROIs of the three groups that have undergone ICV normalization.
  • FIG. 12 shows the result of performing ICV normalization.
  • the sites with a significant difference in gray matter volume compared to the three groups were found to have a relatively wide range of significant differences, and the most significant difference was the area extending from the parahippocampal gyrus to the brain stem.
  • FIG. 13 shows the results of evaluating the effect in ROI of each group subjected to ICV normalization with 90% CI. No significant difference was observed between the DLB group and the AD group.
  • the support unit 30 uses a first model (deep learning model) 74 machine-learned to evaluate a first disease, eg, AD or DLB, based on medical images.
  • a first disease eg, AD or DLB
  • the second image evaluation system 70 can be accessed in step 87.
  • the second evaluation result 76 of the second image evaluation system 70 is acquired via the second access unit (interface) 13.
  • FIG. 14 shows an outline of the adopted model.
  • ResNet is a kind of convolutional neural network model, and has a feature of having a model structure that prevents the disappearance of the characteristics of the signal source as compared with a general convolutional neural network.
  • ResNet can adopt a mechanism of transmitting the output to the next layer by combining the output of the convolution and the input of the layer by adding a mechanism called "skip connection" to the convolution layer. This makes it possible to prevent information loss of training data even when the model layer is deepened, and high accuracy can be obtained in many image classification tasks.
  • FIG. 15 shows a ROC plot of the model with the maximum verification accuracy of each 5-fold, in which changes in sensitivity and specificity were confirmed while moving the softmax disease determination threshold of the output layer.
  • the sensitivity and specificity when balanced by YoudenIndex were 81.54 ⁇ 10.43% and 76.77%, respectively, and the accuracy at that time was 79.15 ⁇ 5.22% (sensitivity and accuracy are specificity. 5-foldmean ⁇ SD when fixed). Although limited, it was confirmed from this experiment that the deep learning model using the same gray matter volume data has the ability to discriminate between the DLB group and the AD group, for which no significant difference could be confirmed by the conventional SPM statistical test. did it.
  • the brainstem region was detected in the analysis using ICV, and there is an analysis in other studies that confirmed the significant difference between the DLB group and the AD group although it was white matter on the dorsal side of the brainstem.
  • the difference in the degree of atrophy of gray matter including the brain stem from the hippocampus of the DLB group and the AD group was small compared to the intracranial volume.
  • the atrophy pattern of the DLB group and the AD group may be fine, while the deep learning model shows a certain level of discrimination performance.
  • step 88b when the display of the evaluation results of the respective systems 60 and 70 is requested in step 88a, in step 88b, the display / comparison unit 31 of the support unit 30 is transferred from the first image evaluation system 60.
  • the first result 66 regarding the evaluation of the acquired medical image and the second result 76 regarding the evaluation of the medical image of the subject acquired from the second image evaluation system 70 are provided to the user via the common image evaluation environment 15. offer.
  • step 89a when a review of statistical processing is requested based on the discrimination result of the learning model 74, in step 89b, the restatistical processing request unit 32 of the support unit 30 is affected by the second image evaluation system 70.
  • the first image evaluation system 60 is requested via the input control information 67 to re-evaluate the first result 66 regarding the evaluation of the medical image acquired from the first image evaluation system 60.
  • the result 66 is output via the common image evaluation environment 15.
  • FIG. 16 shows the SPM statistical test results and the part with the minimum p-value of five DLB-verified subjects, and the softmax output value (0-1) which is the basis for judgment in the deep learning model 74 of the subject.
  • the gray matter sites with the highest p-values were putamen / caudate nucleus / entorhinal cortex / parahippocampal gyrus / amygdala in each subject.
  • the striatum such as the putamen and caudate nucleus, is the site where degeneration of dopamine neurons is observed in Lewy body dementias and Parkinson's disease. In subjects (c) and (d), atrophy around the hippocampus was confirmed.
  • Atrophy around the hippocampus is often seen in AD cases, but in these cases, the evaluation by the softmax function output value of the proposed method shows that the DLB judgment basis is relatively low, although it is a slight difference.
  • Met Amygdala atrophy was observed in subject (e). The amygdala is also the site where ⁇ -synuclein accumulation is reported in cortical Lewy bodies.
  • the existing method defined and evaluated the ROI limited to the dorsal part of the brain stem
  • the method using the learning model 74 has a necessary feature in Lewy body dementias, which has a wide range of pathological effects. Can be understood more than the existing method, and it can be seen that it may have contributed to the improvement of accuracy.
  • the overlay display unit 33 of the support unit 30 is the first.
  • the first region (ROI), which is emphasized by the first result 66 regarding the evaluation of the medical image obtained from the image evaluation system 60, and the second region (ROI), which is emphasized by the second result 66, are emphasized in determining the morbidity of the second image evaluation system 70.
  • Region (ROI) is output via the common image evaluation environment 15.
  • FIG. 17 shows an example in which the deep learning model 74 uses GradCAM to output the region of interest (ROI) that was heavily used in the discrimination of the deep learning model 74 and displayed it on the anatomical standardized image 101.
  • the output of the GradCAM is displayed using the sagittal section 102, the coronal section 103, and the horizontal section 104 of the anatomically standardized brain.
  • each volume 105 of GM (gray matter), WM (white matter), TBV, and ICV is shown together with the average value (indicated in parentheses) of healthy subjects.
  • the clinical information 108 of the subject and the DLB certainty degree 106 are also displayed.
  • the check item for "part selection” is only “gray matter”, but multiple parts can be selected, not limited to gray matter. It may also be possible to select detailed sites within the gray matter.
  • FIG. 18 shows an example of the result of statistically processing the brain image 53 of the same subject.
  • the region of interest (ROI) of the Z-score is shown using the sagittal section 112, the coronal section 113, and the horizontal section 114 of the anatomical standardized image 111.
  • FIG. 19 shows the first evaluation result including the region of interest of the statistical evaluation regarding the evaluation of the medical image of the first subject acquired from the first image evaluation system, and the second image evaluation system of the first subject. It shows how the second evaluation result including the important region captured when determining the affected state from the medical image is output in a common image evaluation environment.
  • the ROI of the deep learning model 74 obtained by GradCAM and the ROI of the Z score are shown in an overlapping manner.
  • the ROI regions of both are superimposed on the sagittal section 122, the coronal section 123, and the horizontal section 124 of the anatomical standardized image 121.
  • the input of discrimination by the deep learning model 74 is a brain image mapped to the anatomical standard brain, it can be visually recognized by contrasting on the same image as the conventional statistically calculated ROI. It will be possible.
  • the model input selection unit 34 of the support unit 30 is the first image evaluation system.
  • An image region including a first region (ROI) that is emphasized by the first result 66 regarding the evaluation of the medical image obtained from 60 is selected via the common image evaluation environment 15, and the input control information 77 is used to select the image region. It is provided as an evaluation target of the image evaluation system 70 of 2.
  • step 92a when it is selected to perform statistical processing based on the ROI of the learning model 74, in step 92b, the statistical processing input selection unit 35 of the support unit 30 is the second image evaluation system 70.
  • An image region including a second region (ROI) that is emphasized in determining the affected state is selected via a common image evaluation environment 15, and is provided as an evaluation target of the first image evaluation system 60 by input control information 67. do.
  • the first image evaluation system 60 calculates the values of brain volume and blood flow in the region of interest of the deep learning model, and presents a human-interpretable index value for the region that was effective for discrimination. It becomes possible.
  • the statistical processing is not limited to the Z score, and may be a volume value / volume density value, a blood flow rate, a glucose metabolism amount, an accumulation amount of a tracer reactant, or the like.
  • the mapping evaluation unit 36 of the support unit 30 is a common image evaluation environment of the medical image of the subject, standardized in this example.
  • the evaluation of the first result 66 regarding the evaluation of the medical image acquired from the first image evaluation system 60 or the medical image of the subject acquired from the second image evaluation system 70 based on the reliability of mapping to the image 50.
  • the output of the second result 76 using the common image evaluation environment 15 is controlled.
  • the medical personnel may evaluate the discrimination result of the deep learning model 74 in step 94 based on various information provided through the common image evaluation environment 15. ..
  • AD, DLB, and a healthy person have been mainly described, but the present invention is not limited to AD and DLB, and the system, control method, and program of the present embodiment include brain disorders (including brain diseases). ) Can also be applied.
  • Brain disorders include dementia, attention disorders, memory disorders, executive dysfunction, social behavior disorders, aphasia, apraxia, and higher brain disorders such as apraxia.
  • Dementia includes AD (Alzheimer Disease), DLB (Dementia with Lewy Bodies, Lewy body dementias), and other dementia, such as frontotemporal dementia and progressive supranuclear dementia. Includes paralysis, corticobasal degeneration, and dementia with granular dementia.
  • the state of brain disorder is the presence or absence of brain disorder, its progress state, the presence or absence and differentiation of the causative disease (causative disease) of brain disorder such as dementia, the progress state of one or more causative diseases, etc. Includes various aspects of brain damage in patients and users.
  • brain diseases include dementia (including AD, DLB, frontal temporal lobe degeneration (FTLD), normal pressure hydrocephalus (NPH), etc.), brain tumors, psychiatric disorders (also called psychiatric disorders, schizophrenia, etc.) (Including epilepsy, mood disorder, dependence disorder, higher dysfunction, etc.), Parkinson's disease, Asperger's syndrome, attention deficit / hyperactivity disorder (ADHD), sleep disorder, childhood disease, ischemic brain disorder, mood disorder (depression) Etc.) etc. are included.
  • brain disorders include dementia and multiple sclerosis as diseases related to the brain, and mild cognitive impairment (MCI: Mild cognitive impairment) and Alzheimer as diseases related to amyloid ⁇ , for example.
  • Mild cognitive impairment due to illness MCIdue to AD
  • prodromal AD pre-symptomatic AD of Alzheimer's disease / preclinical AD
  • Parkinson's disease multiple sclerosis
  • insomnia sleep disorders
  • cognition includes neurodegenerative diseases such as functional decline, cognitive impairment, and amyloid positive / negative disorders.
  • the target area included in the medical image to be evaluated is the brain or a part of the brain to explain the present invention, but the target area is not limited to the brain and any other body of the subject. Or may be part.
  • the disease to be evaluated is not limited to dementia, and any disease related to other parts of the body may be used as long as it is a disease to be evaluated.
  • Image diagnosis support information provision system 8 9 Configuration range 10 Support system 11 First access unit 12 Second access unit 13 Access unit 15 Image evaluation environment (common evaluation environment) 16a Display 16b Touch panel 17 Cloud 18 Database 19 Program 20 Unit 30 Support unit 31 Individual / comparative evaluation unit 32 Restatistical processing request unit 33 Overlay display (overlay) unit 34 Model input selection unit 35 Statistical processing input selection unit 36 Mapping evaluation Unit 37 Input support function (input support unit) 50 Standardized image 52 Image database 53 Brain image (first type medical image) 55 Mapping system 56 Third result 60 First image evaluation system 61 Processor 62, 72 Input to be evaluated 63, 73 Output of evaluation result 65 Database 66 First result 67, 77 Input control information 70 Second image evaluation System 71 Processor 74 Deep learning model (learning model, first model) 75 database 76 second result

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Medical Informatics (AREA)
  • High Energy & Nuclear Physics (AREA)
  • General Health & Medical Sciences (AREA)
  • Molecular Biology (AREA)
  • Engineering & Computer Science (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Veterinary Medicine (AREA)
  • Pathology (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • Radiology & Medical Imaging (AREA)
  • Public Health (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Optics & Photonics (AREA)
  • General Physics & Mathematics (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Image Analysis (AREA)
  • Apparatus For Radiation Diagnosis (AREA)
  • Magnetic Resonance Imaging Apparatus (AREA)
PCT/JP2021/016601 2020-04-28 2021-04-26 システム、制御方法及びプログラム Ceased WO2021221008A1 (ja)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2022518052A JP7764037B2 (ja) 2020-04-28 2021-04-26 システム、制御方法及びプログラム

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2020079503 2020-04-28
JP2020-079503 2020-04-28

Publications (1)

Publication Number Publication Date
WO2021221008A1 true WO2021221008A1 (ja) 2021-11-04

Family

ID=78374115

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2021/016601 Ceased WO2021221008A1 (ja) 2020-04-28 2021-04-26 システム、制御方法及びプログラム

Country Status (2)

Country Link
JP (1) JP7764037B2 (https=)
WO (1) WO2021221008A1 (https=)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023167157A1 (ja) * 2022-03-01 2023-09-07 株式会社Splink コンピュータプログラム、情報処理装置及び情報処理方法
JP2023143875A (ja) * 2022-03-25 2023-10-06 バイオメディカ コーポレーション 医療用画像解析方法
WO2025070723A1 (ja) * 2023-09-29 2025-04-03 株式会社エム 脳画像解析装置、脳画像解析システムおよび脳画像解析プログラム

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH07284090A (ja) * 1994-04-08 1995-10-27 Olympus Optical Co Ltd 画像分類装置
JP2006043007A (ja) * 2004-08-02 2006-02-16 Fujitsu Ltd 診断支援プログラムおよび診断支援装置

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5051472B2 (ja) * 2006-11-06 2012-10-17 国立大学法人徳島大学 脳画像診断支援方法、プログラムおよび記録媒体
US10445462B2 (en) * 2016-10-12 2019-10-15 Terarecon, Inc. System and method for medical image interpretation
JP6882136B2 (ja) * 2017-10-12 2021-06-02 日本メジフィジックス株式会社 画像処理装置、画像処理方法およびプログラム
TW201941220A (zh) * 2018-03-09 2019-10-16 日商日本醫事物理股份有限公司 診斷支援裝置、程式製品、記錄有學習完成模型的記錄媒體及學習裝置
JP7270626B2 (ja) * 2018-07-09 2023-05-10 富士フイルム株式会社 医用画像処理装置、医用画像処理システム、医用画像処理装置の作動方法、プログラム、及び記憶媒体
WO2020054803A1 (ja) * 2018-09-12 2020-03-19 株式会社Ｓｐｌｉｎｋ 診断支援システムおよび方法

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH07284090A (ja) * 1994-04-08 1995-10-27 Olympus Optical Co Ltd 画像分類装置
JP2006043007A (ja) * 2004-08-02 2006-02-16 Fujitsu Ltd 診断支援プログラムおよび診断支援装置

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
ASAKAWA, NAOKI: "Ideals and reality of explainable AI", NIKKEI COMPUTER, vol. 1009, 6 February 2020 (2020-02-06), JP , pages 38 - 44, XP009532025, ISSN: 0285-4619 *

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023167157A1 (ja) * 2022-03-01 2023-09-07 株式会社Splink コンピュータプログラム、情報処理装置及び情報処理方法
JP2023143875A (ja) * 2022-03-25 2023-10-06 バイオメディカ コーポレーション 医療用画像解析方法
JP7531648B2 (ja) 2022-03-25 2024-08-09 バイオメディカ コーポレーション 医療用画像解析方法
US12511740B2 (en) 2022-03-25 2025-12-30 Biomedica Corporation Medical image analysis method based on deep learning model
WO2025070723A1 (ja) * 2023-09-29 2025-04-03 株式会社エム 脳画像解析装置、脳画像解析システムおよび脳画像解析プログラム

Also Published As

Publication number Publication date
JP7764037B2 (ja) 2025-11-05
JPWO2021221008A1 (https=) 2021-11-04

Similar Documents

Publication Publication Date Title
Ahmed et al. Neuroimaging and machine learning for dementia diagnosis: recent advancements and future prospects
Schuch et al. An open presurgery MRI dataset of people with epilepsy and focal cortical dysplasia type II
Leandrou et al. Quantitative MRI brain studies in mild cognitive impairment and Alzheimer's disease: a methodological review
Albrecht et al. Atrophy in midbrain & cerebral/cerebellar pedunculi is characteristic for progressive supranuclear palsy–A double-validation whole-brain meta-analysis
Jitsuishi et al. Searching for optimal machine learning model to classify mild cognitive impairment (MCI) subtypes using multimodal MRI data
Kim et al. Predicting amyloid positivity in patients with mild cognitive impairment using a radiomics approach
Yang et al. Diagnosis of Parkinson’s disease based on 3D ResNet: The frontal lobe is crucial
JP2014145770A (ja) アルツハイマー病の予測を支援する方法及び自動化システム、並びに、前記システムをトレーニングする方法
Qiao et al. Multivariate deep learning classification of Alzheimer’s disease based on hierarchical partner matching independent component analysis
Augimeri et al. CADA—computer-aided DaTSCAN analysis
JP7764037B2 (ja) システム、制御方法及びプログラム
Poirier et al. 18F-FDG PET-guided diffusion tractography reveals white matter abnormalities around the epileptic focus in medically refractory epilepsy: implications for epilepsy surgical evaluation
Park et al. Deep learning application for the classification of Alzheimer’s disease using 18F-flortaucipir (AV-1451) tau positron emission tomography
WO2021220597A1 (ja) システム、制御方法、情報提供方法及びコンピュータプログラム
Lim et al. Reproducibility of automated habenula segmentation via deep learning in major depressive disorder and normal controls with 7 Tesla MRI
Shukla et al. Analyzing subcortical structures in Alzheimer's disease using ensemble learning
CN116369891A (zh) 轻度认知障碍发展进程预测方法、装置和计算机设备
CN115170540A (zh) 一种基于多模态影像特征融合的轻度创伤性脑损伤分类方法
Hassanaly et al. Evaluation of pseudo-healthy image reconstruction for anomaly detection with deep generative models: Application to brain FDG PET
Kuhn et al. Translating state-of-the-art brain magnetic resonance imaging (MRI) techniques into clinical practice: multimodal MRI differentiates dementia subtypes in a traditional clinical setting
Casamitjana et al. A probabilistic histological atlas of the human brain for MRI segmentation
Kang et al. Alzheimer’s Disease prediction using attention mechanism with dual-phase 18F-Florbetaben images
Zhang et al. Clinical evaluation of a novel atlas-based PET/CT brain image segmentation and quantification method for epilepsy
Spetsieris et al. Highly automated computer-aided diagnosis of neurological disorders using functional brain imaging
Ranjbar et al. Weakly supervised skull stripping of magnetic resonance imaging of brain tumor patients

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21796978

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2022518052

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21796978

Country of ref document: EP

Kind code of ref document: A1