WO2022229671A1 - Detection of bio-markers in functional mri scans - Google Patents

Detection of bio-markers in functional mri scans Download PDF

Info

Publication number
WO2022229671A1
WO2022229671A1 PCT/IB2021/053469 IB2021053469W WO2022229671A1 WO 2022229671 A1 WO2022229671 A1 WO 2022229671A1 IB 2021053469 W IB2021053469 W IB 2021053469W WO 2022229671 A1 WO2022229671 A1 WO 2022229671A1
Authority
WO
WIPO (PCT)
Prior art keywords
blood oxygen
matrix
oxygen level
voxels
fmri
Prior art date
Application number
PCT/IB2021/053469
Other languages
French (fr)
Inventor
Luis Andre Dutra e SILVA
Original Assignee
Silva Luis Andre Dutra E
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Silva Luis Andre Dutra E filed Critical Silva Luis Andre Dutra E
Priority to PCT/IB2021/053469 priority Critical patent/WO2022229671A1/en
Publication of WO2022229671A1 publication Critical patent/WO2022229671A1/en

Links

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01RMEASURING ELECTRIC VARIABLES; MEASURING MAGNETIC VARIABLES
    • G01R33/00Arrangements or instruments for measuring magnetic variables
    • G01R33/20Arrangements or instruments for measuring magnetic variables involving magnetic resonance
    • G01R33/44Arrangements or instruments for measuring magnetic variables involving magnetic resonance using nuclear magnetic resonance [NMR]
    • G01R33/48NMR imaging systems
    • G01R33/4806Functional imaging of brain activation
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/05Detecting, measuring or recording for diagnosis by means of electric currents or magnetic fields; Measuring using microwaves or radio waves 
    • A61B5/055Detecting, measuring or recording for diagnosis by means of electric currents or magnetic fields; Measuring using microwaves or radio waves  involving electronic [EMR] or nuclear [NMR] magnetic resonance, e.g. magnetic resonance imaging
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/145Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue
    • A61B5/14542Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue for measuring blood gases
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/16Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A61B5/165Evaluating the state of mind, e.g. depression, anxiety
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/40Detecting, measuring or recording for evaluating the nervous system
    • A61B5/4058Detecting, measuring or recording for evaluating the nervous system for evaluating the central nervous system
    • A61B5/4064Evaluating the brain
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/40Detecting, measuring or recording for evaluating the nervous system
    • A61B5/4076Diagnosing or monitoring particular conditions of the nervous system
    • A61B5/4088Diagnosing of monitoring cognitive diseases, e.g. Alzheimer, prion diseases or dementia
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/72Signal processing specially adapted for physiological signals or for diagnostic purposes
    • A61B5/7235Details of waveform analysis
    • A61B5/7264Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems
    • A61B5/7267Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems involving training the classification device
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • G06T7/0012Biomedical image inspection
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B2576/00Medical imaging apparatus involving image processing or analysis
    • A61B2576/02Medical imaging apparatus involving image processing or analysis specially adapted for a particular organ or body part
    • A61B2576/026Medical imaging apparatus involving image processing or analysis specially adapted for a particular organ or body part for the brain
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01RMEASURING ELECTRIC VARIABLES; MEASURING MAGNETIC VARIABLES
    • G01R33/00Arrangements or instruments for measuring magnetic variables
    • G01R33/20Arrangements or instruments for measuring magnetic variables involving magnetic resonance
    • G01R33/44Arrangements or instruments for measuring magnetic variables involving magnetic resonance using nuclear magnetic resonance [NMR]
    • G01R33/48NMR imaging systems
    • G01R33/54Signal processing systems, e.g. using pulse sequences ; Generation or control of pulse sequences; Operator console
    • G01R33/56Image enhancement or correction, e.g. subtraction or averaging techniques, e.g. improvement of signal-to-noise ratio and resolution
    • G01R33/5608Data processing and visualization specially adapted for MR, e.g. for feature analysis and pattern recognition on the basis of measured MR data, segmentation of measured MR data, edge contour detection on the basis of measured MR data, for enhancing measured MR data in terms of signal-to-noise ratio by means of noise filtering or apodization, for enhancing measured MR data in terms of resolution by means for deblurring, windowing, zero filling, or generation of gray-scaled images, colour-coded images or images displaying vectors instead of pixels
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10072Tomographic images
    • G06T2207/10088Magnetic resonance imaging [MRI]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20081Training; Learning
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20084Artificial neural networks [ANN]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30004Biomedical image processing
    • G06T2207/30016Brain

Definitions

  • This application generally relates to analysis of functional MRI scans, and more particularly, to detection of bio-markers in functional MRI scans using artificial intelligence-based models.
  • Magnetic Resonance Imaging (MRI) scans of patient brains are widely used.
  • Conventional MRI systems can detect a variety of conditions of the brain such as cysts, tumors, bleeding, swelhng, developmental and structural abnormalities, infections, inflammatory conditions, or problems with the blood vessels.
  • the MRI can determine if a shunt is working and detect damage to the brain caused by an injury or a stroke.
  • a brain scan might be used to rule out other medical illnesses, such as a tumor, that could cause symptoms similar to a mental disorder, such as depression.
  • MRI scans of a brain cannot be used to diagnose a mental disorder, such as autism, anxiety, depression, schizophrenia, or bipolar disorder.
  • Functional magnetic resonance imaging or functional MRI measures brain activity by detecting changes associated with blood oxygen consumption. This technique relies on the fact that cerebral blood oxygen consumption and neuronal activation are coupled. When an area of the brain is in use, blood oxygen consumption to that region also increases.
  • conventional fMRI cannot be used for a reliable detection of mental disorders.
  • An aspect of some embodiments of the present invention relates to a system, comprising a processor of a diagnostics server node and a memory.
  • the processor of a diagnostics server node is connected to an image processor of a functional MRI (fMRI) system and to a first computerized system and to a second computerized system.
  • fMRI functional MRI
  • the memory is configured to store machine readable instructions that when executed by the processor, cause the processor to: (i) provide a fMRI image of a brain taken over a period of time, the fMRI image comprising m volumetric slices of the brain imaged at respective time steps in the period of time, each slice having same thickness and being subdivided into a plurality of voxels; (ii) generate a matrix representative of the fMRI image according to a matrix generation method obtained via a first training, the matrix having m rows and n columns, and having elements f,, with 1 ⁇ i ⁇ m and 1 ⁇ j ⁇ n, wherein each element f,, is indicative of blood oxygen levels of a jth set of voxels of an ith volumetric slice of the fMRI image; and (iii) use the matrix to obtain a set of first probabilities according to a deduction method obtained via a second training, each first probability being indicative of a correlation level between a corresponding mental condition in a h
  • the instructions further cause the processor to: (iv) for each volumetric slice identify in the fMRI image a first set of N voxels having highest blood oxygen level and a second set of N voxels having lowest blood oxygen level, thereby obtain 2m sets of N voxels, where each voxel of the first set and of the second set corresponds to a respective unique region of the brain; (v) use the 2m sets of N voxels to identify 2mN unique regions consisting of mN first unique regions in the brain with highest blood oxygen level and mN second unique regions in the brain with lowest blood oxygen level; (vi) compare the 2mN unique regions to a predetermined atlas which correlates the predetermined mental conditions to groups of brain regions with highest blood oxygen level and with lowest blood oxygen level, in order to yield a set of second probabilities, each second probability being indicative of a similarity between a respective group of brain regions of the predetermined atlas corresponding to a respective mental condition in the list and the m
  • the atlas may be a Talairach atlas.
  • each average is a geometric average of the respective first probability associated with the respective mental condition and the respective second probability associated with the respective mental condition.
  • the instructions further cause the processor to, prior to step (i): (a) train the first computerized system to generate the matrix representative of the fMRI image, by using a set of input fMRI images, according to the first training; and (b) train the second computerized system to use the matrix to obtain the set of first probabilities, according to the second training.
  • the first training comprises: (al) providing the set of input fMRI images, each input fMRI image taken over a respective period of time, each input fMRI image comprising respective m first volumetric slices of the brain imaged at respective timesteps in the period of time, each first volumetric slice having same thickness and being subdivided into a plurality of first voxels, and each first voxel having a respective first location and a respective first blood oxygen level value; (a2) for each of the input fMRI images, instructing the first computerized system to generate a respective matrix having m rows and n columns according to predetermined first guidelines, the matrix having elements f,, with 1 ⁇ i ⁇ m and 1 ⁇ j ⁇ n, wherein each element f,, is indicative of blood oxygen levels of a jth set of voxels of an ith volumetric shoe of the input fMRI image; (a3) using each matrix to infer an output representation of the respective input fMRI images, each input fMRI image taken over
  • the error value is a mean absolute percentage error (MAPE), where where z is a total number of voxels in the set of input fMRI images, F k is the inferred blood oxygen level value of a second voxel k, and A k is the first blood oxygen level value of a first voxel corresponding to the second voxel k.
  • MEP mean absolute percentage error
  • the second training comprises: (bl) after the first training is complete, receiving at least a subset of the set of matrices corresponding to input fMRI images of brains of patients that are known to have one or more of the predetermined mental conditions; (b2) instructing the second computerized system to use the matrices in the subset to predict whether each matrix corresponds to any of the one or more of the predetermined mental conditions, via second guidelines; (b3) calculating an accuracy value for the subset, by comparing predictions generated at (b2) to the known conditions corresponding to each matrix in the subset; (b4) if the accuracy value is lower than a second predetermined threshold, reporting the accuracy value to the second computerized system and instructing the second computerized system to repeat steps (b2) and (b3) to increase the accuracy value by altering one or more parameters of the second guidelines, until the accuracy value is greater than or equal to the second predetermined threshold; and (b5) if the accuracy value is greater than or equal to second predetermined threshold, ending training
  • the accuracy value is .
  • tp is a number of correct predictions
  • fp is a number of false positive predictions
  • fn is a number of false negative predictions.
  • Another aspect of some embodiments of the present invention relates to a method for detection of mental condition based on functional MRI scans, the method comprising: (i) receiving, by a diagnostics server, a fMRI image of a brain taken over a period of time, the fMRI image comprising m volumetric shoes of the brain imaged at respective time steps in the period of time, each slice having same thickness and being subdivided into a plurality of voxels; (ii) generating, by the diagnostics server, a matrix representative of the fMRI image according to a matrix generation method obtained via a first training, the matrix having m rows and n columns, and having elements f,, with 1 ⁇ i ⁇ m and 1 ⁇ j ⁇ n, wherein each element f,, is indicative of blood oxygen levels of a jth set of voxels of an ith volumetric slice of the fMRI image; and (iii) using, by the diagnostics server, the matrix to obtain a set
  • the method further comprises: (iv) for each volumetric slice identifying in the fMRI image a first set of N voxels having highest blood oxygen level and a second set of N voxels having lowest blood oxygen level, thereby obtaining 2m sets of N voxels, where each voxel of the first set and of the second set corresponds to a respective unique region of the brain; (v) using the 2m sets of N voxels to identify 2mN unique regions consisting of mN first unique regions in the brain with highest blood oxygen level and mN second unique regions in the brain with lowest blood oxygen level; (vi) comparing the 2mN unique regions to a predetermined atlas which correlates the predetermined mental conditions to groups of brain regions with highest blood oxygen level and with lowest blood oxygen level, in order to yield a set of second probabilities, each second probability being indicative of a similarity between a respective group of brain regions of the predetermined atlas corresponding to a respective mental condition in the list and the mN
  • the method further comprises, prior to step (i): (a) training a first computerized system to generate the matrix representative of the fMRI image, by using a set of input fMRI images, according to the first training; and (b) training a second computerized system to use the matrix to obtain the set of first probabilities, according to the second training.
  • the first training comprises: (al) providing the set of input fMRI images, each input fMRI image taken over a respective period of time, each input fMRI image comprising respective m first volumetric slices of the brain imaged at respective timesteps in the period of time, each first volumetric slice having same thickness and being subdivided into a plurality of first voxels, and each first voxel having a respective first location and a respective first blood oxygen level value; (a2) for each of the input fMRI images, instruct the first computerized system to generating a respective matrix having m rows and n columns according to predetermined first guidelines, the matrix having elements f,, with 1 ⁇ i ⁇ m and 1 ⁇ j ⁇ n, wherein each element f,, is indicative of blood oxygen levels of a jth set of voxels of an ith volumetric slice of the input fMRI image; (a3) using each matrix to infer an output representation of the respective input fMRI image,
  • the second training comprises: (bl) after the first training is complete, receiving at least a subset of the set of matrices corresponding to input fMRI images of brains of patients that are known to have one or more of the predetermined mental conditions; (b2) instructing the second computerized system to use the matrices in the subset to predict whether each matrix corresponds to any of the one or more of the predetermined mental conditions, via second guidelines; (b3) calculating an accuracy value for the subset, by comparing predictions generated at (b2) to the known conditions corresponding to each matrix in the subset; (b4) if the accuracy value is lower than a second predetermined threshold, reporting computerized system to repeat steps (b2) and (b3) to increase the accuracy value by altering one or more parameters of the second guidelines, until the accuracy value is greater than or equal to the second predetermined threshold; and (b5) if the accuracy value is greater than or equal to second predetermined threshold, ending training.
  • Yet another aspect of some embodiments of the present invention relates to a non-transitory computer readable medium comprising instructions, that when read by a processor, cause the processor to perform: (i) providing a fMRI image of a brain taken over a period of time, the fMRI image comprising m volumetric shoes of the brain imaged at respective time steps in the period of time, each slice having same thickness and being subdivided into a plurality of voxels; (ii) generating a matrix representative of the fMRI image according to a matrix generation method obtained via a first training, the matrix having m rows and n columns, and having elements f,, with 1 ⁇ i ⁇ m and 1 ⁇ j ⁇ n, wherein each element f,, is indicative of blood oxygen levels of a jth set of voxels of an ith volumetric slice of the fMRI image; and (in) using the matrix to obtain a set of first probabilities according to a deduction method obtained via a second training
  • the non-transitory computer readable medium further comprises instructions, that when read by the processor, cause the processor to: (iv) for each volumetric slice identify in the fMRI image a first set of N voxels having highest blood oxygen level and a second set of N voxels having lowest blood oxygen level, thereby obtain 2m sets of N voxels, where each voxel of the first set and of the second set corresponds to a respective unique region of the brain; (v) use the 2m sets of N voxels to identify 2mN unique regions consisting of mN first unique regions in the brain with highest blood oxygen level and mN second unique regions in the brain with lowest blood oxygen level; (vi) compare the 2mN unique regions to a predetermined atlas which correlates the predetermined mental conditions to groups of brain regions with highest blood oxygen level and with lowest blood oxygen level, in order to yield a set of second probabilities, each second probability being indicative of a similarity between a respective group of brain regions of the predetermined
  • the non-transitory computer readable medium further comprises instructions, that when read by the processor, cause the processor to: (a) train a first model to generate the matrix representative of the fMRI image, by using a set of input fMRI images, according to the first training; and (b) train a second model to use the matrix to obtain the set of first probabihties, according to the second training.
  • training of the first model comprises: (al) providing the set of input fMRI images, each input fMRI image taken over a respective period of time, each input fMRI image comprising respective m first volumetric slices of the brain imaged at respective timesteps in the period of time, each first volumetric slice having same thickness and being subdivided into a plurality of first voxels, and each first voxel having a respective first location and a respective first blood oxygen level value; (a2) for each of the input fMRI images, instruct the first computerized system to generating a respective matrix having m rows and n columns according to predetermined first guidelines, the matrix having elements f,, with 1 ⁇ i ⁇ m and 1 ⁇ j ⁇ n, wherein each element f,, is indicative of blood oxygen levels of a jth set of voxels of an ith volumetric slice of the input fMRI image; (a3) using each matrix to infer an output representation of the respective input fMRI
  • the non-transitory computer readable medium further comprises instructions, that when read by the processor, cause the processor to calculate the error value as a mean absolute percentage error (MAPE), z is a total number of voxels in the set of input fMRI images, F k is the inferred blood oxygen level value of a second voxel k, and A k is the first blood oxygen level value of a first voxel corresponding to the second voxel k.
  • MME mean absolute percentage error
  • training of the second model comprises: (bl) after the training of the first model is complete, receiving at least a subset of the set of matrices corresponding to input fMRI images of brains of patients that are known to have one or more of the predetermined mental conditions; (b2) instructing the second model to use the matrices in the subset to predict whether each matrix corresponds to any of the one or more of the predetermined mental conditions, via second guidelines; (b3) calculating an accuracy value for the subset, by comparing predictions generated at (b2) to the known conditions corresponding to each matrix in the subset; (b4) if the accuracy value is lower than a second predetermined threshold, repeating steps (b2) and (b3) to increase the accuracy value by altering one or more parameters of the second guidelines, until the accuracy value is greater than or equal to the second predetermined threshold; and (b5) if the accuracy value is greater than or equal to second predetermined threshold, ending the training of the second model, wherein the accuracy value is tp is a number
  • FIG. 1A illustrates a network diagram of a system including an AI module and a model database, according to example embodiments.
  • FIG. IB illustrates a network diagram of a system including detailed features of a diagnostics server node, according to example embodiments.
  • FIG. 2 illustrates how fMRI system uses scanned layers, according to example embodiments.
  • FIG. 3 illustrates fMRI image processing for detection of mental conditions, according to example embodiments.
  • FIG. 4 illustrates a diagram of application of feature/step matrixes for detection of mental conditions, according to example embodiments.
  • FIG. 5A illustrates a flow diagram of a method, according to example embodiments.
  • FIG. 5B illustrates a further flow diagram of a method, according to example embodiments.
  • FIG. 5C illustrates a flow diagram of an example model training method, according to example embodiments.
  • FIG. 6 illustrates an example server system that supports one or more of the example embodiments.
  • messages may have been used in the description of embodiments, the application may be apphed to many types of network data, such as, packet, frame, datagram, etc.
  • the term “message” also includes packet, frame, datagram, and any equivalents thereof.
  • certain types of messages and signaling may be depicted in exemplary embodiments they are not limited to a certain type of message, and the application is not limited to a certain type of signaling.
  • Example embodiments provide methods, systems, components, non-transitory computer readable media, devices, and/or networks, which provide for diagnosis of mental disorders based on bio-markers in fMRI scans using artificial intelligence-based models.
  • the exemplary embodiment may use Deep Learning models for detetcion of bio-markers through the analysis of fMRI scans, demographic and psychometric data.
  • an artificial intelligence (AI) machine learning systems may be employed for detection of biomarkers associated with mental conditions in fMRI scans of a brain.
  • Machine learning relies on vast quantities of historical data (or training data) to build predictive models for accurate prediction on new diagnosis-related data.
  • Machine learning software may sift through millions of records to unearth non-intuitive patterns.
  • a diagnostics platform may build and deploy a machine learning model for predictive monitoring and detection of mental conditions based on fMRI data.
  • the diagnostics platform may be a cloud platform, a server, a web server, a personal computer, a user device attached to the fMRI system, and the like.
  • a neural network or blockchain may be used to improve both a training process of the machine learning model and a predictive process based on a trained machine learning models. For example, rather than requiring a data scientist or a doctor or other user to collect the data, historical data may be stored on neural network or on the blockchain. This can significantly reduce the collection time needed by the diagnostics platform when performing predictive model training.
  • a U-Net 4D model may be used. This model works with sparse tensors which means that only coordinates and values of each voxel of the fMRI shoe that are different from zero are used as an input to the neural network.
  • the neural network can receive, as input, files of different sizes, without the need to do previous resampling.
  • the only pre-processing may be the normalization of voxels to zero mean and standard deviation one.
  • each file can be different from one iteration to another, the training must be done with only one sample per iteration. This makes the time to train each epoch to be about 48 hours. After almost 30 days of training, the network is able to represent any brain with a “fingerprint” matrix from 4D nifti file with only 9.6% of Mean Absolute Percentage Error (MAPE) in test data.
  • MPE Mean Absolute Percentage Error
  • fMRI scans for a given patient may be classified.
  • a Siamese LSTM network may be trained with the output of the U-Net from previous stage. In this stage, the extracted scan features and demographic or psychometric data may be used in the final model.
  • the exemplary embodiments provide for a specific solution to a problem in the arts/field of fMRI-based diagnostics.
  • a method, system and a computer readable medium for detection of bio-markers in fMRI scans using artificial intelligence -based models are provided.
  • FIG. 1A illustrates a network diagram 100 of a system including an AI module and a model database, according to example embodiments.
  • a diagnostics server 120 may be to a fMRI system 110 over a network.
  • the diagnostics server 120 may be connected to remote users (such as doctors) 118 over a network.
  • the diagnostics server 120 may be connected to AI machine learning systems 106.
  • the diagnostics server 120 may provide training data from a data source 130 to train models 108 of the AI machine learning systems 106.
  • fMRI scans acquired from the fMRI system 110 for a given patient may be classified.
  • a Siamese LSTM network residing on the AI machine learning systems 106 may be trained with the output of the data source 130 (e.g., U-Net).
  • the extracted scan features and demographic or psychometric data may be used in the final model 108 of the AI machine learning systems 106.
  • the diagnostics server 120 may execute the following algorithm:
  • F be the set of fMRI scans of the OpenNeuro database
  • G be the subset of brain representations of a particular study
  • T the set of centroids of all diagnosis
  • FIG. IB illustrates a network diagram 101 of a system including detailed features of an ad processing server node, according to example embodiments.
  • the example network 101 includes the diagnostics server 120 connected to the fMRI system 110 over a network.
  • the diagnostics server 120 may be connected to remote users (such as doctors) 118 over a network.
  • the diagnostics server 120 may be connected to AI machine learning systems 106.
  • the diagnostics server 120 may provide training data to train models of the AI machine learning systems 106.
  • the diagnostics server 120 may be a computing device or a server computer, or the like, and may include a processor 104, which may be a semiconductor-based microprocessor, a central processing unit (CPU), an application specific integrated circuit (ASIC), a field-programmable gate array (FPGA), and/or another hardware device. Although a single processor 104 is depicted, it should be understood that the diagnostics server 120 may include multiple processors, multiple cores, or the like, without departing from the scope of the diagnostics server 120 system.
  • the diagnostics server 120 may also include a non-transitory computer readable medium 112 that may have stored thereon machine-readable instructions executable by the processor 104. Examples of the machine- readable instructions are shown as 114-117 and are iurther discussed below. Examples of the non-transitory computer readable medium 112 may include an electronic, magnetic, optical, or other physical storage device that contains or stores executable instructions. For example, the non-transitory computer readable medium 112 may be a Random Access memory (RAM), an Electrically Erasable Programmable Read-Only Memory (EEPROM), a hard disk, an optical disc, or other type of storage device.
  • RAM Random Access memory
  • EEPROM Electrically Erasable Programmable Read-Only Memory
  • the processor 104 may fetch, decode, and execute the machine-readable instructions 114 to receive a fMRI image of a brain taken over a period of time, the fMRI image comprising m volumetric slices of the brain imaged at respective timesteps in the period of time, each slice having same thickness and being subdivided into a plurality of voxels.
  • the processor 104 may fetch, decode, and execute the machine-readable instructions 116 to generate a matrix representative of the fMRI image according to a matrix generation method obtained via a first training, the matrix having m rows and n columns, and having elements f,, with 1 ⁇ i ⁇ m and 1 ⁇ j ⁇ n, wherein each element f,, is indicative of blood oxygen levels of a jth set of voxels of an ith volumetric slice of the fMRI image.
  • the f is based on a concept of sparse convolutions in 4D volumes.
  • the second AI may receive a point cloud formed by positive voxel values and may transform that volume into a lower dimensional representation using the frozen model of the first AI system.
  • the processor 104 may fetch, decode, and execute the machine-readable instructions 117 to use the matrix to obtain a set of first probabilities according to a deduction method obtained via a second training, each first probability being indicative of a correlation level between a corresponding mental condition in the list and the matrix.
  • the diagnostics server 120 may perform comparison of the matrix representative of the fMRI image with a plurality of matrices obtained in second training each of these matrices being representative of a respective condition. Therefore, the probability of the patient having schizophrenia, for example, is indicative of how closely the matrix generated by instructions 116 matches a matrix representative of schizophrenia that was obtained during the second training that is discussed in more details below.
  • the probabilities for each unknown mental condition are calculated by taking all input matrices and treating them as multiple time series of m steps and n features.
  • the second AI model learns to associate each matrix to the ground truth given by a specific study. It is a model that uses recurrent layers to transform a sequence of features into a unique feature that is the probability.
  • FIG. 2 illustrates how fMRI system uses scanned layers, according to example embodiments.
  • the fMRI system scans the patient’s brain using scan cross sections of equal height 220 to produce slices.
  • the slices 220 have the same thickness and volume of the same number voxels 200.
  • FIG. 3 illustrates fMRI image processing for detection of mental conditions, according to example embodiments.
  • the input fMRI image 310 may consist of m slices.
  • a feature matrix 320 representation of the image 310 is created.
  • the matrix 320 includes a vector representing all features (1 to n) of the same timestep.
  • Each feature of the matrix 320 is indicative of blood oxygen levels of a jth set of voxels of an ith volumetric slice of the fMRI image.
  • the exemplary matrix 320 may include 256 features/voxels recorded over 1024 timesteps.
  • a feature image 320 may be generated based on the matrix 330. Then, the feature image 320 may be compared against each of the m slices 310’ voxel by voxel.
  • the correlation level may indicate a mental condition as discussed in more details herein.
  • the error value of comparison may be calculates as a mean absolute percentage
  • the first predetermined threshold may be set at 9.6%.
  • FIG. 4 illustrates a diagram of application of feature/step matrixes for detection of mental conditions, according to example embodiments.
  • the feature/step matrixes 410 may be used for detection of mental conditions 420. Determination of each of the conditions 420 may produce true positive, false positive and false negative values based on accuracy. The accuracy of the determination may be calculated as:
  • the accuracy value is , tp is a number of true positive predictions, fp is a number of false positive predictions, and fn is a number of false negative predictions.
  • FIG. 5 A illustrates a flow diagram 500 of an example method for detection of mental condition based on functional MRI scans, according to example embodiments.
  • the method 500 may include one or more of the steps described below.
  • FIG. 5A illustrates a flow chart of an example method executed by the diagnostics server 120 (see FIG. IB). It should be understood that method 500 depicted in FIG. 5A may include additional operations and that some of the operations described therein may be removed and/or modified without departing from the scope of the method 500. The description of the method 500 is also made with reference to the features depicted in FIG. IB for purposes of illustration. Particularly, the processor 104 of the diagnostics server 120 may execute some or all of the operations included in the method 500.
  • the processor 104 may receive a fMRI image of a brain taken over a period of time, the fMRI image comprising m volumetric slices of the brain imaged at respective timesteps in the period of time, each shoe having same thickness and being subdivided into a plurality of voxels.
  • the processor 104 may generate a matrix representative of the fMRI image according to a matrix generation method obtained via a first training, the matrix having m rows and n columns, and having elements f,, with 1 ⁇ i ⁇ m and 1 ⁇ j ⁇ n, wherein each element f, is indicative of blood oxygen levels of a jth set of voxels of an ith volumetric slice of the fMRI image.
  • the processor 104 may use the matrix to deduce a set of first probabilities according to a deduction method obtained via a second training, each first probability being indicative of a correlation level between a corresponding mental condition in the hst and the matrix.
  • FIG. 5B illustrates a flow diagram 550 of an example method, according to example embodiments.
  • the method 550 may also include one or more of the following steps.
  • the processor 104 may for each volumetric slice identifying in the fMRI image a first set of N voxels having highest blood oxygen level and a second set of N voxels having lowest blood oxygen level, obtain 2m sets of N voxels, where each voxel of the first set and of the second set corresponds to a respective unique region of the brain.
  • the processor 104 may use the 2m sets of N voxels to identify 2mN unique regions consisting of mN first unique regions in the brain with highest blood oxygen level and mN second unique regions in the brain with lowest blood oxygen level.
  • the processor 104 may compare the 2mN unique regions to a predetermined atlas which correlates the predetermined mental conditions to groups of brain regions with highest blood oxygen level and with lowest blood oxygen level, in order to yield a set of second probabihties, each second probability being indicative of a similarity between a respective group of brain regions of the predetermined atlas corresponding to a respective mental condition in the list and the mN first unique regions with highest blood oxygen level and the mN second unique regions with lowest blood oxygen level in the fMRI image.
  • the processor 104 may calculate a set of averages, each average being associated with a respective mental condition in the list, each average being an average of a respective first probability associated with the respective mental condition and a respective second probability associated with the respective mental condition.
  • the atlas may be a Talairach atlas and N may equal 11.
  • each average may be a geometric average of the respective first probability associated with the respective mental condition and the respective second probability associated with the respective mental condition.
  • FIG. 5C illustrates a flow diagram 560 of an example method, according to example embodiments.
  • the method 560 may also include one or more of the following steps.
  • the processor 104 may train a first computerized system to generate the matrix representative of the fMRI image, by using a set of input fMRI images, according to the first training.
  • the processor 104 may train a second computerized system to use the matrix to deduce the set of first probabihties, according to the second training.
  • the training of the first computerized system may execute the following steps:
  • each input fMRI image taken over a respective period of time, each input fMRI image comprising respective m first volumetric shoes of the brain imaged at respective timesteps in the period of time, each first volumetric shoe having same thickness and being subdivided into a plurality of first voxels, and each first voxel having a respective first location and a respective first blood oxygen level value;
  • each output representation having m second volumetric shoes which correspond to the respective m first volumetric shoes, wherein each second volumetric slice is subdivided into a plurality of second voxels corresponding to the plurality of first voxels of the input fMRI image, each second voxel having a respective second location equal to the first location of the corresponding first voxel and a respective inferred blood oxygen level value;
  • the error value may be calculates as a mean absolute percentage error (MAPE), where where z is a total number of voxels in the set of input fMRI images, F k is the inferred blood oxygen level value of a second voxel k, and A k is the first blood oxygen level value of a first voxel corresponding to the second voxel k.
  • the first predetermined threshold may be set at 9.6%.
  • the training of the second computerized system may execute the following steps: [0098] (bl) after the first training is complete, receiving at least a subset of the set of matrices corresponding to input fMRI images of brains of patients that are known to have one or more of the predetermined mental conditions;
  • the accuracy value may be calculated as y j a number of t predictions, fp is a number of false positive predictions, and fn is a number of false negative predictions.
  • the second predetermined threshold may be set at 90%.
  • a set of 1024 x 256 matrices is generated, in which each matrix is representative of a respective patient’s known mental condition and another set of matrices to test the generalization capability to unknown mental conditions.
  • a computer program may be embodied on a computer readable medium, such as a storage medium.
  • a computer program may reside in random access memory (“RAM”), flash memory, read-only memory (“ROM”), erasable programmable read-only memory (“EPROM”), electrically erasable programmable read-only memory (“EEPROM”), registers, hard disk, a removable disk, a compact disk read-only memory (“CD-ROM”), or any other form of storage medium known in the art.
  • RAM random access memory
  • ROM read-only memory
  • EPROM erasable programmable read-only memory
  • EEPROM electrically erasable programmable read-only memory
  • registers hard disk, a removable disk, a compact disk read-only memory (“CD-ROM”), or any other form of storage medium known in the art.
  • An exemplary storage medium may be coupled to the processor such that the processor may read information from, and write information to, the storage medium.
  • the storage medium may be integral to the processor.
  • the processor and the storage medium may reside in an application specific integrated circuit (“ASIC”).
  • ASIC application specific integrated circuit
  • the processor and the storage medium may reside as discrete components.
  • FIG. 6 illustrates an example computer system/server node 600, which may represent or be integrated in any of the above-described components, etc.
  • FIG. 6 is not intended to suggest any limitation as to the scope of use or functionality of embodiments of the application described herein. Regardless, the computing node 600 is capable of being implemented and/or performing any of the functionality set forth hereinabove.
  • a computer system/server 602 which is operational with numerous other general purposes or special purpose computing system environments or configurations.
  • Examples of well-known computing systems, environments, and/or configurations that may be suitable for use with computer system/server 602 include, but are not limited to, personal computer systems, server computer systems, thin clients, thick clients, hand-held or laptop devices, multiprocessor systems, microprocessor-based systems, set top boxes, programmable consumer electronics, network PCs, minicomputer systems, mainframe computer systems, and distributed cloud computing environments that include any of the above systems or devices, and the like.
  • Computer system/server 602 may be described in the general context of computer system-executable instructions, such as program modules, being executed by a computer system.
  • program modules may include routines, programs, objects, components, logic, data structures, and so on that perform particular tasks or implement particular abstract data types.
  • Computer system/server 602 may be practiced in distributed cloud computing environments where tasks are performed by remote processing devices that are linked through a communications network.
  • program modules may be located in both local and remote computer system storage media including memory storage devices.
  • the computer system/server 602 may be used in cloud computing node 600 shown in the form of a general-purpose computing device.
  • the components of the computer system/server 602 may include, but are not limited to, one or more processors or processing units 604, a system memory 606, and a bus that couples various system components including system memory 606 to processor 604.
  • the bus represents one or more of any of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, and a processor or local bus using any of a variety of bus architectures.
  • bus architectures include Industry Standard Architecture (ISA) bus, Micro Channel Architecture (MCA) bus, Enhanced ISA (EISA) bus, Video Electronics Standards Association (VESA) local bus, and Peripheral Component Interconnects (PCI) bus.
  • the exemplary computer system/server 602 typically includes a variety of computer system readable media. Such media may be any available media that is accessible by the computer system/server 602, and it includes both volatile and non-volatile media, removable and non-removable media.
  • the system memory 606 can include computer system readable media in the form of volatile memory, such as random-access memory (RAM) 610 and/or cache memory 612.
  • RAM random-access memory
  • the computer system/server 602 may further include other removable/non-removable, volatile/nonvolatile computer system storage media.
  • storage system 614 can be provided for reading from and writing to a non-removable, non-volatile magnetic media (not shown and typically called a “hard drive”).
  • a magnetic disk drive for reading from and writing to a removable, nonvolatile magnetic disk
  • an optical disk drive for reading from or writing to a removable, non-volatile optical disk such as a CD-ROM, DVD-ROM or other optical media
  • each can be connected to the bus by one or more data media interfaces.
  • memory 606 may include at least one program product having a set (e.g., at least one) of program modules that are configured to carry out the functions of various embodiments of the application.
  • Program/utility 616 having a set (at least one) of program modules 618, may be stored in memory 606 by way of example, and not limitation, as well as an operating system, one or more application programs, other program modules, and program data. Each of the operating system, one or more application programs, other program modules, and program data or some combination thereof, may include an implementation of a networking environment.
  • Program modules 618 generally carry out the functions and/or methodologies of various embodiments of the application as described herein.
  • aspects of the present application may be embodied as a system, method, or computer program product. Accordingly, aspects of the present application may take the form of an entirely hardware embodiment, an entirely software embodiment (including firmware, resident software, micro-code, etc.) or an embodiment combining software and hardware aspects that may all generally be referred to herein as a “circuit,” “module” or “system.” Furthermore, aspects of the present application may take the form of a computer program product embodied in one or more computer readable medium(s) having computer readable program code embodied thereon.
  • the computer system/server 602 may also communicate with one or more external devices 620 such as a keyboard, a pointing device, a display 622, etc.; one or more devices that enable a user to interact with computer system/server 602; and or any devices (e.g., network card, modem, etc.) that enable computer system/server 602 to communicate with one or more other computing devices. Such communication can occur via I/O interfaces 624. Still yet, the computer system/server 602 can communicate with one or more networks such as a local area network (LAN), a general wide area network (WAN), and/or a pubhc network (e.g., the Internet) via network adapter 626.
  • LAN local area network
  • WAN wide area network
  • pubhc network e.g., the Internet
  • network adapter 626 communicates with the other components of computer system/server 602 via a bus. It should be understood that although not shown, other hardware and/or software components could be used in conjunction with computer system/server 602. Examples include, but are not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data archival storage systems, etc.
  • the information sent between various modules can be sent between the modules via at least one of: a data network, the Internet, a voice network, an Internet Protocol network, a wireless device, a wired device and/or via plurality of protocols. Also, the messages sent or received by any of the modules may be sent or received directly and/or via one or more of the other modules.
  • a “system” could be embodied as a personal computer, a server, a console, a personal digital assistant (PDA), a cell phone, a tablet computing device, a Smart phone or any other suitable computing device, or combination of devices.
  • PDA personal digital assistant
  • Presenting the above-described functions as being performed by a “system” is not intended to limit the scope of the present application in any way but is intended to provide one example of many embodiments. Indeed, methods, systems and apparatuses disclosed herein may be implemented in localized and distributed forms consistent with computing technology.
  • modules may be implemented as a hardware circuit comprising custom very large-scale integration (VLSI) circuits or gate arrays, off-the-shelf semiconductors such as logic chips, transistors, or other discrete components.
  • VLSI very large-scale integration
  • a module may also be implemented in programmable hardware devices such as field programmable gate arrays, programmable array logic, programmable logic devices, graphics processing units, or the like.
  • a module may also be at least partially implemented in software for execution by various types of processors.
  • An identified unit of executable code may, for instance, comprise one or more physical or logical blocks of computer instructions that may, for instance, be organized as an object, procedure, or function. Nevertheless, the executables of an identified module need not be physically located together but may comprise disparate instructions stored in different locations which, when joined logically together, comprise the module and achieve the stated purpose for the module.
  • modules may be stored on a computer- readable medium, which may be, for instance, a hard disk drive, flash device, random access memory (RAM), tape, or any other such medium used to store data.
  • a module of executable code could be a single instruction, or many instructions, and may even be distributed over several different code segments, among different programs, and across several memory devices.
  • operational data may be identified and illustrated herein within modules and may be embodied in any suitable form and organized within any suitable type of data structure. The operational data may be collected as a single data set or may be distributed over different locations including over different storage devices, and may exist, at least partially, merely as electronic signals on a system or network.
  • Figs. 30-31 are a schematic drawings illustrating a front view and a side view of an eyewear article 900 of some embodiments of the present invention that enables peripheral vision, in which the slit is divided into a left slit portion and a right slit portion.
  • the eyewear article 900 includes a central panel 902 connecting the middle section of lower visor 904 to the middle section of the upper visor 906.
  • the slit is cut into a left slit portion 906 and a right slit portion 908.
  • the left slit portion 906 extends from the central panel 902 into the left side visor 910.
  • the right slit portion 908 extends from the central panel 902 into the right side visor 912.

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Biomedical Technology (AREA)
  • Public Health (AREA)
  • Neurology (AREA)
  • Biophysics (AREA)
  • Pathology (AREA)
  • Animal Behavior & Ethology (AREA)
  • Surgery (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Veterinary Medicine (AREA)
  • Molecular Biology (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Psychiatry (AREA)
  • Artificial Intelligence (AREA)
  • Physiology (AREA)
  • Psychology (AREA)
  • Neurosurgery (AREA)
  • Radiology & Medical Imaging (AREA)
  • Child & Adolescent Psychology (AREA)
  • Developmental Disabilities (AREA)
  • General Physics & Mathematics (AREA)
  • Hospice & Palliative Care (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • High Energy & Nuclear Physics (AREA)
  • Social Psychology (AREA)
  • Evolutionary Computation (AREA)
  • Fuzzy Systems (AREA)
  • Mathematical Physics (AREA)
  • Educational Technology (AREA)
  • Signal Processing (AREA)
  • Condensed Matter Physics & Semiconductors (AREA)
  • Optics & Photonics (AREA)
  • Quality & Reliability (AREA)
  • Theoretical Computer Science (AREA)
  • Magnetic Resonance Imaging Apparatus (AREA)

Abstract

An example system may include a processor and memory of a diagnostics server, wherein the processor is configured to perform one or more of provide a fMRI image of a brain taken over a period of time; generate a matrix representative of the fMRI image according to a matrix generation method obtained via a first training, the matrix having m rows and n columns, and having elements fij with 1 ≤ i ≤ m and 1 ≤ j ≤ n, wherein each element fij is indicative of blood oxygen levels of a jth set of voxels of an ith volumetric slice of the fMRI image; and use the matrix to obtain a set of first probabilities according to a deduction method obtained via a second training, each first probability being indicative of a correlation level between a corresponding mental condition in a list and the matrix.

Description

Detection of Bio-Markers in Functional MRI Scans
Technical Field
[0001] This application generally relates to analysis of functional MRI scans, and more particularly, to detection of bio-markers in functional MRI scans using artificial intelligence-based models.
Background of the Invention
[0002] Magnetic Resonance Imaging (MRI) scans of patient brains are widely used. Conventional MRI systems can detect a variety of conditions of the brain such as cysts, tumors, bleeding, swelhng, developmental and structural abnormalities, infections, inflammatory conditions, or problems with the blood vessels. The MRI can determine if a shunt is working and detect damage to the brain caused by an injury or a stroke.
[0003] In some cases, a brain scan might be used to rule out other medical illnesses, such as a tumor, that could cause symptoms similar to a mental disorder, such as depression. However, as it comes to mental disorders, MRI scans of a brain cannot be used to diagnose a mental disorder, such as autism, anxiety, depression, schizophrenia, or bipolar disorder. Functional magnetic resonance imaging or functional MRI (fMRI) measures brain activity by detecting changes associated with blood oxygen consumption. This technique relies on the fact that cerebral blood oxygen consumption and neuronal activation are coupled. When an area of the brain is in use, blood oxygen consumption to that region also increases. However, conventional fMRI cannot be used for a reliable detection of mental disorders.
Brief Summary of Embodiments of the Invention
[0004] Accordingly, a system and method for diagnosis of mental disorders based on bio-markers in functional MRI scans using artificial intelligence-based models are desired.
[0005] An aspect of some embodiments of the present invention relates to a system, comprising a processor of a diagnostics server node and a memory. The processor of a diagnostics server node is connected to an image processor of a functional MRI (fMRI) system and to a first computerized system and to a second computerized system. The memory is configured to store machine readable instructions that when executed by the processor, cause the processor to: (i) provide a fMRI image of a brain taken over a period of time, the fMRI image comprising m volumetric slices of the brain imaged at respective time steps in the period of time, each slice having same thickness and being subdivided into a plurality of voxels; (ii) generate a matrix representative of the fMRI image according to a matrix generation method obtained via a first training, the matrix having m rows and n columns, and having elements f,, with 1 < i < m and 1 < j < n, wherein each element f,, is indicative of blood oxygen levels of a jth set of voxels of an ith volumetric slice of the fMRI image; and (iii) use the matrix to obtain a set of first probabilities according to a deduction method obtained via a second training, each first probability being indicative of a correlation level between a corresponding mental condition in a hst and the matrix. [0006] In a variant, the instructions further cause the processor to: (iv) for each volumetric slice identify in the fMRI image a first set of N voxels having highest blood oxygen level and a second set of N voxels having lowest blood oxygen level, thereby obtain 2m sets of N voxels, where each voxel of the first set and of the second set corresponds to a respective unique region of the brain; (v) use the 2m sets of N voxels to identify 2mN unique regions consisting of mN first unique regions in the brain with highest blood oxygen level and mN second unique regions in the brain with lowest blood oxygen level; (vi) compare the 2mN unique regions to a predetermined atlas which correlates the predetermined mental conditions to groups of brain regions with highest blood oxygen level and with lowest blood oxygen level, in order to yield a set of second probabilities, each second probability being indicative of a similarity between a respective group of brain regions of the predetermined atlas corresponding to a respective mental condition in the list and the mN first unique regions with highest blood oxygen level and the mN second unique regions with lowest blood oxygen level in the fMRI image; and (vii) calculate a set of averages, each average being associated with a respective mental condition in the list, each average being an average of a respective first probability associated with the respective mental condition and a respective second probability associated with the respective mental condition.
[0007] The atlas may be a Talairach atlas.
[0008] In another variant, each average is a geometric average of the respective first probability associated with the respective mental condition and the respective second probability associated with the respective mental condition.
[0009] In yet another variant, the instructions further cause the processor to, prior to step (i): (a) train the first computerized system to generate the matrix representative of the fMRI image, by using a set of input fMRI images, according to the first training; and (b) train the second computerized system to use the matrix to obtain the set of first probabilities, according to the second training.
[0010] In some embodiments of the present invention, the first training comprises: (al) providing the set of input fMRI images, each input fMRI image taken over a respective period of time, each input fMRI image comprising respective m first volumetric slices of the brain imaged at respective timesteps in the period of time, each first volumetric slice having same thickness and being subdivided into a plurality of first voxels, and each first voxel having a respective first location and a respective first blood oxygen level value; (a2) for each of the input fMRI images, instructing the first computerized system to generate a respective matrix having m rows and n columns according to predetermined first guidelines, the matrix having elements f,, with 1 < i < m and 1 < j < n, wherein each element f,, is indicative of blood oxygen levels of a jth set of voxels of an ith volumetric shoe of the input fMRI image; (a3) using each matrix to infer an output representation of the respective input fMRI image, each output representation having m second volumetric slices which correspond to the respective m first volumetric slices, wherein each second volumetric slice is subdivided into a plurality of second voxels corresponding to the plurality of first voxels of the input fMRI image, each second voxel having a respective second location equal to the first location of the corresponding first voxel and a respective inferred blood oxygen level value; (a4) calculating an error value by comparing each inferred blood oxygen level value of each second voxel to the first blood oxygen level of the corresponding first voxel; (a5) if the error value is greater than a first predetermined threshold, reporting the error value to the first computerized system and instructing the first computerized system to repeat steps (a2) through (a4) to lower the error value by altering one or more parameters of the first guidelines, until the error value is lower than or equal to the first predetermined threshold; and (a6) if the error value is smaller than or equal to first predetermined threshold, ending training.
[0011] In a variant, the error value is a mean absolute percentage error (MAPE), where
Figure imgf000005_0001
where z is a total number of voxels in the set of input fMRI images, Fk is the inferred blood oxygen level value of a second voxel k, and Ak is the first blood oxygen level value of a first voxel corresponding to the second voxel k.
[0012] In some embodiments of the present invention, the second training comprises: (bl) after the first training is complete, receiving at least a subset of the set of matrices corresponding to input fMRI images of brains of patients that are known to have one or more of the predetermined mental conditions; (b2) instructing the second computerized system to use the matrices in the subset to predict whether each matrix corresponds to any of the one or more of the predetermined mental conditions, via second guidelines; (b3) calculating an accuracy value for the subset, by comparing predictions generated at (b2) to the known conditions corresponding to each matrix in the subset; (b4) if the accuracy value is lower than a second predetermined threshold, reporting the accuracy value to the second computerized system and instructing the second computerized system to repeat steps (b2) and (b3) to increase the accuracy value by altering one or more parameters of the second guidelines, until the accuracy value is greater than or equal to the second predetermined threshold; and (b5) if the accuracy value is greater than or equal to second predetermined threshold, ending training.
[0013] In a variant, the accuracy value is
Figure imgf000005_0002
. tp is a number of correct predictions, fp is a number of false positive predictions, and fn is a number of false negative predictions.
[0014] Another aspect of some embodiments of the present invention relates to a method for detection of mental condition based on functional MRI scans, the method comprising: (i) receiving, by a diagnostics server, a fMRI image of a brain taken over a period of time, the fMRI image comprising m volumetric shoes of the brain imaged at respective time steps in the period of time, each slice having same thickness and being subdivided into a plurality of voxels; (ii) generating, by the diagnostics server, a matrix representative of the fMRI image according to a matrix generation method obtained via a first training, the matrix having m rows and n columns, and having elements f,, with 1 < i < m and 1 < j < n, wherein each element f,, is indicative of blood oxygen levels of a jth set of voxels of an ith volumetric slice of the fMRI image; and (iii) using, by the diagnostics server, the matrix to obtain a set of first probabilities according to a deduction method obtained via a second training, each first probability being indicative of a correlation level between a corresponding mental condition in a hst and the matrix.
[0015] In a variant the method further comprises: (iv) for each volumetric slice identifying in the fMRI image a first set of N voxels having highest blood oxygen level and a second set of N voxels having lowest blood oxygen level, thereby obtaining 2m sets of N voxels, where each voxel of the first set and of the second set corresponds to a respective unique region of the brain; (v) using the 2m sets of N voxels to identify 2mN unique regions consisting of mN first unique regions in the brain with highest blood oxygen level and mN second unique regions in the brain with lowest blood oxygen level; (vi) comparing the 2mN unique regions to a predetermined atlas which correlates the predetermined mental conditions to groups of brain regions with highest blood oxygen level and with lowest blood oxygen level, in order to yield a set of second probabilities, each second probability being indicative of a similarity between a respective group of brain regions of the predetermined atlas corresponding to a respective mental condition in the list and the mN first unique regions with highest blood oxygen level and the mN second unique regions with lowest blood oxygen level in the fMRI image; and (vii) calculating a set of averages, each average being associated with a respective mental condition in the list, each average being an average of a respective first probability associated with the respective mental condition and a respective second probability associated with the respective mental condition.
[0016] In a variant, the method further comprises, prior to step (i): (a) training a first computerized system to generate the matrix representative of the fMRI image, by using a set of input fMRI images, according to the first training; and (b) training a second computerized system to use the matrix to obtain the set of first probabilities, according to the second training.
[0017] In a variant, the first training comprises: (al) providing the set of input fMRI images, each input fMRI image taken over a respective period of time, each input fMRI image comprising respective m first volumetric slices of the brain imaged at respective timesteps in the period of time, each first volumetric slice having same thickness and being subdivided into a plurality of first voxels, and each first voxel having a respective first location and a respective first blood oxygen level value; (a2) for each of the input fMRI images, instruct the first computerized system to generating a respective matrix having m rows and n columns according to predetermined first guidelines, the matrix having elements f,, with 1 < i < m and 1 < j < n, wherein each element f,, is indicative of blood oxygen levels of a jth set of voxels of an ith volumetric slice of the input fMRI image; (a3) using each matrix to infer an output representation of the respective input fMRI image, each output representation having m second volumetric slices which correspond to the respective m first volumetric slices, wherein each second volumetric slice is subdivided into a plurality of second voxels corresponding to the plurality of first voxels of the input fMRI image, each second voxel having a respective second location equal to the first location of the corresponding first voxel and a respective inferred blood oxygen level value; (a4) calculating an error value by comparing each inferred blood oxygen level value of each second voxel to the first blood oxygen level of the corresponding first voxel; (a5) if the error value is greater than a first predetermined threshold, reporting the error value to the first computerized system and instructing the first computerized system to repeat steps (a2) through (a4) to lower the error value by altering one or more parameters of the first guidelines, until the error value is lower than or equal to the first predetermined threshold; and (a6) if the error value is smaller than or equal to first predetermined threshold, ending training.
[0018] In a variant, the second training comprises: (bl) after the first training is complete, receiving at least a subset of the set of matrices corresponding to input fMRI images of brains of patients that are known to have one or more of the predetermined mental conditions; (b2) instructing the second computerized system to use the matrices in the subset to predict whether each matrix corresponds to any of the one or more of the predetermined mental conditions, via second guidelines; (b3) calculating an accuracy value for the subset, by comparing predictions generated at (b2) to the known conditions corresponding to each matrix in the subset; (b4) if the accuracy value is lower than a second predetermined threshold, reporting computerized system to repeat steps (b2) and (b3) to increase the accuracy value by altering one or more parameters of the second guidelines, until the accuracy value is greater than or equal to the second predetermined threshold; and (b5) if the accuracy value is greater than or equal to second predetermined threshold, ending training.
[0019] Yet another aspect of some embodiments of the present invention relates to a non-transitory computer readable medium comprising instructions, that when read by a processor, cause the processor to perform: (i) providing a fMRI image of a brain taken over a period of time, the fMRI image comprising m volumetric shoes of the brain imaged at respective time steps in the period of time, each slice having same thickness and being subdivided into a plurality of voxels; (ii) generating a matrix representative of the fMRI image according to a matrix generation method obtained via a first training, the matrix having m rows and n columns, and having elements f,, with 1 < i < m and 1 < j < n, wherein each element f,, is indicative of blood oxygen levels of a jth set of voxels of an ith volumetric slice of the fMRI image; and (in) using the matrix to obtain a set of first probabilities according to a deduction method obtained via a second training, each first probability being indicative of a correlation level between a corresponding mental condition in a hst and the matrix. \
[0020] In a variant, the non-transitory computer readable medium further comprises instructions, that when read by the processor, cause the processor to: (iv) for each volumetric slice identify in the fMRI image a first set of N voxels having highest blood oxygen level and a second set of N voxels having lowest blood oxygen level, thereby obtain 2m sets of N voxels, where each voxel of the first set and of the second set corresponds to a respective unique region of the brain; (v) use the 2m sets of N voxels to identify 2mN unique regions consisting of mN first unique regions in the brain with highest blood oxygen level and mN second unique regions in the brain with lowest blood oxygen level; (vi) compare the 2mN unique regions to a predetermined atlas which correlates the predetermined mental conditions to groups of brain regions with highest blood oxygen level and with lowest blood oxygen level, in order to yield a set of second probabilities, each second probability being indicative of a similarity between a respective group of brain regions of the predetermined atlas corresponding to a respective mental condition in the hst and the mN first unique regions with highest blood oxygen level and the mN second unique regions with lowest blood oxygen level in the fMRI image; and (vii) calculate a set of averages, each average being associated with a respective mental condition in the list, each average being an average of a respective first probability associated with the respective mental condition and a respective second probability associated with the respective mental condition.
[0021] In some embodiments of the present invention, the non-transitory computer readable medium further comprises instructions, that when read by the processor, cause the processor to: (a) train a first model to generate the matrix representative of the fMRI image, by using a set of input fMRI images, according to the first training; and (b) train a second model to use the matrix to obtain the set of first probabihties, according to the second training.
[0022] In a variant, training of the first model comprises: (al) providing the set of input fMRI images, each input fMRI image taken over a respective period of time, each input fMRI image comprising respective m first volumetric slices of the brain imaged at respective timesteps in the period of time, each first volumetric slice having same thickness and being subdivided into a plurality of first voxels, and each first voxel having a respective first location and a respective first blood oxygen level value; (a2) for each of the input fMRI images, instruct the first computerized system to generating a respective matrix having m rows and n columns according to predetermined first guidelines, the matrix having elements f,, with 1 < i < m and 1 < j < n, wherein each element f,, is indicative of blood oxygen levels of a jth set of voxels of an ith volumetric slice of the input fMRI image; (a3) using each matrix to infer an output representation of the respective input fMRI image, each output representation having m second volumetric shoes which correspond to the respective m first volumetric shoes, wherein each second volumetric slice is subdivided into a plurality of second voxels corresponding to the plurality of first voxels of the input fMRI image, each second voxel having a respective second location equal to the first location of the corresponding first voxel and a respective inferred blood oxygen level value; (a4) calculating an error value by comparing each inferred blood oxygen level value of each second voxel to the first blood oxygen level of the corresponding first voxel; (a5) if the error value is greater than a first predetermined threshold, reporting the error value to the first computerized system and instructing the first computerized system to repeat steps (a2) through (a4) to lower the error value by altering one or more parameters of the first guidelines, until the error value is lower than or equal to the first predetermined threshold; and (a6) if the error value is smaller than or equal to first predetermined threshold, ending the training of the first model.
[0023] In a variant, the non-transitory computer readable medium further comprises instructions, that when read by the processor, cause the processor to calculate the error value as a mean absolute percentage error (MAPE),
Figure imgf000008_0001
z is a total number of voxels in the set of input fMRI images, Fk is the inferred blood oxygen level value of a second voxel k, and Ak is the first blood oxygen level value of a first voxel corresponding to the second voxel k.
[0024] In a variant, training of the second model comprises: (bl) after the training of the first model is complete, receiving at least a subset of the set of matrices corresponding to input fMRI images of brains of patients that are known to have one or more of the predetermined mental conditions; (b2) instructing the second model to use the matrices in the subset to predict whether each matrix corresponds to any of the one or more of the predetermined mental conditions, via second guidelines; (b3) calculating an accuracy value for the subset, by comparing predictions generated at (b2) to the known conditions corresponding to each matrix in the subset; (b4) if the accuracy value is lower than a second predetermined threshold, repeating steps (b2) and (b3) to increase the accuracy value by altering one or more parameters of the second guidelines, until the accuracy value is greater than or equal to the second predetermined threshold; and (b5) if the accuracy value is greater than or equal to second predetermined threshold, ending the training of the second model, wherein the accuracy value is
Figure imgf000009_0001
tp is a number of correct predictions, fp is a number of false positive predictions, and fn is a number of false negative predictions.
Brief Description of the Drawings
[0025] The present invention, in accordance with one or more various embodiments, is described in detail with reference to the following figures. The drawings are provided for purposes of illustration only and merely depict typical or example embodiments of the invention. These drawings are provided to facilitate the reader’s understanding of the invention and shall not be considered limiting of the breadth, scope, or applicability of the invention. It should be noted that for clarity and ease of illustration these drawings are not necessarily made to scale.
[0026] Some of the figures included herein illustrate various embodiments of the invention from different viewing angles. Although the accompanying descriptive text may refer to such views as “top,” “bottom” or “side” views, such references are merely descriptive and do not imply or require that the invention be implemented or used in a particular spatial orientation unless exphcitly stated otherwise.
[0027] FIG. 1A illustrates a network diagram of a system including an AI module and a model database, according to example embodiments.
[0028] FIG. IB illustrates a network diagram of a system including detailed features of a diagnostics server node, according to example embodiments.
[0029] FIG. 2 illustrates how fMRI system uses scanned layers, according to example embodiments.
[0030] FIG. 3 illustrates fMRI image processing for detection of mental conditions, according to example embodiments.
[0031] FIG. 4 illustrates a diagram of application of feature/step matrixes for detection of mental conditions, according to example embodiments.
[0032] FIG. 5A illustrates a flow diagram of a method, according to example embodiments.
[0033] FIG. 5B illustrates a further flow diagram of a method, according to example embodiments.
[0034] FIG. 5C illustrates a flow diagram of an example model training method, according to example embodiments.
[0035] FIG. 6 illustrates an example server system that supports one or more of the example embodiments.
[0036] The figures are not intended to be exhaustive or to limit the invention to the precise form disclosed. It should be understood that the invention can be practiced with modification and alteration, and that the invention be limited only by the claims and the equivalents thereof. Detailed Description of the Embodiments of the Invention
[0037] It will be readily understood that the instant components, as generally described and illustrated in the figures herein, may be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of the embodiments of at least one of a method, apparatus, non-transitory computer readable medium and system, as represented in the attached figures, is not intended to limit the scope of the application as claimed but is merely representative of selected embodiments.
[0038] The instant features, structures, or characteristics as described throughout this specification may be combined in any suitable manner in one or more embodiments. For example, the usage of the phrases “example embodiments”, “some embodiments”, or other similar language, throughout this specification refers to the fact that a particular feature, structure, or characteristic described in connection with the embodiment may be included in at least one embodiment. Thus, appearances of the phrases “example embodiments”, “in some embodiments”, “in other embodiments”, or other similar language, throughout this specification do not necessarily all refer to the same group of embodiments, and the described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.
[0039] In addition, while the term “message” may have been used in the description of embodiments, the application may be apphed to many types of network data, such as, packet, frame, datagram, etc. The term “message” also includes packet, frame, datagram, and any equivalents thereof. Furthermore, while certain types of messages and signaling may be depicted in exemplary embodiments they are not limited to a certain type of message, and the application is not limited to a certain type of signaling.
[0040] Example embodiments provide methods, systems, components, non-transitory computer readable media, devices, and/or networks, which provide for diagnosis of mental disorders based on bio-markers in fMRI scans using artificial intelligence-based models.
[0041] The exemplary embodiment may use Deep Learning models for detetcion of bio-markers through the analysis of fMRI scans, demographic and psychometric data. In one embodiment an artificial intelligence (AI) machine learning systems may be employed for detection of biomarkers associated with mental conditions in fMRI scans of a brain.
[0042] Machine learning relies on vast quantities of historical data (or training data) to build predictive models for accurate prediction on new diagnosis-related data. Machine learning software may sift through millions of records to unearth non-intuitive patterns. In the example embodiment, a diagnostics platform may build and deploy a machine learning model for predictive monitoring and detection of mental conditions based on fMRI data. The diagnostics platform may be a cloud platform, a server, a web server, a personal computer, a user device attached to the fMRI system, and the like. A neural network or blockchain may be used to improve both a training process of the machine learning model and a predictive process based on a trained machine learning models. For example, rather than requiring a data scientist or a doctor or other user to collect the data, historical data may be stored on neural network or on the blockchain. This can significantly reduce the collection time needed by the diagnostics platform when performing predictive model training.
[0043] According to one embodiment, a U-Net 4D model may be used. This model works with sparse tensors which means that only coordinates and values of each voxel of the fMRI shoe that are different from zero are used as an input to the neural network. Thus, the neural network can receive, as input, files of different sizes, without the need to do previous resampling. The only pre-processing may be the normalization of voxels to zero mean and standard deviation one.
[0044] Since the size of each file can be different from one iteration to another, the training must be done with only one sample per iteration. This makes the time to train each epoch to be about 48 hours. After almost 30 days of training, the network is able to represent any brain with a “fingerprint” matrix from 4D nifti file with only 9.6% of Mean Absolute Percentage Error (MAPE) in test data. Once a particular experiment is chosen a feature extraction may be performed. For every file in nifti 4D format, a forward pass to the U-Net is performed and the result may be stored as a numpy array for the next stage. This stage may take around 2 hours per unique diagnosis of a bio-marker.
[0045] Then, fMRI scans for a given patient may be classified. To classify each fMRI scan of a given patient as positive or negative according to the chosen biomarker, a Siamese LSTM network may be trained with the output of the U-Net from previous stage. In this stage, the extracted scan features and demographic or psychometric data may be used in the final model.
[0046] Accordingly, the exemplary embodiments provide for a specific solution to a problem in the arts/field of fMRI-based diagnostics. According to the exemplary embodiments, a method, system and a computer readable medium for detection of bio-markers in fMRI scans using artificial intelligence -based models are provided.
[0047] FIG. 1A illustrates a network diagram 100 of a system including an AI module and a model database, according to example embodiments.
[0048] Referring to FIG. 1A, a diagnostics server 120 may be to a fMRI system 110 over a network. The diagnostics server 120 may be connected to remote users (such as doctors) 118 over a network. In one embodiment, the diagnostics server 120 may be connected to AI machine learning systems 106. The diagnostics server 120 may provide training data from a data source 130 to train models 108 of the AI machine learning systems 106.
[0049] As discussed above, fMRI scans acquired from the fMRI system 110 for a given patient may be classified. To classify each fMRI scan of a given patient as positive or negative according to the chosen biomarker, a Siamese LSTM network residing on the AI machine learning systems 106 may be trained with the output of the data source 130 (e.g., U-Net). In this stage, the extracted scan features and demographic or psychometric data may be used in the final model 108 of the AI machine learning systems 106. [0050] According to the exemplary embodiments, the diagnostics server 120 may execute the following algorithm:
[0051] 1. Let F be the set of fMRI scans of the OpenNeuro database;
[0052] 2. For each x in F, perform f(x) = x using a 4D Sparse U-Net;
[0053] 3. Calculate Mean Absolute Percentage Error (MAPE);
[0054] 4. If MAPE < 10%, then continue, else go to step 2;
[0055] 5. Let M be the representation model of individual brains;
[0056] 6. Let G be the subset of brain representations of a particular study;
[0057] 7. For each y in G, classified as c, perform g(y) = c’ using a LSTM network;
[0058] 8. Calculate Accuracy;
[0059] 9. If Accuracy > 90%, then continue, else, go to step 7;
[0060] 10. Let L be the classification model of a particular study
[0061] 11. For each class c, obtain the centroid of c, calculating the average matrix;
[0062] 12. Let T be the set of centroids of all diagnosis;
[0063] 13. For each x, z in F, perform h(x, z) = 1 if i(x) = i(z), where i is an individual
[0064] , else h(x, z) = 0;
[0065] 14. Calculate Accuracy;
[0066] 15. If Accuracy > 99%, then continue, else go to step 13 ;
[0067] 16. Let r be the fMRI scan performed by an individual;
[0068] 17. Perform g(r) and obtain class c’;
[0069] 18. For each t in T, Perform h(r, t) = v, where t is the centroid of class c’;
[0070] 19. Get the maximum value of v and set the result as class c”;
[0071] FIG. IB illustrates a network diagram 101 of a system including detailed features of an ad processing server node, according to example embodiments. [0072] Referring to FIG. IB, the example network 101 includes the diagnostics server 120 connected to the fMRI system 110 over a network. The diagnostics server 120 may be connected to remote users (such as doctors) 118 over a network. In one embodiment, the diagnostics server 120 may be connected to AI machine learning systems 106. The diagnostics server 120 may provide training data to train models of the AI machine learning systems 106.
[0073] While this example describes in detail only one diagnostics server 120, multiple such nodes may be connected to the fMRI system 110. It should be understood that the diagnostics server 120 may include additional components and that some of the components described herein may be removed and/or modified without departing from a scope of the diagnostics server 120 disclosed herein. The diagnostics server 120 may be a computing device or a server computer, or the like, and may include a processor 104, which may be a semiconductor-based microprocessor, a central processing unit (CPU), an application specific integrated circuit (ASIC), a field-programmable gate array (FPGA), and/or another hardware device. Although a single processor 104 is depicted, it should be understood that the diagnostics server 120 may include multiple processors, multiple cores, or the like, without departing from the scope of the diagnostics server 120 system.
[0074] The diagnostics server 120 may also include a non-transitory computer readable medium 112 that may have stored thereon machine-readable instructions executable by the processor 104. Examples of the machine- readable instructions are shown as 114-117 and are iurther discussed below. Examples of the non-transitory computer readable medium 112 may include an electronic, magnetic, optical, or other physical storage device that contains or stores executable instructions. For example, the non-transitory computer readable medium 112 may be a Random Access memory (RAM), an Electrically Erasable Programmable Read-Only Memory (EEPROM), a hard disk, an optical disc, or other type of storage device.
[0075] The processor 104 may fetch, decode, and execute the machine-readable instructions 114 to receive a fMRI image of a brain taken over a period of time, the fMRI image comprising m volumetric slices of the brain imaged at respective timesteps in the period of time, each slice having same thickness and being subdivided into a plurality of voxels. The processor 104 may fetch, decode, and execute the machine-readable instructions 116 to generate a matrix representative of the fMRI image according to a matrix generation method obtained via a first training, the matrix having m rows and n columns, and having elements f,, with 1 < i < m and 1 < j < n, wherein each element f,, is indicative of blood oxygen levels of a jth set of voxels of an ith volumetric slice of the fMRI image. Note that the f,, is based on a concept of sparse convolutions in 4D volumes. The second AI may receive a point cloud formed by positive voxel values and may transform that volume into a lower dimensional representation using the frozen model of the first AI system.
[0076] The processor 104 may fetch, decode, and execute the machine-readable instructions 117 to use the matrix to obtain a set of first probabilities according to a deduction method obtained via a second training, each first probability being indicative of a correlation level between a corresponding mental condition in the list and the matrix. [0077] According to the exemplary embodiments, the diagnostics server 120 may perform comparison of the matrix representative of the fMRI image with a plurality of matrices obtained in second training each of these matrices being representative of a respective condition. Therefore, the probability of the patient having schizophrenia, for example, is indicative of how closely the matrix generated by instructions 116 matches a matrix representative of schizophrenia that was obtained during the second training that is discussed in more details below.
[0078] Note that the probabilities for each unknown mental condition are calculated by taking all input matrices and treating them as multiple time series of m steps and n features. The second AI model learns to associate each matrix to the ground truth given by a specific study. It is a model that uses recurrent layers to transform a sequence of features into a unique feature that is the probability.
[0079] FIG. 2 illustrates how fMRI system uses scanned layers, according to example embodiments. Referring to FIG. 2, the fMRI system scans the patient’s brain using scan cross sections of equal height 220 to produce slices. The slices 220 have the same thickness and volume of the same number voxels 200.
[0080] FIG. 3 illustrates fMRI image processing for detection of mental conditions, according to example embodiments. The input fMRI image 310 may consist of m slices. A feature matrix 320 representation of the image 310 is created. The matrix 320 includes a vector representing all features (1 to n) of the same timestep. Each feature of the matrix 320 is indicative of blood oxygen levels of a jth set of voxels of an ith volumetric slice of the fMRI image. The exemplary matrix 320 may include 256 features/voxels recorded over 1024 timesteps. A feature image 320 may be generated based on the matrix 330. Then, the feature image 320 may be compared against each of the m slices 310’ voxel by voxel. The correlation level may indicate a mental condition as discussed in more details herein. The error value of comparison may be calculates as a mean absolute percentage
MAFE = -å f =1 error (MAPE), where s *
Figure imgf000014_0001
where z is a total number of voxels in the set of input fMRI images, Fk is the inferred blood oxygen level value of a second voxel k, and Ak is the first blood oxygen level value of a first voxel corresponding to the second voxel k. The first predetermined threshold may be set at 9.6%.
[0081] FIG. 4 illustrates a diagram of application of feature/step matrixes for detection of mental conditions, according to example embodiments. As discussed with reference to FIG. 3, the feature/step matrixes 410 may be used for detection of mental conditions 420. Determination of each of the conditions 420 may produce true positive, false positive and false negative values based on accuracy. The accuracy of the determination may be calculated as:
[0082] the accuracy value is
Figure imgf000014_0002
, tp is a number of true positive predictions, fp is a number of false positive predictions, and fn is a number of false negative predictions.
[0083] FIG. 5 A illustrates a flow diagram 500 of an example method for detection of mental condition based on functional MRI scans, according to example embodiments. Referring to FIG. 5A, the method 500 may include one or more of the steps described below. [0084] FIG. 5A illustrates a flow chart of an example method executed by the diagnostics server 120 (see FIG. IB). It should be understood that method 500 depicted in FIG. 5A may include additional operations and that some of the operations described therein may be removed and/or modified without departing from the scope of the method 500. The description of the method 500 is also made with reference to the features depicted in FIG. IB for purposes of illustration. Particularly, the processor 104 of the diagnostics server 120 may execute some or all of the operations included in the method 500.
[0085] With reference to FIG. 5A, at block 512, the processor 104 may receive a fMRI image of a brain taken over a period of time, the fMRI image comprising m volumetric slices of the brain imaged at respective timesteps in the period of time, each shoe having same thickness and being subdivided into a plurality of voxels. At block 514, the processor 104 may generate a matrix representative of the fMRI image according to a matrix generation method obtained via a first training, the matrix having m rows and n columns, and having elements f,, with 1 < i < m and 1 < j < n, wherein each element f, is indicative of blood oxygen levels of a jth set of voxels of an ith volumetric slice of the fMRI image. At block 516, the processor 104 may use the matrix to deduce a set of first probabilities according to a deduction method obtained via a second training, each first probability being indicative of a correlation level between a corresponding mental condition in the hst and the matrix.
[0086] FIG. 5B illustrates a flow diagram 550 of an example method, according to example embodiments. Referring to FIG. 5B, the method 550 may also include one or more of the following steps. At block 552, the processor 104 may for each volumetric slice identifying in the fMRI image a first set of N voxels having highest blood oxygen level and a second set of N voxels having lowest blood oxygen level, obtain 2m sets of N voxels, where each voxel of the first set and of the second set corresponds to a respective unique region of the brain. At block 554, the processor 104 may use the 2m sets of N voxels to identify 2mN unique regions consisting of mN first unique regions in the brain with highest blood oxygen level and mN second unique regions in the brain with lowest blood oxygen level. At block 556, the processor 104 may compare the 2mN unique regions to a predetermined atlas which correlates the predetermined mental conditions to groups of brain regions with highest blood oxygen level and with lowest blood oxygen level, in order to yield a set of second probabihties, each second probability being indicative of a similarity between a respective group of brain regions of the predetermined atlas corresponding to a respective mental condition in the list and the mN first unique regions with highest blood oxygen level and the mN second unique regions with lowest blood oxygen level in the fMRI image. At block 558, the processor 104 may calculate a set of averages, each average being associated with a respective mental condition in the list, each average being an average of a respective first probability associated with the respective mental condition and a respective second probability associated with the respective mental condition.
[0087] In one exemplary embodiment, the atlas may be a Talairach atlas and N may equal 11. Note that each average may be a geometric average of the respective first probability associated with the respective mental condition and the respective second probability associated with the respective mental condition.
[0088] FIG. 5C illustrates a flow diagram 560 of an example method, according to example embodiments. Referring to FIG. 5C, the method 560 may also include one or more of the following steps. At block 562, the processor 104 may train a first computerized system to generate the matrix representative of the fMRI image, by using a set of input fMRI images, according to the first training. At block 562, the processor 104 may train a second computerized system to use the matrix to deduce the set of first probabihties, according to the second training.
[0089] According to one embodiment, the training of the first computerized system (i.e., a first model) may execute the following steps:
[0090] (al) providing the set of input fMRI images, each input fMRI image taken over a respective period of time, each input fMRI image comprising respective m first volumetric shoes of the brain imaged at respective timesteps in the period of time, each first volumetric shoe having same thickness and being subdivided into a plurality of first voxels, and each first voxel having a respective first location and a respective first blood oxygen level value;
[0091] (a2) for each of the input fMRI images, instructing the first computerized system to generate a respective matrix having m rows and n columns according to predetermined first guidelines, the matrix having elements f,, with 1 < i < m and 1 < j < n, wherein each element f,, is indicative of blood oxygen levels of a jth set of voxels of an ith volumetric slice of the input fMRI image;
[0092] (a3) using each matrix to infer an output representation of the respective input fMRI image, each output representation having m second volumetric shoes which correspond to the respective m first volumetric shoes, wherein each second volumetric slice is subdivided into a plurality of second voxels corresponding to the plurality of first voxels of the input fMRI image, each second voxel having a respective second location equal to the first location of the corresponding first voxel and a respective inferred blood oxygen level value;
[0093] (a4) calculating an error value by comparing each inferred blood oxygen level value of each second voxel to the first blood oxygen level of the corresponding first voxel;
[0094] (a5) if the error value is greater than a first predetermined threshold, reporting the error value to the first computerized system and instructing the first computerized system to repeat steps (a2) through (a4) to lower the error value by altering one or more parameters of the first guidelines, until the error value is lower than or equal to the first predetermined threshold;
[0095] (a6) if the error value is smaller than or equal to first predetermined threshold, ending training.
[0096] Note, that the error value may be calculates as a mean absolute percentage error (MAPE), where
Figure imgf000016_0001
where z is a total number of voxels in the set of input fMRI images, Fk is the inferred blood oxygen level value of a second voxel k, and Ak is the first blood oxygen level value of a first voxel corresponding to the second voxel k. The first predetermined threshold may be set at 9.6%.
[0097] The training of the second computerized system (i.e., a second model) may execute the following steps: [0098] (bl) after the first training is complete, receiving at least a subset of the set of matrices corresponding to input fMRI images of brains of patients that are known to have one or more of the predetermined mental conditions;
[0099] (b2) instructing the second computerized system to use the matrices in the subset to predict whether each matrix corresponds to any of the one or more of the predetermined mental conditions, via second guidehnes;
[00100] (b3) calculating an accuracy value for the subset, by comparing predictions generated at (b2) to the known conditions corresponding to each matrix in the subset;
[00101] (b4) if the accuracy value is lower than a second predetermined threshold, reporting the accuracy value to the second computerized system and instructing the second computerized system to repeat steps (b2) and (b3) to increase the accuracy value by altering one or more parameters of the second guidelines, until the accuracy value is greater than or equal to the second predetermined threshold;
[00102] (b5) if the accuracy value is greater than or equal to second predetermined threshold, ending training.
[00103] Note, that the accuracy value may be calculated as
Figure imgf000017_0001
y j a number of t predictions, fp is a number of false positive predictions, and fn is a number of false negative predictions. The second predetermined threshold may be set at 90%.
[00104] According to one embodiment, during the training of the second AI model to predict conditions from matrices, a set of 1024 x 256 matrices is generated, in which each matrix is representative of a respective patient’s known mental condition and another set of matrices to test the generalization capability to unknown mental conditions.
[00105] The above embodiments may be implemented in hardware, in a computer program executed by a processor, in firmware, or in a combination of the above. A computer program may be embodied on a computer readable medium, such as a storage medium. For example, a computer program may reside in random access memory (“RAM”), flash memory, read-only memory (“ROM”), erasable programmable read-only memory (“EPROM”), electrically erasable programmable read-only memory (“EEPROM”), registers, hard disk, a removable disk, a compact disk read-only memory (“CD-ROM”), or any other form of storage medium known in the art.
[00106] An exemplary storage medium may be coupled to the processor such that the processor may read information from, and write information to, the storage medium. In the alternative, the storage medium may be integral to the processor. The processor and the storage medium may reside in an application specific integrated circuit (“ASIC”). In the alternative, the processor and the storage medium may reside as discrete components. For example, FIG. 6 illustrates an example computer system/server node 600, which may represent or be integrated in any of the above-described components, etc. [00107] FIG. 6 is not intended to suggest any limitation as to the scope of use or functionality of embodiments of the application described herein. Regardless, the computing node 600 is capable of being implemented and/or performing any of the functionality set forth hereinabove.
[00108] In the computing node 600 there is a computer system/server 602, which is operational with numerous other general purposes or special purpose computing system environments or configurations. Examples of well- known computing systems, environments, and/or configurations that may be suitable for use with computer system/server 602 include, but are not limited to, personal computer systems, server computer systems, thin clients, thick clients, hand-held or laptop devices, multiprocessor systems, microprocessor-based systems, set top boxes, programmable consumer electronics, network PCs, minicomputer systems, mainframe computer systems, and distributed cloud computing environments that include any of the above systems or devices, and the like.
[00109] Computer system/server 602 may be described in the general context of computer system-executable instructions, such as program modules, being executed by a computer system. Generally, program modules may include routines, programs, objects, components, logic, data structures, and so on that perform particular tasks or implement particular abstract data types. Computer system/server 602 may be practiced in distributed cloud computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed cloud computing environment, program modules may be located in both local and remote computer system storage media including memory storage devices.
[00110] As shown in FIG. 6, the computer system/server 602 may be used in cloud computing node 600 shown in the form of a general-purpose computing device. The components of the computer system/server 602 may include, but are not limited to, one or more processors or processing units 604, a system memory 606, and a bus that couples various system components including system memory 606 to processor 604.
[00111] The bus represents one or more of any of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, and a processor or local bus using any of a variety of bus architectures. By way of example, and not limitation, such architectures include Industry Standard Architecture (ISA) bus, Micro Channel Architecture (MCA) bus, Enhanced ISA (EISA) bus, Video Electronics Standards Association (VESA) local bus, and Peripheral Component Interconnects (PCI) bus.
[00112] The exemplary computer system/server 602 typically includes a variety of computer system readable media. Such media may be any available media that is accessible by the computer system/server 602, and it includes both volatile and non-volatile media, removable and non-removable media. System memory 606, in one embodiment, implements the flow diagrams of the other figures. The system memory 606 can include computer system readable media in the form of volatile memory, such as random-access memory (RAM) 610 and/or cache memory 612. The computer system/server 602 may further include other removable/non-removable, volatile/nonvolatile computer system storage media. By way of example only, storage system 614 can be provided for reading from and writing to a non-removable, non-volatile magnetic media (not shown and typically called a “hard drive”). Although not shown, a magnetic disk drive for reading from and writing to a removable, nonvolatile magnetic disk, and an optical disk drive for reading from or writing to a removable, non-volatile optical disk such as a CD-ROM, DVD-ROM or other optical media can be provided. In such instances, each can be connected to the bus by one or more data media interfaces. As will be further depicted and described below, memory 606 may include at least one program product having a set (e.g., at least one) of program modules that are configured to carry out the functions of various embodiments of the application.
[00113] Program/utility 616, having a set (at least one) of program modules 618, may be stored in memory 606 by way of example, and not limitation, as well as an operating system, one or more application programs, other program modules, and program data. Each of the operating system, one or more application programs, other program modules, and program data or some combination thereof, may include an implementation of a networking environment. Program modules 618 generally carry out the functions and/or methodologies of various embodiments of the application as described herein.
[00114] As will be appreciated by one skilled in the art, aspects of the present application may be embodied as a system, method, or computer program product. Accordingly, aspects of the present application may take the form of an entirely hardware embodiment, an entirely software embodiment (including firmware, resident software, micro-code, etc.) or an embodiment combining software and hardware aspects that may all generally be referred to herein as a “circuit,” “module” or “system.” Furthermore, aspects of the present application may take the form of a computer program product embodied in one or more computer readable medium(s) having computer readable program code embodied thereon.
[00115] The computer system/server 602 may also communicate with one or more external devices 620 such as a keyboard, a pointing device, a display 622, etc.; one or more devices that enable a user to interact with computer system/server 602; and or any devices (e.g., network card, modem, etc.) that enable computer system/server 602 to communicate with one or more other computing devices. Such communication can occur via I/O interfaces 624. Still yet, the computer system/server 602 can communicate with one or more networks such as a local area network (LAN), a general wide area network (WAN), and/or a pubhc network (e.g., the Internet) via network adapter 626. As depicted, network adapter 626 communicates with the other components of computer system/server 602 via a bus. It should be understood that although not shown, other hardware and/or software components could be used in conjunction with computer system/server 602. Examples include, but are not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data archival storage systems, etc.
[00116] Although an exemplary embodiment of at least one of a system, method, and non-transitory computer readable medium has been illustrated in the accompanied drawings and described in the foregoing detailed description, it will be understood that the application is not limited to the embodiments disclosed, but is capable of numerous rearrangements, modifications, and substitutions as set forth and defined by the following claims. For example, the capabihties of the system of the various figures can be performed by one or more of the modules or components described herein or in a distributed architecture and may include a transmitter, recipient or pair of both. For example, all or part of the functionality performed by the individual modules, may be performed by one or more of these modules. Further, the functionality described herein may be performed at various times and in relation to various events, internal or external to the modules or components. Also, the information sent between various modules can be sent between the modules via at least one of: a data network, the Internet, a voice network, an Internet Protocol network, a wireless device, a wired device and/or via plurality of protocols. Also, the messages sent or received by any of the modules may be sent or received directly and/or via one or more of the other modules.
[00117] One skilled in the art will appreciate that a “system” could be embodied as a personal computer, a server, a console, a personal digital assistant (PDA), a cell phone, a tablet computing device, a Smart phone or any other suitable computing device, or combination of devices. Presenting the above-described functions as being performed by a “system” is not intended to limit the scope of the present application in any way but is intended to provide one example of many embodiments. Indeed, methods, systems and apparatuses disclosed herein may be implemented in localized and distributed forms consistent with computing technology.
[00118] It should be noted that some of the system features described in this specification have been presented as modules, in order to more particularly emphasize their implementation independence. For example, a module may be implemented as a hardware circuit comprising custom very large-scale integration (VLSI) circuits or gate arrays, off-the-shelf semiconductors such as logic chips, transistors, or other discrete components. A module may also be implemented in programmable hardware devices such as field programmable gate arrays, programmable array logic, programmable logic devices, graphics processing units, or the like.
[00119] A module may also be at least partially implemented in software for execution by various types of processors. An identified unit of executable code may, for instance, comprise one or more physical or logical blocks of computer instructions that may, for instance, be organized as an object, procedure, or function. Nevertheless, the executables of an identified module need not be physically located together but may comprise disparate instructions stored in different locations which, when joined logically together, comprise the module and achieve the stated purpose for the module. Further, modules may be stored on a computer- readable medium, which may be, for instance, a hard disk drive, flash device, random access memory (RAM), tape, or any other such medium used to store data.
[00120] Indeed, a module of executable code could be a single instruction, or many instructions, and may even be distributed over several different code segments, among different programs, and across several memory devices. Similarly, operational data may be identified and illustrated herein within modules and may be embodied in any suitable form and organized within any suitable type of data structure. The operational data may be collected as a single data set or may be distributed over different locations including over different storage devices, and may exist, at least partially, merely as electronic signals on a system or network.
[00121] It will be readily understood that the components of the application, as generally described and illustrated in the figures herein, may be arranged and designed in a wide variety of different configurations. Thus, the detailed description of the embodiments is not intended to limit the scope of the application as claimed but is merely representative of selected embodiments of the application. [00122] One having ordinary skill in the art will readily understand that the above may be practiced with steps in a different order, and/or with hardware elements in configurations that are different than those which are disclosed. Therefore, although the application has been described based upon these preferred embodiments, it would be apparent to those of skill in the art that certain modifications, variations, and alternative constructions would be apparent.
[00123] While preferred embodiments of the present application have been described, it is to be understood that the embodiments described are illustrative only and the scope of the application is to be defined solely by the appended claims when considered with a full range of equivalents and modifications (e.g., protocols, hardware devices, software platforms, etc.) thereto.
[00124] Figs. 30-31 are a schematic drawings illustrating a front view and a side view of an eyewear article 900 of some embodiments of the present invention that enables peripheral vision, in which the slit is divided into a left slit portion and a right slit portion. The eyewear article 900 includes a central panel 902 connecting the middle section of lower visor 904 to the middle section of the upper visor 906. Thus, the slit is cut into a left slit portion 906 and a right slit portion 908. The left slit portion 906 extends from the central panel 902 into the left side visor 910. The right slit portion 908 extends from the central panel 902 into the right side visor 912.

Claims

Claims What is claimed is:
1. An eyewear article article for reducing glare, comprising an upper visor, a lower visor, a left side visor, 1. A system, comprising: a processor of a diagnostics server node connected to an image processor of a functional MRI (fMRI) system and to a first computerized system and to a second computerized system; a memory on which are stored machine readable instructions that when executed by the processor, cause the processor to:
(i) provide a fMRI image of a brain taken over a period of time, the fMRI image comprising m volumetric slices of the brain imaged at respective time steps in the period of time, each slice having same thickness and being subdivided into a plurality of voxels;
(ii) generate a matrix representative of the fMRI image according to a matrix generation method obtained via a first training, the matrix having m rows and n columns, and having elements f,, with 1 < i < m and 1 < j < n, wherein each element f,, is indicative of blood oxygen levels of a jth set of voxels of an ith volumetric slice of the fMRI image; and
(hi) use the matrix to obtain a set of first probabilities according to a deduction method obtained via a second training, each first probability being indicative of a correlation level between a corresponding mental condition in a list and the matrix.
2. The system of claim 1, wherein the instructions further cause the processor to:
(iv) for each volumetric slice identify in the fMRI image a first set of N voxels having highest blood oxygen level and a second set of N voxels having lowest blood oxygen level, thereby obtain 2m sets of N voxels, where each voxel of the first set and of the second set corresponds to a respective unique region of the brain;
(v) use the 2m sets of N voxels to identify 2mN unique regions consisting of mN first unique regions in the brain with highest blood oxygen level and mN second unique regions in the brain with lowest blood oxygen level;
(vi) compare the 2mN unique regions to a predetermined atlas which correlates the predetermined mental conditions to groups of brain regions with highest blood oxygen level and with lowest blood oxygen level, in order to yield a set of second probabilities, each second probability being indicative of a similarity between a respective group of brain regions of the predetermined atlas corresponding to a respective mental condition in the list and the mN first unique regions with highest blood oxygen level and the mN second unique regions with lowest blood oxygen level in the fMRI image; and
(vii) calculate a set of averages, each average being associated with a respective mental condition in the hst, each average being an average of a respective first probability associated with the respective mental condition and a respective second probability associated with the respective mental condition.
3. The system of claim 2, wherein the atlas is a Talairach atlas.
4. The system of claim 1, wherein each average is a geometric average of the respective first probability associated with the respective mental condition and the respective second probability associated with the respective mental condition.
5. The system of claim 1, wherein the instructions further cause the processor to, prior to step (i):
(a) train the first computerized system to generate the matrix representative of the fMRI image, by using a set of input fMRI images, according to the first training; and
(b) train the second computerized system to use the matrix to obtain the set of first probabilities, according to the second training.
6. The system of claim 5, wherein the first training comprises:
(al) providing the set of input fMRI images, each input fMRI image taken over a respective period of time, each input fMRI image comprising respective m first volumetric slices of the brain imaged at respective timesteps in the period of time, each first volumetric slice having same thickness and being subdivided into a plurality of first voxels, and each first voxel having a respective first location and a respective first blood oxygen level value;
(a2) for each of the input fMRI images, instructing the first computerized system to generate a respective matrix having m rows and n columns according to predetermined first guidelines, the matrix having elements f,, with 1 < i < m and 1 < j < n, wherein each element f,, is indicative of blood oxygen levels of a jth set of voxels of an ith volumetric slice of the input fMRI image;
(a3) using each matrix to infer an output representation of the respective input fMRI image, each output representation having m second volumetric shoes which correspond to the respective m first volumetric shoes, wherein each second volumetric slice is subdivided into a plurality of second voxels corresponding to the plurality of first voxels of the input fMRI image, each second voxel having a respective second location equal to the first location of the corresponding first voxel and a respective inferred blood oxygen level value;
(a4) calculating an error value by comparing each inferred blood oxygen level value of each second voxel to the first blood oxygen level of the corresponding first voxel;
(a5) if the error value is greater than a first predetermined threshold, reporting the error value to the first computerized system and instructing the first computerized system to repeat steps (a2) through (a4) to lower the error value by altering one or more parameters of the first guidelines, until the error value is lower than or equal to the first predetermined threshold; and
(a6) if the error value is smaller than or equal to first predetermined threshold, ending training.
7. The system of claim 6, wherein the error value is a mean absolute percentage error (MAPE), where , where z is a total number of voxels in the set of input fMRI images, Fk is the inferred blood oxygen level value of a second voxel k, and Ak is the first blood oxygen level value of a first voxel corresponding to the second voxel k.
8. The system of claim 5, wherein the second training comprises: (bl) after the first training is complete, receiving at least a subset of the set of matrices corresponding to input fMRI images of brains of patients that are known to have one or more of the predetermined mental conditions;
(b2) instructing the second computerized system to use the matrices in the subset to predict whether each matrix corresponds to any of the one or more of the predetermined mental conditions, via second guidelines;
(b3) calculating an accuracy value for the subset, by comparing predictions generated at (b2) to the known conditions corresponding to each matrix in the subset;
(b4) if the accuracy value is lower than a second predetermined threshold, reporting the accuracy value to the second computerized system and instructing the second computerized system to repeat steps (b2) and (b3) to increase the accuracy value by altering one or more parameters of the second guidelines, until the accuracy value is greater than or equal to the second predetermined threshold; and
(b5) if the accuracy value is greater than or equal to second predetermined threshold, ending training.
9. The system of claim 8, wherein the accuracy value is , tp is a number of correct predictions, fp is a number of false positive predictions, and fn is a number of false negative predictions.
10. A method for detection of mental condition based on functional MRI scans, the method comprising:
(i) receiving, by a diagnostics server, a fMRI image of a brain taken over a period of time, the fMRI image comprising m volumetric slices of the brain imaged at respective time steps in the period of time, each slice having same thickness and being subdivided into a plurality of voxels;
(ii) generating, by the diagnostics server, a matrix representative of the fMRI image according to a matrix generation method obtained via a first training, the matrix having m rows and n columns, and having elements f,, with 1 < i < m and 1 < j < n, wherein each element f,, is indicative of blood oxygen levels of a jth set of voxels of an ith volumetric slice of the fMRI image; and
(iii) using, by the diagnostics server, the matrix to obtain a set of first probabihties according to a deduction method obtained via a second training, each first probability being indicative of a correlation level between a corresponding mental condition in a list and the matrix.
11. The method of claim 10, further comprising:
(iv) for each volumetric slice identifying in the fMRI image a first set of N voxels having highest blood oxygen level and a second set of N voxels having lowest blood oxygen level, thereby obtaining 2m sets of N voxels, where each voxel of the first set and of the second set corresponds to a respective unique region of the brain;
(v) using the 2m sets of N voxels to identify 2mN unique regions consisting of mN first unique regions in the brain with highest blood oxygen level and mN second unique regions in the brain with lowest blood oxygen level;
(vi) comparing the 2mN unique regions to a predetermined atlas which correlates the predetermined mental conditions to groups of brain regions with highest blood oxygen level and with lowest blood oxygen level, in order to yield a set of second probabilities, each second probability being indicative of a similarity between a respective group of brain regions of the predetermined atlas corresponding to a respective mental condition in the list and the mN first unique regions with highest blood oxygen level and the mN second unique regions with lowest blood oxygen level in the fMRI image; and
(vii) calculating a set of averages, each average being associated with a respective mental condition in the list, each average being an average of a respective first probability associated with the respective mental condition and a respective second probability associated with the respective mental condition.
12. The method of claim 10, further comprising, prior to step (i):
(a) training a first computerized system to generate the matrix representative of the fMRI image, by using a set of input fMRI images, according to the first training; and
(b) training a second computerized system to use the matrix to obtain the set of first probabilities, according to the second training.
13. The method of claim 12, wherein the first training comprises:
(al) providing the set of input fMRI images, each input fMRI image taken over a respective period of time, each input fMRI image comprising respective m first volumetric slices of the brain imaged at respective timesteps in the period of time, each first volumetric slice having same thickness and being subdivided into a plurality of first voxels, and each first voxel having a respective first location and a respective first blood oxygen level value;
(a2) for each of the input fMRI images, instruct the first computerized system to generating a respective matrix having m rows and n columns according to predetermined first guidelines, the matrix having elements f,, with 1 < i < m and 1 < j < n, wherein each element f,, is indicative of blood oxygen levels of a jth set of voxels of an ith volumetric slice of the input fMRI image;
(a3) using each matrix to infer an output representation of the respective input fMRI image, each output representation having m second volumetric shoes which correspond to the respective m first volumetric shoes, wherein each second volumetric slice is subdivided into a plurality of second voxels corresponding to the plurality of first voxels of the input fMRI image, each second voxel having a respective second location equal to the first location of the corresponding first voxel and a respective inferred blood oxygen level value;
(a4) calculating an error value by comparing each inferred blood oxygen level value of each second voxel to the first blood oxygen level of the corresponding first voxel;
(a5) if the error value is greater than a first predetermined threshold, reporting the error value to the first computerized system and instructing the first computerized system to repeat steps (a2) through (a4) to lower the error value by altering one or more parameters of the first guidelines, until the error value is lower than or equal to the first predetermined threshold; and
(a6) if the error value is smaller than or equal to first predetermined threshold, ending training.
14. The method of claim 12, wherein the second training comprises:
(bl) after the first training is complete, receiving at least a subset of the set of matrices corresponding to input fMRI images of brains of patients that are known to have one or more of the predetermined mental conditions; (b2) instructing the second computerized system to use the matrices in the subset to predict whether each matrix corresponds to any of the one or more of the predetermined mental conditions, via second guidelines;
(b3) calculating an accuracy value for the subset, by comparing predictions generated at (b2) to the known conditions corresponding to each matrix in the subset;
(b4) if the accuracy value is lower than a second predetermined threshold, reporting computerized system to repeat steps (b2) and (b3) to increase the accuracy value by altering one or more parameters of the second guidelines, until the accuracy value is greater than or equal to the second predetermined threshold; and
(b5) if the accuracy value is greater than or equal to second predetermined threshold, ending training.
15. A non-transitory computer readable medium comprising instructions, that when read by a processor, cause the processor to perform:
(i) providing a fMRI image of a brain taken over a period of time, the fMRI image comprising m volumetric slices of the brain imaged at respective time steps in the period of time, each slice having same thickness and being subdivided into a plurality of voxels;
(ii) generating a matrix representative of the fMRI image according to a matrix generation method obtained via a first training, the matrix having m rows and n columns, and having elements f,, with 1 < i < m and 1 < j < n, wherein each element f,, is indicative of blood oxygen levels of a jth set of voxels of an ith volumetric slice of the fMRI image; and
(hi) using the matrix to obtain a set of first probabilities according to a deduction method obtained via a second training, each first probability being indicative of a correlation level between a corresponding mental condition in a list and the matrix.
16. The non-transitory computer readable medium of claim 15, further comprising instructions, that when read by the processor, cause the processor to:
(iv) for each volumetric slice identify in the fMRI image a first set of N voxels having highest blood oxygen level and a second set of N voxels having lowest blood oxygen level, thereby obtain 2m sets of N voxels, where each voxel of the first set and of the second set corresponds to a respective unique region of the brain;
(v) use the 2m sets of N voxels to identify 2mN unique regions consisting of mN first unique regions in the brain with highest blood oxygen level and mN second unique regions in the brain with lowest blood oxygen level;
(vi) compare the 2mN unique regions to a predetermined atlas which correlates the predetermined mental conditions to groups of brain regions with highest blood oxygen level and with lowest blood oxygen level, in order to yield a set of second probabilities, each second probability being indicative of a similarity between a respective group of brain regions of the predetermined atlas corresponding to a respective mental condition in the list and the mN first unique regions with highest blood oxygen level and the mN second unique regions with lowest blood oxygen level in the fMRI image; and
(vii) calculate a set of averages, each average being associated with a respective mental condition in the list, each average being an average of a respective first probability associated with the respective mental condition and a respective second probability associated with the respective mental condition.
17. The non-transitory computer readable medium of claim 15, further comprising instructions, that when read by the processor, cause the processor to:
(a) train a first model to generate the matrix representative of the fMRI image, by using a set of input fMRI images, according to the first training; and
(b) train a second model to use the matrix to obtain the set of first probabihties, according to the second training.
18. The non-transitory computer readable medium of claim 17, wherein training of the first model comprises: (al) providing the set of input fMRI images, each input fMRI image taken over a respective period of time, each input fMRI image comprising respective m first volumetric shoes of the brain imaged at respective timesteps in the period of time, each first volumetric shoe having same thickness and being subdivided into a plurality of first voxels, and each first voxel having a respective first location and a respective first blood oxygen level value;
(a2) for each of the input fMRI images, instruct the first computerized system to generating a respective matrix having m rows and n columns according to predetermined first guidelines, the matrix having elements f,, with 1 < i < m and 1 < j < n, wherein each element f,, is indicative of blood oxygen levels of a jth set of voxels of an ith volumetric slice of the input fMRI image;
(a3) using each matrix to infer an output representation of the respective input fMRI image, each output representation having m second volumetric shoes which correspond to the respective m first volumetric shoes, wherein each second volumetric slice is subdivided into a plurality of second voxels corresponding to the plurality of first voxels of the input fMRI image, each second voxel having a respective second location equal to the first location of the corresponding first voxel and a respective inferred blood oxygen level value;
(a4) calculating an error value by comparing each inferred blood oxygen level value of each second voxel to the first blood oxygen level of the corresponding first voxel;
(a5) if the error value is greater than a first predetermined threshold, reporting the error value to the first computerized system and instructing the first computerized system to repeat steps (a2) through (a4) to lower the error value by altering one or more parameters of the first guidelines, until the error value is lower than or equal to the first predetermined threshold; and
(a6) if the error value is smaller than or equal to first predetermined threshold, ending the training of the first model.
19. The non-transitory computer readable medium of claim 18, further comprising instructions, that when read by the processor, cause the processor to calculate the error value as a mean absolute percentage error (MAPE), where , where z is a total number of voxels in the set of input fMRI images, Fk is the inferred blood oxygen level value of a second voxel k, and Ak is the first blood oxygen level value of a first voxel corresponding to the second voxel k.
20. The non-transitory computer readable medium of claim 17, wherein training of the second model comprises:
(bl) after the training of the first model is complete, receiving at least a subset of the set of matrices corresponding to input fMRI images of brains of patients that are known to have one or more of the predetermined mental conditions;
(b2) instructing the second model to use the matrices in the subset to predict whether each matrix corresponds to any of the one or more of the predetermined mental conditions, via second guidelines;
(b3) calculating an accuracy value for the subset, by comparing predictions generated at (b2) to the known conditions corresponding to each matrix in the subset;
(b4) if the accuracy value is lower than a second predetermined threshold, repeating steps (b2) and (b3) to increase the accuracy value by altering one or more parameters of the second guidelines, until the accuracy value is greater than or equal to the second predetermined threshold; and
(b5) if the accuracy value is greater than or equal to second predetermined threshold, ending the training of the second model, wherein the accuracy value is , tp is a number of correct predictions, fp is a number of false positive predictions, and fn is a number of false negative predictions.
PCT/IB2021/053469 2021-04-27 2021-04-27 Detection of bio-markers in functional mri scans WO2022229671A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/IB2021/053469 WO2022229671A1 (en) 2021-04-27 2021-04-27 Detection of bio-markers in functional mri scans

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/IB2021/053469 WO2022229671A1 (en) 2021-04-27 2021-04-27 Detection of bio-markers in functional mri scans

Publications (1)

Publication Number Publication Date
WO2022229671A1 true WO2022229671A1 (en) 2022-11-03

Family

ID=83847913

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2021/053469 WO2022229671A1 (en) 2021-04-27 2021-04-27 Detection of bio-markers in functional mri scans

Country Status (1)

Country Link
WO (1) WO2022229671A1 (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050215884A1 (en) * 2004-02-27 2005-09-29 Greicius Michael D Evaluation of Alzheimer's disease using an independent component analysis of an individual's resting-state functional MRI
US20110301431A1 (en) * 2010-06-05 2011-12-08 The Board Of Trustees Of The Leland Stanford Junior University Methods of classifying cognitive states and traits and applications thereof
US20160063701A1 (en) * 2014-08-28 2016-03-03 International Business Machines Corporation Real-time subject-driven functional connectivity analysis
US20160239968A1 (en) * 2008-05-28 2016-08-18 The Trustees Of Columbia University In The City Of New York Voxel-based methods for assessing subjects using magnetic resonance imaging
US20200163609A1 (en) * 2015-11-24 2020-05-28 Advanced Telecommunications Research Institute International Brain activity analyzing apparatus, brain activity analyzing method, program and biomarker apparatus
US20200342359A1 (en) * 2017-11-17 2020-10-29 Mayo Foundation For Medical Education And Research Methods for Using Machine Learning and Mechanistic Models for Biological Feature Mapping with Multiparametric MRI

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050215884A1 (en) * 2004-02-27 2005-09-29 Greicius Michael D Evaluation of Alzheimer's disease using an independent component analysis of an individual's resting-state functional MRI
US20160239968A1 (en) * 2008-05-28 2016-08-18 The Trustees Of Columbia University In The City Of New York Voxel-based methods for assessing subjects using magnetic resonance imaging
US20110301431A1 (en) * 2010-06-05 2011-12-08 The Board Of Trustees Of The Leland Stanford Junior University Methods of classifying cognitive states and traits and applications thereof
US20160063701A1 (en) * 2014-08-28 2016-03-03 International Business Machines Corporation Real-time subject-driven functional connectivity analysis
US20200163609A1 (en) * 2015-11-24 2020-05-28 Advanced Telecommunications Research Institute International Brain activity analyzing apparatus, brain activity analyzing method, program and biomarker apparatus
US20200342359A1 (en) * 2017-11-17 2020-10-29 Mayo Foundation For Medical Education And Research Methods for Using Machine Learning and Mechanistic Models for Biological Feature Mapping with Multiparametric MRI

Similar Documents

Publication Publication Date Title
US10332254B2 (en) Computer Aided Diagnosis (CAD) apparatus and method
JP7058373B2 (en) Lesion detection and positioning methods, devices, devices, and storage media for medical images
US10853449B1 (en) Report formatting for automated or assisted analysis of medical imaging data and medical diagnosis
Doan et al. SONNET: A self-guided ordinal regression neural network for segmentation and classification of nuclei in large-scale multi-tissue histology images
CN114926477B (en) Brain tumor multi-mode MRI image segmentation method based on deep learning
JP7189257B2 (en) Method, apparatus and computer readable storage medium for detecting specific facial syndromes
Hu et al. Classification of metaphase chromosomes using deep convolutional neural network
Yao et al. Pneumonia Detection Using an Improved Algorithm Based on Faster R‐CNN
US11830187B2 (en) Automatic condition diagnosis using a segmentation-guided framework
CN112183572B (en) Method and device for generating prediction model for predicting severity of pneumonia
US11875898B2 (en) Automatic condition diagnosis using an attention-guided framework
CN113366499A (en) Associating population descriptors with trained models
CN110414562B (en) X-ray film classification method, device, terminal and storage medium
CN116402739A (en) Quality evaluation method and device for electronic endoscope detection flow
Wang et al. Multimodal autism spectrum disorder diagnosis method based on DeepGCN
CN111462203B (en) DR focus evolution analysis device and method
Mirchandani et al. Comparing the Architecture and Performance of AlexNet Faster R-CNN and YOLOv4 in the Multiclass Classification of Alzheimer Brain MRI Scans
CN116091446A (en) Method, system, medium and equipment for detecting abnormality of esophageal endoscope image
EP3998586A1 (en) Method and system for predicting responsiveness to therapy for cancer patient
US20220334205A1 (en) Detection of Bio-Markers in Functional MRI Scans
WO2022229671A1 (en) Detection of bio-markers in functional mri scans
CN115063351A (en) Deep learning-based fetal MRI brain tissue segmentation method and device
CN111476775B (en) DR symptom identification device and method
Bhookya Examine Lung Disorders and Disease Classification Using Advanced CNN Approach
CN115457339B (en) AD prediction method, system and device based on deep ensemble learning

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21939146

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 27/03/2024)