CN113870243A - Magnetic resonance brain image hippocampus segmentation method - Google Patents

Magnetic resonance brain image hippocampus segmentation method Download PDF

Info

Publication number
CN113870243A
CN113870243A CN202111189822.5A CN202111189822A CN113870243A CN 113870243 A CN113870243 A CN 113870243A CN 202111189822 A CN202111189822 A CN 202111189822A CN 113870243 A CN113870243 A CN 113870243A
Authority
CN
China
Prior art keywords
magnetic resonance
hippocampus
hippocampal
brain image
probability matrix
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202111189822.5A
Other languages
Chinese (zh)
Inventor
郑强
刘彬
童向荣
武栓虎
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Yantai University
Original Assignee
Yantai University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Yantai University filed Critical Yantai University
Priority to CN202111189822.5A priority Critical patent/CN113870243A/en
Publication of CN113870243A publication Critical patent/CN113870243A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • G06T7/0012Biomedical image inspection
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/24Classification techniques
    • G06F18/241Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
    • G06F18/2415Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches based on parametric or probabilistic models, e.g. based on likelihood ratio or false acceptance rate versus a false rejection rate
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/045Combinations of networks
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • G06T7/11Region-based segmentation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10072Tomographic images
    • G06T2207/10088Magnetic resonance imaging [MRI]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20112Image segmentation details
    • G06T2207/20132Image cropping
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30004Biomedical image processing
    • G06T2207/30016Brain

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Artificial Intelligence (AREA)
  • Health & Medical Sciences (AREA)
  • Evolutionary Computation (AREA)
  • General Engineering & Computer Science (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Molecular Biology (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Computational Linguistics (AREA)
  • Probability & Statistics with Applications (AREA)
  • Evolutionary Biology (AREA)
  • Computing Systems (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • Medical Informatics (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Radiology & Medical Imaging (AREA)
  • Quality & Reliability (AREA)
  • Magnetic Resonance Imaging Apparatus (AREA)

Abstract

A magnetic resonance brain image hippocampal segmentation method comprises the following steps: linearly registering a nuclear magnetic resonance brain image to be segmented on a template; step 2: cutting each nuclear magnetic resonance brain image into image blocks containing the hippocampus by a determined box which is enough to cover the hippocampus in the space; and step 3: filling image blocks by using zero filling, inputting the image blocks into a designed deep learning network model HPCSeg-Net, outputting a probability matrix of the sea horse through a softmax function in the network model, and 4: and (4) inputting the hippocampal probability matrix obtained in the step (3) into an argmax function to convert the probability matrix into a 0-1 binary label, and then reversely filling the 0-1 binary label to obtain a hippocampal segmentation result. The invention has the characteristics of high segmentation speed and high segmentation precision.

Description

Magnetic resonance brain image hippocampus segmentation method
Technical Field
The invention belongs to the technical field of brain image hippocampus segmentation, and particularly relates to a magnetic resonance brain image hippocampus segmentation method.
Background
Hippocampal lesions are the causative factors of various mental diseases, and hippocampal segmentation is an important prerequisite for further analysis of diseases by using images, and its volume, shape characteristics, and the like have also been widely used in analysis of mental diseases such as alzheimer's disease. However, the magnetic resonance image has small bilateral hippocampus volume, low contrast with peripheral tissue structures, and unclear boundaries. Therefore, accurate and fast segmentation of hippocampus from MRI remains a challenge.
In the prior art, a multi-atlas method is more stable in segmentation of structural changes, but the segmentation algorithm excessively depends on the performances of an image registration algorithm and a fusion algorithm, accurate segmentation of the hippocampus with large differences is difficult to realize by means of a simple registration algorithm, and the segmentation time is increased along with the increase of the registration number.
A semantic gap problem can be generated based on a traditional U-Net model, and the class imbalance in the sea horse segmentation also enables a deep learning network not to extract enough fine-grained information.
Disclosure of Invention
In order to overcome the technical problems, the invention aims to provide a magnetic resonance brain image hippocampal segmentation method which can extract fine-grained information and weaken the semantic gap problem at the same time.
In order to achieve the purpose, the invention adopts the technical scheme that:
a magnetic resonance brain image hippocampal segmentation method comprises the following steps;
step 1: in order to reduce the differences in the individualization space, the MRI brain image to be segmented is linearly registered to a voxel size of 1 x 1mm3On the MNI152 template;
step 2: determining a box which is enough to cover the hippocampus in the space, fusing the box by using the labels of the selected atlas images, determining the boundaries of the box, expanding 7 voxels outwards in each direction, and cutting each nuclear magnetic resonance brain image into image blocks which are 60 x 48 in size and contain the hippocampus;
and step 3: filling the image blocks with the size of 60 × 48 into 64 × 48 by using zero filling, inputting the image blocks into a designed deep learning network model HPCSeg-Net, and outputting a probability matrix of the hippocampus through a softmax function in the network model, wherein the formula is as follows:
Figure BDA0003298251520000021
wherein z isiThe output value of the ith node is C, and the number of the classified classes is C;
and 4, step 4: and (4) inputting the hippocampal probability matrix obtained in the step (3) into an argmax function to convert the probability matrix into 0-1 binary labels, and then back-filling the 0-1 binary labels to obtain a hippocampal segmentation result with the size of 60 x 48.
The invention has the beneficial effects.
The invention designs a cascade automatic focusing attention mechanism comprising an automatic focusing module and an attention module based on a basic framework of U-Net, and uses the cascade automatic focusing attention mechanism in U-Net jump connection to reduce semantic gap problems.
The standard convolution in U-Net is replaced by an adaptive feature reorganization and recalibration module to extract fine-grained information.
The HPCSeg-Net provided by the invention is superior to the MAIS method in the aspects of segmentation performance and calculation cost:
the HPCSeg-Net segmentation of 70 magnetic resonance images only needs 0.35 minute, the average segmentation time is less than 1 second, and the segmentation result is superior to the MAIS method. While the average run time of the MAIS method segmentation included NLP (3.73 minutes), RLBP (10.95 minutes), ML (46.18 minutes), LLL (4.8 minutes), RF (46.7 minutes), and RF-SSLP (48 minutes).
Description of the drawings:
fig. 1 is a schematic diagram of a magnetic resonance brain image hippocampal segmentation method of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
As shown in fig. 1: the invention provides a hippocampus segmentation network model HPCSeg-Net based on a U-shaped convolution neural network framework, which adopts a cascade automatic focusing attention mechanism and a self-adaptive characteristic recombination and recalibration module. A cascading autofocus attention mechanism includes an autofocus module and an attention module for a jump connection between down-sampling and up-sampling to reduce a semantic gap. The autofocus module generates stronger features (number of convolutional layers 3, 2, 1 in autofocus modules 1, 2, 3) by parallelizing multiple convolutional layers of different expansion ratios (2, 4, 6), and the follow-up attention module contains 2 inputs, where the up-sampled feature map contains deeper level information, which can suppress irrelevant areas around the hippocampus, highlighting salient features. The feature recombination adopts linear expansion and compression to generate complex semantic segmentation features, and the feature recalibration module collects context information and retains spatial information. In order to prevent the network from being over-fitted, a structured packet loss form is added in the feature recombination and recalibration module to standardize the convolution network.

Claims (1)

1. A magnetic resonance brain image hippocampal segmentation method is characterized by comprising the following steps;
step 1: in order to reduce the differences in the individualization space, the MRI brain image to be segmented is linearly registered to a voxel size of 1 x 1mm3On the MNI152 template;
step 2: determining a box which is enough to cover the hippocampus in the space, fusing the box by using the labels of the selected atlas images, determining the boundaries of the box, expanding 7 voxels outwards in each direction, and cutting each nuclear magnetic resonance brain image into image blocks which are 60 x 48 in size and contain the hippocampus;
and step 3: filling the image blocks with the size of 60 × 48 into 64 × 48 by using zero filling, inputting the image blocks into a designed deep learning network model HPCSeg-Net, and outputting a probability matrix of the hippocampus through a softmax function in the network model, wherein the formula is as follows:
Figure FDA0003298251510000011
Figure FDA0003298251510000012
wherein z isiThe output value of the ith node is C, and the number of the classified classes is C;
and 4, step 4: and (4) inputting the hippocampal probability matrix obtained in the step (3) into an argmax function to convert the probability matrix into 0-1 binary labels, and then back-filling the 0-1 binary labels to obtain a hippocampal segmentation result with the size of 60 x 48.
CN202111189822.5A 2021-10-11 2021-10-11 Magnetic resonance brain image hippocampus segmentation method Pending CN113870243A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111189822.5A CN113870243A (en) 2021-10-11 2021-10-11 Magnetic resonance brain image hippocampus segmentation method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111189822.5A CN113870243A (en) 2021-10-11 2021-10-11 Magnetic resonance brain image hippocampus segmentation method

Publications (1)

Publication Number Publication Date
CN113870243A true CN113870243A (en) 2021-12-31

Family

ID=78999319

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111189822.5A Pending CN113870243A (en) 2021-10-11 2021-10-11 Magnetic resonance brain image hippocampus segmentation method

Country Status (1)

Country Link
CN (1) CN113870243A (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110969626A (en) * 2019-11-27 2020-04-07 西南交通大学 Method for extracting hippocampus of human brain nuclear magnetic resonance image based on 3D neural network
WO2021104056A1 (en) * 2019-11-27 2021-06-03 中国科学院深圳先进技术研究院 Automatic tumor segmentation system and method, and electronic device
CN113052856A (en) * 2021-03-12 2021-06-29 北京工业大学 Hippocampus three-dimensional semantic network segmentation method based on multi-scale feature multi-path attention fusion mechanism

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110969626A (en) * 2019-11-27 2020-04-07 西南交通大学 Method for extracting hippocampus of human brain nuclear magnetic resonance image based on 3D neural network
WO2021104056A1 (en) * 2019-11-27 2021-06-03 中国科学院深圳先进技术研究院 Automatic tumor segmentation system and method, and electronic device
CN113052856A (en) * 2021-03-12 2021-06-29 北京工业大学 Hippocampus three-dimensional semantic network segmentation method based on multi-scale feature multi-path attention fusion mechanism

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
BIN LIU ET AL.: "HPCSeg-Net: Hippocampus Segmentation Network Integrating Autofocus Attention Mechanism and Feature Recombination and Recalibration Module", 《ICIG 2021: IMAGE AND GRAPHICS》, pages 773 *
YONGFU HAO ET AL.: "Local label learning (LLL) for subcortical structure segmentation: Application to hippocampus segmentation", 《HUMAN BRAIN MAPPING》, vol. 35, no. 6, pages 2674 *

Similar Documents

Publication Publication Date Title
CN110232394A (en) A kind of multi-scale image semantic segmentation method
CN114565770B (en) Image segmentation method and system based on edge auxiliary calculation and mask attention
US11604272B2 (en) Methods and systems for object detection
CN112364931A (en) Low-sample target detection method based on meta-feature and weight adjustment and network model
CN115424059B (en) Remote sensing land utilization classification method based on pixel level contrast learning
CN113870335A (en) Monocular depth estimation method based on multi-scale feature fusion
CN111062395A (en) Real-time video semantic segmentation method
CN110866938A (en) Full-automatic video moving object segmentation method
US11514660B1 (en) Scene recognition method, training method and device based on pyramid attention
CN112785496A (en) Device and method for processing image super-resolution
CN112329857A (en) Image classification method based on improved residual error network
CN107066520A (en) A kind of picture retrieval method and system based on multiple semantic hierarchies
CN115082928A (en) Method for asymmetric double-branch real-time semantic segmentation of network for complex scene
CN116229106A (en) Video significance prediction method based on double-U structure
Yang et al. An efficient semantic segmentation method based on transfer learning from object detection
CN113870243A (en) Magnetic resonance brain image hippocampus segmentation method
Gongguo et al. An improved small target detection method based on Yolo V3
Liu et al. Ensemble of fine‐tuned convolutional neural networks for urine sediment microscopic image classification
CN115204318B (en) Event automatic hierarchical classification method and electronic equipment
CN116740714A (en) Intelligent self-labeling method and device for hip joint diseases based on unsupervised learning
CN113496496B (en) MRI image hippocampus region segmentation method based on multiple losses and multiscale characteristics
CN115830633A (en) Pedestrian re-identification method and system based on multitask learning residual error neural network
CN115937850A (en) Laser radar point cloud semantic segmentation method based on asymmetric convolution
CN114170276A (en) Magnetic resonance brain image hippocampus registration method
CN113947250A (en) Urban fine-grained flow prediction method and system based on limited data resources

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination