CN111179228A - Single-energy CT energy spectrum imaging method based on deep learning - Google Patents

Single-energy CT energy spectrum imaging method based on deep learning Download PDF

Info

Publication number
CN111179228A
CN111179228A CN201911295085.XA CN201911295085A CN111179228A CN 111179228 A CN111179228 A CN 111179228A CN 201911295085 A CN201911295085 A CN 201911295085A CN 111179228 A CN111179228 A CN 111179228A
Authority
CN
China
Prior art keywords
energy
image
network
training
images
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201911295085.XA
Other languages
Chinese (zh)
Inventor
牛田野
江阳康
薛一
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhejiang University ZJU
Original Assignee
Zhejiang University ZJU
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhejiang University ZJU filed Critical Zhejiang University ZJU
Priority to CN201911295085.XA priority Critical patent/CN111179228A/en
Publication of CN111179228A publication Critical patent/CN111179228A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • G06T7/0012Biomedical image inspection
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10072Tomographic images
    • G06T2207/10081Computed x-ray tomography [CT]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20081Training; Learning
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20084Artificial neural networks [ANN]

Landscapes

  • Engineering & Computer Science (AREA)
  • Quality & Reliability (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Radiology & Medical Imaging (AREA)
  • Health & Medical Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Apparatus For Radiation Diagnosis (AREA)
  • Image Analysis (AREA)

Abstract

The invention discloses a single-energy CT energy spectrum imaging method based on deep learning, which comprises the following steps of: taking the single-energy CT image and the label high-energy CT image as a training sample to form a training set; constructing an image conversion model for predicting and outputting a high-energy CT image according to an input single-energy CT image based on a deep learning network, and training the image conversion model by utilizing a training set to determine model parameters of the image conversion model; and inputting the single-energy CT image to be imaged into an image conversion model determined by the model parameters, and calculating to output a high-energy CT image. The method can realize the rapid, accurate and robust acquisition of the high-energy CT image by using the single-energy CT image, and meets the clinical requirements.

Description

Single-energy CT energy spectrum imaging method based on deep learning
Technical Field
The invention relates to the technical field of medical engineering, in particular to a single-energy CT energy spectrum imaging method based on deep learning.
Background
At present, modern X-ray CT imaging is widely applied to medical clinical diagnosis and treatment, and has great social value and significance. In recent years, with the continuous emergence of new modalities of various CT imaging, spectral CT and its material decomposition characteristics show great clinical potential. At present, the energy spectrum CT imaging technology is widely applied to clinical diagnosis such as pathological organ contour delineation, virtual single-energy imaging, virtual non-enhanced imaging, hepatic fibrosis quantification, gout diagnosis, artery CT angiography imaging and the like.
The current energy spectrum CT imaging technology mainly comprises multiple scanning, a fast kVp switching technology, a double-layer plate detector technology, a photon counting detector technology and a double-source CT imaging technology. Multiple scans are easy to implement but increase the radiation dose and scan time. Fast kVp switching techniques can generate dual energy data in a single scan, but implementation of such schemes is challenging due to the difficulty in controlling the exposure at different tube voltages. The dual-layer detector scheme provides two overlapping detectors with different energy responses to incident X-ray photons to generate dual-energy projection data. This approach may generate consistent dual-energy projection data in a single scan, with the disadvantage that there is not enough energy reserve between the acquired high-energy and low-energy projections. Photon counting detectors can distinguish more of the incident X-ray energy spectrum, but still suffer from various limitations, including detector charge sharing, pulse packing, limited detection efficiency, and the like. Dual source CT imaging techniques mount two X-ray tubes nearly perpendicular to each other to generate dual energy data in one scan. The scheme can flexibly adjust tube voltage to obtain high-quality CT images, but is limited by cross scattering of photons generated by two bulbs, and in addition, two X-ray tube imaging schemes cannot obtain accurate and consistent dual-energy projection. The defects of the energy spectrum CT imaging technologies are that the hardware implementation difficulty is high, the reconstruction algorithm is relatively complex, and the radiation dose to a patient is increased.
Recently, deep learning has attracted a wide range of attention in the fields of machine learning and computer vision. Deep learning can efficiently learn high-level features from pixel-level data through a multi-layer hidden layer framework. Several network architectures proposed at present have been applied in the field of medical images, such as image restoration, image noise reduction, image super-high resolution improvement, image segmentation, organ classification, cell edge detection, and the like.
Inspired by the great potential of deep learning in the aspect of image processing, a single-energy CT energy spectrum imaging method based on deep learning is provided. The method can obtain energy spectrum CT data by single-energy CT by utilizing the mapping relation between CT images under different energies.
Disclosure of Invention
The invention aims to provide a single-energy CT energy spectrum imaging method based on deep learning. The method can realize the rapid, accurate and robust acquisition of the high-energy CT image by using the single-energy CT image, and meets the clinical requirements.
In order to achieve the purpose, the invention provides the following technical scheme:
a method of single energy CT spectral imaging based on deep learning, the method comprising the steps of:
taking the single-energy CT image and the label high-energy CT image as a training sample to form a training set;
constructing an image conversion model for predicting and outputting a high-energy CT image according to an input single-energy CT image based on a deep learning network, and training the image conversion model by utilizing a training set to determine model parameters of the image conversion model;
and inputting the single-energy CT image to be imaged into an image conversion model determined by the model parameters, and calculating to output a high-energy CT image.
Compared with the prior art, the invention has the beneficial effects that:
the image conversion model obtained through training can obtain a converted high-energy CT image based on the single-energy CT image, and the high-energy CT image has the image quality close to that of a real high-energy CT image and can be used for clinical diagnosis.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.
FIG. 1 is a flowchart of a method for single-energy CT spectral imaging based on deep learning according to an embodiment of the present invention;
fig. 2 is a related picture of high-energy CT image imaging performed by using an image transformation model constructed by a supervised learning network according to an embodiment of the present invention, where (a) is a single-energy CT image, (b) is a real high-energy CT image, and (c) is a predicted high-energy CT image;
fig. 3 is related pictures of high-energy CT image imaging performed by using an image transformation model constructed by an unsupervised learning network according to an embodiment of the present invention, where (a) is a single-energy CT image, (b) is a real high-energy CT image, and (c) is a predicted high-energy CT image.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention will be further described in detail with reference to the accompanying drawings and examples. It should be understood that the detailed description and specific examples, while indicating the scope of the invention, are intended for purposes of illustration only and are not intended to limit the scope of the invention.
Fig. 1 is a flowchart of a method for single-energy CT spectral imaging based on deep learning according to an embodiment of the present invention. Referring to fig. 1, the single energy CT energy spectrum imaging method includes the following steps:
s101, taking the single-energy CT image and the label high-energy CT image as a training sample to form a training set.
In the embodiment, high-energy CT images obtained from Siemens SOMATOM Force X-ray computed tomography equipment are used as a data set, wherein a CT image with one energy is used as a single-energy CT image, and CT images with the rest energy are used as label high-energy CT images. And dividing the data set into a training set and a verification set, wherein the training set is used for optimizing model parameters of the image conversion model, and the verification set is used for verifying the prediction effectiveness degree of the image conversion model.
S102, an image conversion model used for predicting and outputting a high-energy CT image according to an input single-energy CT image is built on the basis of a deep learning network, and the image conversion model is trained by utilizing a training set to determine model parameters of the image conversion model.
In this embodiment, the image transformation model may be obtained by optimizing network parameters using a supervised learning network. Specifically, the image conversion model takes a deep convolutional neural network as a network basis, a training set is used for training network parameters of the deep convolutional neural network, a joint residual learning framework is adopted to learn a residual compensation image between an input single-energy CT image and a labeled high-energy CT image in the training process, and the mapping function of the residual learning framework is as follows:
fspectral=M(fsingle)+fsingle
wherein f isspectralIs a high-energy CT image, fsingleIs a monoenergetic CT image, M (-) is an end-to-end mapping function used to train residual compensation images, M (f)single) Is a residual compensated image.
During training, the minimization loss function is:
Figure BDA0002320299250000041
wherein N is the total number of training samples in the training set, fspectralIs a high-energy CT image, fsingleIs a single-energy CT image and can be used,
Figure BDA0002320299250000051
is the optimized mapping function result;
and solving the minimized loss function to obtain an optimized mapping function result.
In this embodiment, the image conversion model may also be obtained by optimizing network parameters using an unsupervised learning network. Specifically, the image conversion model is based on a cycle generation countermeasure network as a network basis, and the cycle generation countermeasure network comprises a generator and two discriminators which form two cycle networks and compete with each other until convergence to an equilibrium point; the discriminator is used for distinguishing a real high-energy CT image from a predicted high-energy CT image, the generator is used for generating the predicted high-energy CT image with the distribution which is finally matched with the real high-energy CT image, and the discriminator is deceived to classify the predicted high-energy CT image into real data to realize an unsupervised learning mode.
Wherein, the generator GAFor generating high-energy CT images from monoenergetic CT images, generator GBUsed for generating a single-energy CT image according to the high-energy CT image; discriminator DAFor distinguishing true high-energy CT images and for generating high-energy CT images, discriminator DBForDistinguishing a real single-energy CT image and generating a single-energy CT image;
in this embodiment, the generator specifically adopts a residual error network structure, the discriminator specifically adopts a PatchGAN network structure,
training the loop to generate a confrontation network by using a training set, wherein a generator loss function adopted during training is as follows:
Figure BDA0002320299250000052
the discriminator loss function is used as:
Figure BDA0002320299250000053
wherein,
Figure BDA0002320299250000054
and
Figure BDA0002320299250000055
is a generator GAAnd generator GBLoss function of Fcycle-spectralAnd Fcycle-singleIs a loss function of two cycles, λ is a weight coefficient,
Figure BDA0002320299250000056
and
Figure BDA0002320299250000057
as a discriminator DAAnd discriminator DBIs measured.
In this embodiment, an adaptive moment estimation algorithm is used as a solver to optimize network parameters of a supervised learning network and an unsupervised learning network.
S103, inputting the single-energy CT image to be imaged into an image conversion model determined by the model parameters, and calculating to output a high-energy CT image.
In the single-energy CT energy spectrum imaging method based on deep learning, after a high-energy CT image is obtained by using an image conversion model, the effect of energy spectrum CT conversion is evaluated by taking root mean square error and structural similarity as quantitative evaluation indexes of the image.
Fig. 2 is a related picture of high-energy CT image imaging performed by using an image transformation model constructed by a supervised learning network according to an embodiment of the present invention, where (a) is a single-energy CT image, (b) is a real high-energy CT image, and (c) is a predicted high-energy CT image;
fig. 3 is related pictures of high-energy CT image imaging performed by using an image transformation model constructed by an unsupervised learning network according to an embodiment of the present invention, where (a) is a single-energy CT image, (b) is a real high-energy CT image, and (c) is a predicted high-energy CT image.
By analyzing the images in fig. 2 and 3, the accuracy of predicting the CT number of the high-energy CT image is 10HU compared with the real high-energy CT image, and the texture features and the boundary features of the original high-energy CT image are well reproduced.
The above-mentioned embodiments are intended to illustrate the technical solutions and advantages of the present invention, and it should be understood that the above-mentioned embodiments are only the most preferred embodiments of the present invention, and are not intended to limit the present invention, and any modifications, additions, equivalents, etc. made within the scope of the principles of the present invention should be included in the scope of the present invention.

Claims (8)

1. A single-energy CT energy spectrum imaging method based on deep learning is characterized by comprising the following steps:
taking the single-energy CT image and the label high-energy CT image as a training sample to form a training set;
constructing an image conversion model for predicting and outputting a high-energy CT image according to an input single-energy CT image based on a deep learning network, and training the image conversion model by utilizing a training set to determine model parameters of the image conversion model;
and inputting the single-energy CT image to be imaged into an image conversion model determined by the model parameters, and calculating to output a high-energy CT image.
2. The method of claim 1, wherein the image transformation model is obtained by optimizing network parameters using a supervised learning network.
3. The method as claimed in claim 2, wherein the image transformation model uses a deep convolutional neural network as a network basis, and trains network parameters of the deep convolutional neural network by using a training set, and during the training process, a joint residual learning framework is used to learn a residual compensation image between the input mono-energy CT image and the labeled high-energy CT image, and a mapping function of the residual learning framework is:
fspectral=M(fsingle)+fsingle
wherein f isspectralIs a high-energy CT image, fsingleIs a monoenergetic CT image, M (-) is an end-to-end mapping function used to train residual compensation images, M (f)single) Is a residual compensated image.
4. The method of claim 3, wherein during the training process, the minimization loss function is:
Figure FDA0002320299240000011
wherein N is the total number of training samples in the training set, fspectralIs a high-energy CT image, fsingleIs a single-energy CT image and can be used,
Figure FDA0002320299240000021
is the optimized mapping function result;
and solving the minimized loss function to obtain an optimized mapping function result.
5. The method of claim 1, wherein the image transformation model is obtained by optimizing network parameters using an unsupervised learning network.
6. The method of claim 5, wherein the image transformation model is based on a recurrent countermeasure network, the recurrent countermeasure network comprises a generator and two discriminators, which form two recurrent networks and compete with each other until convergence to an equilibrium point;
generator GAFor generating high-energy CT images from monoenergetic CT images, generator GBUsed for generating a single-energy CT image according to the high-energy CT image; discriminator DAFor distinguishing true high-energy CT images and for generating high-energy CT images, discriminator DBThe system is used for distinguishing real single-energy CT images and generating single-energy CT images;
training the loop to generate a confrontation network by using a training set, wherein a generator loss function adopted during training is as follows:
Figure FDA0002320299240000022
the discriminator loss function is used as:
Figure FDA0002320299240000023
wherein,
Figure FDA0002320299240000024
and
Figure FDA0002320299240000025
is a generator GAAnd generator GBLoss function of Fcycle-spectralAnd Fcycle-singleIs a loss function of two cycles, λ is a weight coefficient,
Figure FDA0002320299240000026
and
Figure FDA0002320299240000027
as a discriminator DAAnd discriminator DBIs measured.
7. The deep learning-based single energy CT spectral imaging method according to any one of claims 2 to 6, characterized in that an adaptive moment estimation algorithm is adopted as a solver to optimize network parameters of a supervised learning network and an unsupervised learning network.
8. The single-energy CT spectral imaging method based on deep learning of claim 1, wherein after the high-energy CT image is obtained by using the image conversion model, the effect of the energy spectrum CT conversion is evaluated by using the root mean square error and the structural similarity as quantitative evaluation indexes of the image.
CN201911295085.XA 2019-12-16 2019-12-16 Single-energy CT energy spectrum imaging method based on deep learning Pending CN111179228A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911295085.XA CN111179228A (en) 2019-12-16 2019-12-16 Single-energy CT energy spectrum imaging method based on deep learning

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911295085.XA CN111179228A (en) 2019-12-16 2019-12-16 Single-energy CT energy spectrum imaging method based on deep learning

Publications (1)

Publication Number Publication Date
CN111179228A true CN111179228A (en) 2020-05-19

Family

ID=70656597

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911295085.XA Pending CN111179228A (en) 2019-12-16 2019-12-16 Single-energy CT energy spectrum imaging method based on deep learning

Country Status (1)

Country Link
CN (1) CN111179228A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113343924A (en) * 2021-07-01 2021-09-03 齐鲁工业大学 Modulation signal identification method based on multi-scale cyclic spectrum feature and self-attention generation countermeasure network
CN114403912A (en) * 2022-01-17 2022-04-29 明峰医疗系统股份有限公司 Energy spectrum CT effective atomic number estimation method based on deep learning

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107577985A (en) * 2017-07-18 2018-01-12 南京邮电大学 The implementation method of the face head portrait cartooning of confrontation network is generated based on circulation
US20180182129A1 (en) * 2015-09-09 2018-06-28 Tsinghua University Spectral ct image reconstructing method and spectral ct imaging system
CN108230277A (en) * 2018-02-09 2018-06-29 中国人民解放军战略支援部队信息工程大学 A kind of dual intensity CT picture breakdown methods based on convolutional neural networks
CN109242920A (en) * 2017-07-11 2019-01-18 清华大学 Substance decomposition methods, devices and systems
CN109741410A (en) * 2018-12-07 2019-05-10 天津大学 Fluorescence-encoded micro-beads image based on deep learning generates and mask method
CN109815893A (en) * 2019-01-23 2019-05-28 中山大学 The normalized method in colorized face images illumination domain of confrontation network is generated based on circulation
CN109903356A (en) * 2019-05-13 2019-06-18 南京邮电大学 Missing CT data for projection estimation method based on the multiple parsing network of depth
CN109916933A (en) * 2019-01-04 2019-06-21 中国人民解放军战略支援部队信息工程大学 X ray computer tomographic imaging spectra estimation method based on convolutional neural networks
CN110176045A (en) * 2019-05-05 2019-08-27 东南大学 A method of dual-energy CT image is generated by single energy CT image
CN110559009A (en) * 2019-09-04 2019-12-13 中山大学 Method, system and medium for converting multi-modal low-dose CT into high-dose CT based on GAN

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180182129A1 (en) * 2015-09-09 2018-06-28 Tsinghua University Spectral ct image reconstructing method and spectral ct imaging system
CN109242920A (en) * 2017-07-11 2019-01-18 清华大学 Substance decomposition methods, devices and systems
CN107577985A (en) * 2017-07-18 2018-01-12 南京邮电大学 The implementation method of the face head portrait cartooning of confrontation network is generated based on circulation
CN108230277A (en) * 2018-02-09 2018-06-29 中国人民解放军战略支援部队信息工程大学 A kind of dual intensity CT picture breakdown methods based on convolutional neural networks
CN109741410A (en) * 2018-12-07 2019-05-10 天津大学 Fluorescence-encoded micro-beads image based on deep learning generates and mask method
CN109916933A (en) * 2019-01-04 2019-06-21 中国人民解放军战略支援部队信息工程大学 X ray computer tomographic imaging spectra estimation method based on convolutional neural networks
CN109815893A (en) * 2019-01-23 2019-05-28 中山大学 The normalized method in colorized face images illumination domain of confrontation network is generated based on circulation
CN110176045A (en) * 2019-05-05 2019-08-27 东南大学 A method of dual-energy CT image is generated by single energy CT image
CN109903356A (en) * 2019-05-13 2019-06-18 南京邮电大学 Missing CT data for projection estimation method based on the multiple parsing network of depth
CN110559009A (en) * 2019-09-04 2019-12-13 中山大学 Method, system and medium for converting multi-modal low-dose CT into high-dose CT based on GAN

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
JUN-YAN ZHU: "Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks", 《ARXIV:1703.10593V6》, pages 4 - 5 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113343924A (en) * 2021-07-01 2021-09-03 齐鲁工业大学 Modulation signal identification method based on multi-scale cyclic spectrum feature and self-attention generation countermeasure network
CN114403912A (en) * 2022-01-17 2022-04-29 明峰医疗系统股份有限公司 Energy spectrum CT effective atomic number estimation method based on deep learning

Similar Documents

Publication Publication Date Title
US10489939B2 (en) Spectral CT image reconstructing method and spectral CT imaging system
CN110728727B (en) Low-dose energy spectrum CT projection data recovery method
JP6044046B2 (en) Motion following X-ray CT image processing method and motion following X-ray CT image processing apparatus
Panta et al. First human imaging with MARS photon-counting CT
CN109242920B (en) Method, device and system for decomposing substance
US20220409159A1 (en) Apparatus for generating photon counting spectral image data
Zhao et al. A unified material decomposition framework for quantitative dual‐and triple‐energy CT imaging
CN111179228A (en) Single-energy CT energy spectrum imaging method based on deep learning
CN113167913A (en) Energy weighting of photon counts for conventional imaging
CN109916933B (en) X-ray computed tomography energy spectrum estimation method based on convolutional neural network
Zhou et al. The synthesis of high-energy CT images from low-energy CT images using an improved cycle generative adversarial network
Taguchi et al. Photon counting detector computed tomography
CN109448071A (en) A kind of power spectrum image rebuilding method and system
CN112001978B (en) Method and device for reconstructing image based on dual-energy dual-90-degree CT scanning of generating countermeasure network
Yang et al. Transfer learning framework for low‐dose CT reconstruction based on marginal distribution adaptation in multiscale
CN116664429A (en) Semi-supervised method for removing metal artifacts in multi-energy spectrum CT image
US20230326100A1 (en) Methods and systems related to x-ray imaging
Chen et al. Preliminary research on multi-material decomposition of spectral CT using deep learning
Ogawa et al. Identification of a material with a photon counting x-ray CT system
Zhang et al. A x-ray spectrum estimation method by exploring image-domain characteristic via CNN
Szczykutowicz et al. The dependence of image quality on the number of high and low kVp projections in dual energy CT using the prior image constrained compressed sensing (PICCS) algorithm
CN117456038B (en) Energy spectrum CT iterative expansion reconstruction system based on low-rank constraint
US20240193827A1 (en) Determining a confidence indication for deep learning image reconstruction in computed tomography
Tilley High-quality computed tomography using advanced model-based iterative reconstruction
Haase et al. Estimation of statistical weights for model-based iterative CT reconstruction

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20200519

RJ01 Rejection of invention patent application after publication