WO2021031069A1 - 一种图像重建方法及装置 - Google Patents
一种图像重建方法及装置 Download PDFInfo
- Publication number
- WO2021031069A1 WO2021031069A1 PCT/CN2019/101371 CN2019101371W WO2021031069A1 WO 2021031069 A1 WO2021031069 A1 WO 2021031069A1 CN 2019101371 W CN2019101371 W CN 2019101371W WO 2021031069 A1 WO2021031069 A1 WO 2021031069A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- image
- sample
- processing result
- projection
- resolution
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06T3/4053—Scaling of whole images or parts thereof, e.g. expanding or contracting based on super-resolution, i.e. the output image resolution being higher than the sensor resolution
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06T3/4046—Scaling of whole images or parts thereof, e.g. expanding or contracting using neural networks
Definitions
- This application belongs to the field of computer application technology, and in particular relates to an image reconstruction method and device.
- PET Positron Emission Computed Tomography
- FBP Filtered Back-projection
- the iterative reconstruction algorithm also includes algebraic reconstruction and statistical reconstruction. At present, the maximum likelihood expectation maximization in statistical reconstruction is widely used in clinical and practice because of its better performance. However, when there is relatively serious statistical noise in the projected image, the image quality will produce checkerboard artifacts as the number of iterations increase. This method will amplify the noise accordingly, and the quality of the reconstructed image will be lower.
- the embodiments of the present application provide an image reconstruction method and device, which can solve the problem that image noise is amplified during image reconstruction in the prior art and the quality of the reconstructed image obtained is low.
- an image reconstruction method including:
- mapping matrix super-resolution processing is performed on the first image to obtain a second image; the mapping matrix is obtained by training the acquired sample images and projection images through the decision tree method, and is used to convert low The resolution image is mapped to a high-resolution image; the projection image is obtained by performing affine transformation on the sample image.
- the method before performing super-resolution processing on the first image according to a preset mapping matrix to obtain a second image, the method further includes:
- the mapping relationship is the mapping relationship between the sample processing result and the projection image .
- performing decision tree training on the sample image and the projection image to obtain a sample processing result includes:
- the calculating the loss function between the sample processing result and the projection image, and adjusting a preset mapping relationship according to the loss function to obtain the mapping matrix includes:
- the relationship matrix between the target result and the projected image is determined as the mapping matrix.
- said performing iterative processing on said sample image to obtain said sample processing result according to a preset decision tree method includes:
- the calculation of the square loss function value between each of the sample processing results and the projection image includes:
- N represents the total number of sample images
- x n denotes the n-th sample image
- y n represents the n-th sample image corresponding to the projected image
- X represents the sample image
- Y represents the projected image
- ⁇ represents a preset regularization parameter
- I represents a unit matrix
- the iterative super-resolution processing on the fused image to obtain the sample processing result includes:
- W represents the mapping matrix
- an embodiment of the present application provides an image reconstruction device, including a memory, a processor, and computer-readable instructions stored in the memory and executable on the processor, and the processor executes the The following steps are implemented when computer-readable instructions:
- mapping matrix super-resolution processing is performed on the first image to obtain a second image; the mapping matrix is obtained by training the acquired sample images and projection images through the decision tree method, and is used to convert low The resolution image is mapped to a high-resolution image; the projection image is obtained by performing affine transformation on the sample image.
- an image reconstruction device including:
- the reconstruction unit is configured to perform super-resolution processing on the first image according to a preset mapping matrix to obtain a second image; the mapping matrix is obtained by training the acquired sample images and projection images through a decision tree method , Used to map a low-resolution image to a high-resolution image; the projection image is obtained by performing affine transformation on the sample image.
- an embodiment of the present application provides a computer-readable storage medium that stores computer-readable instructions, the computer-readable instructions include program instructions, and the program instructions when executed by a processor The processor is caused to execute the method of the first aspect described above.
- the embodiments of the present application provide a computer-readable instruction product, which when the computer-readable instruction product runs on a terminal device, causes the terminal device to execute the image reconstruction method described in any one of the above-mentioned first aspects.
- the embodiment of the present application has the following beneficial effects: obtaining the first image to be processed; performing super-resolution processing on the first image according to a preset mapping matrix to obtain the second image.
- the obtained sample image and the projection image are passed through a decision tree method in advance to fit the mapping relationship from the low-resolution image to the high-resolution image, so as to convert the low-resolution positron emission computer
- the tomographic PET mapping is a high-resolution projection image, which improves the quality of the PET image reconstructed in each iteration, so that the reconstruction reaches convergence in advance, and improves the quality of the PET reconstructed image while reducing the number of iterations.
- FIG. 1 is a flowchart of an image reconstruction method provided in Embodiment 1 of the present application.
- FIG. 2 is a flowchart of an image reconstruction method provided by Embodiment 2 of the present application.
- Fig. 3 is an experimental result of image reconstruction provided in the second embodiment of the present application.
- FIG. 4 is a schematic diagram of an image reconstruction device provided in Embodiment 3 of the present application.
- FIG. 5 is a schematic diagram of an image reconstruction device provided in Embodiment 4 of the present application.
- the term “if” can be construed as “when” or “once” or “in response to determination” or “in response to detecting “.
- the phrase “if determined” or “if detected [described condition or event]” can be interpreted as meaning “once determined” or “response to determination” or “once detected [described condition or event]” depending on the context ]” or “in response to detection of [condition or event described]”.
- FIG. 1 is a flowchart of an image reconstruction method provided in Embodiment 1 of the present application.
- the execution subject of the image reconstruction method in this embodiment is a device with an image reconstruction function, including but not limited to devices such as computers, servers, tablets, or terminals.
- the image reconstruction method shown in the figure may include the following steps:
- S101 Acquire a first image to be processed.
- This embodiment proposes a PET positron emission computer tomography image reconstruction algorithm based on a decision tree.
- the super-resolution technology based on the decision tree is added to the PET image reconstruction algorithm based on the stain, and the decision tree is used to fit The model that maps the resolution image to the high resolution image, and super-resolution is performed on the image reconstructed in each iteration. It is possible to reduce the number of iterations to achieve convergence earlier, and at the same time reduce the time to adjust parameters, achieve better reconstruction results under relatively poor parameter settings, and improve the quality of PET reconstructed images.
- Positron emission computed tomography is a relatively advanced clinical examination imaging technology in the field of nuclear medicine, and high-quality PET can improve the diagnosis accuracy of doctors, so improving the PET image reconstruction algorithm has always been the subject of research.
- the existing PET image reconstruction algorithms are mainly divided into two categories: analytical reconstruction algorithms and iterative reconstruction algorithms.
- Analytical reconstruction algorithms mainly include back projection, filtered back projection and Fourier reconstruction.
- One of the most widely used algorithms is filtered back projection.
- Iterative reconstruction algorithms also include algebraic reconstruction and statistical reconstruction.
- maximum likelihood-expectation maximization in statistical reconstruction is widely used in clinical and practice because of its better performance.
- the image quality will produce checkerboard artifacts as the number of iterations increases, but worse. Therefore, there is a penalized likelihood PET image reconstruction algorithm based on color spots that introduces regularization terms.
- the first image in this embodiment is used to represent a PET image with a lower resolution or a reconstructed image.
- the acquisition method can be directly acquired through PET scanning equipment.
- S102 Perform super-resolution processing on the first image according to a preset mapping matrix to obtain a second image; the mapping matrix is obtained by training the acquired sample image and projection image through a decision tree method, and is used for The low-resolution image is mapped to a high-resolution image; the projection image is obtained by performing affine transformation on the sample image.
- the first image in this embodiment is used to represent an acquired low-resolution PET image or a reconstructed image
- the second image is used to represent a high-resolution projection image obtained by performing PET image reconstruction on the first image.
- a machine learning algorithm is added in the process of reconstructing the PET image.
- a decision tree is used to train the low-resolution image block and the corresponding high-resolution image block to fit the low-resolution image
- the mapping relationship that is mapped to the high-resolution image that is, the mapping matrix, is used to perform super-resolution processing on the first image through the mapping matrix to obtain the second image, which improves the quality of the PET image after each iteration and makes the reconstruction reach convergence in advance. It reduces the number of iterations while improving the quality of PET reconstructed images.
- the first image to be processed is acquired; the super-resolution processing is performed on the first image according to the preset mapping matrix to obtain the second image.
- the obtained sample image and the projection image are passed through a decision tree method in advance to fit the mapping relationship from the low-resolution image to the high-resolution image, so as to convert the low-resolution positron emission computer
- the tomographic PET mapping is a high-resolution projection image, which improves the quality of the PET image reconstructed in each iteration, so that the reconstruction reaches convergence in advance, and improves the quality of the PET reconstructed image while reducing the number of iterations.
- FIG. 2 is a flowchart of an image reconstruction method provided by an embodiment of the present application.
- the image reconstruction method as shown in the figure may include the following steps before step S101:
- the sample image in this embodiment may be a reconstructed image, where the reconstructed image x is a PET image of a hospital patient, and the projection image y is obtained by performing affine transformation on x.
- the data obtained in this embodiment is not a projection image collected in real time, so the projection image y is obtained by projecting the reconstructed PET image x, and the super-resolution process is added during the reconstruction of the projection image y into a PET image, and finally the reconstructed PET image is obtained.
- the reconstructed image x is obtained by affine transformation: Among them, P represents the system matrix, which represents the probability that the detector detects a coincidence event for the pixel i in the sample image; r represents a random background event, and s represents a scattering event.
- S203 Perform decision tree training on the sample image and the projection image to obtain a sample processing result.
- Step S203 includes: performing iterative processing on the sample image to obtain the sample processing result according to a preset decision tree method.
- x)- ⁇ U(x); among them, the regularization parameter ⁇ can be set to ⁇ 2 -7 during initialization, we choose Q L (x; x n ), As the likelihood proxy function L(y
- the step of iteratively processing the sample image to obtain the sample processing result according to a preset decision tree method includes S2031 to S2033:
- S2031 According to a preset decision tree method, perform image smoothing iterative processing on the sample image to obtain a smooth image.
- x n represents the nth iteration image
- N j represents the total pixel value of the jth image block
- w jk represents the weight related to the neighborhood block, which is adaptively determined by the penalty function and the current estimated image of each iteration .
- S2032 Perform pixel image fusion iterative processing on the pixels in the smooth image to obtain a fused image.
- the EM image is obtained by updating the sinogram ⁇ y i ⁇ Then get through image smoothing Finally, it is fused pixel by pixel, and the iterative image of each penalty likelihood reconstruction is obtained through the KKT condition: among them,
- the regularization parameter ⁇ is a constant, used to control the weight of the prior and balance the log-likelihood term and the penalty term.
- iterative super-resolution processing is performed on the fused image according to the following formula to obtain the sample processing result:
- W represents the mapping matrix
- Re represents the pixel value of the fused image in the n+1th iteration
- the sample processing result corresponding to the pixel value of the fused image in the n+1th iteration.
- the decision tree is used to perform super-resolution processing.
- the model from low-resolution image to high-resolution image fitted through multiple decision tree training is used to reconstruct the image in each iteration on: among them, It is the mapping matrix fitted by the decision tree training.
- the image x and the high-resolution reference image y reconstructed in each iteration of the low resolution training sample are used to fit the closest mapping from x to y using the decision tree clustering Model, namely W.
- S204 Calculate the loss function between the sample processing result and the projection image, and adjust a preset mapping relationship according to the loss function to obtain the mapping matrix; the mapping relationship is between the sample processing result and the projection image Mapping relations.
- step S204 includes:
- S2041 Calculate the square loss function value between each of the sample processing results and the projection image, and identify the sample processing result when the square loss function value is the smallest as the target result.
- the square loss function value between the processing result of each sample and the projected image is calculated by the following formula: Where N represents the total number of sample images, x n represents the nth sample image, and y n represents the projection image corresponding to the nth sample image;
- mapping matrix fitted by the decision tree training.
- the training sample that is, the image x and the high-resolution reference image y reconstructed in each iteration of the sample image, are mapped from x to y using the decision tree clustering
- the closest model is W.
- W depends on the low-resolution image block x. Then this mapping relationship can be written as,
- S2042 Determine the relationship matrix between the target result and the projection image as the mapping matrix.
- W T (X T X + ⁇ I) -1 X T ⁇ Y can be calculated; where X and Y respectively represent low resolution
- ⁇ I represents the regular term added; I represents the unit matrix; ⁇ represents the regularization parameter, and ⁇ can be set to 0.01.
- T decision trees to obtain T models and the final prediction result is the average of the predicted values of T trees.
- How to train a decision tree is to split and cluster each group of corresponding high- and low-resolution image blocks ⁇ x H , x L ⁇ to the left and right sub-nodes recursively and disjointly, like a binary tree. Until the node sample size is less than 2 and cannot be split or reaches the maximum depth, it stops splitting to form leaf nodes.
- the leaf node model is the model we need to train and fit.
- the principle of splitting is to calculate the response function according to the characteristics of the image block.
- each split will traverse all the features of the image block to select the optimal feature.
- the reference quantity of the optimal feature is defined as:
- (X H c , X L c ) represents the corresponding high and low resolution image blocks split into the left child node and the right child node.
- W(x L n )x L n represents the predicted value of the sample x L n
- represents the number of samples split to the child node, that is, the image block
- k represents the set hyperparameter;
- the decision tree model is not only applied to the image reconstructed in each iteration, but also to the projection image ⁇ y i ⁇ at the beginning of the loop. It only replaces the training set with the projection image calculated by the iterative reconstruction of each back projection and the corresponding original Reference projection.
- the decision tree of this embodiment is to cluster the samples into the last few leaf nodes, that is, several categories through the above-described splitting process, and then find the mapping matrix W through the above-described principle of minimizing the square loss function, that is, to find the mapping model.
- Figure a in Figure 3 is a reference PET image
- Figure b is a PET image reconstructed based on the patch regularization iterative reconstruction algorithm
- Figure c is a PET image reconstructed by the algorithm of this embodiment. It can be seen from the figure that the resolution of the PET image reconstructed in this embodiment is better than the PET image reconstructed based on the patch regularization iterative reconstruction algorithm, and it is also closer to the reference PET image, which fully illustrates the feasibility of the algorithm. It can also be seen from the evaluation parameter table that the image reconstructed by this algorithm is better than patch-based reconstruction on PNSR and SSIM, which further proves the effectiveness of this algorithm.
- the above solution is to obtain the sample image to be trained; perform affine transformation on the sample image to obtain the projection image; perform decision tree training on the sample image and the projection image to obtain the sample processing result; calculate the sample
- the preset mapping relationship is adjusted according to the loss function to obtain the mapping matrix
- the mapping relationship is the mapping relationship between the sample processing result and the projection image.
- FIG. 4 is a schematic diagram of an image reconstruction device provided in Embodiment 3 of the present application.
- the image reconstruction device 400 may be a mobile terminal such as a smart phone or a tablet computer.
- the units included in the image reconstruction apparatus 400 of this embodiment are used to execute the steps in the embodiment corresponding to FIG. 1.
- the image reconstruction device 400 of this embodiment includes:
- the acquiring unit 401 is configured to acquire the first image to be processed
- the reconstruction unit 402 is configured to perform super-resolution processing on the first image according to a preset mapping matrix to obtain a second image; the mapping matrix is used to train the acquired sample images and projection images through a decision tree method Obtained, used to map a low-resolution image to a high-resolution image; the projection image is obtained by performing affine transformation on the sample image.
- the image reconstruction device 400 further includes:
- the first acquiring unit is used to acquire the sample image to be trained
- a transformation unit configured to perform affine transformation on the sample image to obtain the projection image
- a training unit configured to train the sample image and the projection image on a decision tree to obtain a sample processing result
- the calculation unit is configured to calculate a loss function between the sample processing result and the projection image, and adjust a preset mapping relationship according to the loss function to obtain the mapping matrix; the mapping relationship is the sample processing result and the projection The mapping relationship between images.
- the training unit includes:
- An iterative processing unit configured to iteratively process the sample image according to a preset decision tree method to obtain the sample processing result
- calculation unit includes:
- the first calculation unit is configured to calculate the square loss function value between each of the sample processing results and the projection image, and identify the sample processing result when the square loss function value is the smallest as the target result;
- the matrix determination unit is used to determine the relationship matrix between the target result and the projection image as the mapping matrix.
- the iterative processing unit includes:
- a smoothing unit configured to perform image smoothing iterative processing on the sample image according to a preset decision tree method to obtain a smooth image
- a fusion unit configured to perform pixel image fusion iterative processing on the pixels in the smooth image to obtain a fused image
- the super-resolution processing unit is configured to perform iterative super-resolution processing on the fused image to obtain the sample processing result.
- the calculating the square loss function value between each of the sample processing results and the projection image includes:
- N represents the total number of sample images
- x n denotes the n-th sample image
- y n represents the n-th sample image corresponding to the projected image
- X represents the sample image
- Y represents the projected image
- ⁇ represents a preset regularization parameter
- I represents a unit matrix
- the super-resolution processing unit is used for:
- W represents the mapping matrix
- the first image to be processed is acquired; the super-resolution processing is performed on the first image according to the preset mapping matrix to obtain the second image.
- the obtained sample image and the projection image are passed through a decision tree method in advance to fit the mapping relationship from the low-resolution image to the high-resolution image, so as to convert the low-resolution positron emission computer
- the tomographic PET mapping is a high-resolution projection image, which improves the quality of the PET image after each iteration, so that the reconstruction reaches convergence in advance, and improves the quality of the PET reconstruction image while reducing the number of iterations.
- FIG. 5 is a schematic diagram of an image reconstruction apparatus provided in Embodiment 4 of the present application.
- the image reconstruction apparatus 500 in this embodiment as shown in FIG. 5 may include: a processor 501, a memory 502, and computer-readable instructions 503 stored in the memory 502 and running on the processor 501.
- the processor 501 executes the computer-readable instruction 503, the steps in the foregoing image reconstruction method embodiments are implemented.
- the memory 502 is configured to store computer-readable instructions, and the computer-readable instructions include program instructions.
- the processor 501 is configured to execute program instructions stored in the memory 502. Wherein, the processor 501 is configured to call the program instructions to perform the following operations:
- the processor 501 is used for:
- the mapping relationship is the mapping relationship between the sample processing result and the projection image .
- processor 501 is specifically configured to:
- the calculating the loss function between the sample processing result and the projection image, and adjusting a preset mapping relationship according to the loss function to obtain the mapping matrix includes:
- the relationship matrix between the target result and the projected image is determined as the mapping matrix.
- processor 501 is specifically configured to:
- the calculating the square loss function value between each of the sample processing results and the projection image includes:
- N represents the total number of sample images
- x n denotes the n-th sample image
- y n represents the n-th sample image corresponding to the projected image
- X represents the sample image
- Y represents the projected image
- ⁇ represents a preset regularization parameter
- I represents a unit matrix
- processor 501 is specifically configured to:
- W represents the mapping matrix
- the first image to be processed is acquired; the super-resolution processing is performed on the first image according to the preset mapping matrix to obtain the second image.
- the obtained sample image and the projection image are passed through a decision tree method in advance to fit the mapping relationship from the low-resolution image to the high-resolution image, so as to convert the low-resolution positron emission computer
- the tomographic PET mapping is a high-resolution projection image, which improves the quality of the PET image after each iteration, so that the reconstruction reaches convergence in advance, and improves the quality of the PET reconstructed image while reducing the number of iterations.
- the processor 501 may be a central processing unit (Central Processing Unit, CPU), and the processor may also be other general-purpose processors or digital signal processors (DSP). , Application Specific Integrated Circuit (ASIC), Field-Programmable Gate Array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc.
- the general-purpose processor may be a microprocessor or the processor may also be any conventional processor or the like.
- the memory 502 may include a read-only memory and a random access memory, and provides instructions and data to the processor 501.
- a part of the memory 502 may also include a non-volatile random access memory.
- the memory 502 may also store device type information.
- the processor 501, memory 502, and computer-readable instructions 503 described in the embodiments of this application can execute the implementations described in the first embodiment and the second embodiment of the image reconstruction method provided in the embodiments of this application.
- the way, the implementation way of the terminal described in the embodiment of this application can also be implemented, which will not be repeated here.
- a computer-readable storage medium stores computer-readable instructions, the computer-readable instructions include program instructions, and the program instructions are executed by a processor When realized:
- the mapping relationship is the mapping relationship between the sample processing result and the projection image .
- the calculating the loss function between the sample processing result and the projection image, and adjusting a preset mapping relationship according to the loss function to obtain the mapping matrix includes:
- the relationship matrix between the target result and the projected image is determined as the mapping matrix.
- N represents the total number of sample images
- x n denotes the n-th sample image
- y n represents the n-th sample image corresponding to the projected image
- X represents the sample image
- Y represents the projected image
- ⁇ represents a preset regularization parameter
- I represents a unit matrix
- W represents the mapping matrix
- the first image to be processed is acquired; the super-resolution processing is performed on the first image according to the preset mapping matrix to obtain the second image.
- the obtained sample image and the projection image are passed through a decision tree method in advance to fit the mapping relationship from the low-resolution image to the high-resolution image, so as to convert the low-resolution positron emission computer
- the tomographic PET mapping is a high-resolution projection image, which improves the quality of the PET image reconstructed in each iteration, so that the reconstruction reaches convergence in advance, and improves the quality of the PET reconstructed image while reducing the number of iterations.
- the computer-readable storage medium may be the internal storage unit of the terminal described in any of the foregoing embodiments, such as the hard disk or memory of the terminal.
- the computer-readable storage medium may also be an external storage device of the terminal, such as a plug-in hard disk equipped on the terminal, a smart memory card (Smart Media Card, SMC), or a Secure Digital (SD) card , Flash Card, etc.
- the computer-readable storage medium may also include both an internal storage unit of the terminal and an external storage device.
- the computer-readable storage medium is used to store the computer-readable instructions and other programs and data required by the terminal.
- the computer-readable storage medium can also be used to temporarily store data that has been output or will be output.
- the disclosed terminal and method can be implemented in other ways.
- the device embodiments described above are only illustrative.
- the division of the units is only a logical function division, and there may be other divisions in actual implementation, for example, multiple units or components can be combined or It can be integrated into another system, or some features can be ignored or not implemented.
- the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may also be electrical, mechanical or other forms of connection.
- the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions of the embodiments of the present application.
- the functional units in the various embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit.
- the above-mentioned integrated unit can be implemented in the form of hardware or software functional unit.
- the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer readable storage medium.
- the technical solution of this application is essentially or the part that contributes to the existing technology, or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium It includes several instructions to make a computer device (which may be a personal computer, a server, or a network device, etc.) execute all or part of the steps of the method described in each embodiment of the present application.
- the aforementioned storage media include: U disk, mobile hard disk, read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disk or optical disk and other media that can store program code .
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Artificial Intelligence (AREA)
- Evolutionary Computation (AREA)
- Apparatus For Radiation Diagnosis (AREA)
- Image Processing (AREA)
Abstract
Description
| 评估参数 | 峰值信噪比PNSR | 结构相似形SSIM |
| 基于patch的重建图像 | 29.67 | 0.87 |
| 本实施例的重建图像 | 34.51 | 0.88 |
Claims (20)
- 一种图像重建方法,其特征在于,包括:获取待处理的第一图像;根据预设的映射矩阵,对所述第一图像进行超分辨处理,得到第二图像;所述映射矩阵为对获取到的样本图像和投影图像通过决策树的方法进行训练得到,用于将低分辨率图像映射为高分辨率图像;所述投影图像为对所述样本图像进行仿射变换得到。
- 如权利要求1所述的图像重建方法,其特征在于,所述根据预设的映射矩阵,对所述第一图像进行超分辨处理,得到第二图像之前,还包括:获取待训练的样本图像;对所述样本图像进行仿射变换得到所述投影图像;对所述样本图像和所述投影图像进行决策树训练,得到样本处理结果;计算所述样本处理结果和所述投影图像之间的损失函数,根据所述损失函数调整预设的映射关系,得到所述映射矩阵;所述映射关系为样本处理结果和投影图像之间映射关系。
- 如权利要求2所述的图像重建方法,其特征在于,所述对所述样本图像和所述投影图像进行决策树训练,得到样本处理结果,包括:根据预设的决策树方法,对所述样本图像进行迭代处理得到所述样本处理结果;所述计算所述样本处理结果和所述投影图像之间的损失函数,根据所述损失函数调整预设的映射关系,得到所述映射矩阵,包括:计算每个所述样本处理结果与所述投影图像之间的平方损失函数值,识别所述平方损失函数值最小时的样本处理结果为目标结果;确定所述目标结果和所述投影图像之间的关系矩阵,作为所述映射矩阵。
- 如权利要求3所述的图像重建方法,其特征在于,所述根据预设的决策树方法,对所述样本图像进行迭代处理得到所述样本处理结果,包括:根据预设的决策树方法,对所述样本图像进行图像平滑迭代处理得到平滑图像;对所述平滑图像中的像素点进行像素图像融合迭代处理,得到融合图像;对所述融合图像进行迭代的超分辨处理,得到所述样本处理结果。
- 一种图像重建装置,其特征在于,包括:获取单元,用于获取待处理的第一图像;重建单元,用于根据预设的映射矩阵,对所述第一图像进行超分辨处理,得到第二图像;所述映射矩阵为对获取到的样本图像和投影图像通过决策树的方法进行训练得到,用于将低分辨率图像映射为高分辨率图像;所述投影图像为对所述样本图像进行仿射变换得到。
- 如权利要求8所述的图像重建装置,其特征在于,所述图像重建装置还包括:第一获取单元,用于获取待训练的样本图像;变换单元,用于对所述样本图像进行仿射变换得到所述投影图像;训练单元,用于对所述样本图像和所述投影图像进行决策树训练,得到样本处理结果;计算单元,用于计算所述样本处理结果和所述投影图像之间的损失函数,根据所述损失函数调整预设的映射关系,得到所述映射矩阵;所述映射关系为样本处理结果和投影图像之间映射关系。
- 如权利要求9所述的图像重建装置,其特征在于,所述训练单元包括:迭代处理单元,用于迭代根据预设的决策树方法,对所述样本图像进行迭代处理得到所述样本处理结果;所述计算单元包括:第一计算单元,用于计算每个所述样本处理结果与所述投影图像之间的平方损失函数值,识别所述平方损失函数值最小时的样本处理结果为目标结果;矩阵确定单元,用于确定所述目标结果和所述投影图像之间的关系矩阵,作为所述映射矩阵。
- 一种图像重建装置,包括存储器、处理器以及存储在所述存储器中并可在所述处理器上运行的计算机可读指令,其特征在于,所述处理器执行所述计算机可读指令时实现 如下步骤:获取待处理的第一图像;根据预设的映射矩阵,对所述第一图像进行超分辨处理,得到第二图像;所述映射矩阵为对获取到的样本图像和投影图像通过决策树的方法进行训练得到,用于将低分辨率图像映射为高分辨率图像;所述投影图像为对所述样本图像进行仿射变换得到。
- 如权利要求11所述的图像重建装置,其特征在于,所述根据预设的映射矩阵,对所述第一图像进行超分辨处理,得到第二图像之前,还包括:获取待训练的样本图像;对所述样本图像进行仿射变换得到所述投影图像;对所述样本图像和所述投影图像进行决策树训练,得到样本处理结果;计算所述样本处理结果和所述投影图像之间的损失函数,根据所述损失函数调整预设的映射关系,得到所述映射矩阵;所述映射关系为样本处理结果和投影图像之间映射关系。
- 如权利要求12所述的图像重建装置,其特征在于,所述对所述样本图像和所述投影图像进行决策树训练,得到样本处理结果,包括:根据预设的决策树方法,对所述样本图像进行迭代处理得到所述样本处理结果;所述计算所述样本处理结果和所述投影图像之间的损失函数,根据所述损失函数调整预设的映射关系,得到所述映射矩阵,包括:计算每个所述样本处理结果与所述投影图像之间的平方损失函数值,识别所述平方损失函数值最小时的样本处理结果为目标结果;确定所述目标结果和所述投影图像之间的关系矩阵,作为所述映射矩阵。
- 如权利要求13所述的图像重建装置,其特征在于,所述根据预设的决策树方法,对所述样本图像进行迭代处理得到所述样本处理结果,包括:根据预设的决策树方法,对所述样本图像进行图像平滑迭代处理得到平滑图像;对所述平滑图像中的像素点进行像素图像融合迭代处理,得到融合图像;对所述融合图像进行迭代的超分辨处理,得到所述样本处理结果。
- 一种计算机可读存储介质,所述计算机可读存储介质存储有计算机可读指令,其特征在于,所述计算机可读指令被处理器执行时实现如下步骤:获取待处理的第一图像;根据预设的映射矩阵,对所述第一图像进行超分辨处理,得到第二图像;所述映射矩阵为对获取到的样本图像和投影图像通过决策树的方法进行训练得到,用于将低分辨率图像映射为高分辨率图像;所述投影图像为对所述样本图像进行仿射变换得到。
- 如权利要求18所述的计算机可读存储介质,其特征在于,所述根据预设的映射矩阵,对所述第一图像进行超分辨处理,得到第二图像之前,还包括:获取待训练的样本图像;对所述样本图像进行仿射变换得到所述投影图像;对所述样本图像和所述投影图像进行决策树训练,得到样本处理结果;计算所述样本处理结果和所述投影图像之间的损失函数,根据所述损失函数调整预设的映射关系,得到所述映射矩阵;所述映射关系为样本处理结果和投影图像之间映射关系。
- 如权利要求19所述的计算机可读存储介质,其特征在于,所述对所述样本图像和所述投影图像进行决策树训练,得到样本处理结果,包括:根据预设的决策树方法,对所述样本图像进行迭代处理得到所述样本处理结果;所述计算所述样本处理结果和所述投影图像之间的损失函数,根据所述损失函数调整预设的映射关系,得到所述映射矩阵,包括:计算每个所述样本处理结果与所述投影图像之间的平方损失函数值,识别所述平方损失函数值最小时的样本处理结果为目标结果;确定所述目标结果和所述投影图像之间的关系矩阵,作为所述映射矩阵。
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2019/101371 WO2021031069A1 (zh) | 2019-08-19 | 2019-08-19 | 一种图像重建方法及装置 |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2019/101371 WO2021031069A1 (zh) | 2019-08-19 | 2019-08-19 | 一种图像重建方法及装置 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2021031069A1 true WO2021031069A1 (zh) | 2021-02-25 |
Family
ID=74660142
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2019/101371 Ceased WO2021031069A1 (zh) | 2019-08-19 | 2019-08-19 | 一种图像重建方法及装置 |
Country Status (1)
| Country | Link |
|---|---|
| WO (1) | WO2021031069A1 (zh) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115700785A (zh) * | 2021-07-16 | 2023-02-07 | 顺丰科技有限公司 | 图像特征提取方法、装置、电子设备及存储介质 |
| CN115830362A (zh) * | 2022-11-02 | 2023-03-21 | 抖音视界有限公司 | 图像处理方法、装置、设备、介质及产品 |
| CN116403114A (zh) * | 2023-04-18 | 2023-07-07 | 中科开采夫(海南)空天信息研究院有限公司 | 一种基于深度学习的遥感影像目标识别方法及系统 |
| CN117726656A (zh) * | 2024-02-08 | 2024-03-19 | 开拓导航控制技术股份有限公司 | 基于超分辨率图像的目标跟踪方法、装置、系统和介质 |
| CN120147132A (zh) * | 2025-02-28 | 2025-06-13 | 西安邮电大学 | 一种基于图像超分辨的激光焦点动态跟踪方法及系统 |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130156297A1 (en) * | 2011-12-15 | 2013-06-20 | Microsoft Corporation | Learning Image Processing Tasks from Scene Reconstructions |
| US20190090826A1 (en) * | 2017-09-26 | 2019-03-28 | General Electric Company | Systems and methods for improved diagnostics for nuclear medicine imaging |
| CN109564677A (zh) * | 2018-11-09 | 2019-04-02 | 香港应用科技研究院有限公司 | 基于随机森林分类器加权结果的超分辨率合成系统和方法 |
| CN109598676A (zh) * | 2018-11-15 | 2019-04-09 | 华南理工大学 | 一种基于哈达玛变换的单幅图像超分辨率方法 |
| CN109961834A (zh) * | 2019-03-22 | 2019-07-02 | 上海联影医疗科技有限公司 | 影像诊断报告的生成方法及设备 |
-
2019
- 2019-08-19 WO PCT/CN2019/101371 patent/WO2021031069A1/zh not_active Ceased
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130156297A1 (en) * | 2011-12-15 | 2013-06-20 | Microsoft Corporation | Learning Image Processing Tasks from Scene Reconstructions |
| US20190090826A1 (en) * | 2017-09-26 | 2019-03-28 | General Electric Company | Systems and methods for improved diagnostics for nuclear medicine imaging |
| CN109564677A (zh) * | 2018-11-09 | 2019-04-02 | 香港应用科技研究院有限公司 | 基于随机森林分类器加权结果的超分辨率合成系统和方法 |
| CN109598676A (zh) * | 2018-11-15 | 2019-04-09 | 华南理工大学 | 一种基于哈达玛变换的单幅图像超分辨率方法 |
| CN109961834A (zh) * | 2019-03-22 | 2019-07-02 | 上海联影医疗科技有限公司 | 影像诊断报告的生成方法及设备 |
Non-Patent Citations (1)
| Title |
|---|
| HU ZHANLI, WANG YING, ZHANG XUEZHU, ZHANG MENGXI, YANG YONGFENG, LIU XIN, ZHENG HAIRONG, LIANG DONG: "Super-resolution of PET image based on dictionary learning and random forests", NUCLEAR INSTRUMENTS & METHODS IN PHYSICS RESEARCH. SECTION A, ELSEVIER BV * NORTH-HOLLAND, NL, vol. 927, 1 May 2019 (2019-05-01), NL, pages 320 - 329, XP055783319, ISSN: 0168-9002, DOI: 10.1016/j.nima.2019.02.042 * |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115700785A (zh) * | 2021-07-16 | 2023-02-07 | 顺丰科技有限公司 | 图像特征提取方法、装置、电子设备及存储介质 |
| CN115830362A (zh) * | 2022-11-02 | 2023-03-21 | 抖音视界有限公司 | 图像处理方法、装置、设备、介质及产品 |
| CN116403114A (zh) * | 2023-04-18 | 2023-07-07 | 中科开采夫(海南)空天信息研究院有限公司 | 一种基于深度学习的遥感影像目标识别方法及系统 |
| CN117726656A (zh) * | 2024-02-08 | 2024-03-19 | 开拓导航控制技术股份有限公司 | 基于超分辨率图像的目标跟踪方法、装置、系统和介质 |
| CN117726656B (zh) * | 2024-02-08 | 2024-06-04 | 开拓导航控制技术股份有限公司 | 基于超分辨率图像的目标跟踪方法、装置、系统和介质 |
| CN120147132A (zh) * | 2025-02-28 | 2025-06-13 | 西安邮电大学 | 一种基于图像超分辨的激光焦点动态跟踪方法及系统 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2021031069A1 (zh) | 一种图像重建方法及装置 | |
| CN109712209B (zh) | Pet图像的重建方法、计算机存储介质、计算机设备 | |
| CN107123095B (zh) | 一种pet图像重建方法、成像系统 | |
| CN107133996B (zh) | 产生用于pet数据重建的衰减图的方法及pet/ct系统 | |
| CN107481297B (zh) | 一种基于卷积神经网络的ct图像重建方法 | |
| WO2021159948A1 (zh) | 一种基于深度学习的低剂量pet三维重建方法 | |
| CN109961491A (zh) | 多模态图像截断补偿方法、装置、计算机设备和介质 | |
| CN107527359A (zh) | 一种pet图像重建方法及pet成像设备 | |
| CN111709897B (zh) | 一种基于域变换的正电子发射断层图像的重建方法 | |
| CN111325695B (zh) | 基于多剂量等级的低剂量图像增强方法、系统及存储介质 | |
| CN103186882B (zh) | Pet系统中图像的衰减校正方法及装置 | |
| WO2020118829A1 (zh) | 基于决策树的pet图像超分辨重建方法、装置、设备及介质 | |
| US12597189B2 (en) | Methods and apparatus for synthetic computed tomography image generation | |
| WO2020118830A1 (zh) | 字典训练及图像超分辨重建方法、系统、设备及存储介质 | |
| CN108038840A (zh) | 一种图像处理方法、装置、图像处理设备及存储介质 | |
| CN110580689A (zh) | 一种图像重建方法及装置 | |
| CN109961435B (zh) | 脑图像获取方法、装置、设备及存储介质 | |
| CN110874855A (zh) | 一种协同成像方法、装置、存储介质和协同成像设备 | |
| CN108537755B (zh) | 一种基于几何结构约束的pet图像增强的方法及系统 | |
| CN116228753A (zh) | 肿瘤预后评估方法、装置、计算机设备和存储介质 | |
| WO2021184350A1 (zh) | 一种基于神经网络的网格化磁共振图像重建方法和装置 | |
| CN114862980A (zh) | 散射校正方法、pet成像方法、装置、设备及存储介质 | |
| CN114549594A (zh) | 图像配准方法、装置和电子设备 | |
| CN113469915A (zh) | 一种基于去噪打分匹配网络的pet重建方法 | |
| WO2025067508A1 (zh) | 用于处理扫描数据的方法、装置、计算机设备和存储介质 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 19942309 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 19942309 Country of ref document: EP Kind code of ref document: A1 |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 19942309 Country of ref document: EP Kind code of ref document: A1 |
|
| 32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 16.02.2023) |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 19942309 Country of ref document: EP Kind code of ref document: A1 |



