CN112150370B - Space compound imaging method and device - Google Patents

Space compound imaging method and device Download PDF

Info

Publication number
CN112150370B
CN112150370B CN201910579569.0A CN201910579569A CN112150370B CN 112150370 B CN112150370 B CN 112150370B CN 201910579569 A CN201910579569 A CN 201910579569A CN 112150370 B CN112150370 B CN 112150370B
Authority
CN
China
Prior art keywords
image
fusion
ultrasonic
kalman
hand
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910579569.0A
Other languages
Chinese (zh)
Other versions
CN112150370A (en
Inventor
杨加成
刘林泉
张强
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
SHENZHEN EMPEROR ELECTRONIC TECHNOLOGY CO LTD
Original Assignee
SHENZHEN EMPEROR ELECTRONIC TECHNOLOGY CO LTD
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by SHENZHEN EMPEROR ELECTRONIC TECHNOLOGY CO LTD filed Critical SHENZHEN EMPEROR ELECTRONIC TECHNOLOGY CO LTD
Priority to CN201910579569.0A priority Critical patent/CN112150370B/en
Publication of CN112150370A publication Critical patent/CN112150370A/en
Application granted granted Critical
Publication of CN112150370B publication Critical patent/CN112150370B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G06T5/92
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/52Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/5215Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of medical diagnostic data
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/52Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/5269Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving detection or reduction of artifacts
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/50Image enhancement or restoration by the use of more than one image, e.g. averaging, subtraction
    • G06T5/70
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10132Ultrasound image
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20212Image combination
    • G06T2207/20221Image fusion; Image merging
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30004Biomedical image processing

Abstract

A spatial compound imaging method and apparatus comprising: and a data acquisition step: scanning the same position along different deflection directions by the probe to obtain ultrasonic images with different deflection angles; and a coordinate conversion step: converting the polar coordinate system of the ultrasonic image into a Cartesian coordinate system; and (3) image fusion: fusing the ultrasonic images through a Kalman space compounding algorithm to generate a fused image; an image correction step: and correcting the fusion image. The Kalman data fusion is introduced into ultrasonic image space compounding by utilizing the characteristics of the Kalman, so that adverse factors such as speckle noise and artifact of an ultrasonic image can be effectively restrained, and in addition, the Kalman data fusion dynamically programs a weighting coefficient according to the variance of related data, so that left bias data and right bias data are fused better, and noise reduction and fusion enhancement effects are achieved.

Description

Space compound imaging method and device
Technical Field
The present application relates to image processing, and more particularly, to a spatial compound imaging method and apparatus.
Background
In recent years, with the continuous progress and development of medical technology, imaging technology has been rapidly developed. The ultrasonic technology is used as an important component of the medical imaging technology, has the characteristics of real-time performance, noninvasive performance, low cost, simple operation and the like in the practical application process, is widely applied clinically, and becomes one of the most common modes of medical diagnosis. The basic principle of ultrasonic imaging is that when ultrasonic pulse encounters an interface with changed acoustic impedance, reflected or scattered pulse signals are generated, and through receiving and processing the signals, images of organs in the body are obtained. Early diagnosis and treatment are therefore of paramount importance.
The prior ultrasonic composite imaging mode has the following defects: the problem of low signal-to-noise ratio exists after imaging; low resolution and low contrast problems; two-dimensional images present speckle noise and artifacts.
Disclosure of Invention
The application provides a space compound imaging method and a space compound imaging device.
According to a first aspect of the present application, there is provided a spatial compounding imaging method comprising:
and a data acquisition step: scanning the same position along different deflection directions by the probe to obtain ultrasonic images with different deflection angles;
and a coordinate conversion step: converting the polar coordinate system of the ultrasonic image into a Cartesian coordinate system;
and (3) image fusion: fusing the ultrasonic images through a Kalman space compounding algorithm to generate a fused image;
an image correction step: and correcting the fusion image.
According to a second aspect of the present application, there is provided a spatial compound imaging device comprising:
the data acquisition module is used for scanning the same position along different deflection directions by using the probe to acquire ultrasonic images with different deflection angles;
the coordinate conversion module is used for converting the polar coordinate system of the ultrasonic image into a Cartesian coordinate system;
the image fusion module is used for fusing the ultrasonic images through a Kalman space compounding algorithm to generate a fused image;
and the image correction module is used for correcting the fusion image.
According to a third aspect of the present application, there is provided an ultrasound doppler fluid signal processing device comprising:
a memory for storing a program;
and a processor for implementing the method as described above by executing the program stored in the memory.
According to a fourth aspect of the present application, there is provided a computer readable storage medium comprising a program executable by a processor to implement a method as described above.
Due to the adoption of the technical scheme, the beneficial effects of the application are that:
in the specific embodiment of the application, the method comprises the steps of fusing ultrasonic images through a Kalman space compounding algorithm, generating a fused image and correcting the fused image; the Kalman data fusion method has the advantages of super high timeliness, congenital advantages in the ultrasonic field and certain filtering effect on data, and the Kalman data fusion is introduced into ultrasonic image space compounding, so that adverse factors such as speckle noise and artifact of ultrasonic images can be effectively restrained by using the characteristics of the Kalman, and the problems of low resolution and low contrast are solved.
Drawings
FIG. 1 is a schematic diagram of a Kalman filtering process in the prior art;
FIG. 2 is a flow chart of a method of the present application in one embodiment;
FIG. 3 is a flow chart of image processing in one embodiment of the method of the present application;
FIG. 4 is a schematic diagram of program modules of the apparatus of the present application in one embodiment.
Detailed Description
The invention will be described in further detail below with reference to the drawings by means of specific embodiments. This application may be embodied in many different forms and is not limited to the implementations described in this example. The following detailed description is provided to facilitate a more thorough understanding of the present disclosure, in which words of upper, lower, left, right, etc., indicating orientations are used solely for the illustrated structure in the corresponding figures.
However, one skilled in the relevant art will recognize that the detailed description of one or more of the specific details may be omitted, or that other methods, components, or materials may be used. In some instances, some embodiments are not described or described in detail.
The numbering of the components itself, e.g. "first", "second", etc., is used herein merely to distinguish between the described objects and does not have any sequential or technical meaning.
Furthermore, the features and aspects described herein may be combined in any suitable manner in one or more embodiments. It will be readily understood by those skilled in the art that the steps or order of operation of the methods associated with the embodiments provided herein may also be varied. Thus, any order in the figures and examples is for illustrative purposes only and does not imply that a certain order is required unless explicitly stated that a certain order is required.
The specific method of Kalman filtering is as follows, and the system model is as follows:the formula is a state transition equation and a measurement equation respectively, wherein k represents time, x (k) is a state vector, z (k) is a measurement vector, matrix A is a state transition matrix of the system, matrix H is a measurement matrix of a sensor, v (k) is state noise, represents noise existing in the motion process of an ultrasonic probe, w (k) is measurement noise, represents noise introduced in the measurement process of the ultrasonic probeLet the variance of the system noise be Q and the variance of the measured noise be R. Fig. 1 is a schematic diagram of a kalman filter flow.
1. The k+1 moment state is deduced according to the k moment state, and the variance P of the state vector is updated:
P(k+1|k)=AP(k)A T +Q
2. correcting the estimated value according to the measurement information, and correcting the variance:
P(k+1)=(I-K(k+1)H k )P(k+1|k)
wherein the matrix K is the kalman gain:
the process can complete the state ground pushing from the moment k to the moment k+1, so that the real-time estimation of the state can be completed according to the measurement information of each moment as long as the initial state of the moment zero is given.
Embodiment one:
as shown in fig. 2 and 3, one embodiment of the spatial compound imaging method of the present application includes the following steps:
step 202: and a data acquisition step: the probe scans the same position along different deflection directions to acquire ultrasonic images with different deflection angles.
The pixel values outside the normal range of the ultrasound image are referred to as outliers, and typically, outliers refer to values outside the range of 3 standard deviations around the average value. Outliers in an image are classified into high outliers and low outliers, typically caused by strong and weak echoes of the organized reflection. For ultrasound, high outliers are typically blurred laterally, in the form of specular artifacts or noise. Low outliers typically occur in areas of shadows or lost reflection information, which is generally less common. The target is scanned from different angles and a set of pixel values obtained for the same target point are also different. For the above reasons, in the ultrasound field, multiple angles or multiple images are compositely imaged, which can effectively reduce blurring and artifacts, and can better visualize the ultrasound non-scannable partial region.
Further, step 202 may include obtaining left-hand images, non-hand images, and right-hand images from the hardware layer.
Step 204: and a coordinate conversion step: and converting the polar coordinate system of the ultrasonic image into a Cartesian coordinate system. For converting the data form into a real form, i.e. matrix-fan.
Step 206: and (3) image fusion: and fusing the ultrasonic images through a Kalman space compounding algorithm to generate a fused image.
When the Kalman fusion is carried out, the fusion is carried out according to the matrix array, and because the two-dimensional Kalman difficulty and the calculated amount are large, only the scanning data are needed to be used as each column in the coordinate conversion according to the actual requirement, and the initial value of the biggest part of the data after the coordinate conversion is 0, so that the Kalman fusion is inhibited to a certain extent from being too sensitive to the initial value.
Further, step 206 may include: carrying out Kalman data fusion on the left partial image and the right partial image to generate the fusion image
Step 208: an image correction step: and correcting the fusion image.
Further, step 208 may include:
and carrying out weighted superposition on the fused image and the unbiased image, wherein the weighting coefficients of the fused image and the unbiased image can be dynamically adjusted, and in the embodiment, the weighting coefficients of the fused image and the unbiased image are both 0.5.
The standard space compounding method has great inhibiting effect on artifact, blurring and abnormal value.
The Kalman data fusion is introduced into ultrasonic image space compounding by utilizing the characteristics of the Kalman, so that adverse factors such as speckle noise and artifact of an ultrasonic image can be effectively restrained, and in addition, the Kalman data fusion dynamically programs a weighting coefficient according to the variance of related data, so that left bias data and right bias data are fused better, and noise reduction and fusion enhancement effects are achieved.
Embodiment two:
as shown in fig. 4, one embodiment of the spatial composite imaging device of the present application includes a data acquisition module, a coordinate conversion module, an image fusion module, and an image correction module.
The data acquisition module is used for scanning the same position along different deflection directions by using the probe to acquire ultrasonic images with different deflection angles;
and the coordinate conversion module is used for converting the polar coordinate system of the ultrasonic image into a Cartesian coordinate system.
The pixel values outside the normal range of the ultrasound image are referred to as outliers, and typically, outliers refer to values outside the range of 3 standard deviations around the average value. Outliers in an image are classified into high outliers and low outliers, typically caused by strong and weak echoes of the organized reflection. For ultrasound, high outliers are typically blurred laterally, in the form of specular artifacts or noise. Low outliers typically occur in areas of shadows or lost reflection information, which is generally less common. The target is scanned from different angles and a set of pixel values obtained for the same target point are also different. For the above reasons, in the ultrasound field, multiple angles or multiple images are compositely imaged, which can effectively reduce blurring and artifacts, and can better visualize the ultrasound non-scannable partial region.
And the image fusion module is used for fusing the ultrasonic images through a Kalman space compounding algorithm to generate a fused image.
When the Kalman fusion is carried out, the fusion is carried out according to the matrix array, and because the two-dimensional Kalman difficulty and the calculated amount are large, only the scanning data are needed to be used as each column in the coordinate conversion according to the actual requirement, and the initial value of the biggest part of the data after the coordinate conversion is 0, so that the Kalman fusion is inhibited to a certain extent from being too sensitive to the initial value.
And the image correction module is used for correcting the fusion image.
The standard space compounding method has great inhibiting effect on artifact, blurring and abnormal value.
Further, the data acquisition module can also be used for acquiring left offset images, unbiased images and right offset images from the hardware layer.
Further, the image fusion module can be further used for carrying out Kalman data fusion on the left-side partial image and the right-side partial image to generate a fusion image.
Further, the image correction module may be further configured to perform weighted superposition on the fused image and the unbiased image. The weighting coefficients of the fused image and the unbiased image can be dynamically adjusted, and in this embodiment, the weighting coefficients of the fused image and the unbiased image are both 0.5.
The Kalman data fusion is introduced into ultrasonic image space compounding by utilizing the characteristics of the Kalman, so that adverse factors such as speckle noise and artifact of an ultrasonic image can be effectively restrained, and in addition, the Kalman data fusion dynamically programs a weighting coefficient according to the variance of related data, so that left bias data and right bias data are fused better, and noise reduction and fusion enhancement effects are achieved.
Embodiment III:
one embodiment of a spatial compound imaging device of the present application includes a memory and a processor.
A memory for storing a program;
a processor configured to implement the method in the first embodiment by executing a program stored in the memory.
Embodiment four:
a computer-readable storage medium including a program executable by a processor to implement the method of the first embodiment.
Those skilled in the art will appreciate that all or part of the steps of the various methods in the above embodiments may be implemented by a program to instruct related hardware, and the program may be stored in a computer readable storage medium, where the storage medium may include: read-only memory, random access memory, magnetic or optical disk, etc.
The foregoing is a further detailed description of the present application in connection with the specific embodiments, and it is not intended that the practice of the present application be limited to such descriptions. It will be apparent to those skilled in the art to which the present application pertains that several simple deductions or substitutions may be made without departing from the spirit of the present application.

Claims (10)

1. A method of spatially compounded imaging, comprising:
and a data acquisition step: scanning the same position along different deflection directions by the probe to obtain ultrasonic images with different deflection angles; wherein, the unbiased image is included;
and a coordinate conversion step: converting the polar coordinate system of the ultrasonic image into a Cartesian coordinate system;
and (3) image fusion: based on a Kalman filtering algorithm, fusing the ultrasonic images to generate a fused image;
an image correction step: and carrying out weighted superposition on the fusion image and the unbiased image.
2. The method of claim 1, wherein the data acquisition step comprises acquiring left-hand, non-hand, and right-hand images from a hardware layer.
3. The method of claim 2, wherein the image fusion step comprises:
and carrying out Kalman data fusion on the left-hand offset image and the right-hand offset image to generate the fusion image.
4. The method of claim 3, wherein,
and the weighting coefficients of the fusion image and the unbiased image are 0.5.
5. A spatial compound imaging apparatus, comprising:
the data acquisition module is used for scanning the same position along different deflection directions by using the probe to acquire ultrasonic images with different deflection angles; wherein, the unbiased image is included;
the coordinate conversion module is used for converting the polar coordinate system of the ultrasonic image into a Cartesian coordinate system;
the image fusion module is used for fusing the ultrasonic images based on a Kalman filtering algorithm to generate a fused image;
and the image correction module is used for carrying out weighted superposition on the fusion image and the unbiased image.
6. The apparatus of claim 5, wherein the data acquisition module is further configured to obtain a left-hand image, an unbiased image, and a right-hand image from a hardware layer.
7. The apparatus of claim 6, wherein the image fusion module is further configured to perform kalman data fusion on the left-hand image and the right-hand image to generate the fused image.
8. The apparatus of claim 7, wherein the weighting coefficients of the fused image and the unbiased image are each 0.5.
9. An ultrasonic doppler fluid signal processing device, comprising:
a memory for storing a program;
a processor for implementing the method according to any one of claims 1-4 by executing a program stored in said memory.
10. A computer readable storage medium comprising a program executable by a processor to implement the method of any one of claims 1-4.
CN201910579569.0A 2019-06-28 2019-06-28 Space compound imaging method and device Active CN112150370B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910579569.0A CN112150370B (en) 2019-06-28 2019-06-28 Space compound imaging method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910579569.0A CN112150370B (en) 2019-06-28 2019-06-28 Space compound imaging method and device

Publications (2)

Publication Number Publication Date
CN112150370A CN112150370A (en) 2020-12-29
CN112150370B true CN112150370B (en) 2024-02-06

Family

ID=73891623

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910579569.0A Active CN112150370B (en) 2019-06-28 2019-06-28 Space compound imaging method and device

Country Status (1)

Country Link
CN (1) CN112150370B (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102949205A (en) * 2011-08-25 2013-03-06 深圳市蓝韵实业有限公司 Method and system for space composite imaging
CN103505288A (en) * 2012-06-29 2014-01-15 通用电气公司 Ultrasonic imaging method and ultrasonic imaging device
CN103584882A (en) * 2012-08-13 2014-02-19 深圳市蓝韵实业有限公司 Spatial compound imaging method and device and ultrasonic imaging system
CN106605257A (en) * 2014-06-09 2017-04-26 美国西门子医疗解决公司 Landmark detection with spatial and temporal constraints in medical imaging
CN107238396A (en) * 2016-03-28 2017-10-10 美国西门子医疗解决公司 The pose recovery of ultrasonic transducer
WO2018129737A1 (en) * 2017-01-16 2018-07-19 深圳迈瑞生物医疗电子股份有限公司 Method for measuring parameters in ultrasonic image and ultrasonic imaging system

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11113812B2 (en) * 2015-08-14 2021-09-07 Elucid Bioimaging Inc. Quantitative imaging for detecting vulnerable plaque

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102949205A (en) * 2011-08-25 2013-03-06 深圳市蓝韵实业有限公司 Method and system for space composite imaging
CN103505288A (en) * 2012-06-29 2014-01-15 通用电气公司 Ultrasonic imaging method and ultrasonic imaging device
CN103584882A (en) * 2012-08-13 2014-02-19 深圳市蓝韵实业有限公司 Spatial compound imaging method and device and ultrasonic imaging system
CN106605257A (en) * 2014-06-09 2017-04-26 美国西门子医疗解决公司 Landmark detection with spatial and temporal constraints in medical imaging
CN107238396A (en) * 2016-03-28 2017-10-10 美国西门子医疗解决公司 The pose recovery of ultrasonic transducer
WO2018129737A1 (en) * 2017-01-16 2018-07-19 深圳迈瑞生物医疗电子股份有限公司 Method for measuring parameters in ultrasonic image and ultrasonic imaging system

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
A Weighted Measurement Fusion Kalman Filter implementation for UAV navigation;Shu Ting Goh 等;《 Aerospace Science and Technology》;1-20 *
Pixel-Level Image Fusion using Kalman Algorithm;S. A. Quadri 等;《International Journal of Signal Processing, Image Processing and Pattern Recognition》;75-86 *
小波图像融合改善超声图像分辨率;戴光智 等;《光学精密工程》;第16卷(第11期);2290-2295 *
通信受限下网络化多传感器系统序贯卡尔曼滤波加权融合;张冬梅 等;《控制与决策》;第32卷(第12期);2162-2168 *

Also Published As

Publication number Publication date
CN112150370A (en) 2020-12-29

Similar Documents

Publication Publication Date Title
US5566674A (en) Method and apparatus for reducing ultrasound image shadowing and speckle
US8157737B2 (en) Method and apparatus for real time spatial compound imaging
US11413006B2 (en) 3D image compounding for ultrasound fetal imaging
JP4831565B2 (en) Method and system for motion correction of ultrasonic volumetric data sets
KR101468418B1 (en) Method and apparatus for processing ultrasound images
RU2653274C2 (en) Coupled segmentation in conventional and contrast ultrasound 3d images
US9123139B2 (en) Ultrasonic image processing with directional interpolation in order to increase the resolution of an image
US20120128223A1 (en) Method and system for processing ultrasound data
JP2009172381A (en) Contrast agent enhanced medical ultrasound diagnostic imaging method, computer-readable storage medium and contrast agent enhanced medical ultrasound diagnostic imaging apparatus
US20130343627A1 (en) Suppression of reverberations and/or clutter in ultrasonic imaging systems
US9186124B2 (en) Ultrasonic diagnostic apparatus, ultrasonic image processing apparatus, and ultrasonic image processing method
US8070683B2 (en) Scan conversion for ultrasonic imaging and apparatus using the same
US20120155727A1 (en) Method and apparatus for providing motion-compensated images
US9384568B2 (en) Method and system for enhanced frame rate upconversion in ultrasound imaging
JP2023525938A (en) Graph-Based Array Signal Denoising for Perturbed Synthetic Aperture Radars
US20090204003A1 (en) Tracking selection for medical diagnostic ultrasound imaging
CN110731795B (en) Processing method and device for spatial compound imaging
Touil et al. Analysis of motion tracking in echocardiographic image sequences: Influence of system geometry and point-spread function
US6306092B1 (en) Method and apparatus for calibrating rotational offsets in ultrasound transducer scans
CN112150370B (en) Space compound imaging method and device
US9888178B2 (en) Method and system for enhanced structural visualization by temporal compounding of speckle tracked 3D ultrasound data
KR20210022056A (en) Synthetic and non-rigid image matching for ultrasonic speckle reduction
KR101097539B1 (en) Ultrasound apparatus and method for compensating volume data
KR100656861B1 (en) Image processing system and method for rendering volume data
Lin et al. Ultrasound image compounding based on motion compensation

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant