WO2021169086A1 - Method, apparatus and device for generating four-dimensional radiographic image, and storage medium - Google Patents

Method, apparatus and device for generating four-dimensional radiographic image, and storage medium Download PDF

Info

Publication number
WO2021169086A1
WO2021169086A1 PCT/CN2020/096260 CN2020096260W WO2021169086A1 WO 2021169086 A1 WO2021169086 A1 WO 2021169086A1 CN 2020096260 W CN2020096260 W CN 2020096260W WO 2021169086 A1 WO2021169086 A1 WO 2021169086A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
ultrasound probe
contrast
dimensional
swing
Prior art date
Application number
PCT/CN2020/096260
Other languages
French (fr)
Chinese (zh)
Inventor
黄文政
刘旭江
唐艳红
Original Assignee
深圳开立生物医疗科技股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳开立生物医疗科技股份有限公司 filed Critical 深圳开立生物医疗科技股份有限公司
Publication of WO2021169086A1 publication Critical patent/WO2021169086A1/en

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/48Diagnostic techniques
    • A61B8/481Diagnostic techniques involving the use of contrast agent, e.g. microbubbles introduced into the bloodstream
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/52Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/5215Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of medical diagnostic data
    • A61B8/5223Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of medical diagnostic data for extracting a diagnostic or physiological parameter from medical diagnostic data
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/52Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/5269Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving detection or reduction of artifacts

Definitions

  • This application relates to the field of image processing technology, and in particular to a method, device, equipment, and storage medium for generating a four-dimensional contrast image.
  • radiography is to take in substances containing elements with high atomic number, and then take radiographs in the body to be diagnosed for medical diagnosis.
  • a substance with a density higher or lower than that of the structure or organ that is, a contrast agent, can be introduced into the organ or the space around it to produce a contrast image.
  • the purpose of this application is to provide a method, device, equipment and storage medium for generating a four-dimensional contrast image, so as to avoid the problem of color confusion in the generated four-dimensional contrast image.
  • a method for generating four-dimensional contrast images including:
  • the positioning information of the ultrasound probe determine whether the swing of the ultrasound probe reaches a preset correction condition
  • the four-dimensional time-rendered image is generated based on the contrast data.
  • a positioning device is provided on the ultrasound probe, and the determining whether the swing of the ultrasound probe reaches a preset correction condition according to the positioning information of the ultrasound probe includes:
  • the determining whether the swing of the ultrasonic probe reaches a preset correction condition according to the spatial rotation angle and translation distance includes:
  • the spatial rotation angle is greater than the preset angle threshold and/or the translation distance is greater than the preset distance threshold, it is determined that the swing of the ultrasound probe reaches the preset correction condition.
  • the positioning device is an electromagnetic positioning device
  • the correction of the imaging data includes:
  • coordinate transformation is performed on the contrast data on the electromagnetic positioning coordinate system and converted back to the ultrasound image coordinate system to obtain the corrected contrast data.
  • the method further includes :
  • the noise points are eliminated from the contrast data.
  • the determining whether each voxel in the contrast data is a noise point includes:
  • the voxels whose corresponding gray-level average value is less than the preset gray-level threshold are determined as noise points.
  • the determining the average gray value corresponding to each voxel in the contrast data includes:
  • the ratio of the gray scale corresponding to each voxel to the number of voxels in the corresponding area is determined as the mean gray scale corresponding to each voxel.
  • the method further includes:
  • the target part is segmented from the complete angiography data of the target part according to a three-dimensional region growth method.
  • a four-dimensional contrast image generating device including:
  • An imaging data obtaining module which is used to obtain the imaging data of the current frame of the target part
  • a judging module configured to determine whether the swing of the ultrasonic probe reaches a preset correction condition according to the positioning information of the ultrasonic probe;
  • An contrast data correction module configured to correct the contrast data when it is determined that the swing of the ultrasound probe reaches the preset correction condition
  • An angiographic image generating module configured to generate a four-dimensional time-rendered image based on the corrected angiographic data
  • the contrast image generation module is further configured to generate the four-dimensional time-rendered image based on the contrast data when it is determined that the swing of the ultrasound probe does not reach the preset correction condition.
  • a four-dimensional radiography image generating device including:
  • Memory used to store computer programs
  • the processor is configured to implement the steps of any one of the four-dimensional contrast image generation methods described above when the computer program is executed.
  • a computer-readable storage medium having a computer program stored on the computer-readable storage medium, and when the computer program is executed by a processor, realizes the steps of any one of the above-mentioned four-dimensional image generation methods.
  • the contrast data of the current frame of the target part after obtaining the contrast data of the current frame of the target part, according to the spatial position of the ultrasound probe of the current frame, it is determined whether the oscillation of the ultrasound probe reaches the preset correction condition. If it reaches, the contrast data can be compared Perform correction and generate a four-dimensional contrast image based on the corrected contrast data. If it does not reach, then generate a four-dimensional contrast image based on the contrast data. When the swing of the ultrasound probe reaches the correction condition, the contrast data of the current frame is corrected and then the four-dimensional contrast image is generated.
  • FIG. 1 is an implementation flowchart of a method for generating a four-dimensional contrast image in an embodiment of the application
  • FIG. 3 is a comparison diagram before and after preprocessing the angiography data in an embodiment of the application
  • FIG. 5 is a schematic structural diagram of a four-dimensional contrast image generating device in an embodiment of the application.
  • Fig. 6 is a schematic structural diagram of a four-dimensional contrast image generating device in an embodiment of the application.
  • an implementation flowchart of a method for generating a four-dimensional angiography image provided by an embodiment of this application.
  • the method may include the following steps:
  • the target part is the part in the body to be diagnosed, such as the uterus and fallopian tubes.
  • a bolus of contrast agent can be injected to the target site to obtain contrast data.
  • the contrast of the target part can be scanned to obtain the contrast data of the current frame.
  • the contrast data may be a three-dimensional contrast image.
  • S120 According to the positioning information of the ultrasound probe, determine whether the swing of the ultrasound probe reaches a preset correction condition.
  • Contrast data can be collected by an ultrasound probe. While obtaining the contrast data of the current frame of the target part, the positioning information of the ultrasound probe can be obtained. Specifically, the probe positioning technology can be used to obtain the positioning information of the ultrasound probe. Through the positioning information, the spatial position of the ultrasound probe in the current frame can be determined.
  • Electromagnetic positioning technology has the advantages of high accuracy, convenient and flexible operation, and no line of sight obstruction.
  • the electromagnetic positioning system mainly includes an electromagnetic transmitter and a probe receiver.
  • the electromagnetic transmitter collects the positioning information of the ultrasonic probe through the feedback signal of the probe receiver.
  • the positioning information of the ultrasound probe it can be determined whether the swing of the ultrasound probe is too large and whether the preset correction condition is reached.
  • the preset correction conditions can be set and adjusted according to actual conditions.
  • step S130 when the swing of the ultrasound probe reaches the preset correction condition, the operation of step S130 can be continued to correct the contrast data of the current frame. If the swing of the ultrasound probe does not reach the preset correction condition, Then, the contrast data of the current frame may not be corrected, and the operation of step S140 is performed, and the contrast data of the current frame is directly used to generate a four-dimensional time-rendered image.
  • the positioning information of the ultrasound probe it can be determined whether the swing of the ultrasound probe is too large and whether the preset correction condition is reached. If it is determined that the swing of the ultrasound probe reaches the preset correction condition, the contrast data of the current frame can be corrected.
  • the angiographic data of the current frame can be corrected by means of spatial coordinate transformation.
  • a four-dimensional time contrast image can be generated based on the corrected angiography data.
  • the corrected contrast data of the current frame can be compared with the contrast data of the previous frame to obtain a new contrast area, and fill the corresponding color in the newly appeared contrast area to generate a four-dimensional time rendered image.
  • the contrast data of the previous frame may be the contrast data of the previous frame that does not require correction processing, or the contrast data of the previous frame that has undergone correction processing.
  • the contrast data of the current frame can be compared with the contrast data of the previous frame to obtain a new contrast area, fill the corresponding color in the newly appeared contrast area, and generate a four-dimensional time-rendered image.
  • the contrast area corresponding to different times can correspond to different colors.
  • the contrast data of the previous frame may be the contrast data of the previous frame that does not require correction processing, or the contrast data of the previous frame that has undergone correction processing.
  • multiple color pseudo colors can be used to correspond the flow of the contrast agent over time to the color one-to-one.
  • the four-dimensional time-rendered image it is convenient to visually observe the direction and process of the flow of the contrast agent.
  • the contrast data of each frame of the target part can be obtained in real time, and the contrast data of each frame can be processed in real time to generate a four-dimensional time rendered image.
  • the target can be obtained based on the recorded relevant data.
  • the imaging data of each frame of the part, and the steps of this application are executed for each frame of the imaging data to generate a four-dimensional time-rendered image.
  • the contrast data of each frame of the target part can be obtained in real time, and the contrast data of each frame can be processed in real time, and relevant data, such as contrast data that does not need to be processed, are recorded. , Processed angiography data, etc., when the generation of a four-dimensional time-rendered image is required in the later stage, a four-dimensional time-rendered image is generated based on the recorded related data.
  • a positioning device is provided on the ultrasound probe, and step S120 may include the following steps:
  • Step 1 Determine the spatial position of the ultrasound probe in the current frame according to the positioning information of the ultrasound probe
  • Step 2 Compare the spatial position of the ultrasound probe in the current frame with the spatial position of the ultrasound probe in the first frame obtained in advance to determine the spatial rotation angle and translation distance of the ultrasound probe;
  • Step 3 Determine whether the swing of the ultrasonic probe reaches the preset correction condition according to the spatial rotation angle and translation distance.
  • a positioning device may be provided on the ultrasonic probe, and the positioning device may be a probe receiver in an electromagnetic positioning system.
  • the electromagnetic transmitter of the electromagnetic positioning system can collect and obtain the ultrasonic probe through the feedback signal of the probe receiver. Location information.
  • the spatial position of the ultrasound probe of the first frame can be obtained in advance through the electromagnetic positioning system.
  • the spatial position of the ultrasound probe of the current frame can be determined according to the positioning information of the ultrasound probe.
  • the spatial position of the ultrasound probe of the current frame is compared with the spatial position of the ultrasound probe of the first frame, and the spatial rotation angle and translation distance of the ultrasound probe can be determined according to the comparison result. That is, the spatial position of the ultrasound probe in the first frame is used as a reference to determine the spatial rotation angle and translation distance of the ultrasound probe in the current frame.
  • the determined spatial rotation angle and translation distance it can be determined whether the swing of the ultrasonic probe reaches the preset correction condition. Specifically, if the spatial rotation angle is greater than the preset angle threshold and/or the translation distance is greater than the preset distance threshold, it can be determined that the swing of the ultrasound probe reaches the preset correction condition.
  • the angle threshold and distance threshold can be set and adjusted according to the actual situation.
  • the spatial rotation angle of the ultrasound probe is greater than the preset angle threshold and/or the translation distance is greater than the preset distance threshold, it can be considered that the swing of the ultrasound probe is too large, which will cause the image to shift and cause the color of the rendering result of the time imaging to be disordered. In this case, it can be determined that the swing of the ultrasonic probe has reached the preset correction condition.
  • the spatial rotation angle and translation distance of the ultrasound probe are determined, so that the ultrasound probe can be accurately determined according to the spatial rotation angle and translation distance. Whether the swing reaches the preset correction condition.
  • step S130 to correct the angiographic data may include the following steps:
  • the first step Determine the electromagnetic positioning coordinate system as the world coordinate system
  • the second step Convert the ultrasound image coordinate system to the electromagnetic positioning coordinate system
  • the third step determine the affine matrix of the ultrasonic probe swing
  • the fourth step Combining the affine matrix, perform coordinate transformation on the contrast data in the electromagnetic positioning coordinate system, and convert it back to the ultrasound image coordinate system to obtain the corrected contrast data.
  • an electromagnetic positioning system may be used to perform positioning information of the ultrasound probe.
  • the position of the electromagnetic transmitter in the electromagnetic positioning system is not moving, and the electromagnetic positioning coordinate system can be determined as the world coordinate system.
  • the contrast data can be corrected.
  • the swing of the ultrasound probe is in the electromagnetic positioning coordinate system, and the ultrasound image coordinate system can be converted to the electromagnetic positioning coordinate system first, and then the affine matrix of the ultrasound probe swing can be determined.
  • the contrast data is transformed on the electromagnetic positioning coordinate system and converted back to the ultrasound image coordinate system to obtain the corrected contrast data.
  • the three-dimensional affine matrix of the ultrasound probe obtained by calculation is as follows:
  • step S110 obtains the contrast data of the current frame of the target part and before step S120 determines whether the oscillation of the ultrasound probe reaches the preset correction condition according to the positioning information of the ultrasound probe
  • the method may further include the following step:
  • Step 1 Determine whether each voxel in the angiographic data is a noise point
  • Step 2 Eliminate noise points in the angiographic data.
  • the contrast data after obtaining the contrast data of the current frame of the target part, the contrast data may be preprocessed such as noise reduction first.
  • each voxel in the contrast data is a noise point. Specifically, the average gray value corresponding to each voxel in the contrast data may be determined first, and the voxels with the corresponding gray average value less than the preset gray threshold value may be determined as noise points.
  • the gray level average value corresponding to the voxel can be determined first. If the gray level average value corresponding to the voxel is greater than or equal to the preset gray level threshold, the voxel can be determined to be non-noise If the average gray value corresponding to the voxel is less than the preset gray threshold, it can be determined that the voxel is a noise point. For each voxel in the contrast data, the noise point can be determined in this way.
  • the gray-scale threshold can be set and adjusted according to actual conditions, which is not limited in the embodiment of the present application.
  • the gray scale sum of the voxel in the area of the set size corresponding to the voxel determines the ratio of the gray scale sum to the number of voxels in the area as the volume
  • the gray mean value corresponding to the element can be set and adjusted according to the actual situation, and a uniform standard can be used when determining the noise point.
  • Each voxel has its own corresponding gray-level mean, and then based on the gray-level mean, it is determined whether each voxel is a noise point.
  • the noise points can be eliminated from the contrast data to obtain the reduced noise contrast data, and further operations, such as corrections, can be performed on the reduced noise contrast data. Finally, a four-dimensional time-rendered image is generated.
  • This pre-processing method for noise reduction is different from traditional filtering operations and will not affect the resolution of the image region of interest. As shown in Figure 3, it is a comparison chart before and after pretreatment.
  • the method may further include the following steps:
  • the target part is segmented from the complete angiographic data of the target part according to the three-dimensional region growing method.
  • the complete angiography data of the target part can be obtained first, and then the complete angiography data is called back to generate a four-dimensional time-rendered image.
  • the target part can be segmented from the angiographic data based on the tissue characteristics of the target part. Specifically, the target part can be segmented from the complete angiography data of the target part according to the three-dimensional region growing method. This can effectively remove noise and speed up the calculation speed of subsequent operations.
  • the three-dimensional region growth method can be used to segment the uterus and fallopian tubes.
  • Using the three-dimensional region growth method to segment the uterus and fallopian tubes mainly uses the three-dimensional connected domain labeling method, which is fast and convenient for calculation. Specifically, sorting can be performed according to the size of the connected regions to obtain the first n regions with the largest region volume. It can be seen from the tissue characteristics that the uterus and fallopian tubes are generally one or several large connected areas, while noise is a small scattered area, so the uterus and fallopian tubes and noise can be distinguished by the size of the connected area. Among them, the volume of the connected area can be calculated by the number of voxels in the connected area. In practical applications, the value of n can be obtained through subsequent clinical images to obtain a more appropriate value, or it can be adjusted according to the actual situation.
  • the target part is segmented from the angiography data, that is, the area of the non-target part is removed from the angiography data, and the noise in the angiography data is further reduced.
  • Figure 4 shows the comparison of the target part before and after segmentation.
  • the generated contrast data of the target part is subjected to a four-dimensional time-rendered image generation operation, which can speed up the calculation speed.
  • the embodiments of the present application also provide a four-dimensional angiography image generation device.
  • the four-dimensional angiography image generation device described below and the four-dimensional angiography image generation method described above can be referred to each other.
  • the device may include the following modules:
  • An angiography data obtaining module 510 configured to obtain angiography data of the current frame of the target part
  • the judging module 520 is configured to determine whether the swing of the ultrasonic probe reaches the preset correction condition according to the positioning information of the ultrasonic probe;
  • the contrast data correction module 530 is used to correct the contrast data when it is determined that the swing of the ultrasound probe reaches the preset correction condition;
  • An angiographic image generating module 540 configured to generate a four-dimensional time-rendered image based on the corrected angiographic data
  • the contrast image generation module 540 is also used to generate a four-dimensional time-rendered image based on the contrast data when it is determined that the swing of the ultrasound probe has not reached the preset correction condition.
  • the device After obtaining the contrast data of the current frame of the target part, according to the positioning information of the ultrasound probe, it is determined whether the swing of the ultrasound probe reaches the preset correction condition, and if it is reached, the contrast data can be corrected. And based on the corrected angiography data, generate a four-dimensional time-rendered image, if it does not reach, then generate a four-dimensional time-rendered image based on the angiography data. Because the swing of the ultrasound probe will cause the image to shift, if the swing of the ultrasound probe is too large, the amplitude of the image shift will be larger, which will cause the color of the rendering result of the time imaging to be disordered.
  • the contrast data of the current frame is corrected, and then a four-dimensional time-rendered image is generated based on the corrected contrast data, which can effectively avoid the image shift caused by the swing of the ultrasound probe.
  • the rendering result of the temporal imaging is caused by color disorder.
  • a positioning device is provided on the ultrasonic probe, and the judgment module 520 is used for:
  • the spatial rotation angle and translation distance it is determined whether the swing of the ultrasonic probe reaches the preset correction condition.
  • the judgment module 520 is configured to:
  • the spatial rotation angle is greater than the preset angle threshold and/or the translation distance is greater than the preset distance threshold, it is determined that the swing of the ultrasound probe reaches the preset correction condition.
  • the angiography data correction module 530 is used to:
  • the contrast data is transformed on the electromagnetic positioning coordinate system and converted back to the ultrasound image coordinate system to obtain the corrected contrast data.
  • a preprocessing module for:
  • the preprocessing module is used to:
  • the voxels whose corresponding gray-level average value is less than the preset gray-level threshold are determined as noise points.
  • the preprocessing module is used to:
  • the ratio of the gray scale corresponding to each voxel to the number of voxels in the corresponding area is determined as the mean gray scale corresponding to each voxel.
  • a segmentation module for:
  • the target part is segmented from the complete angiography data of the target part according to the three-dimensional region growing method .
  • an embodiment of the present application also provides a four-dimensional contrast image generation device, including:
  • Memory used to store computer programs
  • the processor is used to implement the steps of the above-mentioned four-dimensional contrast image generation method when the computer program is executed.
  • FIG. 6 it is a schematic diagram of the composition structure of a four-dimensional radiography image generating device.
  • the four-dimensional radiography image generating device may include a processor 10, a memory 11, a communication interface 12, and a communication bus 13.
  • the processor 10, the memory 11, and the communication interface 12 all communicate with each other through the communication bus 13.
  • the processor 10 may be a central processing unit (CPU), an application-specific integrated circuit, a digital signal processor, a field programmable gate array, or other programmable logic devices.
  • the processor 10 may call a program stored in the memory 11, and specifically, the processor 10 may perform operations in the embodiment of the method for generating a four-dimensional angiography image.
  • the memory 11 is used to store one or more programs, the programs may include program codes, and the program codes include computer operation instructions.
  • the memory 11 stores at least programs for implementing the following functions:
  • the positioning information of the ultrasound probe determine whether the swing of the ultrasound probe reaches the preset correction condition
  • the contrast data is corrected, and a four-dimensional time rendering image is generated based on the corrected contrast data
  • a four-dimensional time-rendered image is generated based on the contrast data.
  • the memory 11 may include a program storage area and a data storage area, where the program storage area may store an operating system and an application program required by at least one function (such as a data processing function and an image generation function). Etc.; the data storage area can store data created during use, such as angiography data, correction data, etc.
  • the program storage area may store an operating system and an application program required by at least one function (such as a data processing function and an image generation function).
  • Etc. the data storage area can store data created during use, such as angiography data, correction data, etc.
  • the memory 11 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device or other volatile solid-state storage devices.
  • the communication interface 13 may be an interface of a communication module for connecting with other devices or systems.
  • the structure shown in FIG. 6 does not constitute a limitation on the four-dimensional contrast image generating device in the embodiment of the present application.
  • the four-dimensional contrast image generating device may include more or more than that shown in FIG. 6 Few parts, or a combination of some parts.
  • the embodiment of the present application also provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the steps of the above-mentioned four-dimensional contrast image generation method are implemented. .
  • the steps of the method or algorithm described in the embodiments disclosed in this document can be directly implemented by hardware, a software module executed by a processor, or a combination of the two.
  • the software module can be placed in random access memory (RAM), internal memory, read-only memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disks, removable disks, CD-ROMs, or all areas in the technical field. Any other known storage media.

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Molecular Biology (AREA)
  • Biophysics (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Pathology (AREA)
  • Radiology & Medical Imaging (AREA)
  • Biomedical Technology (AREA)
  • Veterinary Medicine (AREA)
  • Medical Informatics (AREA)
  • Physics & Mathematics (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physiology (AREA)
  • Hematology (AREA)
  • Ultra Sonic Daignosis Equipment (AREA)
  • Apparatus For Radiation Diagnosis (AREA)

Abstract

A method, an apparatus and a device for generating a four-dimensional radiographic image, and a computer-readable storage medium. Said method comprises: obtaining radiographic data of the current frame of a target site (S110); and determining, according to positioning information of an ultrasonic probe, whether a swing of the ultrasonic probe reaches a preset correction condition (S120): if so, correcting the radiographic data, and generating a four-dimensional time rendered image on the basis of the corrected radiographic data (S130), and if not, generating a four-dimensional time rendered image on the basis of the radiographic data (S140). The method and apparatus can effectively avoid the problem of a swing of an ultrasonic probe causing an image offset, which leads to disordered colours of the time-imaged rendered result. In addition, there is no need to perform a time-consuming and inefficient three-dimensional feature matching operation to implement the adjustment with respect to radiographic image offset, thereby improving the generation efficiency of a four-dimensional radiographic image.

Description

一种四维造影图像生成方法、装置、设备及存储介质Method, device, equipment and storage medium for generating four-dimensional contrast image
本申请要求于2020年02月28日提交中国专利局、申请号为202010129489.8、发明名称为“一种四维造影图像生成方法、装置、设备及存储介质”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。This application claims the priority of a Chinese patent application filed with the Chinese Patent Office on February 28, 2020, the application number is 202010129489.8, and the invention title is "a method, device, equipment, and storage medium for generating four-dimensional radiography images", and its entire contents Incorporated in this application by reference.
技术领域Technical field
本申请涉及图像处理技术领域,特别是涉及一种四维造影图像生成方法、装置、设备及存储介质。This application relates to the field of image processing technology, and in particular to a method, device, equipment, and storage medium for generating a four-dimensional contrast image.
背景技术Background technique
随着医学技术的进步,造影技术逐渐发展起来。造影,是在放射诊断学中,通过摄入含原子序数高的元素的物质,然后在待诊断体内部位摄取放射照片以供医学诊断。对缺乏自然对比的结构或器官,可将密度高于或低于该结构或器官的物质即造影剂引入器官内或其周围间隙,使之产生对比显影。With the advancement of medical technology, imaging technology has gradually developed. In radiology, radiography is to take in substances containing elements with high atomic number, and then take radiographs in the body to be diagnosed for medical diagnosis. For structures or organs lacking natural contrast, a substance with a density higher or lower than that of the structure or organ, that is, a contrast agent, can be introduced into the organ or the space around it to produce a contrast image.
为了方便直观观察造影剂流动的方法与过程,可以在成像过程中,采用多段颜色伪彩,将造影剂随时间的流动与颜色一一对应。但是,如果在图像采集过程中,超声探头的摆动过大,则将容易出现难以对三维图像进行有效匹配,渲染颜色错乱的问题。In order to visually observe the method and process of the contrast agent flow, it is possible to use multiple color pseudo-colors during the imaging process to correspond the flow of the contrast agent over time to the color one-to-one. However, if the ultrasound probe swings too much during the image acquisition process, it will be difficult to effectively match the three-dimensional image and the rendering color will be disordered.
发明内容Summary of the invention
本申请的目的是提供一种四维造影图像生成方法、装置、设备及存储介质,以避免生成的四维造影图像出现颜色错乱问题。The purpose of this application is to provide a method, device, equipment and storage medium for generating a four-dimensional contrast image, so as to avoid the problem of color confusion in the generated four-dimensional contrast image.
为解决上述技术问题,本申请提供如下技术方案:In order to solve the above technical problems, this application provides the following technical solutions:
一种四维造影图像生成方法,包括:A method for generating four-dimensional contrast images, including:
获得目标部位当前帧的造影数据;Obtain the contrast data of the current frame of the target part;
根据超声探头的定位信息,确定所述超声探头的摆动是否达到预设修正条件;According to the positioning information of the ultrasound probe, determine whether the swing of the ultrasound probe reaches a preset correction condition;
如果确定所述超声探头的摆动达到所述预设修正条件,则对所述造影数据进行修正,并基于修正后的所述造影数据,生成四维时间渲染图像;If it is determined that the swing of the ultrasound probe reaches the preset correction condition, correct the contrast data, and generate a four-dimensional time-rendered image based on the corrected contrast data;
如果确定所述超声探头的摆动未达到所述预设修正条件,则基于所述造影数据,生成所述四维时间渲染图像。If it is determined that the swing of the ultrasound probe does not reach the preset correction condition, the four-dimensional time-rendered image is generated based on the contrast data.
在本申请的一种具体实施方式中,所述超声探头上设置有定位装置,所述根据超声探头的定位信息,确定所述超声探头的摆动是否达到预设修正条件,包括:In a specific implementation of the present application, a positioning device is provided on the ultrasound probe, and the determining whether the swing of the ultrasound probe reaches a preset correction condition according to the positioning information of the ultrasound probe includes:
根据超声探头的定位信息,确定当前帧所述超声探头的空间位置;Determine the spatial position of the ultrasound probe in the current frame according to the positioning information of the ultrasound probe;
将所述当前帧超声探头的空间位置与预先获得的首帧所述超声探头的空间位置进行比对,确定所述超声探头的空间旋转角度和平移距离;Comparing the spatial position of the ultrasound probe in the current frame with the spatial position of the ultrasound probe in the first frame obtained in advance to determine the spatial rotation angle and translation distance of the ultrasound probe;
根据所述空间旋转角度和平移距离,确定所述超声探头的摆动是否达到预设修正条件。According to the spatial rotation angle and the translation distance, it is determined whether the swing of the ultrasonic probe reaches a preset correction condition.
在本申请的一种具体实施方式中,所述根据所述空间旋转角度和平移距离,确定所述超声探头的摆动是否达到预设修正条件,包括:In a specific implementation manner of the present application, the determining whether the swing of the ultrasonic probe reaches a preset correction condition according to the spatial rotation angle and translation distance includes:
如果所述空间旋转角度大于预设角度阈值和/或所述平移距离大于预设距离阈值,则确定所述超声探头的摆动达到预设修正条件。If the spatial rotation angle is greater than the preset angle threshold and/or the translation distance is greater than the preset distance threshold, it is determined that the swing of the ultrasound probe reaches the preset correction condition.
在本申请的一种具体实施方式中,所述定位装置为电磁定位装置,所述对所述造影数据进行修正,包括:In a specific implementation manner of the present application, the positioning device is an electromagnetic positioning device, and the correction of the imaging data includes:
将电磁定位坐标系确定为世界坐标系;Determine the electromagnetic positioning coordinate system as the world coordinate system;
将超声图像坐标系转换到所述电磁定位坐标系;Converting the ultrasound image coordinate system to the electromagnetic positioning coordinate system;
确定所述超声探头摆动的仿射矩阵;Determining the affine matrix of the ultrasonic probe swing;
结合所述仿射矩阵,在所述电磁定位坐标系上对所述造影数据进行坐标变换,并转换回所述超声图像坐标系,获得修正后的所述造影数据。In combination with the affine matrix, coordinate transformation is performed on the contrast data on the electromagnetic positioning coordinate system and converted back to the ultrasound image coordinate system to obtain the corrected contrast data.
在本申请的一种具体实施方式中,在所述获得目标部位当前帧的造影数据之后、所述根据超声探头的定位信息,确定所述超声探头的摆动是否达到预设修正条件之前,还包括:In a specific implementation of the present application, after the acquisition of the contrast data of the current frame of the target part, and before the determining whether the oscillation of the ultrasound probe reaches the preset correction condition according to the positioning information of the ultrasound probe, the method further includes :
确定所述造影数据中每个体素是否为噪声点;Determine whether each voxel in the contrast data is a noise point;
在所述造影数据中剔除所述噪声点。The noise points are eliminated from the contrast data.
在本申请的一种具体实施方式中,所述确定所述造影数据中每个体素 是否为噪声点,包括:In a specific implementation manner of the present application, the determining whether each voxel in the contrast data is a noise point includes:
确定所述造影数据中的每个体素对应的灰度均值;Determining a gray average value corresponding to each voxel in the contrast data;
将对应的灰度均值小于预设的灰度阈值的体素确定为噪声点。The voxels whose corresponding gray-level average value is less than the preset gray-level threshold are determined as noise points.
在本申请的一种具体实施方式中,所述确定所述造影数据中的每个体素对应的灰度均值,包括:In a specific implementation manner of the present application, the determining the average gray value corresponding to each voxel in the contrast data includes:
确定所述造影数据中的每个体素对应的设定大小的区域中体素的灰度和;Determining the gray scale sum of the voxels in the area of the set size corresponding to each voxel in the contrast data;
将每个体素对应的灰度和与相应区域中体素个数的比值,确定为每个体素对应的灰度均值。The ratio of the gray scale corresponding to each voxel to the number of voxels in the corresponding area is determined as the mean gray scale corresponding to each voxel.
在本申请的一种具体实施方式中,在对已获得的所述目标部位的完整造影数据进行后处理的情况下,在所述生成四维时间渲染图像之前,还包括:In a specific implementation of the present application, in the case of performing post-processing on the obtained complete angiography data of the target part, before the generating a four-dimensional time-rendered image, the method further includes:
基于所述目标部位的组织特征,根据三维区域生长法在所述目标部位的完整造影数据中分割出所述目标部位。Based on the tissue characteristics of the target part, the target part is segmented from the complete angiography data of the target part according to a three-dimensional region growth method.
一种四维造影图像生成装置,包括:A four-dimensional contrast image generating device, including:
造影数据获得模块,用于获得目标部位当前帧的造影数据;An imaging data obtaining module, which is used to obtain the imaging data of the current frame of the target part;
判断模块,用于根据超声探头的定位信息,确定所述超声探头的摆动是否达到预设修正条件;A judging module, configured to determine whether the swing of the ultrasonic probe reaches a preset correction condition according to the positioning information of the ultrasonic probe;
造影数据修正模块,用于在确定所述超声探头的摆动达到所述预设修正条件时,对所述造影数据进行修正;An contrast data correction module, configured to correct the contrast data when it is determined that the swing of the ultrasound probe reaches the preset correction condition;
造影图像生成模块,用于基于修正后的所述造影数据,生成四维时间渲染图像;An angiographic image generating module, configured to generate a four-dimensional time-rendered image based on the corrected angiographic data;
所述造影图像生成模块,还用于在确定所述超声探头的摆动未达到所述预设修正条件时,基于所述造影数据,生成所述四维时间渲染图像。The contrast image generation module is further configured to generate the four-dimensional time-rendered image based on the contrast data when it is determined that the swing of the ultrasound probe does not reach the preset correction condition.
一种四维造影图像生成设备,包括:A four-dimensional radiography image generating device, including:
存储器,用于存储计算机程序;Memory, used to store computer programs;
处理器,用于执行所述计算机程序时实现上述任一项所述四维造影图像生成方法的步骤。The processor is configured to implement the steps of any one of the four-dimensional contrast image generation methods described above when the computer program is executed.
一种计算机可读存储介质,所述计算机可读存储介质上存储有计算机 程序,所述计算机程序被处理器执行时实现上述任一项所述四维造影图像生成方法的步骤。A computer-readable storage medium having a computer program stored on the computer-readable storage medium, and when the computer program is executed by a processor, realizes the steps of any one of the above-mentioned four-dimensional image generation methods.
应用本申请实施例所提供的技术方案,获得目标部位当前帧的造影数据后,根据当前帧超声探头的空间位置,确定超声探头的摆动是否达到预设修正条件,如果达到,则可以对造影数据进行修正,并基于修正后的造影数据,生成四维造影图像,如果未达到,则基于造影数据,生成四维造影图像。在超声探头的摆动达到修正条件时,对当前帧的造影数据进行修正后再生成四维造影图像,这样可以有效避免超声探头的摆动造成图像偏移,从而导致的时间成像的渲染结果颜色错乱的问题,同时,无需进行耗时低效的三维特征匹配操作来实现造影图像偏移的调整,提高了四维造影图像生成效率。Applying the technical solutions provided by the embodiments of this application, after obtaining the contrast data of the current frame of the target part, according to the spatial position of the ultrasound probe of the current frame, it is determined whether the oscillation of the ultrasound probe reaches the preset correction condition. If it reaches, the contrast data can be compared Perform correction and generate a four-dimensional contrast image based on the corrected contrast data. If it does not reach, then generate a four-dimensional contrast image based on the contrast data. When the swing of the ultrasound probe reaches the correction condition, the contrast data of the current frame is corrected and then the four-dimensional contrast image is generated. This can effectively avoid the image shift caused by the swing of the ultrasound probe, resulting in the problem of color confusion in the rendering result of time imaging At the same time, there is no need to perform time-consuming and inefficient three-dimensional feature matching operations to realize the adjustment of the contrast image offset, which improves the efficiency of four-dimensional contrast image generation.
附图说明Description of the drawings
为了更清楚地说明本申请实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本申请的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to more clearly describe the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the drawings in the following description are only These are some embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative work.
图1为本申请实施例中一种四维造影图像生成方法的实施流程图;FIG. 1 is an implementation flowchart of a method for generating a four-dimensional contrast image in an embodiment of the application;
图2为本申请实施例中三维仿射变换前后图像对比图;2 is a comparison diagram of images before and after three-dimensional affine transformation in an embodiment of the application;
图3为本申请实施例中对造影数据进行预处理前后对比图;FIG. 3 is a comparison diagram before and after preprocessing the angiography data in an embodiment of the application; FIG.
图4为本申请实施例中目标部位分割前后对比图;4 is a comparison diagram before and after segmentation of a target part in an embodiment of the application;
图5为本申请实施例中一种四维造影图像生成装置的结构示意图;FIG. 5 is a schematic structural diagram of a four-dimensional contrast image generating device in an embodiment of the application;
图6为本申请实施例中一种四维造影图像生成设备的结构示意图。Fig. 6 is a schematic structural diagram of a four-dimensional contrast image generating device in an embodiment of the application.
具体实施方式Detailed ways
为了使本技术领域的人员更好地理解本申请方案,下面结合附图和具体实施方式对本申请作进一步的详细说明。显然,所描述的实施例仅仅是 本申请一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。In order to enable those skilled in the art to better understand the solution of the application, the application will be further described in detail below with reference to the accompanying drawings and specific implementations. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of this application.
参见图1所示,为本申请实施例所提供的一种四维造影图像生成方法的实施流程图,该方法可以包括以下步骤:Referring to FIG. 1, an implementation flowchart of a method for generating a four-dimensional angiography image provided by an embodiment of this application. The method may include the following steps:
S110:获得目标部位当前帧的造影数据。S110: Obtain the contrast data of the current frame of the target part.
目标部位为待诊断体内部位,如子宫输卵管等部位。可以向目标部位进行造影剂推注进而获得造影数据。在向目标部位进行造影剂的推注过程中,可以对目标部位的造影进行扫查,获取当前帧的造影数据。该造影数据可以是三维造影图像。The target part is the part in the body to be diagnosed, such as the uterus and fallopian tubes. A bolus of contrast agent can be injected to the target site to obtain contrast data. In the process of bolus injection of the contrast agent to the target part, the contrast of the target part can be scanned to obtain the contrast data of the current frame. The contrast data may be a three-dimensional contrast image.
S120:根据超声探头的定位信息,确定超声探头的摆动是否达到预设修正条件。S120: According to the positioning information of the ultrasound probe, determine whether the swing of the ultrasound probe reaches a preset correction condition.
造影数据可以通过超声探头采集得到。在获得目标部位当前帧的造影数据的同时,可以获得超声探头的定位信息。具体的,可以采用探头定位技术得到超声探头的定位信息。通过定位信息,可以确定当前帧超声探头的空间位置。Contrast data can be collected by an ultrasound probe. While obtaining the contrast data of the current frame of the target part, the positioning information of the ultrasound probe can be obtained. Specifically, the probe positioning technology can be used to obtain the positioning information of the ultrasound probe. Through the positioning information, the spatial position of the ultrasound probe in the current frame can be determined.
目前常用的空间定位技术主要有光学定位和电磁定位,电磁定位技术具有精度高、操作方便灵活、无视线遮挡问题等优点。电磁定位系统,主要包括电磁发射器和探头接收器,电磁发射器通过探头接收器的反馈信号,采集得到超声探头的定位信息。At present, the commonly used spatial positioning technologies mainly include optical positioning and electromagnetic positioning. Electromagnetic positioning technology has the advantages of high accuracy, convenient and flexible operation, and no line of sight obstruction. The electromagnetic positioning system mainly includes an electromagnetic transmitter and a probe receiver. The electromagnetic transmitter collects the positioning information of the ultrasonic probe through the feedback signal of the probe receiver.
根据超声探头的定位信息,可以确定超声探头的摆动是否过大,是否达到预设修正条件。该预设修正条件可以根据实际情况进行设定和调整。According to the positioning information of the ultrasound probe, it can be determined whether the swing of the ultrasound probe is too large and whether the preset correction condition is reached. The preset correction conditions can be set and adjusted according to actual conditions.
因为超声探头的摆动会造成图像偏移,从而导致时间成像的渲染结果颜色错乱。所以,本申请实施例中,当超声探头的摆动达到预设修正条件时,可以继续执行步骤S130的操作,对当前帧的造影数据进行修正处理,如果超声探头的摆动未达到预设修正条件,则对当前帧的造影数据可以不做修正处理,执行步骤S140的操作,直接利用当前帧的造影数据进行四维时间渲染图像的生成。Because the swing of the ultrasound probe will cause the image to shift, which causes the color of the rendering result of the time imaging to be disordered. Therefore, in the embodiment of the present application, when the swing of the ultrasound probe reaches the preset correction condition, the operation of step S130 can be continued to correct the contrast data of the current frame. If the swing of the ultrasound probe does not reach the preset correction condition, Then, the contrast data of the current frame may not be corrected, and the operation of step S140 is performed, and the contrast data of the current frame is directly used to generate a four-dimensional time-rendered image.
S130:如果确定超声探头的摆动达到预设修正条件,则对造影数据进 行修正,并基于修正后的造影数据,生成四维时间渲染图像。S130: If it is determined that the swing of the ultrasound probe reaches the preset correction condition, correct the contrast data, and generate a four-dimensional time-rendered image based on the corrected contrast data.
根据超声探头的定位信息,可以确定超声探头的摆动是否过大,是否达到预设修正条件。如果确定超声探头的摆动达到预设修正条件,则可以对当前帧的造影数据进行修正。如可以通过空间坐标变换等方式对当前帧的造影数据进行修正。According to the positioning information of the ultrasound probe, it can be determined whether the swing of the ultrasound probe is too large and whether the preset correction condition is reached. If it is determined that the swing of the ultrasound probe reaches the preset correction condition, the contrast data of the current frame can be corrected. For example, the angiographic data of the current frame can be corrected by means of spatial coordinate transformation.
在对造影数据进行修正后,可以基于修正后的造影数据,生成四维时间造影图像。具体的,可以将当前帧修正后的造影数据与前一帧的造影数据进行比对,得到新的造影区域,在新出现的造影区域内填充相应颜色,生成四维时间渲染图像。这里前一帧的造影数据可以是前一帧的不需要修正处理的造影数据还可以是前一帧的经过修正处理的造影数据。After the angiography data is corrected, a four-dimensional time contrast image can be generated based on the corrected angiography data. Specifically, the corrected contrast data of the current frame can be compared with the contrast data of the previous frame to obtain a new contrast area, and fill the corresponding color in the newly appeared contrast area to generate a four-dimensional time rendered image. Here, the contrast data of the previous frame may be the contrast data of the previous frame that does not require correction processing, or the contrast data of the previous frame that has undergone correction processing.
S140:如果确定超声探头的摆动未达到修正条件,则基于造影数据,生成四维时间渲染图像。S140: If it is determined that the swing of the ultrasound probe does not meet the correction condition, generate a four-dimensional time-rendered image based on the contrast data.
在确定超声探头的摆动未达到修正条件时,不需要对当前帧的造影数据做修正处理,可以直接基于当前帧的造影数据,生成四维时间渲染图像。同样,可以将当前帧的造影数据与前一帧的造影数据进行比对,得到新的造影区域,在新出现的造影区域内填充相应颜色,生成四维时间渲染图像。不同时间对应的造影区域可以对应不同颜色。这里前一帧的造影数据可以是前一帧的不需要修正处理的造影数据还可以是前一帧的经过修正处理的造影数据。When it is determined that the swing of the ultrasound probe has not reached the correction condition, there is no need to perform correction processing on the contrast data of the current frame, and a four-dimensional time-rendered image can be generated directly based on the contrast data of the current frame. Similarly, the contrast data of the current frame can be compared with the contrast data of the previous frame to obtain a new contrast area, fill the corresponding color in the newly appeared contrast area, and generate a four-dimensional time-rendered image. The contrast area corresponding to different times can correspond to different colors. Here, the contrast data of the previous frame may be the contrast data of the previous frame that does not require correction processing, or the contrast data of the previous frame that has undergone correction processing.
在生成四维时间渲染图像过程中,可以采用多段颜色伪彩,将造影剂随时间的流动与颜色一一对应,通过四维时间渲染图像可以方便直观观察造影剂流动的方向与过程。In the process of generating a four-dimensional time-rendered image, multiple color pseudo colors can be used to correspond the flow of the contrast agent over time to the color one-to-one. Through the four-dimensional time-rendered image, it is convenient to visually observe the direction and process of the flow of the contrast agent.
对于目标部位的每一帧造影数据均按照上述步骤进行,可以得到最终的目标部位的四维时间渲染图像。For each frame of angiographic data of the target part, follow the above steps to obtain the final four-dimensional time-rendered image of the target part.
当然,在实际应用中,可以先针对于每一帧造影数据,确定是否对其进行修正处理,并在确定需要对其进行修正处理时,对其进行修正处理。最后再基于最终获得的针对目标部位的造影数据,生成四维时间渲染图像。Of course, in actual applications, it is possible to first determine whether to correct each frame of angiographic data, and when it is determined that it needs to be corrected, correct it. Finally, based on the finally obtained angiographic data for the target part, a four-dimensional time-rendered image is generated.
应用本申请实施例所提供的方法,获得目标部位当前帧的造影数据后,根据超声探头的定位信息,确定超声探头的摆动是否达到预设修正条件, 如果达到,则可以对造影数据进行修正,并基于修正后的造影数据,生成四维时间渲染图像,如果未达到,则基于造影数据,生成四维时间渲染图像。因为超声探头的摆动会造成图像偏移,如果超声探头的摆动过大,则将使得图像偏移幅度较大,从而会导致时间成像的渲染结果出现颜色错乱的情况。在超声探头的摆动过大,达到预设修正条件时,对当前帧的造影数据进行修正后,再基于修正后的造影数据生成四维时间渲染图像,可以有效避免超声探头的摆动造成图像偏移,从而导致的时间成像的渲染结果颜色错乱的问题,同时,不需要进行耗时低效的三维特征匹配操作来实现造影图像偏移的调整,提高了四维时间渲染图像的生成效率。Applying the method provided in the embodiments of the present application, after obtaining the contrast data of the current frame of the target part, according to the positioning information of the ultrasound probe, it is determined whether the swing of the ultrasound probe reaches the preset correction condition, and if it is reached, the contrast data can be corrected. And based on the corrected angiography data, generate a four-dimensional time-rendered image, if it does not reach, then generate a four-dimensional time-rendered image based on the angiography data. Because the swing of the ultrasound probe will cause the image to shift, if the swing of the ultrasound probe is too large, the amplitude of the image shift will be large, which will cause the color of the rendering result of the time imaging to be disordered. When the swing of the ultrasound probe is too large and the preset correction conditions are reached, after correcting the contrast data of the current frame, a four-dimensional time-rendered image is generated based on the corrected contrast data, which can effectively avoid the image shift caused by the swing of the ultrasound probe. This leads to the problem of color confusion in the rendering result of the time imaging, and at the same time, there is no need to perform a time-consuming and inefficient three-dimensional feature matching operation to realize the adjustment of the contrast image offset, which improves the generation efficiency of the four-dimensional time rendering image.
在实际应用中,可以在向目标部位推注造影剂的过程中,实时获得目标部位的每一帧的造影数据,实时对于每一帧的造影数据进行相应处理,生成四维时间渲染图像。还可以在向目标部位推注造影剂的过程中,记录相关数据,如造影数据、超声探头的定位信息等,在后期需要进行四维时间渲染图像的生成时,基于已记录的相关数据,获得目标部位每一帧的造影数据,并针对每一帧的造影数据执行本申请步骤,生成四维时间渲染图像。还可以在向目标部位推注造影剂的过程中,实时获得目标部位的每一帧的造影数据,实时对于每一帧的造影数据进行相应处理,并记录相关数据,如不需要处理的造影数据、进行过处理的造影数据等,在后期需要进行四维时间渲染图像的生成时,基于已记录的相关数据,生成四维时间渲染图像。In practical applications, during the process of injecting a contrast agent into the target part, the contrast data of each frame of the target part can be obtained in real time, and the contrast data of each frame can be processed in real time to generate a four-dimensional time rendered image. You can also record relevant data, such as contrast data, positioning information of ultrasound probes, etc. during the process of injecting contrast agent into the target site. When the generation of four-dimensional time-rendered images is required in the later stage, the target can be obtained based on the recorded relevant data. The imaging data of each frame of the part, and the steps of this application are executed for each frame of the imaging data to generate a four-dimensional time-rendered image. In the process of injecting contrast agent into the target part, the contrast data of each frame of the target part can be obtained in real time, and the contrast data of each frame can be processed in real time, and relevant data, such as contrast data that does not need to be processed, are recorded. , Processed angiography data, etc., when the generation of a four-dimensional time-rendered image is required in the later stage, a four-dimensional time-rendered image is generated based on the recorded related data.
在本申请的一个实施例中,超声探头上设置有定位装置,步骤S120可以包括以下步骤:In an embodiment of the present application, a positioning device is provided on the ultrasound probe, and step S120 may include the following steps:
步骤一:根据超声探头的定位信息,确定当前帧超声探头的空间位置;Step 1: Determine the spatial position of the ultrasound probe in the current frame according to the positioning information of the ultrasound probe;
步骤二:将当前帧超声探头的空间位置与预先获得的首帧超声探头的空间位置进行比对,确定超声探头的空间旋转角度和平移距离;Step 2: Compare the spatial position of the ultrasound probe in the current frame with the spatial position of the ultrasound probe in the first frame obtained in advance to determine the spatial rotation angle and translation distance of the ultrasound probe;
步骤三:根据空间旋转角度和平移距离,确定超声探头的摆动是否达到预设修正条件。Step 3: Determine whether the swing of the ultrasonic probe reaches the preset correction condition according to the spatial rotation angle and translation distance.
为便于描述,将上述三个步骤结合起来进行说明。For ease of description, the above three steps are combined for description.
在本申请实施例中,超声探头上可以设置有定位装置,该定位装置可 以是电磁定位系统中的探头接收器,电磁定位系统的电磁发射器通过探头接收器的反馈信号,可以采集得到超声探头的定位信息。In the embodiments of the present application, a positioning device may be provided on the ultrasonic probe, and the positioning device may be a probe receiver in an electromagnetic positioning system. The electromagnetic transmitter of the electromagnetic positioning system can collect and obtain the ultrasonic probe through the feedback signal of the probe receiver. Location information.
在实际应用中,可以通过电磁定位系统预先获得首帧超声探头的空间位置。在获得目标部位当前帧的造影数据时,可以根据超声探头的定位信息,确定当前帧超声探头的空间位置。In practical applications, the spatial position of the ultrasound probe of the first frame can be obtained in advance through the electromagnetic positioning system. When obtaining the contrast data of the current frame of the target part, the spatial position of the ultrasound probe of the current frame can be determined according to the positioning information of the ultrasound probe.
将当前帧超声探头的空间位置与首帧超声探头的空间位置进行比对,根据比对结果,可以确定超声探头的空间旋转角度和平移距离。即以首帧超声探头的空间位置为基准,确定当前帧超声探头的空间旋转角度和平移距离。The spatial position of the ultrasound probe of the current frame is compared with the spatial position of the ultrasound probe of the first frame, and the spatial rotation angle and translation distance of the ultrasound probe can be determined according to the comparison result. That is, the spatial position of the ultrasound probe in the first frame is used as a reference to determine the spatial rotation angle and translation distance of the ultrasound probe in the current frame.
根据确定的空间旋转角度和平移距离,可以确定超声探头的摆动是否达到预设修正条件。具体的,如果空间旋转角度大于预设角度阈值和/或平移距离大于预设距离阈值,则可以确定超声探头的摆动达到预设修正条件。角度阈值和距离阈值可以根据实际情况进行设定和调整。According to the determined spatial rotation angle and translation distance, it can be determined whether the swing of the ultrasonic probe reaches the preset correction condition. Specifically, if the spatial rotation angle is greater than the preset angle threshold and/or the translation distance is greater than the preset distance threshold, it can be determined that the swing of the ultrasound probe reaches the preset correction condition. The angle threshold and distance threshold can be set and adjusted according to the actual situation.
即在超声探头的空间旋转角度大于预设角度阈值和/或平移距离大于预设距离阈值时,可以认为超声探头的摆动过大,会造成图像偏移,导致时间成像的渲染结果颜色错乱,在这种情况下,可以确定超声探头的摆动达到了预设修正条件。That is, when the spatial rotation angle of the ultrasound probe is greater than the preset angle threshold and/or the translation distance is greater than the preset distance threshold, it can be considered that the swing of the ultrasound probe is too large, which will cause the image to shift and cause the color of the rendering result of the time imaging to be disordered. In this case, it can be determined that the swing of the ultrasonic probe has reached the preset correction condition.
通过将当前帧超声探头的空间位置与预先获得的首帧超声探头的空间位置进行比对,确定超声探头的空间旋转角度和平移距离,从而根据空间旋转角度和平移距离,可以准确确定超声探头的摆动是否达到预设修正条件。By comparing the spatial position of the ultrasound probe in the current frame with the spatial position of the ultrasound probe in the first frame obtained in advance, the spatial rotation angle and translation distance of the ultrasound probe are determined, so that the ultrasound probe can be accurately determined according to the spatial rotation angle and translation distance. Whether the swing reaches the preset correction condition.
在本申请的一个实施例中,步骤S130对造影数据进行修正,可以包括以下步骤:In an embodiment of the present application, step S130 to correct the angiographic data may include the following steps:
第一个步骤:将电磁定位坐标系确定为世界坐标系;The first step: Determine the electromagnetic positioning coordinate system as the world coordinate system;
第二个步骤:将超声图像坐标系转换到电磁定位坐标系;The second step: Convert the ultrasound image coordinate system to the electromagnetic positioning coordinate system;
第三个步骤:确定超声探头摆动的仿射矩阵;The third step: determine the affine matrix of the ultrasonic probe swing;
第四个步骤:结合仿射矩阵,在电磁定位坐标系上对造影数据进行坐标变换,并转换回超声图像坐标系,获得修正后的造影数据。The fourth step: Combining the affine matrix, perform coordinate transformation on the contrast data in the electromagnetic positioning coordinate system, and convert it back to the ultrasound image coordinate system to obtain the corrected contrast data.
为便于描述,将上述四个步骤结合起来进行说明。For ease of description, the above four steps are combined for description.
在本申请实施例中,可以使用电磁定位系统进行超声探头的定位信息。电磁定位系统中的电磁发射器位置是不动的,可以将电磁定位坐标系确定为世界坐标系。在确定超声探头的摆动达到预设修正条件时,可以对造影数据进行修正。超声探头的摆动在电磁定位坐标系,可以先将超声图像坐标系转换到电磁定位坐标系,然后确定超声探头摆动的仿射矩阵。In the embodiment of the present application, an electromagnetic positioning system may be used to perform positioning information of the ultrasound probe. The position of the electromagnetic transmitter in the electromagnetic positioning system is not moving, and the electromagnetic positioning coordinate system can be determined as the world coordinate system. When it is determined that the swing of the ultrasound probe reaches the preset correction condition, the contrast data can be corrected. The swing of the ultrasound probe is in the electromagnetic positioning coordinate system, and the ultrasound image coordinate system can be converted to the electromagnetic positioning coordinate system first, and then the affine matrix of the ultrasound probe swing can be determined.
结合仿射矩阵,在电磁定位坐标系上对造影数据进行坐标变换,并转换回超声图像坐标系,即可获得修正后的造影数据。Combined with the affine matrix, the contrast data is transformed on the electromagnetic positioning coordinate system and converted back to the ultrasound image coordinate system to obtain the corrected contrast data.
举例而言,通过计算得到的超声探头的三维仿射矩阵如下:For example, the three-dimensional affine matrix of the ultrasound probe obtained by calculation is as follows:
Figure PCTCN2020096260-appb-000001
Figure PCTCN2020096260-appb-000001
像素P 1(x 1,y 1,z 1)和P 2(x 2,y 2,z 2)变换关系为:P 2=M·P 1。变换前后的图像对比如图2所示。 The transformation relationship between pixels P 1 (x 1 , y 1 , z 1 ) and P 2 (x 2 , y 2 , z 2 ) is: P 2 =M·P 1 . The image comparison before and after the transformation is shown in Figure 2.
在本申请的一个实施例中,在步骤S110获得目标部位当前帧的造影数据之后、步骤S120根据超声探头的定位信息,确定超声探头的摆动是否达到预设修正条件之前,该方法还可以包括以下步骤:In an embodiment of the present application, after step S110 obtains the contrast data of the current frame of the target part and before step S120 determines whether the oscillation of the ultrasound probe reaches the preset correction condition according to the positioning information of the ultrasound probe, the method may further include the following step:
步骤一:确定造影数据中每个体素是否为噪声点;Step 1: Determine whether each voxel in the angiographic data is a noise point;
步骤二:在造影数据中剔除噪声点。Step 2: Eliminate noise points in the angiographic data.
为便于描述,将上述两个步骤结合起来进行说明。For ease of description, the above two steps are combined for description.
在本申请实施例中,获得目标部位当前帧的造影数据之后,可以先对造影数据进行降噪等预处理。In the embodiment of the present application, after obtaining the contrast data of the current frame of the target part, the contrast data may be preprocessed such as noise reduction first.
在对造影数据进行预处理时,可以先确定造影数据中每个体素是否为噪声点。具体的,可以先确定造影数据中的每个体素对应的灰度均值,将对应的灰度均值小于预设的灰度阈值的体素确定为噪声点。When preprocessing the contrast data, you can first determine whether each voxel in the contrast data is a noise point. Specifically, the average gray value corresponding to each voxel in the contrast data may be determined first, and the voxels with the corresponding gray average value less than the preset gray threshold value may be determined as noise points.
即针对造影数据中的每个体素,可以先确定该体素对应的灰度均值,如果该体素对应的灰度均值大于或等于预设的灰度阈值,则可以确定该体素为非噪声点,如果该体素对应的灰度均值小于该预设的灰度阈值,则可 以确定该体素为噪声点。针对于造影数据中的每个体素都可以按照这样的方式进行噪声点的确定。灰度阈值可以根据实际情况进行设定和调整,本申请实施例对此不做限制。That is, for each voxel in the contrast data, the gray level average value corresponding to the voxel can be determined first. If the gray level average value corresponding to the voxel is greater than or equal to the preset gray level threshold, the voxel can be determined to be non-noise If the average gray value corresponding to the voxel is less than the preset gray threshold, it can be determined that the voxel is a noise point. For each voxel in the contrast data, the noise point can be determined in this way. The gray-scale threshold can be set and adjusted according to actual conditions, which is not limited in the embodiment of the present application.
在确定造影数据中的每个体素对应的灰度均值时,可以先确定造影数据中的每个体素对应的设定大小的区域中体素的灰度和,然后将每个体素对应的灰度和与相应区域中体素个数的比值,确定为每个体素对应的灰度均值。When determining the average gray value of each voxel in the contrast data, you can first determine the gray sum of the voxels in the set size area corresponding to each voxel in the contrast data, and then calculate the gray value corresponding to each voxel. The ratio of sum to the number of voxels in the corresponding area is determined as the mean gray level corresponding to each voxel.
即针对于造影数据中的每个体素,确定该体素对应的设定大小的区域中体素的灰度和,将该灰度和与该区域中体素个数的比值,确定为该体素对应的灰度均值。设定大小可以根据实际情况进行设定和调整,在进行噪声点的确定时均使用统一标准即可。That is, for each voxel in the contrast data, determine the gray scale sum of the voxel in the area of the set size corresponding to the voxel, and determine the ratio of the gray scale sum to the number of voxels in the area as the volume The gray mean value corresponding to the element. The setting size can be set and adjusted according to the actual situation, and a uniform standard can be used when determining the noise point.
每个体素具有各自对应的灰度均值,再基于灰度均值确定每个体素是否为噪声点。Each voxel has its own corresponding gray-level mean, and then based on the gray-level mean, it is determined whether each voxel is a noise point.
在对造影数据中的每个体素进行噪声点的确定之后,可以在造影数据中剔除噪声点,得到降噪后的造影数据,并对降噪后的造影数据进行进一步操作,如修正等操作,最后生成四维时间渲染图像。这种降噪预处理方式不同于传统滤波运算,不会影响感兴趣图像区域的分辨率。如图3所示即为预处理前后对比图。After the noise points are determined for each voxel in the contrast data, the noise points can be eliminated from the contrast data to obtain the reduced noise contrast data, and further operations, such as corrections, can be performed on the reduced noise contrast data. Finally, a four-dimensional time-rendered image is generated. This pre-processing method for noise reduction is different from traditional filtering operations and will not affect the resolution of the image region of interest. As shown in Figure 3, it is a comparison chart before and after pretreatment.
为便于理解,举例说明。For ease of understanding, an example is given.
假设当前帧的造影数据I(x,y,z),设定大小的区域为(a,b,c),对于造影数据中的每个体素I(x 0,y 0,z 0),可以计算得到该体素对应的设定大小的区域中体素的灰度和: Assuming the contrast data I(x,y,z) of the current frame, the area of the set size is (a,b,c), for each voxel I(x 0 ,y 0 ,z 0 ) in the contrast data, you can Calculate the gray scale sum of the voxel in the area of the set size corresponding to the voxel:
Figure PCTCN2020096260-appb-000002
Figure PCTCN2020096260-appb-000002
再计算该体素对应的灰度和与该区域中体素个数的比值,将该比值确定为该体素对应的灰度均值。Then calculate the ratio of the gray level corresponding to the voxel to the number of voxels in the region, and determine the ratio as the average gray level corresponding to the voxel.
如果该灰度均值大于或等于预设的灰度阈值,则可以确定该体素为非噪声点,I(x 0,y 0,z 0)可以保持不变,如果该灰度均值小于该预设的灰度阈值,则可以确定该体素为噪声点,可以令I(x 0,y 0,z 0)=0。 If the average gray value is greater than or equal to the preset gray threshold, the voxel can be determined to be a non-noise point, and I(x 0 , y 0 , z 0 ) can remain unchanged. If the average gray value is less than the preset If the gray threshold is set, the voxel can be determined to be a noise point, and I(x 0 ,y 0 ,z 0 )=0.
在对造影数据进行修正、进行四维时间渲染图像的生成之前,先对造 影数据进行降噪等预处理,可以减少造影数据中的噪声,避免出现最后生成的四维时间渲染图像的渲染结果颜色杂乱的问题。Before correcting the angiography data and generating the four-dimensional time-rendered image, perform preprocessing such as noise reduction on the angiographic data first, which can reduce the noise in the angiographic data and avoid the color of the final generated four-dimensional time-rendered image. problem.
在本申请的一个实施例中,在对已获得目标部位的完整造影数据进行后处理的情况下,在生成四维时间渲染图像之前,该方法还可以包括以下步骤:In an embodiment of the present application, in the case of performing post-processing on the complete angiographic data of the obtained target part, before generating the four-dimensional time-rendered image, the method may further include the following steps:
基于目标部位的组织特征,根据三维区域生长法在目标部位的完整造影数据中分割出目标部位。Based on the tissue characteristics of the target part, the target part is segmented from the complete angiographic data of the target part according to the three-dimensional region growing method.
在本申请实施例中,可以先获得目标部位的完整造影数据,然后在对完整造影数据进行回调,生成四维时间渲染图像。在对已获得的目标部位的完整造影数据进行后处理的情况下,在生成四维时间渲染图像之前,可以基于目标部位的组织特征,在造影数据中分割出目标部位。具体的,可以根据三维区域生长法在目标部位的完整造影数据中分割出目标部位。这样可以有效去除噪声,加快后续操作的运算速度。In the embodiment of the present application, the complete angiography data of the target part can be obtained first, and then the complete angiography data is called back to generate a four-dimensional time-rendered image. In the case of post-processing the obtained complete angiographic data of the target part, before generating the four-dimensional time-rendered image, the target part can be segmented from the angiographic data based on the tissue characteristics of the target part. Specifically, the target part can be segmented from the complete angiography data of the target part according to the three-dimensional region growing method. This can effectively remove noise and speed up the calculation speed of subsequent operations.
以目标部位为子宫输卵管为例,由于子宫输卵管形状特征和灰度特征等组织特征比较明显,可使用三维区域生长法分割出子宫输卵管。使用三维区域生长法对子宫输卵管进行分割主要采用的是三维连通域标记法,这种方法计算快速、便捷。具体的,可以根据连通区域大小进行排序,得到区域体积最大的前n个区域。由组织特征可知,子宫输卵管一般是一个或几个大的连通区域,而噪声是分布零散的小区域,因此子宫输卵管与噪声可以通过连通区域的体积大小进行区分。其中,连通区域体积大小可以通过连通区域体素个数计算得到。在实际应用中,n值大小可以通过后续临床图像得到一个较为合适的值,也可以根据实际情况进行调节。Taking the target site as the uterus and fallopian tubes as an example, because the uterus and fallopian tubes have obvious tissue features such as shape and grayscale features, the three-dimensional region growth method can be used to segment the uterus and fallopian tubes. Using the three-dimensional region growth method to segment the uterus and fallopian tubes mainly uses the three-dimensional connected domain labeling method, which is fast and convenient for calculation. Specifically, sorting can be performed according to the size of the connected regions to obtain the first n regions with the largest region volume. It can be seen from the tissue characteristics that the uterus and fallopian tubes are generally one or several large connected areas, while noise is a small scattered area, so the uterus and fallopian tubes and noise can be distinguished by the size of the connected area. Among them, the volume of the connected area can be calculated by the number of voxels in the connected area. In practical applications, the value of n can be obtained through subsequent clinical images to obtain a more appropriate value, or it can be adjusted according to the actual situation.
在造影数据中分割出目标部位,也就是在造影数据中去除了非目标部位的区域,进一步减少了造影数据中的噪声,如图4所示为目标部位分割前后对比图,后续只需要对分割出的目标部位的造影数据进行四维时间渲染图像的生成操作,可以加快运算速度。The target part is segmented from the angiography data, that is, the area of the non-target part is removed from the angiography data, and the noise in the angiography data is further reduced. Figure 4 shows the comparison of the target part before and after segmentation. The generated contrast data of the target part is subjected to a four-dimensional time-rendered image generation operation, which can speed up the calculation speed.
相应于上面的方法实施例,本申请实施例还提供了一种四维造影图像生成装置,下文描述的一种四维造影图像生成装置与上文描述的一种四维造影图像生成方法可相互对应参照。Corresponding to the above method embodiments, the embodiments of the present application also provide a four-dimensional angiography image generation device. The four-dimensional angiography image generation device described below and the four-dimensional angiography image generation method described above can be referred to each other.
参见图5所示,该装置可以包括以下模块:As shown in Figure 5, the device may include the following modules:
造影数据获得模块510,用于获得目标部位当前帧的造影数据;An angiography data obtaining module 510, configured to obtain angiography data of the current frame of the target part;
判断模块520,用于根据超声探头的定位信息,确定超声探头的摆动是否达到预设修正条件;The judging module 520 is configured to determine whether the swing of the ultrasonic probe reaches the preset correction condition according to the positioning information of the ultrasonic probe;
造影数据修正模块530,用于在确定超声探头的摆动达到预设修正条件时,对造影数据进行修正;The contrast data correction module 530 is used to correct the contrast data when it is determined that the swing of the ultrasound probe reaches the preset correction condition;
造影图像生成模块540,用于基于修正后的造影数据,生成四维时间渲染图像;An angiographic image generating module 540, configured to generate a four-dimensional time-rendered image based on the corrected angiographic data;
造影图像生成模块540,还用于在确定超声探头的摆动未达到预设修正条件时,基于造影数据,生成四维时间渲染图像。The contrast image generation module 540 is also used to generate a four-dimensional time-rendered image based on the contrast data when it is determined that the swing of the ultrasound probe has not reached the preset correction condition.
应用本申请实施例所提供的装置,获得目标部位当前帧的造影数据后,根据超声探头的定位信息,确定超声探头的摆动是否达到预设修正条件,如果达到,则可以对造影数据进行修正,并基于修正后的造影数据,生成四维时间渲染图像,如果未达到,则基于造影数据,生成四维时间渲染图像。因为超声探头的摆动会造成图像偏移,如果超声探头的摆动过大,则将使得图像偏移幅度较大,从而会导致时间成像的渲染结果出现颜色错乱的情况。在超声探头的摆动过大,达到预设修正条件时,对当前帧的造影数据进行修正后,再基于修正后的造影数据生成四维时间渲染图像,可以有效避免超声探头的摆动造成图像偏移,从而导致的时间成像的渲染结果颜色错乱的问题,同时,不需要进行耗时低效的三维特征匹配操作来实现造影图像偏移的调整,提高了四维时间渲染图像的生成效率。Using the device provided by the embodiment of the present application, after obtaining the contrast data of the current frame of the target part, according to the positioning information of the ultrasound probe, it is determined whether the swing of the ultrasound probe reaches the preset correction condition, and if it is reached, the contrast data can be corrected. And based on the corrected angiography data, generate a four-dimensional time-rendered image, if it does not reach, then generate a four-dimensional time-rendered image based on the angiography data. Because the swing of the ultrasound probe will cause the image to shift, if the swing of the ultrasound probe is too large, the amplitude of the image shift will be larger, which will cause the color of the rendering result of the time imaging to be disordered. When the swing of the ultrasound probe is too large and the preset correction conditions are reached, the contrast data of the current frame is corrected, and then a four-dimensional time-rendered image is generated based on the corrected contrast data, which can effectively avoid the image shift caused by the swing of the ultrasound probe. As a result, the rendering result of the temporal imaging is caused by color disorder. At the same time, there is no need to perform a time-consuming and inefficient three-dimensional feature matching operation to realize the adjustment of the contrast image offset, which improves the generation efficiency of the four-dimensional temporal rendering image.
在本申请的一种具体实施方式中,超声探头上设置有定位装置,判断模块520,用于:In a specific implementation of the present application, a positioning device is provided on the ultrasonic probe, and the judgment module 520 is used for:
根据超声探头的定位信息,确定当前帧超声探头的空间位置;Determine the spatial position of the ultrasound probe in the current frame according to the positioning information of the ultrasound probe;
将当前帧超声探头的空间位置与预先获得的首帧超声探头的空间位置进行比对,确定超声探头的空间旋转角度和平移距离;Compare the spatial position of the ultrasound probe in the current frame with the spatial position of the ultrasound probe in the first frame obtained in advance to determine the spatial rotation angle and translation distance of the ultrasound probe;
根据空间旋转角度和平移距离,确定超声探头的摆动是否达到预设修正条件。According to the spatial rotation angle and translation distance, it is determined whether the swing of the ultrasonic probe reaches the preset correction condition.
在本申请的一种具体实施方式中,判断模块520,用于:In a specific implementation manner of the present application, the judgment module 520 is configured to:
如果空间旋转角度大于预设角度阈值和/或平移距离大于预设距离阈值,则确定超声探头的摆动达到预设修正条件。If the spatial rotation angle is greater than the preset angle threshold and/or the translation distance is greater than the preset distance threshold, it is determined that the swing of the ultrasound probe reaches the preset correction condition.
在本申请的一种具体实施方式中,造影数据修正模块530,用于:In a specific implementation of the present application, the angiography data correction module 530 is used to:
将电磁定位坐标系确定为世界坐标系;Determine the electromagnetic positioning coordinate system as the world coordinate system;
将超声图像坐标系转换到电磁定位坐标系;Convert the ultrasound image coordinate system to the electromagnetic positioning coordinate system;
确定超声探头摆动的仿射矩阵;Determine the affine matrix of the ultrasonic probe swing;
结合仿射矩阵,在电磁定位坐标系上对造影数据进行坐标变换,并转换回超声图像坐标系,获得修正后的造影数据。Combined with the affine matrix, the contrast data is transformed on the electromagnetic positioning coordinate system and converted back to the ultrasound image coordinate system to obtain the corrected contrast data.
在本申请的一种具体实施方式中,还包括预处理模块,用于:In a specific implementation manner of this application, it further includes a preprocessing module for:
在获得目标部位当前帧的造影数据之后、根据超声探头的定位信息,确定超声探头的摆动是否达到预设修正条件之前,确定造影数据中每个体素是否为噪声点;After obtaining the contrast data of the current frame of the target part, and before determining whether the swing of the ultrasound probe reaches the preset correction condition according to the positioning information of the ultrasound probe, determine whether each voxel in the contrast data is a noise point;
在造影数据中剔除噪声点。Eliminate noise points in the angiographic data.
在本申请的一种具体实施方式中,预处理模块,用于:In a specific implementation manner of this application, the preprocessing module is used to:
确定造影数据中的每个体素对应的灰度均值;Determine the gray mean value corresponding to each voxel in the angiographic data;
将对应的灰度均值小于预设的灰度阈值的体素确定为噪声点。The voxels whose corresponding gray-level average value is less than the preset gray-level threshold are determined as noise points.
在本申请的一种具体实施方式中,预处理模块,用于:In a specific implementation manner of this application, the preprocessing module is used to:
确定造影数据中的每个体素对应的设定大小的区域中体素的灰度和;Determine the gray scale sum of the voxels in the area of the set size corresponding to each voxel in the contrast data;
将每个体素对应的灰度和与相应区域中体素个数的比值,确定为每个体素对应的灰度均值。The ratio of the gray scale corresponding to each voxel to the number of voxels in the corresponding area is determined as the mean gray scale corresponding to each voxel.
在本申请的一种具体实施方式中,还包括分割模块,用于:In a specific implementation manner of this application, it further includes a segmentation module for:
在对已获得的目标部位的完整造影数据进行后处理的情况下,在生成四维时间渲染图像之前,基于目标部位的组织特征,根据三维区域生长法在目标部位的完整造影数据中分割出目标部位。In the case of post-processing the obtained complete angiography data of the target part, before generating the four-dimensional time rendering image, based on the tissue characteristics of the target part, the target part is segmented from the complete angiography data of the target part according to the three-dimensional region growing method .
相应于上面的方法实施例,本申请实施例还提供了一种四维造影图像生成设备,包括:Corresponding to the above method embodiment, an embodiment of the present application also provides a four-dimensional contrast image generation device, including:
存储器,用于存储计算机程序;Memory, used to store computer programs;
处理器,用于执行计算机程序时实现上述四维造影图像生成方法的步骤。The processor is used to implement the steps of the above-mentioned four-dimensional contrast image generation method when the computer program is executed.
如图6所示,为四维造影图像生成设备的组成结构示意图,四维造影图像生成设备可以包括:处理器10、存储器11、通信接口12和通信总线13。处理器10、存储器11、通信接口12均通过通信总线13完成相互间的通信。As shown in FIG. 6, it is a schematic diagram of the composition structure of a four-dimensional radiography image generating device. The four-dimensional radiography image generating device may include a processor 10, a memory 11, a communication interface 12, and a communication bus 13. The processor 10, the memory 11, and the communication interface 12 all communicate with each other through the communication bus 13.
在本申请实施例中,处理器10可以为中央处理器(Central Processing Unit,CPU)、特定应用集成电路、数字信号处理器、现场可编程门阵列或者其他可编程逻辑器件等。In the embodiment of the present application, the processor 10 may be a central processing unit (CPU), an application-specific integrated circuit, a digital signal processor, a field programmable gate array, or other programmable logic devices.
处理器10可以调用存储器11中存储的程序,具体的,处理器10可以执行四维造影图像生成方法的实施例中的操作。The processor 10 may call a program stored in the memory 11, and specifically, the processor 10 may perform operations in the embodiment of the method for generating a four-dimensional angiography image.
存储器11中用于存放一个或者一个以上程序,程序可以包括程序代码,程序代码包括计算机操作指令,在本申请实施例中,存储器11中至少存储有用于实现以下功能的程序:The memory 11 is used to store one or more programs, the programs may include program codes, and the program codes include computer operation instructions. In the embodiment of the present application, the memory 11 stores at least programs for implementing the following functions:
获得目标部位当前帧的造影数据;Obtain the contrast data of the current frame of the target part;
根据超声探头的定位信息,确定超声探头的摆动是否达到预设修正条件;According to the positioning information of the ultrasound probe, determine whether the swing of the ultrasound probe reaches the preset correction condition;
如果确定超声探头的摆动达到预设修正条件,则对造影数据进行修正,并基于修正后的造影数据,生成四维时间渲染图像;If it is determined that the swing of the ultrasound probe reaches the preset correction condition, the contrast data is corrected, and a four-dimensional time rendering image is generated based on the corrected contrast data;
如果确定超声探头的摆动未达到预设修正条件,则基于造影数据,生成四维时间渲染图像。If it is determined that the swing of the ultrasound probe has not reached the preset correction condition, a four-dimensional time-rendered image is generated based on the contrast data.
在一种可能的实现方式中,存储器11可包括存储程序区和存储数据区,其中,存储程序区可存储操作系统,以及至少一个功能(比如数据处理功能、图像生成功能)所需的应用程序等;存储数据区可存储使用过程中所创建的数据,如造影数据、修正数据等。In a possible implementation manner, the memory 11 may include a program storage area and a data storage area, where the program storage area may store an operating system and an application program required by at least one function (such as a data processing function and an image generation function). Etc.; the data storage area can store data created during use, such as angiography data, correction data, etc.
此外,存储器11可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件或其他易失性固态存储器件。In addition, the memory 11 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device or other volatile solid-state storage devices.
通信接口13可以为通信模块的接口,用于与其他设备或者系统连接。The communication interface 13 may be an interface of a communication module for connecting with other devices or systems.
当然,需要说明的是,图6所示的结构并不构成对本申请实施例中四维造影图像生成设备的限定,在实际应用中四维造影图像生成设备可以包括比图6所示的更多或更少的部件,或者组合某些部件。Of course, it should be noted that the structure shown in FIG. 6 does not constitute a limitation on the four-dimensional contrast image generating device in the embodiment of the present application. In practical applications, the four-dimensional contrast image generating device may include more or more than that shown in FIG. 6 Few parts, or a combination of some parts.
相应于上面的方法实施例,本申请实施例还提供了一种计算机可读存储介质,计算机可读存储介质上存储有计算机程序,计算机程序被处理器执行时实现上述四维造影图像生成方法的步骤。Corresponding to the above method embodiment, the embodiment of the present application also provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the steps of the above-mentioned four-dimensional contrast image generation method are implemented. .
本说明书中各个实施例采用递进的方式描述,每个实施例重点说明的都是与其它实施例的不同之处,各个实施例之间相同或相似部分互相参见即可。The various embodiments in this specification are described in a progressive manner. Each embodiment focuses on the differences from other embodiments, and the same or similar parts between the various embodiments can be referred to each other.
专业人员还可以进一步意识到,结合本文中所公开的实施例描述的各示例的单元及算法步骤,能够以电子硬件、计算机软件或者二者的结合来实现,为了清楚地说明硬件和软件的可互换性,在上述说明中已经按照功能一般性地描述了各示例的组成及步骤。这些功能究竟以硬件还是软件方式来执行,取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能,但是这种实现不应认为超出本申请的范围。Professionals may further realize that the units and algorithm steps of the examples described in the embodiments disclosed in this article can be implemented by electronic hardware, computer software, or a combination of the two, in order to clearly illustrate the possibilities of hardware and software. Interchangeability, in the above description, the composition and steps of each example have been generally described in accordance with the function. Whether these functions are executed by hardware or software depends on the specific application and design constraint conditions of the technical solution. Professionals and technicians can use different methods for each specific application to implement the described functions, but such implementation should not be considered beyond the scope of this application.
结合本文中所公开的实施例描述的方法或算法的步骤可以直接用硬件、处理器执行的软件模块,或者二者的结合来实施。软件模块可以置于随机存储器(RAM)、内存、只读存储器(ROM)、电可编程ROM、电可擦除可编程ROM、寄存器、硬盘、可移动磁盘、CD-ROM、或技术领域内所公知的任意其它形式的存储介质中。The steps of the method or algorithm described in the embodiments disclosed in this document can be directly implemented by hardware, a software module executed by a processor, or a combination of the two. The software module can be placed in random access memory (RAM), internal memory, read-only memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disks, removable disks, CD-ROMs, or all areas in the technical field. Any other known storage media.
本文中应用了具体个例对本申请的原理及实施方式进行了阐述,以上实施例的说明只是用于帮助理解本申请的技术方案及其核心思想。应当指出,对于本技术领域的普通技术人员来说,在不脱离本申请原理的前提下,还可以对本申请进行若干改进和修饰,这些改进和修饰也落入本申请权利要求的保护范围内。Specific examples are used in this article to describe the principles and implementations of the present application, and the description of the above embodiments is only used to help understand the technical solutions and core ideas of the present application. It should be pointed out that for those of ordinary skill in the art, without departing from the principles of this application, several improvements and modifications can be made to this application, and these improvements and modifications also fall within the protection scope of the claims of this application.

Claims (11)

  1. 一种四维造影图像生成方法,其特征在于,包括:A method for generating four-dimensional contrast images, which is characterized in that it comprises:
    获得目标部位当前帧的造影数据;Obtain the contrast data of the current frame of the target part;
    根据超声探头的定位信息,确定所述超声探头的摆动是否达到预设修正条件;According to the positioning information of the ultrasound probe, determine whether the swing of the ultrasound probe reaches a preset correction condition;
    如果确定所述超声探头的摆动达到所述预设修正条件,则对所述造影数据进行修正,并基于修正后的所述造影数据,生成四维时间渲染图像;If it is determined that the swing of the ultrasound probe reaches the preset correction condition, correct the contrast data, and generate a four-dimensional time-rendered image based on the corrected contrast data;
    如果确定所述超声探头的摆动未达到所述预设修正条件,则基于所述造影数据,生成所述四维时间渲染图像。If it is determined that the swing of the ultrasound probe does not reach the preset correction condition, the four-dimensional time-rendered image is generated based on the contrast data.
  2. 根据权利要求1所述的方法,其特征在于,所述超声探头上设置有定位装置,所述根据超声探头的定位信息,确定所述超声探头的摆动是否达到预设修正条件,包括:The method according to claim 1, wherein the ultrasonic probe is provided with a positioning device, and the determining whether the swing of the ultrasonic probe reaches a preset correction condition according to the positioning information of the ultrasonic probe comprises:
    根据超声探头的定位信息,确定当前帧所述超声探头的空间位置;Determine the spatial position of the ultrasound probe in the current frame according to the positioning information of the ultrasound probe;
    将所述当前帧超声探头的空间位置与预先获得的首帧所述超声探头的空间位置进行比对,确定所述超声探头的空间旋转角度和平移距离;Comparing the spatial position of the ultrasound probe in the current frame with the spatial position of the ultrasound probe in the first frame obtained in advance to determine the spatial rotation angle and translation distance of the ultrasound probe;
    根据所述空间旋转角度和平移距离,确定所述超声探头的摆动是否达到预设修正条件。According to the spatial rotation angle and the translation distance, it is determined whether the swing of the ultrasonic probe reaches a preset correction condition.
  3. 根据权利要求2所述的方法,其特征在于,所述根据所述空间旋转角度和平移距离,确定所述超声探头的摆动是否达到预设修正条件,包括:The method according to claim 2, wherein the determining whether the swing of the ultrasonic probe reaches a preset correction condition according to the spatial rotation angle and translation distance comprises:
    如果所述空间旋转角度大于预设角度阈值和/或所述平移距离大于预设距离阈值,则确定所述超声探头的摆动达到预设修正条件。If the spatial rotation angle is greater than the preset angle threshold and/or the translation distance is greater than the preset distance threshold, it is determined that the swing of the ultrasound probe reaches the preset correction condition.
  4. 根据权利要求2所述的方法,其特征在于,所述定位装置为电磁定位装置,所述对所述造影数据进行修正,包括:The method according to claim 2, wherein the positioning device is an electromagnetic positioning device, and the correcting the imaging data comprises:
    将电磁定位坐标系确定为世界坐标系;Determine the electromagnetic positioning coordinate system as the world coordinate system;
    将超声图像坐标系转换到所述电磁定位坐标系;Converting the ultrasound image coordinate system to the electromagnetic positioning coordinate system;
    确定所述超声探头摆动的仿射矩阵;Determining the affine matrix of the ultrasonic probe swing;
    结合所述仿射矩阵,在所述电磁定位坐标系上对所述造影数据进行坐标变换,并转换回所述超声图像坐标系,获得修正后的所述造影数据。In combination with the affine matrix, coordinate transformation is performed on the contrast data on the electromagnetic positioning coordinate system and converted back to the ultrasound image coordinate system to obtain the corrected contrast data.
  5. 根据权利要求1所述的方法,其特征在于,在所述获得目标部位当 前帧的造影数据之后、所述根据超声探头的定位信息,确定所述超声探头的摆动是否达到预设修正条件之前,还包括:The method according to claim 1, wherein after said obtaining the contrast data of the current frame of the target part and before said determining whether the oscillation of the ultrasound probe reaches a preset correction condition according to the positioning information of the ultrasound probe, Also includes:
    确定所述造影数据中每个体素是否为噪声点;Determine whether each voxel in the contrast data is a noise point;
    在所述造影数据中剔除所述噪声点。The noise points are eliminated from the contrast data.
  6. 根据权利要求5所述的方法,其特征在于,所述确定所述造影数据中每个体素是否为噪声点,包括:The method according to claim 5, wherein the determining whether each voxel in the contrast data is a noise point comprises:
    确定所述造影数据中的每个体素对应的灰度均值;Determining a gray average value corresponding to each voxel in the contrast data;
    将对应的灰度均值小于预设的灰度阈值的体素确定为噪声点。The voxels whose corresponding gray-level average value is less than the preset gray-level threshold are determined as noise points.
  7. 根据权利要求6所述的方法,其特征在于,所述确定所述造影数据中的每个体素对应的灰度均值,包括:The method according to claim 6, wherein the determining the gray-level mean value corresponding to each voxel in the contrast data comprises:
    确定所述造影数据中的每个体素对应的设定大小的区域中体素的灰度和;Determining the gray scale sum of the voxels in the area of the set size corresponding to each voxel in the contrast data;
    将每个体素对应的灰度和与相应区域中体素个数的比值,确定为每个体素对应的灰度均值。The ratio of the gray scale corresponding to each voxel to the number of voxels in the corresponding area is determined as the mean gray scale corresponding to each voxel.
  8. 根据权利要求1至7之中任一项所述的方法,其特征在于,在对已获得的所述目标部位的完整造影数据进行后处理的情况下,在所述生成四维时间渲染图像之前,还包括:The method according to any one of claims 1 to 7, characterized in that, in the case of performing post-processing on the obtained complete angiographic data of the target part, before said generating a four-dimensional temporally rendered image, Also includes:
    基于所述目标部位的组织特征,根据三维区域生长法在所述目标部位的完整造影数据中分割出所述目标部位。Based on the tissue characteristics of the target part, the target part is segmented from the complete angiography data of the target part according to a three-dimensional region growth method.
  9. 一种四维造影图像生成装置,其特征在于,包括:A four-dimensional contrast image generating device, which is characterized in that it comprises:
    造影数据获得模块,用于获得目标部位当前帧的造影数据;An imaging data obtaining module, which is used to obtain the imaging data of the current frame of the target part;
    判断模块,用于根据超声探头的定位信息,确定所述超声探头的摆动是否达到预设修正条件;A judging module, configured to determine whether the swing of the ultrasonic probe reaches a preset correction condition according to the positioning information of the ultrasonic probe;
    造影数据修正模块,用于在确定所述超声探头的摆动达到所述预设修正条件时,对所述造影数据进行修正;An contrast data correction module, configured to correct the contrast data when it is determined that the swing of the ultrasound probe reaches the preset correction condition;
    造影图像生成模块,用于基于修正后的所述造影数据,生成四维时间渲染图像;An angiographic image generating module, configured to generate a four-dimensional time-rendered image based on the corrected angiographic data;
    所述造影图像生成模块,还用于在确定所述超声探头的摆动未达到所述预设修正条件时,基于所述造影数据,生成所述四维时间渲染图像。The contrast image generation module is further configured to generate the four-dimensional time-rendered image based on the contrast data when it is determined that the swing of the ultrasound probe does not reach the preset correction condition.
  10. 一种四维造影图像生成设备,其特征在于,包括:A four-dimensional radiography image generating device, which is characterized in that it comprises:
    存储器,用于存储计算机程序;Memory, used to store computer programs;
    处理器,用于执行所述计算机程序时实现如权利要求1至8任一项所述四维造影图像生成方法的步骤。The processor is configured to implement the steps of the four-dimensional contrast image generation method according to any one of claims 1 to 8 when the computer program is executed.
  11. 一种计算机可读存储介质,其特征在于,所述计算机可读存储介质上存储有计算机程序,所述计算机程序被处理器执行时实现如权利要求1至8任一项所述四维造影图像生成方法的步骤。A computer-readable storage medium, characterized in that a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the four-dimensional angiography image generation according to any one of claims 1 to 8 is realized Method steps.
PCT/CN2020/096260 2020-02-28 2020-06-16 Method, apparatus and device for generating four-dimensional radiographic image, and storage medium WO2021169086A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202010129489.8 2020-02-28
CN202010129489.8A CN111358492A (en) 2020-02-28 2020-02-28 Four-dimensional contrast image generation method, device, equipment and storage medium

Publications (1)

Publication Number Publication Date
WO2021169086A1 true WO2021169086A1 (en) 2021-09-02

Family

ID=71198292

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/096260 WO2021169086A1 (en) 2020-02-28 2020-06-16 Method, apparatus and device for generating four-dimensional radiographic image, and storage medium

Country Status (2)

Country Link
CN (1) CN111358492A (en)
WO (1) WO2021169086A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112529804A (en) * 2020-12-14 2021-03-19 深圳开立生物医疗科技股份有限公司 Image denoising method, device and equipment and computer readable storage medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1606966A (en) * 2003-10-14 2005-04-20 阿洛卡株式会社 Ultrasound diagnosis apparatus
US20140200449A1 (en) * 2013-01-16 2014-07-17 Samsung Medison Co., Ltd. Ultrasound apparatus and method of providing information of the same
CN106725612A (en) * 2016-12-23 2017-05-31 深圳开立生物医疗科技股份有限公司 Four-dimensional ultrasound image optimization method and system
US20170258446A1 (en) * 2014-05-12 2017-09-14 Imagistx, Inc. Medical-imaging system and method thereof
CN109480900A (en) * 2018-11-01 2019-03-19 飞依诺科技(苏州)有限公司 4D ultrasonic probe scanning control method and device and storage medium
CN109788943A (en) * 2016-09-26 2019-05-21 富士胶片株式会社 The control method of diagnostic ultrasound equipment and diagnostic ultrasound equipment

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1847222B1 (en) * 2005-02-09 2011-04-13 Hitachi Medical Corporation Ultrasonographic device and ultrasonographic method
JP2010088585A (en) * 2008-10-06 2010-04-22 Toshiba Corp Ultrasonic diagnostic apparatus and ultrasonic probe
CN101634551B (en) * 2009-08-18 2011-04-13 清华大学深圳研究生院 Method and system for detecting surface roughness
JP5762076B2 (en) * 2010-03-30 2015-08-12 株式会社東芝 Ultrasonic diagnostic apparatus, ultrasonic image processing apparatus, and medical image diagnostic apparatus
CN107440720B (en) * 2012-06-27 2020-09-08 东芝医疗系统株式会社 Ultrasonic diagnostic apparatus and method for correcting image data
CN103473805B (en) * 2013-09-18 2016-04-13 内蒙古科技大学 The method of three-dimensional reconstruction hepatic model volume is measured based on improved confinement growth algorithm
CN104574329B (en) * 2013-10-09 2018-03-09 深圳迈瑞生物医疗电子股份有限公司 Ultrasonic fusion of imaging method, ultrasonic fusion of imaging navigation system
CN106327487B (en) * 2016-08-18 2018-01-02 苏州润迈德医疗科技有限公司 Coronary flow reserve fraction computational methods based on X ray coronary angiography image
CN110313943A (en) * 2018-03-30 2019-10-11 佳能医疗系统株式会社 Medical diagnostic apparatus, medical image-processing apparatus and image processing method
CN109447974B (en) * 2018-10-31 2022-01-25 上海联影医疗科技股份有限公司 Volume data processing method, volume data processing apparatus, image processing workstation, and readable storage medium

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1606966A (en) * 2003-10-14 2005-04-20 阿洛卡株式会社 Ultrasound diagnosis apparatus
US20140200449A1 (en) * 2013-01-16 2014-07-17 Samsung Medison Co., Ltd. Ultrasound apparatus and method of providing information of the same
US20170258446A1 (en) * 2014-05-12 2017-09-14 Imagistx, Inc. Medical-imaging system and method thereof
CN109788943A (en) * 2016-09-26 2019-05-21 富士胶片株式会社 The control method of diagnostic ultrasound equipment and diagnostic ultrasound equipment
CN106725612A (en) * 2016-12-23 2017-05-31 深圳开立生物医疗科技股份有限公司 Four-dimensional ultrasound image optimization method and system
CN109480900A (en) * 2018-11-01 2019-03-19 飞依诺科技(苏州)有限公司 4D ultrasonic probe scanning control method and device and storage medium

Also Published As

Publication number Publication date
CN111358492A (en) 2020-07-03

Similar Documents

Publication Publication Date Title
CN103020928B (en) The metal artifacts reduction method of cone-beam CT system
CN109146994B (en) Metal artifact correction method for multi-energy spectrum X-ray CT imaging
CN111145160B (en) Method, device, server and medium for determining coronary artery branches where calcified regions are located
CN111223156A (en) Metal artifact eliminating method for dental cone beam CT system
WO2021174479A1 (en) Method and apparatus for calculating dental movement amount before and after oral orthodontic treatment
CN102024251A (en) System and method for multi-image based virtual non-contrast image enhancement for dual source CT
JP2023515367A (en) Out-of-distribution detection of input instances to model
WO2021169086A1 (en) Method, apparatus and device for generating four-dimensional radiographic image, and storage medium
CN111445550B (en) Iterative reconstruction method, device and computer readable storage medium for PET image
CN109741254A (en) Dictionary training and Image Super-resolution Reconstruction method, system, equipment and storage medium
CN110555897B (en) Image generation method, device, equipment and storage medium
CN113689337B (en) Ultrasonic image super-resolution reconstruction method and system based on generation countermeasure network
CN113658284A (en) X-ray image synthesis from CT images for training nodule detection systems
Johari et al. Metal artifact suppression in dental cone beam computed tomography images using image processing techniques
US20210212656A1 (en) Methods and systems for improved spectral fidelity for material decomposition
CN114299081B (en) Maxillary sinus CBCT image segmentation method, maxillary sinus CBCT image segmentation device, maxillary sinus CBCT storage medium and electronic equipment
KR102477991B1 (en) Medical image processing method and apparatus
CN116363038A (en) Ultrasonic image fusion method, device, computer equipment and storage medium
WO2023117509A1 (en) 3d dsa image reconstruction
CN116309909A (en) Oral cavity scanning image processing method and device
CN113096238B (en) X-ray diagram simulation method and device, electronic equipment and storage medium
Zhang et al. Metal artifact reduction based on the combined prior image
CN111507918B (en) Medical image enhancement method based on deep learning technology
CN110264537B (en) PET image reconstruction method, system, readable storage medium and apparatus
EP4221580A1 (en) Method and system for estimating arterial input function

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20921183

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20921183

Country of ref document: EP

Kind code of ref document: A1