CN114831729B - Left auricle plugging simulation system for fusion of echocardiography and CT multi-mode images - Google Patents
Left auricle plugging simulation system for fusion of echocardiography and CT multi-mode images Download PDFInfo
- Publication number
- CN114831729B CN114831729B CN202210262054.XA CN202210262054A CN114831729B CN 114831729 B CN114831729 B CN 114831729B CN 202210262054 A CN202210262054 A CN 202210262054A CN 114831729 B CN114831729 B CN 114831729B
- Authority
- CN
- China
- Prior art keywords
- left auricle
- image
- fusion
- heart
- dimensional
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000004927 fusion Effects 0.000 title claims abstract description 50
- 238000004088 simulation Methods 0.000 title claims abstract description 25
- 238000002592 echocardiography Methods 0.000 title claims description 11
- 210000005248 left atrial appendage Anatomy 0.000 claims description 27
- 238000000034 method Methods 0.000 claims description 25
- 238000004873 anchoring Methods 0.000 claims description 24
- 230000011218 segmentation Effects 0.000 claims description 21
- 230000000694 effects Effects 0.000 claims description 12
- 238000012545 processing Methods 0.000 claims description 8
- 210000005242 cardiac chamber Anatomy 0.000 claims description 6
- 230000002980 postoperative effect Effects 0.000 claims description 6
- 230000008569 process Effects 0.000 claims description 6
- 238000005259 measurement Methods 0.000 claims description 5
- 238000012549 training Methods 0.000 claims description 5
- 230000002792 vascular Effects 0.000 claims description 5
- 238000007781 pre-processing Methods 0.000 claims description 4
- 210000005240 left ventricle Anatomy 0.000 claims description 3
- 210000005241 right ventricle Anatomy 0.000 claims description 3
- 238000012502 risk assessment Methods 0.000 claims description 3
- 238000013528 artificial neural network Methods 0.000 claims description 2
- 210000005246 left atrium Anatomy 0.000 claims description 2
- 210000005245 right atrium Anatomy 0.000 claims description 2
- 238000003384 imaging method Methods 0.000 abstract description 11
- 238000013486 operation strategy Methods 0.000 abstract description 2
- 238000013175 transesophageal echocardiography Methods 0.000 description 18
- 238000002604 ultrasonography Methods 0.000 description 10
- 238000011156 evaluation Methods 0.000 description 5
- 230000000903 blocking effect Effects 0.000 description 4
- 230000000747 cardiac effect Effects 0.000 description 4
- 210000003238 esophagus Anatomy 0.000 description 4
- 210000000709 aorta Anatomy 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 3
- 238000013527 convolutional neural network Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 229910052739 hydrogen Inorganic materials 0.000 description 3
- 230000033001 locomotion Effects 0.000 description 3
- 230000009466 transformation Effects 0.000 description 3
- 230000000007 visual effect Effects 0.000 description 3
- 238000004891 communication Methods 0.000 description 2
- 238000004195 computer-aided diagnosis Methods 0.000 description 2
- 238000006073 displacement reaction Methods 0.000 description 2
- 238000000605 extraction Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 208000007536 Thrombosis Diseases 0.000 description 1
- 238000002583 angiography Methods 0.000 description 1
- 230000010100 anticoagulation Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 238000003759 clinical diagnosis Methods 0.000 description 1
- 238000007796 conventional method Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 238000003745 diagnosis Methods 0.000 description 1
- 238000002405 diagnostic procedure Methods 0.000 description 1
- 239000003814 drug Substances 0.000 description 1
- 230000009977 dual effect Effects 0.000 description 1
- 230000002526 effect on cardiovascular system Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000005755 formation reaction Methods 0.000 description 1
- 210000002837 heart atrium Anatomy 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 210000004115 mitral valve Anatomy 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000002601 radiography Methods 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 238000002560 therapeutic procedure Methods 0.000 description 1
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/10—Computer-aided planning, simulation or modelling of surgical operations
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/10—Computer-aided planning, simulation or modelling of surgical operations
- A61B2034/101—Computer-aided simulation of surgical operations
- A61B2034/102—Modelling of surgical devices, implants or prosthesis
- A61B2034/104—Modelling the effect of the tool, e.g. the effect of an implanted prosthesis or for predicting the effect of ablation or burring
Landscapes
- Health & Medical Sciences (AREA)
- Surgery (AREA)
- Engineering & Computer Science (AREA)
- Life Sciences & Earth Sciences (AREA)
- Biomedical Technology (AREA)
- Robotics (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Heart & Thoracic Surgery (AREA)
- Medical Informatics (AREA)
- Molecular Biology (AREA)
- Animal Behavior & Ethology (AREA)
- General Health & Medical Sciences (AREA)
- Public Health (AREA)
- Veterinary Medicine (AREA)
- Image Processing (AREA)
Abstract
The invention relates to a left auricle plugging simulation system for fusion of an echocardiogram and a CT multi-mode image, and belongs to the technical field of medical appliances. According to the invention, through the combined application of two imaging methods, DICOM image data of the two images are respectively acquired, fusion imaging is realized by design software, the internal structure, the function and the external morphology of the left auricle are simultaneously displayed, then matching of the occluder is simulated, so that an operator can select an operation strategy by using the left auricle occlusion simulation device before operation, and the optimal and most suitable occluder device is selected. The image fusion simulation system provided by the invention can realize the fusion of the transesophageal real-time four-dimensional echocardiogram and the CT multi-mode image of the left auricle, and can fuse the internal structure and the function of the left auricle, the external integral form and the adjacent left auricle, thereby providing a practical imaging method for improving the success rate of left auricle plugging operation and reducing complications.
Description
Technical Field
The invention relates to a left auricle plugging simulation system for fusion of an echocardiogram and a CT multi-mode image, and belongs to the technical field of medical appliances.
Background
At present, in the left auricle plugging operation, the clinical application is mostly based on the guidance of a transesophageal echocardiography or CT single-mode imaging method, and the effect of observing the left auricle plugging is realized by combining operation center angiography.
However, with the wide development of left atrial appendage occlusion, particularly in extremely simple surgical modes, on the one hand, the residual split rate after left atrial appendage occlusion is high, which is still one of the important problems facing cardiovascular doctors, and the risk of thrombosis on the surface of the patient occluder with high residual split rate is increased, so that the residual cavity needs to be occluded again in addition to long-term anticoagulation treatment; on the other hand, because the anatomical form of the left auricle is various, the conventional method has limited evaluation on the anatomical form and adjacent form of the left auricle, and the diameter of an anchoring area, the depth of the left auricle and the like can be measured when left auricle radiography is carried out in the left auricle plugging operation, but the evaluation on the left auricle in the operation is limited, and the instant plugging strategy is relatively rapid and inaccurate. The situation can cause left auricle blocking failure or the situations of more residual shunt volume, displacement, even falling off of the blocking device and the like after blocking operation, and the like, and the operation doctor has difficulty in selecting the blocking device, so that the operation effect is influenced. Therefore, the technical problem of how to simulate the left atrial appendage occlusion effect before operation, reduce complications such as residual shunt after left atrial appendage occlusion operation and improve the success rate of operation is needed to be solved in the technical field.
Disclosure of Invention
The invention aims to solve the technical problems of simulating the left auricle plugging effect before operation, reducing complications such as residual shunt, displacement, even falling off and the like around a left auricle plugging device after the left auricle plugging operation and improving the success rate of the operation.
In order to achieve the purpose of solving the problems, the technical scheme adopted by the invention is to provide a method for predicting the left auricle plugging effect by fusing a transesophageal real-time four-dimensional echocardiogram and a CT multi-mode image, which comprises the following steps:
Step 1: acquiring DICOM (DIGITAL IMAGING AND Communications IN MEDICINE, digital imaging and communication in medicine) format image data of a human heart left auricle transesophageal real-time four-dimensional echocardiogram and CT;
step 2: threshold segmentation is carried out on CT images of the human heart; for a typical heart segmentation task, the input CT images are generated into right/left/right/left and basic vascular structures through a full convolutional neural network FCN (Fully-Convolutional Neural Networks); the FCN performs model training through a U-structure network and a supervised learning framework based on the disclosed full heart segmentation data set; extracting main directions by adopting all grid points in a heart structure; for a given DSCT (Dual Source CT) image Wherein C is the number of channels, D, H, W are the thickness, height and width of the input image, respectively.
Step 3: preprocessing and segmenting a real-time four-dimensional ultrasonic image of the left auricle of the human body through the esophagus based on an Expectation-Maximization (EM) algorithm; the segmentation process comprises the steps of firstly selecting a basic position through a four-cavity plane, carrying out local region expansion based on a Sobel operator, and introducing time sequence weight for similarity measurement between CT and TEE (transesophageal echocardiography, transesophageal echocardiography, TEE); given a sequence of RT4D-TEE ultrasound images, containing N B 3D-TEE images in total, the model will yield N B point set Y l for characterizing the four-lumen contours in the ultrasound images.
Step 4: based on the processed CT image and the ultrasonic image, performing initial coarse ultrasonic frame and CT horizon matching by an exhaustive discrete search method similar to the existing method; for each time point t, the cross section with the least mean square error will be transformed as a rigid to an optimal match;
step 5: carrying out spatial registration on the heart chamber, the CT three-dimensional model of the left auricle and the ultrasonic four-dimensional model of the left auricle to obtain a fusion model of a left auricle image based on an ultrasonic/CT image, and realizing the joint display of two image modes in a visual mode to obtain the fusion model of the left auricle image of the ultrasonic/CT image;
Step 6: based on the fusion model of the left auricle image, the left auricle plugging device is simulated to be placed into the left auricle fusion model for assisting a clinician in judging focus grades and guiding operation planning and postoperative effect evaluation.
Preferably, the spatial registration in the step 5 includes a registration algorithm, and the registration algorithm maps two heterogeneous image modes under the same coordinate space through feature transformation, and can have better robustness to local non-rigid deformation caused by motion.
Preferably, the inner surface of the left auricle displayed by the fusion model in the step 5 is provided with a positioning anchoring area, and the bottom is provided with a mark point of the depth of the left auricle; in the step 6, the left atrial appendage occlusion device is simulated to be placed in the left atrial appendage fusion model, and the left atrial appendage occlusion device is placed in the anchoring area.
The invention provides a left auricle plugging simulation system, which comprises:
The data acquisition module is used for acquiring DICOM format image data of real-time four-dimensional echocardiography and CT of the left auricle of the human heart;
The data processing module is used for processing CT images of the human heart and real-time four-dimensional ultrasonic images of the left auricle of the human body through the esophagus and modeling; carrying out spatial registration on the heart chamber, the CT three-dimensional model of the left auricle and the ultrasonic four-dimensional model of the left auricle to obtain a fusion model of the left auricle image based on ultrasonic/CT images;
The simulation operation module is used for simulating the placement of the left auricle plugging device into the left auricle fusion model;
The risk assessment module is used for assisting a clinician in distinguishing the focus and guiding operation planning and postoperative effect assessment; and selecting a proper left auricle plugging device and a proper operation scheme according to the simulation effect.
Preferably, the simulated operation module is provided with a matching device for simulating different types of left atrial appendage occlusion devices.
Preferably, the matching means is provided with formations for anchoring with the left atrial appendage anchoring region.
The invention provides a storage device which stores a plurality of instructions, wherein the instructions are suitable for executing the steps in the method for predicting the left auricle plugging effect through the fusion of the real-time four-dimensional echocardiogram and the CT multi-mode image.
The invention provides application of the left atrial appendage occlusion simulation system in a non-diagnostic method and a non-therapeutic method.
The invention provides application of the method for predicting the left auricle plugging effect by fusing the transesophageal real-time four-dimensional echocardiogram and the CT multi-mode image in a non-diagnosis method and a non-treatment method.
Compared with the prior art, the invention has the following beneficial effects:
The invention relates to a transesophageal real-time four-dimensional echocardiography and CT multi-mode image fusion system and a left auricle plugging simulation device. Through the combined application of the two imaging methods, DICOM image data of the two imaging methods are respectively acquired, fusion imaging is realized by design software, the internal structure and the function as well as the external morphology and the adjacent of the left auricle are simultaneously displayed, and then matching of the occluders is simulated, so that an operator can select an operation strategy by using the left auricle occlusion simulation device before operation, and the optimal and most suitable occluder device is selected. The left auricle multi-mode fusion-prediction system provided by the invention can realize the fusion of the transesophageal real-time four-dimensional echocardiogram and the CT multi-mode image of the left auricle, and the fusion of the internal structure and the function, the external integral form and the adjacent left auricle of the left auricle is carried out, so that a feasible imaging method is provided for improving the success rate of left auricle plugging operation and reducing complications.
The left auricle plugging simulation system provided by the invention can realize the matching of the left auricle plugging device and the left auricle, and helps a clinician to select the most suitable plugging device; the invention provides a feasible imaging method for improving the success rate of left auricle plugging operation and reducing complications for the feasibility, accuracy and generalizability of the conventional left auricle plugging device.
The invention is helpful for selecting the most suitable occluder device, and is helpful for judging whether the occluder device is suitable for occlusion or not and selecting an occluder for the left auricle with special shape; the invention is beneficial to designing the occluder device with special shape, guiding the design of the device and improving the device on the basis of the prior device, and lays a foundation for improving the left auricle occluder device.
Drawings
Fig. 1 is a diagram of an analysis process of complications such as occluder selection and residual shunt based on fusion images.
Fig. 2 is a schematic diagram of a left atrial appendage occlusion device for simulating left atrial appendage placement.
Fig. 3 is a schematic diagram II of a left atrial appendage occlusion device for simulating left atrial appendage placement.
Detailed Description
In order to make the invention more comprehensible, preferred embodiments accompanied with the accompanying drawings are described in detail as follows:
as shown in fig. 1-3, in order to reduce residual flow rate after left atrial appendage occlusion and improve operation success rate, the invention provides a method for predicting left atrial appendage occlusion effect by fusing a transesophageal real-time four-dimensional echocardiogram and a CT multi-modal image, which comprises the following steps:
Step 1: acquiring DICOM format image data of a human heart left auricle, a real-time four-dimensional echocardiogram and CT;
Step 2: threshold segmentation is carried out on CT images of the human heart; for a typical heart segmentation task, generating a right ventricle/left ventricle/right atrium/left atrium and a basic vascular structure from input CT images through a full convolution neural network FCN; the FCN performs model training through a U-structure network and a supervised learning framework based on the disclosed full heart segmentation data set; extracting main directions by adopting all grid points in a heart structure; for a given DSCT image Wherein C is the number of channels, D, H, W are the thickness, height and width of the input image, respectively.
Step 3: preprocessing and dividing a real-time four-dimensional ultrasonic image of the left auricle of the human body through the esophagus based on a maximization-expectation EM algorithm; the segmentation process comprises the steps of firstly selecting a basic position through a four-cavity plane, carrying out local region expansion based on a Sobel operator, and introducing time sequence weight for similarity measurement between CT and TEE; given a sequence of RT4D-TEE ultrasound images, containing N B 3D-TEE images in total, the model will yield N B point set Y l for characterizing the four-lumen contours in the ultrasound images.
Step 4: based on the processed CT image and the ultrasonic image, performing initial coarse ultrasonic frame and CT horizon matching by an exhaustive discrete search method similar to the existing method; for each time point t, the cross section with the least mean square error will be transformed as a rigid to an optimal match;
step 5: carrying out spatial registration on the heart chamber, the CT three-dimensional model of the left auricle and the ultrasonic four-dimensional model of the left auricle to obtain a fusion model of a left auricle image based on an ultrasonic/CT image, and realizing the joint display of two image modes in a visual mode to obtain the fusion model of the left auricle image of the ultrasonic/CT image;
Step 6: based on the fusion model of the left auricle image, the left auricle plugging device is simulated to be placed into the left auricle fusion model for assisting a clinician in judging focus grades and guiding operation planning and postoperative effect evaluation.
The spatial registration in the step 5 includes a registration algorithm, wherein the registration algorithm maps two heterogeneous image modes under the same coordinate space through feature transformation, and the registration algorithm has better robustness to local non-rigid deformation caused by motion.
The inner surface of the left auricle displayed by the fusion model in the step 5 is provided with a positioning anchoring area, and the bottom is provided with a mark point of the depth of the left auricle; in the step 6, the left atrial appendage occlusion device is simulated to be placed in the left atrial appendage fusion model, and the left atrial appendage occlusion device is placed in the anchoring area.
The invention provides a left auricle plugging simulation system for fusion of echocardiography and CT multi-mode images, which comprises the following components:
The data acquisition module is used for acquiring DICOM format image data of real-time four-dimensional echocardiography and CT of the left auricle of the human heart;
The data processing module is used for processing CT images of the human heart and real-time four-dimensional ultrasonic images of the left auricle of the human body through the esophagus and modeling; carrying out spatial registration on the heart chamber, the CT three-dimensional model of the left auricle and the ultrasonic four-dimensional model of the left auricle to obtain a fusion model of the left auricle image based on ultrasonic/CT images;
The simulation operation module is used for simulating the placement of the left auricle plugging device into the left auricle fusion model;
The risk assessment module is used for assisting a clinician in distinguishing the focus and guiding operation planning and postoperative effect assessment; and selecting a proper left auricle plugging device and a proper operation scheme according to the simulation effect.
The simulation operation module is provided with a matching device for simulating different types of left atrial appendage occlusion devices.
The matching device is provided with a structure for anchoring with the left auricle anchoring area.
The present invention provides a storage device storing a plurality of instructions adapted to perform the steps of a method of predicting left atrial appendage occlusion effect according to a transesophageal real-time four-dimensional echocardiography and CT multi-modal image fusion as described above.
The left auricle plugging simulation system for fusing the echocardiogram and the CT multi-mode image provided by the invention can realize the fusion of the transesophageal real-time four-dimensional echocardiogram and the CT multi-mode image of the left auricle, is applied to embedded equipment integrated with left auricle image modeling and the fusion system thereof,
The image fusion comprises the following steps: acquiring DICOM format image data of a human heart left auricle, a real-time four-dimensional echocardiogram and CT; threshold segmentation is carried out on CT images of the human heart; for a typical cardiac segmentation task, the fully convolutional neural network FCN generates input CT images into right/left/right/left (RV/LV/RA/LA) and basic vascular structures such as the Aorta (aortas) and the like. The FCN performs model training through the U-structured network and the supervised learning framework based on the disclosed full cardiac segmentation dataset. On this basis, all grid points in the heart structure are further used for main direction extraction. For a given DSCT imageWherein C is the number of channels, D, H, W are the thickness, height and width of the input image, respectively. The transesophageal real-time four-dimensional ultrasound image of the left atrial appendage of the human body is first preprocessed and segmented based on an Expectation-Maximization (EM) algorithm. The segmentation process firstly selects basic positions through four cavity planes, carries out local region expansion based on Sobel operators, and introduces time sequence weights for similarity measurement between CT and TEE (transesophageal echocardiography transesophageal echocardiography, TEE). Given a sequence of RT4D-TEE ultrasound images, containing N B 3D-TEE images in total, the model will yield N B point set Y l for characterizing the four-lumen contours in the ultrasound images.
The invention provides a transesophageal real-time four-dimensional echocardiography and CT multi-modal image fusion left auricle plugging simulation system, which comprises a transesophageal real-time four-dimensional echocardiography and CT multi-modal image fusion system and a matching device;
wherein, the image fusion system comprises a transesophageal echocardiogram and a CT image; the transesophageal echocardiography image includes two-dimensional and four-dimensional images; CT images, including two-dimensional and three-dimensional images; the matching device is used for simulating different types of left atrial appendage occluder devices; the matching device has anchoring areas of different occluder devices thereon.
The left auricle image modeling method of the left auricle plugging simulation system for the fusion of the echocardiography and the CT multi-mode image comprises the following steps:
1. Ultrasonic image and CT data of the left auricle of the human body are acquired, and the medical detection instrument is used for acquiring ultrasonic image data and CT data of the left auricle DICOM format of the patient.
2. In the patient left atrial appendage ultrasound image, preprocessing and segmentation is first performed based on a maximization-expectation EM algorithm. The segmentation process firstly selects basic positions through four cavity planes, local region expansion is carried out based on Sobel operators, and time sequence weights are introduced for similarity measurement between CT and TEE.
3. In a CT image of a human heart, first, FCN is used to segment the basic structure of the heart. For a typical cardiac segmentation task, the FCN will input CT images to generate left and right ventricles/atria (RV/LV/RA/LA) and basic vascular structures (Aorta et al). The FCN performs model training through the U-structured network and the supervised learning framework based on the disclosed full cardiac segmentation dataset. On this basis, all grid points in the heart structure are further used for main direction extraction.
4. Based on the processed CT image and the ultrasound image, an initial coarse ultrasound frame is matched with the CT horizon by an exhaustive discrete search method similar to the prior method. For each time point t, the cross section with the least mean square error will be transformed as a rigid to the best match.
5. Spatially registering the heart chamber, the CT three-dimensional model of the left auricle and the ultrasonic four-dimensional model of the left auricle to obtain a fusion model of the left auricle image based on the ultrasonic-CT image, wherein the method comprises the following steps: a registration algorithm is designed, two heterogeneous image modes are mapped to the position under the same coordinate space through feature transformation, and the method has good robustness to local non-rigid deformation caused by movement. Finally, the combined display of the two image modes is realized in a visual mode, and a fusion model of the left auricle image of the ultrasonic-CT image is obtained and is used for clinical diagnosis.
6. Computer aided diagnosis framework research based on multi-modal feature fusion is conducted: after the multi-modal registration work is completed, a corresponding computer-aided diagnosis algorithm is designed based on the visualized image data, and is used for assisting a clinician in judging the focus level and guiding the operation planning and the postoperative effect evaluation.
The inner surface of the fusion model of the left auricle image is provided with a positioning anchoring area structure; the bottom of the fusion model of the left auricle image is provided with a mark point of left auricle depth; the left atrial appendage occlusion device is placed over the anchoring zone structure.
The inner surface of the fusion model of the left auricle image is provided with a positioning anchoring area structure in the direction extending to the inner position of the body of the movable part; the left auricle is plugged by placing the left auricle plugging device on the anchoring area structure.
The matching device is used for simulating different types of left atrial appendage occluder devices; the matching device is provided with different anchoring areas corresponding to different plugging device devices.
The fusion model of the left auricle image is positioned at the position of the left auricle inner opening and the gyrotron and is respectively provided with an anchoring area. The position of the anchoring area is an adjustable structure aiming at the left auricle with different forms. The position of the outer opening of the left auricle is positioned between the Hua method Lin Ji and the mitral valve annulus, the area of the connecting line between the connecting line and the anchoring area is provided with a coverage area, and the left auricle with different forms is an adjustable structure. The coverage area and the anchor area may be for different types of occluder devices.
The left auricle plugging simulation system provided by the invention can realize the matching of the left auricle plugging device and the left auricle, and is beneficial to selecting the most suitable plugging device; setting a matching device, wherein the matching device is provided with different anchoring areas corresponding to different plugging device devices; the position of the anchoring area in the fusion model of the left auricle image is an adjustable structure, and the fusion model is also provided with a coverage area, and the left auricle image is an adjustable structure aiming at different forms. The coverage area and the anchoring area can be aimed at occluder devices of different specifications and models.
While the invention has been described with respect to preferred embodiments thereof, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. Equivalent embodiments of the present invention will be apparent to those skilled in the art having the benefit of the teachings disclosed herein, when considered in the light of the foregoing disclosure, and without departing from the spirit and scope of the invention; meanwhile, any equivalent changes, modifications and evolution of the above embodiments according to the essential technology of the present invention still fall within the scope of the technical solution of the present invention.
Claims (1)
1. An echocardiography and CT multi-modal image fusion left atrial appendage occlusion simulation system comprising:
(1) The data acquisition module is used for acquiring the left auricle four-dimensional echocardiogram of the human heart and DICOM format image data of CT;
(2) The data processing module is used for processing the CT image of the human heart and the four-dimensional ultrasonic image of the left auricle of the human body, modeling, and carrying out spatial registration on the three-dimensional model of the heart chamber and the four-dimensional model of the left auricle to obtain a fusion model of the left auricle image based on the ultrasonic/CT image;
The processing of the CT image of the human heart refers to threshold segmentation of the CT image of the human heart; for a typical heart segmentation task, generating a right ventricle/left ventricle/right atrium/left atrium and a basic vascular structure from input CT images through a full convolution neural network FCN; the FCN performs model training through a U-structure network and a supervised learning framework based on the disclosed full heart segmentation data set; extracting main directions by adopting all grid points in a heart structure;
The processing of the four-dimensional ultrasonic image of the left auricle of the human body refers to preprocessing and segmentation of the four-dimensional ultrasonic image of the left auricle of the human body based on a maximization-expectation-maximization (EM) algorithm; the segmentation process comprises the steps of firstly selecting a basic position through a four-cavity plane, carrying out local region expansion based on a Sobel operator, and introducing time sequence weight for similarity measurement between CT and TEE;
The modeling comprises the steps of executing initial coarse ultrasonic frame and CT horizon matching by an exhaustive discrete search method similar to the prior method based on the processed CT image and ultrasonic image; for each time point t, the cross section with the least mean square error will be transformed as a rigid to an optimal match;
(3) The simulation operation module is used for simulating the placement of the left auricle plugging device into the left auricle fusion model;
The simulation operation module is internally provided with a matching device for simulating different types of left auricle plugging devices;
The matching device is provided with an anchoring structure for anchoring with the left auricle anchoring area;
(4) The risk assessment module is used for assisting a clinician in distinguishing the focus and guiding operation planning and postoperative effect assessment; and selecting a proper left auricle plugging device and a proper operation scheme according to the simulation effect.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210262054.XA CN114831729B (en) | 2022-03-17 | 2022-03-17 | Left auricle plugging simulation system for fusion of echocardiography and CT multi-mode images |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210262054.XA CN114831729B (en) | 2022-03-17 | 2022-03-17 | Left auricle plugging simulation system for fusion of echocardiography and CT multi-mode images |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114831729A CN114831729A (en) | 2022-08-02 |
| CN114831729B true CN114831729B (en) | 2024-05-10 |
Family
ID=82562317
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210262054.XA Active CN114831729B (en) | 2022-03-17 | 2022-03-17 | Left auricle plugging simulation system for fusion of echocardiography and CT multi-mode images |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114831729B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108143396A (en) * | 2018-01-19 | 2018-06-12 | 苏州江奥光电科技有限公司 | A kind of portable early stage caries diagnostic device and diagnostic method based on fluorescence imaging |
| US20240058071A1 (en) * | 2022-08-17 | 2024-02-22 | Boston Scientific Scimed, Inc. | Left atrial appendage closure pre-procedure system and methods |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP2538398A1 (en) * | 2011-06-19 | 2012-12-26 | Centrum Transferu Technologii Medycznych Park Technologiczny Sp. z o.o. | System and method for transesophageal echocardiography simulations |
| CN109377520A (en) * | 2018-08-27 | 2019-02-22 | 西安电子科技大学 | Cardiac image registration arrangement and method based on semi-supervised circulation GAN |
| CN113057677A (en) * | 2021-03-30 | 2021-07-02 | 华南理工大学 | Heart image modeling method, system and equipment for fusing ultrasonic image and CT image |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10719986B2 (en) * | 2009-12-22 | 2020-07-21 | Siemens Healthcare Gmbh | Method and system for virtual percutaneous valve implantation |
| US10842379B2 (en) * | 2016-01-29 | 2020-11-24 | Siemens Healthcare Gmbh | Multi-modality image fusion for 3D printing of organ morphology and physiology |
-
2022
- 2022-03-17 CN CN202210262054.XA patent/CN114831729B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP2538398A1 (en) * | 2011-06-19 | 2012-12-26 | Centrum Transferu Technologii Medycznych Park Technologiczny Sp. z o.o. | System and method for transesophageal echocardiography simulations |
| CN109377520A (en) * | 2018-08-27 | 2019-02-22 | 西安电子科技大学 | Cardiac image registration arrangement and method based on semi-supervised circulation GAN |
| CN113057677A (en) * | 2021-03-30 | 2021-07-02 | 华南理工大学 | Heart image modeling method, system and equipment for fusing ultrasonic image and CT image |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114831729A (en) | 2022-08-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| RU2472442C2 (en) | System for complex combination of data of image formation based on statistical anatomical models | |
| CN109589170B (en) | Left atrial appendage closure guidance in medical imaging | |
| CN114831729B (en) | Left auricle plugging simulation system for fusion of echocardiography and CT multi-mode images | |
| JP5797352B1 (en) | Method for tracking a three-dimensional object | |
| US7693563B2 (en) | Method for image processing and contour assessment of the heart | |
| US9292917B2 (en) | Method and system for model-based fusion of computed tomography and non-contrasted C-arm computed tomography | |
| JP5039295B2 (en) | Imaging system for use in medical intervention procedures | |
| US9687204B2 (en) | Method and system for registration of ultrasound and physiological models to X-ray fluoroscopic images | |
| CN100518648C (en) | Cardiac CT system for planning and treatment of biventricular pacing | |
| KR102251830B1 (en) | Systems and methods for registration of ultrasound and ct images | |
| US9589379B2 (en) | System and method for visualization of cardiac changes under various pacing conditions | |
| US20070014452A1 (en) | Method and system for image processing and assessment of a state of a heart | |
| EP1837828A2 (en) | Image registration using locally-weighted fitting | |
| BRPI0806078A2 (en) | anatomical modeling from 3d image and surface mapping | |
| US20170065242A1 (en) | Method and System for Analysis of Myocardial Wall Dynamics | |
| JP2006110344A (en) | Method and system for registering three-dimensional model of anatomical region with projection image of the same | |
| US20150206302A1 (en) | Systems, methods and computer readable storage media storing instructions for integrating fluoroscopy venogram and myocardial images | |
| CN113487665B (en) | Method, device, equipment and medium for measuring cavity gap | |
| WO2002003304A2 (en) | Predicting changes in characteristics of an object | |
| CN114931435B (en) | Three-dimensional model processing method and device and electronic equipment | |
| JP2021504046A (en) | Alignment of static preoperative planning data with respect to dynamic intraoperative segmentation data | |
| CN114283179A (en) | Real-time fracture far-near end space pose acquisition and registration system based on ultrasonic images | |
| Cho et al. | Predicting target vessel location on robot‐assisted coronary artery bypass graft using CT to ultrasound registration | |
| WO2022223042A1 (en) | Surgical path processing system, method, apparatus and device, and storage medium | |
| KR20230021544A (en) | Method for coronary arteries non-rigid registration using hierarchical deformation in computed tomography angiography images recording medium and device for performing the method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |