CN115222881A - Lung tumor reconstruction and dynamic virtual display system based on 4D-CT - Google Patents

Lung tumor reconstruction and dynamic virtual display system based on 4D-CT Download PDF

Info

Publication number
CN115222881A
CN115222881A CN202210819189.1A CN202210819189A CN115222881A CN 115222881 A CN115222881 A CN 115222881A CN 202210819189 A CN202210819189 A CN 202210819189A CN 115222881 A CN115222881 A CN 115222881A
Authority
CN
China
Prior art keywords
data
model
module
display
dimensional
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202210819189.1A
Other languages
Chinese (zh)
Inventor
于金明
钱俊超
王琳琳
朱健
穆向魁
张功森
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Yu Jinming
Cancer Hospital of Shandong First Medical University
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to CN202210819189.1A priority Critical patent/CN115222881A/en
Publication of CN115222881A publication Critical patent/CN115222881A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/003—Navigation within 3D models or images
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/0002—Inspection of images, e.g. flaw detection
    • G06T7/0012—Biomedical image inspection
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10072—Tomographic images
    • G06T2207/10081—Computed x-ray tomography [CT]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30004—Biomedical image processing
    • G06T2207/30061—Lung
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30004—Biomedical image processing
    • G06T2207/30096—Tumor; Lesion

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Computer Graphics (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Quality & Reliability (AREA)
  • Radiology & Medical Imaging (AREA)
  • Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Geometry (AREA)
  • General Health & Medical Sciences (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Apparatus For Radiation Diagnosis (AREA)

Abstract

The invention discloses a lung tumor reconstruction and dynamic virtual display system based on 4D-CT, and relates to the field of medical image reconstruction display. The invention comprises a data preprocessing module, a model reconstruction module and a display module; the data preprocessing module is used for acquiring 4D-CT data of a patient, reading the required 4D-CT data, and dividing according to each breathing time phase to obtain a data preprocessing result; the model reconstruction module is used for reconstructing a simulation image according to a data preprocessing result; and the display module is used for displaying the simulation images and dynamically displaying the virtual 3D models of all time phases. The invention can effectively provide clearer and more novel display results for patients on one hand, and can more truly simulate the conditions of the patients on the other hand, so that the positions of tumors can be more intuitively seen, and the invention is favorable for clinical diagnosis and treatment.

Description

Lung tumor reconstruction and dynamic virtual display system based on 4D-CT
Technical Field
The invention relates to the field of medical image reconstruction display, in particular to a lung tumor reconstruction and dynamic virtual display system based on 4D-CT.
Background
Tumor is a major problem endangering human health in the current society, more and more people pay more attention to the health of the people, lung cancer is a common malignant tumor, and radiotherapy is one of the main treatment means of patients in middle and advanced stages of lung cancer.
In the three-dimensional conformal radiotherapy, the accuracy of delineation of the target region directly influences the curative effect of the radiotherapy, although the precise radiotherapy technology is more and more mature, the precise delineation of the target region is still the basis of the precise radiotherapy, and in the conventional CT examination, the motion error caused by respiratory motion is ignored, and the delineation precision of the target region is reduced, so that the dose calculation in the radiotherapy process is inaccurate, and more uncertain factors are brought to the radiotherapy.
In order to accurately capture the motion track of the tumor, a 4D-CT technology is created, wherein the 4D-CT technology is similar to the heart examination technology in fact, a time factor is introduced, and the dynamic motion track of the tumor at each respiratory phase is accurately captured in a mode of externally applying gating.
In clinical practical application, retrospective 4D-CT is mainly used, the whole respiratory cycle is divided into ten time phases, and the tumor state of a lung cancer patient is better reflected by reconstructing each time phase; the real-time display of the tumor in the body is very important, and if the virtual holographic dynamic display can be carried out in modes such as VR and the like, the real-time display can better reflect the actual situation, and is favorable for clinical diagnosis and observation. Therefore, those skilled in the art need to research how to perform virtual holographic dynamic display by means of VR and the like.
Disclosure of Invention
In view of the above, the present invention provides a lung tumor reconstruction and dynamic virtual display system based on 4D-CT, which reconstructs a tumor position on the basis of reconstructing each time phase model, according to embodiments of various aspects of the present invention, the related 4D-CT data of the system is utilized, a three-dimensional analog image (including a first analog image and a first analog image) of a third viewing angle can be automatically simulated, and the holographic analog image can be directly seen through the display module, so that on one hand, a clearer and novel display result can be effectively provided for a patient, on the other hand, the condition of the patient can be more truly simulated, the position of the tumor can be more intuitively seen, and clinical diagnosis and treatment are facilitated.
In order to achieve the purpose, the invention adopts the following technical scheme:
a lung tumor reconstruction and dynamic virtual display system based on 4D-CT comprises a data preprocessing module, a model reconstruction module and a display module;
the data preprocessing module is used for acquiring 4D-CT data of a patient, reading the required 4D-CT data, and dividing according to each breathing time phase to obtain a data preprocessing result; the data is divided into four time phase phases according to the breathing cycle, namely an inspiration phase, a breath-hold phase after inspiration, an expiration phase and a breath-hold phase after expiration. The data required is 4D-CT scan data for one complete respiratory cycle of the patient.
The model reconstruction module is used for reconstructing a simulation image according to a data preprocessing result;
the display module is used for displaying the simulation images and dynamically displaying the virtual 3D models of all time phases.
Optionally, the simulation reconstruction module is further configured to reconstruct the 4D-CT data of each time phase processed by the data preprocessing module into a three-dimensional model, and generate a first simulation image; and the three-dimensional model is also used for reconstructing tumor data outlined by each time phase into a three-dimensional model and generating a second simulation image.
Optionally, the first analog image and the second analog image include a stereoscopic image at a third person viewing angle. The first simulation image and the second simulation image are both three-dimensional reconstructed 3D models, and the third person-called perspective stereoscopic image refers to a reconstructed three-dimensional model visually seen by an operator/user from a display screen/other display systems.
Optionally, the data preprocessing module is further configured to obtain a tumor region of the patient according to the 4D-CT data of the patient; and storing the tumor data file into a required file format, and storing the tumor data.
Optionally, the model reconstruction module is further configured to perform three-dimensional reconstruction according to 4D-CT related data of a patient, and generate a first simulated image and a second simulated image corresponding to each other; and converting the three-dimensional model into corresponding three-dimensional model data in a preset format, and storing the three-dimensional model data.
Optionally, the three-dimensional model includes any one or more of a three-dimensional radiotherapy radiation field model, a three-dimensional dose distribution model, a three-dimensional radiotherapy structure model, and a three-dimensional radiotherapy device model.
Optionally, the 4D-CT data includes feature data of a patient, feature data of a CT scanning device, and scanning environment data.
Optionally, the display module includes one or more of a computer display, a VR display, and a screen projection display.
Optionally, the first simulated image and the second simulated image satisfy a real position relationship.
According to the technical scheme, compared with the prior art, the invention discloses a lung tumor reconstruction and dynamic virtual display system based on 4D-CT, the tumor position is reconstructed on the basis of reconstructing each time phase model, according to the implementation modes of various aspects of the invention, the three-dimensional simulation image of a third visual angle (comprising the first simulation image and the first simulation image) can be automatically simulated by utilizing the related 4D-CT data of the system, and the holographic simulation image can be directly seen through the display module.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
FIG. 1 is a schematic structural diagram of modules of the present invention;
FIG. 2 is a block diagram of a data preprocessing module according to the present invention;
FIG. 3 is a schematic structural diagram of a model reconstruction module according to the present invention;
fig. 4 is a schematic structural diagram of a display module according to the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The embodiment of the invention discloses a lung tumor reconstruction and dynamic virtual display system based on 4D-CT.
FIG. 1 is a schematic block diagram of a lung 4D-CT data reconstruction display system according to the present invention; FIG. 2 is a schematic diagram of a data preprocessing module according to the present invention; FIG. 3 is a schematic diagram of a model reconstruction module according to the present invention; fig. 4 is a schematic structural diagram of a display module according to the present invention.
The lung tumor reconstruction and dynamic virtual display system based on 4D-CT disclosed by the embodiment can be applied to three-dimensional reconstruction and virtual display of 4D-CT, and comprises the following specific steps:
(1) Reading multi-temporal lung 4D-CT data of a patient in a respiratory cycle;
(2) Performing tumor delineation on the lung 4D-CT data of each time phase, determining the position of the tumor, and storing the delineated data file;
(3) Performing three-dimensional reconstruction through lung 4D-CT data of each time phase and a stored data file with a tumor delineation to generate a three-dimensional data format file;
(4) Reading the three-dimensional data format file by using VR and other modes, and virtually displaying the three-dimensional model;
(5) The virtual 3D model of each time phase is dynamically displayed so as to achieve the purpose of simulating actual respiration, the changes of the position, the angle and the like of the tumor in each model along with the change of the respiration time phase are directly observed, and important biological information is provided for clinical diagnosis and treatment.
As shown in fig. 1, 2, 3, and 4, the system includes:
the data preprocessing module 101 is used for acquiring 4D-CT related data of a patient related to a hospital, reading the 4D-CT data to be processed by the unit 1011 and dividing the data according to each time phase; in addition, the 1012 unit delineates and stores the tumor regions of each time phase of the patient, thereby facilitating subsequent treatment.
A model reconstruction module 102, including a simulated image reconstruction unit (one) 1021, configured to generate a simulated image (one) from the three-dimensional model data; a simulated image reconstruction unit (ii) 1022 configured to reconstruct the tumor data delineated by the time phases into a three-dimensional model, resulting in a simulated image (ii).
A display module 103, which is divided into two units, wherein the first display unit 1031 is used for displaying the analog image (i) and the analog image (ii), or combining the two to display them together; the second display unit 1032 is configured to dynamically display the virtual 3D model of each time phase, so as to achieve the purpose of simulating actual breathing.
The data reading unit 1011 in the data preprocessing module 101 can directly access the data storage path to obtain the required 4D-CT data of the patient. The specific 4D-CT data may include characteristic data of the patient, the characteristic data may include identity data of the patient, such as ID, medical record number, age, sex, etc., and may also include diseased characteristic data of the patient, such as specific disease condition, diseased part, tumor part, etc.
The tumor delineation unit 1012 in the data preprocessing module 101 may delineate and store the location of the tumor in each CT image; the specific tumor position can be manually drawn or realized by a program, and the algorithm can be region growing, watershed segmentation and other related feasible algorithms.
The obtained tumor file needs to be stored, and the stored file suffix can be any one or more of types of dcm, ni, nrrd and the like.
The model reconstruction module 102 may generate corresponding three-dimensional model data according to the 4D-CT related data.
The specific analog image reconstruction unit (one) 1021 can reconstruct the 4D-CT data to be processed read by the unit 1011 to obtain the three-dimensional data model analog image (one).
The simulated image reconstruction unit (ii) 1022 may reconstruct the tumor file obtained and stored by the unit 1012, so as to obtain the three-dimensional data model simulated image (ii).
In addition, the three-dimensional models may include three-dimensional body surface models and three-dimensional models of the treatment zones and body organs. The further model reconstructing unit 102 may further convert the three-dimensional model into data in a corresponding predetermined format, such as obj (3D model file format) format data, stl (streeholithology) format data, vtk (Visualization Toolkit) format data, and the like. And the three-dimensional model data is stored in a corresponding memory, so that the reading and the virtual display of the display module are facilitated.
The display module 103 has a model virtual display function, and as shown in fig. 1, the analog image can be viewed through the corresponding display unit 103.
Specifically, the display device of the display unit 103 may be a pair of holographic glasses, and may be configured to view the two analog images by cooperating with a 3D projection device, or may be a pair of virtual reality devices, such as VR glasses, VR helmet, and the like, and may be configured to view the analog images more realistically by cooperating with corresponding devices.
Specifically, the unit 1031 is mainly responsible for displaying the analog image (i) or the analog image (ii) of a certain time phase individually, or even a combination of the two; and unit 1032 is a three-dimensional model for dynamically and virtually displaying each time phase, simulating real changes in the actual breathing situation of the human body, and may even include selecting a display for adjusting the time phase according to the breathing frequency of the patient. According to the dynamic display result, both the patient and the doctor can benefit from the dynamic display result, the patient can better know the self condition, and the doctor can make a more accurate treatment plan.
Furthermore, the computer program instructions for performing the three-dimensional reconstruction and dynamic display operations of the present invention may be assembler instructions, instruction Set Architecture (ISA) instructions, machine-related instructions, microcode, firmware instructions, state setting data, or source code or object code written in any combination of one or more programming languages, including an object oriented programming language such as Smalltalk, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages.
The computer-readable program instructions may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
The embodiments in the present description are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other. The device disclosed in the embodiment corresponds to the method disclosed in the embodiment, so that the description is simple, and the relevant points can be referred to the description of the method part.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims (9)

1. A lung tumor reconstruction and dynamic virtual display system based on 4D-CT is characterized by comprising a data preprocessing module, a model reconstruction module and a display module;
the data preprocessing module is used for acquiring 4D-CT data of a patient, reading the required 4D-CT data, and dividing according to each breathing time phase to obtain a data preprocessing result;
the model reconstruction module is used for reconstructing a simulation image according to a data preprocessing result;
the display module is used for displaying the simulation images and dynamically displaying the virtual 3D models of all time phases.
2. The system for reconstructing and dynamically virtually displaying lung tumor based on 4D-CT as claimed in claim 1, wherein the simulation reconstruction module is further configured to reconstruct each time phase 4D-CT data processed by the data preprocessing module into a three-dimensional model, so as to generate a first simulation image; and the three-dimensional model is also used for reconstructing tumor data outlined by each time phase into a three-dimensional model and generating a second simulation image.
3. The system of claim 2, wherein the first and second simulated images comprise stereoscopic images from a third perspective view.
4. The system according to claim 1, wherein the data preprocessing module is further configured to obtain a tumor region of the patient according to 4D-CT data of the patient; and storing the tumor data file into a required file format, and storing the tumor data.
5. The system for reconstructing and dynamically virtually displaying lung tumor based on 4D-CT as claimed in claim 1, wherein the model reconstruction module is further configured to perform three-dimensional reconstruction based on 4D-CT related data of a patient to generate a corresponding first simulated image and a corresponding second simulated image; and converting the three-dimensional model into corresponding three-dimensional model data in a preset format, and storing the three-dimensional model data.
6. The 4D-CT-based lung tumor reconstruction and dynamic virtual display system according to claim 2, wherein the three-dimensional model comprises any one or more of a three-dimensional radiotherapy radiation field model, a three-dimensional dose distribution model, a three-dimensional radiotherapy structure model and a three-dimensional radiotherapy equipment model.
7. The system as claimed in claim 1, wherein the 4D-CT data comprises characteristic data of a patient, characteristic data of a CT scanning device, and scanning environment data.
8. The system of claim 1, wherein the display module comprises one or more of a computer display, a VR display, and a screen projection display.
9. The system of claim 1, wherein the first and second simulated images satisfy a real position relationship.
CN202210819189.1A 2022-07-13 2022-07-13 Lung tumor reconstruction and dynamic virtual display system based on 4D-CT Pending CN115222881A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210819189.1A CN115222881A (en) 2022-07-13 2022-07-13 Lung tumor reconstruction and dynamic virtual display system based on 4D-CT

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210819189.1A CN115222881A (en) 2022-07-13 2022-07-13 Lung tumor reconstruction and dynamic virtual display system based on 4D-CT

Publications (1)

Publication Number Publication Date
CN115222881A true CN115222881A (en) 2022-10-21

Family

ID=83611911

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210819189.1A Pending CN115222881A (en) 2022-07-13 2022-07-13 Lung tumor reconstruction and dynamic virtual display system based on 4D-CT

Country Status (1)

Country Link
CN (1) CN115222881A (en)

Similar Documents

Publication Publication Date Title
US20210161424A1 (en) Method and system for modeling lung movement
CN109419524B (en) Control of medical imaging system
Brock et al. Use of image registration and fusion algorithms and techniques in radiotherapy: Report of the AAPM Radiation Therapy Committee Task Group No. 132
Segars et al. 4D XCAT phantom for multimodality imaging research
RU2627147C2 (en) Real-time display of vasculature views for optimal device navigation
Naudi et al. The virtual human face: superimposing the simultaneously captured 3D photorealistic skin surface of the face on the untextured skin image of the CBCT scan
KR20210104715A (en) Augmented reality display using optical code
CN107067398B (en) Completion method and device for missing blood vessels in three-dimensional medical model
Hostettler et al. A real-time predictive simulation of abdominal viscera positions during quiet free breathing
CN110264559B (en) Bone tomographic image reconstruction method and system
US10825257B2 (en) Synthetic representation of a vascular structure
CN103648390B (en) Subsequent image acquisition planning and/or post processing
JP2023512139A (en) Systems and methods for determining radiation parameters
CN113100935A (en) Preoperative puncture path planning method and training system for lung puncture operation
CN115131487A (en) Medical image processing method, system, computer device and storage medium
Wahle et al. 3D heart-vessel reconstruction from biplane angiograms
Urschler et al. Intuitive presentation of clinical forensic data using anonymous and person-specific 3D reference manikins
Santhanam et al. Modeling real-time 3-D lung deformations for medical visualization
CN111640345A (en) Spinal endoscope puncture catheterization training method and device and computer equipment
Advincula et al. Development and future trends in the application of visualization toolkit (VTK): the case for medical image 3D reconstruction
CN101416880A (en) Movable C-arm three-dimensional filming system and imaging method thereof
CN103479376A (en) Method for fully corresponding fusion of pre-operation CT data and intraoperative X-ray radiograph
CN110718284A (en) Three-dimensional medical image data interaction method and system
Pei et al. Personalized tooth shape estimation from radiograph and cast
CN115222881A (en) Lung tumor reconstruction and dynamic virtual display system based on 4D-CT

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right

Effective date of registration: 20230905

Address after: 250117 Shandong city of Ji'nan province Yan Ji Road, No. 440 Shandong Provincial Tumor Hospital

Applicant after: Yu Jinming

Applicant after: Affiliated Tumor Hospital of Shandong First Medical University (Shandong cancer prevention and treatment institute Shandong Cancer Hospital)

Address before: 250117 Shandong city of Ji'nan province Yan Ji Road, No. 440 Shandong Provincial Tumor Hospital

Applicant before: Yu Jinming

TA01 Transfer of patent application right