WO2022198553A1 - Three-dimensional image-guided positioning method and system, and storage medium - Google Patents

Three-dimensional image-guided positioning method and system, and storage medium Download PDF

Info

Publication number
WO2022198553A1
WO2022198553A1 PCT/CN2021/082938 CN2021082938W WO2022198553A1 WO 2022198553 A1 WO2022198553 A1 WO 2022198553A1 CN 2021082938 W CN2021082938 W CN 2021082938W WO 2022198553 A1 WO2022198553 A1 WO 2022198553A1
Authority
WO
WIPO (PCT)
Prior art keywords
patient
image
virtual
tissue
tumor target
Prior art date
Application number
PCT/CN2021/082938
Other languages
French (fr)
Chinese (zh)
Inventor
申国盛
李强
刘新国
戴中颖
金晓东
贺鹏博
Original Assignee
中国科学院近代物理研究所
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中国科学院近代物理研究所 filed Critical 中国科学院近代物理研究所
Priority to PCT/CN2021/082938 priority Critical patent/WO2022198553A1/en
Publication of WO2022198553A1 publication Critical patent/WO2022198553A1/en

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61NELECTROTHERAPY; MAGNETOTHERAPY; RADIATION THERAPY; ULTRASOUND THERAPY
    • A61N5/00Radiation therapy
    • A61N5/10X-ray therapy; Gamma-ray therapy; Particle-irradiation therapy
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/08Learning methods

Definitions

  • the invention relates to a method, a system and a storage medium for three-dimensional image-guided placement based on artificial intelligence technology and a DR system in radiotherapy, and relates to the field of image-guided placement of radiotherapy patients.
  • DR image-based guidance systems require the use of two intersecting DR imaging equipment at large angles (close to or equal to 90 degrees orthogonal) or C-arm-connected rotating DR equipment to generate two large-angle intersecting DR images, which are consistent with patient treatment planning CT.
  • the digital reconstructed radiography (DRR) generated by the image is registered to obtain the offset of the patient's positioning position and guide the patient's positioning, but there is no real three-dimensional (3D) positioning guidance.
  • CBCT and orbital CT imaging systems will add additional radiation dose to patients, increasing the risk of complications for patients, and CBCT and orbital CT imaging systems are expensive, and the obtained CBCT image density resolution is not high. Accuracy and speed are not high.
  • the purpose of the present invention is to provide a method, system and storage medium for 3D image guidance positioning based on artificial intelligence technology and DR system that can achieve accurate 3D image guidance and obtain patient positioning information.
  • the present invention adopts the following technical solutions:
  • the present invention provides a three-dimensional image-guided positioning method, comprising:
  • the patient's 3D-CT image set is automatically segmented into tissues and organs and tumor target areas by automatic segmentation algorithm, and the contour data of the tissues and organs and tumor target areas of the patient's treatment plan are reconstructed through the tissue-organ model reconstruction algorithm;
  • the artificial intelligence network algorithm is used to generate the patient's virtual 3D-CT image set
  • the patient's virtual 3D-CT image set is automatically segmented into virtual tissues and organs and tumor target areas by an automatic segmentation algorithm, and the patient's virtual tissues and organs and tumor target area contour data are reconstructed through the tissue-organ model reconstruction algorithm;
  • the real-time DR image of the patient is acquired by using a DR imaging device.
  • the DR imaging device includes a set of X-ray sources and a corresponding imaging flat panel;
  • the X-ray source is installed on the top of the treatment room, and the imaging plate is installed on the floor portion of the treatment room, and each uses a small-angle track to move; or,
  • the X-ray source and the imaging plate are connected by a C-arm for small-angle movement.
  • the artificial intelligence network algorithm is obtained through training and verification, including:
  • CT image data set part of the data in the established data set is used as a training data set, and the other part is used as a verification data set, a neural network model is constructed for training and verification, and the weights and parameters of the artificial intelligence network are obtained through continuous iteration through operations, and then the trained artificial intelligence network model.
  • the automatic segmentation algorithm adopts a deep learning-based convolutional neural network model, which can automatically segment tissues, organs and tumor target areas according to the input CT images.
  • tissue and organ reconstruction algorithm can reconstruct the 3D models of all or specified tissues and organs, and can render and display different tissues and organs in different colors and modes, which is convenient for users to observe and distinguish operations.
  • the registration employs a tissue-organ registration algorithm for manual and/or automatic 3D model registration.
  • the present invention also provides a three-dimensional image-guided positioning system, the system comprising:
  • the organ reconstruction unit is configured to automatically segment the patient's 3D-CT image set into tissues, organs and tumor target areas by using an automatic segmentation algorithm, and reconstruct the contours of the tissues, organs and tumor target areas of the patient's treatment plan through the tissue-organ model reconstruction algorithm data;
  • the virtual image generation unit based on the real-time DR image of the patient, uses the artificial intelligence network algorithm to generate the virtual 3D-CT image set of the patient;
  • the virtual organ reconstruction unit uses an automatic segmentation algorithm to automatically segment the patient's virtual 3D-CT image set into virtual tissue organs and tumor target areas, and reconstructs the patient's virtual tissue organs and tumor target area contour data through the tissue-organ model reconstruction algorithm;
  • the positioning judgment unit registers the contour data of the tissue and organ and tumor target area of the patient's treatment plan with the virtual tissue and organ and the contour data of the tumor target area, outputs the patient's positioning offset parameter, and judges whether the offset parameter is in line with the radiation therapy. Conditions: If not, guide the patient to reposition; if eligible, complete the position.
  • the present invention further provides a processing device, the processing device includes at least a processor and a memory, and a computer program is stored on the memory, and the processor executes the computer program when running the computer program to realize the first aspect of the present invention
  • the three-dimensional image-guided positioning method of the aspect is not limited to a processor, the processing device, and a memory, and a computer program is stored on the memory, and the processor executes the computer program when running the computer program to realize the first aspect of the present invention.
  • the present invention further provides a computer storage medium having computer-readable instructions stored thereon, and the computer-readable instructions can be executed by a processor to implement the three-dimensional image-guided positioning method described in the first aspect of the present invention .
  • the present invention generates a virtual 3D-CT image of patient placement based on a small number of DR images, performs 3D reconstruction and registration of the patient's treatment plan 3D-CT and virtual 3D-CT, obtains patient placement information, and realizes accurate 3D image-guided radiotherapy , to solve the defects and deficiencies in conventional DR images and CBCT image guidance;
  • the present invention uses artificial intelligence technology to convert real-time 2D-DR images into virtual 3D-CT images, and performs 3D reconstruction and registration of virtual 3D-CT images and treatment plan 3D-CT images to realize 3D guidance in the true sense;
  • the present invention only needs a single DR imaging device, and the cost is low; compared with the CBCT system, while reducing the cost of the device to achieve 3D positioning and guidance, the additional radiation dose to the patient during imaging is also low.
  • the present invention is suitable for patient positioning guidance of any radiotherapy system.
  • FIG. 1 is a flowchart of a method for 3D image-guided positioning provided by an embodiment of the present invention
  • FIG. 2 is a schematic diagram of the coordinates of a DR device according to an embodiment of the present invention.
  • FIG. 3 is a schematic diagram of an artificial intelligence network algorithm according to an embodiment of the present invention.
  • spatially relative terms may be used herein to describe the relationship of one element or feature to another element or feature as shown in the figures, such as “inner”, “outer”, “inner” “, “outside”, “below”, “above”, etc.
  • This spatially relative term is intended to include different orientations of the device in use or operation other than the orientation depicted in the figures.
  • Computer technology especially artificial intelligence technology, has shown excellent performance in computer vision and medical image processing segmentation and multi-modal image generation. More and more multi-modal image generation and automatic segmentation technologies are realized. Therefore, it is feasible and necessary to develop a method based on artificial intelligence technology to achieve 3D high-precision patient positioning image guidance and verification while reducing the price of image-guided equipment.
  • the 3D image-guided positioning method based on artificial intelligence technology and DR system includes the following contents:
  • the DR imaging device in this embodiment includes a set of X-ray emission sources 1 and an imaging flat panel 2 corresponding thereto, which are used to obtain real-time DR images of patients.
  • the system equipment can install the X-ray source 1 on the top of the treatment room, and the imaging plate 2 is installed on the ground part of the treatment room, each of which uses a small-angle track to move, and the movement mode is controlled by the corresponding control system to ensure the consistency of the movement direction and position.
  • the X-ray source 1 and the imaging plate 2 can also be connected together using a C-shaped arm according to needs, so as to perform small-angle movements as a whole.
  • the DR imaging device of this embodiment can take the center point of the treatment room as the origin, perform small-angle rotation imaging, and generate DR images of different angles, wherein, in the treatment room coordinate axis XYZ, the coordinate origin is the beam of the treatment room The isocenter of the flow, the X axis is parallel to the floor of the treatment room and points to the zero degree direction of the treatment bed, the Y axis is parallel to the floor of the treatment room and points to the 90° direction of the treatment bed, and the Z axis is perpendicular to the floor of the treatment room and points to the top of the treatment room.
  • the small angle in this embodiment is defined between -15 degrees and +15 degrees.
  • S2 Build a DR image and a corresponding 3D-CT image data set for patient radiotherapy.
  • the 3D-CT image data set is used for training and verification of an artificial intelligence network algorithm model.
  • a DR imaging device is used to capture a DR image of a patient
  • a CT system is used to capture a 3D-CT image of the same part of the same patient, so that the DR image of the patient and the 3D-CT image are in one-to-one correspondence to establish a data set.
  • step S4 Use the DR image set in step S2 and the corresponding 3D-CT image to train and verify the artificial intelligence network algorithm model in step S3, and obtain the weight and parameters of the artificial intelligence network model, and the parameters include the weight of each neuron of the network model. and neuron parameters;
  • N DR images and the corresponding M-layer 3D-CT images are input.
  • the value range of N is greater than or equal to 1, and the shooting angle of each DR image is different.
  • the DR image to be shot becomes more and more The more, the more additional radiation dose is added to the patient, and the greater the economic cost is, so the N value should not exceed 8.
  • the number of layers of M is determined with reference to the number of layers of CT in the treatment plan. Generally, the number of layers in M is close to or equal to that of CT in the treatment plan. CT for registration.
  • S5 Obtain the real-time DR image of the patient, and use the artificial intelligence network algorithm and artificial intelligence network weights and parameters to generate the virtual 3D-CT image of the current patient with the real-time generated DR image, and the tissues and organs are generated according to the 3D-CT segmentation of the patient. ;
  • the real-time DR image refers to a DR image taken by a patient before or during the current fractional treatment, and the DR image is used to guide and verify the current treatment setup of the patient.
  • S6 Build an automatic segmentation algorithm for tissues and organs based on deep learning. After training and verification by using CT images and the corresponding doctors to manually segment tissues and organs, the algorithm can automatically and accurately segment the tissues and organs on the CT images according to the CT images (such as , skin, bone, etc.) and tumor target areas;
  • an automatic segmentation algorithm for tissues and organs based on deep learning uses a deep learning convolutional neural network model to automatically segment tissues and organs according to the input CT images.
  • the training and verification data of the algorithm comes from experienced physicians.
  • the quality of the manually delineated tissues and organs and the corresponding CT and training certificate datasets must be guaranteed.
  • the algorithm can output all or specified tissue, organs and tumor target contour sets for the next step of 3D reconstruction and registration.
  • the 3D tissue and organ reconstruction algorithm can reconstruct all or specific tissues and organs specified, and render and display different tissues and organs in different colors and modes, which is convenient for users to observe and distinguish operations.
  • S8 Use a 3D tissue and organ reconstruction algorithm to perform 3D reconstruction according to the patient's virtual CT data and/or tissue and organ contour sets to obtain a patient's virtual 3D tissue and organ such as skin, bone and other models;
  • the 3D tissue-organ registration algorithm can perform manual and/or automatic 3D model registration according to the reconstructed 3D tissue-organ model, and accurately output the offset parameter between the two models.
  • S10 Use a 3D model registration algorithm to perform automatic and/or manual registration calculations using the patient's virtual 3D tissue organ and patient plan and real-time partial or full treatment 3D tissue organ and contour set as input.
  • the positioning accuracy of the patient can be verified only by calculating once after the patient completes the positioning or before the treatment, and calculating the positioning accuracy of the patient at an interval of 3-10 minutes during the treatment, and outputting the current positioning offset data of the patient;
  • step S11 Determine whether the offset data output in step S10 meets the set radiation therapy requirements: if it does not meet the patient's treatment requirements, guide the patient to re-setup according to the set-up offset data, and move to step after re-setting S5, start to continue the setup verification process; if the setup offset data meets the treatment requirements, end the setup validation and start the treatment.
  • the standard is obtained by the joint research of doctors and engineering technicians according to the laws and regulations of radiotherapy and industry standards.
  • the present invention uses artificial intelligence technology to perform 3D reconstruction on a simple 2D-DR image, obtains a real-time virtual 3D-CT image of the patient, and reconstructs and matches the reconstructed virtual 3D-CT and the 3D-CT image of the patient treatment plan in three dimensions. Accurate, obtain the patient's precise 3D positioning offset parameters, guide and verify the patient's positioning, and ensure the effect of radiation therapy.
  • this embodiment describes in detail the specific application process of the method for 3D image-guided positioning based on artificial intelligence technology and DR system, and the specific process is as follows:
  • a DR imaging system that can move at a small angle [-15°, +15°] is installed in the treatment room, and the equipment moves around the center of the treatment.
  • the network can reconstruct the virtual 3D-CT image of the patient from N[1 ⁇ 8] DR images.
  • the labeled DR images and corresponding 3D-CT images are used for training and verification, and the weight parameters of the artificial intelligence neural network model are obtained.
  • the network can automatically and accurately segment CT images, and obtain the tissues, organs and tumor target areas in the CT images.
  • the weight parameters of the network model are obtained.
  • Embodiment 1 provides a 3D image-guided positioning method.
  • this embodiment provides a 3D image-guided positioning system.
  • the guidance system provided in this embodiment may implement the 3D image guidance placement method of Embodiment 1, and the guidance system may be implemented by software, hardware, or a combination of software and hardware.
  • the guidance system may include integrated or separate functional modules or functional units to perform corresponding steps in each method of Embodiment 1. Since the guidance system of this embodiment is basically similar to the method embodiment, the description process of this embodiment is relatively simple, and the relevant parts may refer to the partial description of Embodiment 1, and the embodiment of the guidance system of this embodiment is only illustrative of.
  • This embodiment provides a three-dimensional image-guided positioning system, which includes:
  • the organ reconstruction unit is configured to automatically segment the patient's 3D-CT image set into tissues, organs and tumor target areas by using an automatic segmentation algorithm, and reconstruct the contours of the tissues, organs and tumor target areas of the patient's treatment plan through the tissue-organ model reconstruction algorithm data;
  • the virtual image generation unit based on the real-time DR image of the patient, uses the artificial intelligence network algorithm to generate the virtual 3D-CT image set of the patient;
  • the virtual organ reconstruction unit uses an automatic segmentation algorithm to automatically segment the patient's virtual 3D-CT image set into virtual tissue organs and tumor target areas, and reconstructs the patient's virtual tissue organs and tumor target area contour data through the tissue-organ model reconstruction algorithm;
  • the positioning judgment unit registers the contour data of the tissue and organ and tumor target area of the patient's treatment plan with the virtual tissue and organ and the contour data of the tumor target area, outputs the patient's positioning offset parameter, and judges whether the offset parameter is in line with the radiation therapy. Conditions: If not, guide the patient to reposition; if eligible, complete the position.
  • This embodiment provides a processing device corresponding to the 3D image-guided positioning method provided in Embodiment 1, and the processing device may be an electronic device used for a client, such as a mobile phone, a notebook computer, a tablet computer, a desktop computer, etc. , to perform the method of Example 1.
  • a client such as a mobile phone, a notebook computer, a tablet computer, a desktop computer, etc.
  • the processing device includes a processor, a memory, a communication interface and a bus, and the processor, the memory and the communication interface are connected through the bus to complete mutual communication.
  • the bus can be an industry standard architecture (ISA, Industry Standard Architecture) bus, a peripheral device interconnect (PCI, Peripheral Component) bus or an extended industry standard architecture (EISA, Extended Industry Standard Component) bus and so on.
  • ISA Industry Standard Architecture
  • PCI peripheral device interconnect
  • EISA Extended Industry Standard Component
  • the memory may be a high-speed random access memory (RAM: Random Access Memory), and may also include a non-volatile memory (non-volatile memory), such as at least one disk memory.
  • RAM Random Access Memory
  • non-volatile memory such as at least one disk memory.
  • the processor may be various types of general-purpose processors such as a central processing unit (CPU) and a digital signal processor (DSP), which are not limited herein.
  • CPU central processing unit
  • DSP digital signal processor
  • the method for 3D image-guided positioning in Embodiment 1 may be embodied as a computer program product, and the computer program product may include a computer-readable storage medium on which a computer-readable storage medium for executing the method described in Embodiment 1 is uploaded. Read program instructions.
  • a computer-readable storage medium may be a tangible device that retains and stores instructions for use by the instruction execution device.
  • the computer-readable storage medium may be, for example, but not limited to, an electrical storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any combination of the above.

Abstract

A three-dimensional (3D) image-guided positioning method and system, and a storage medium. The method comprises: automatically segmenting a set of 3D-CT images of a patient by means of an automatic segmentation algorithm to obtain tissue organs and tumor target regions, and reconstructing, by means of a tissue organ model reconstruction algorithm, contour data of tissue organs and tumor target regions in a patient treatment plan; generating a set of virtual 3D-CT images of the patient by means of an artificial intelligence network algorithm on the basis of real-time DR images of the patient; automatically segmenting the set of virtual 3D-CT images of the patient by means of the automatic segmentation algorithm to obtain virtual tissue organs and tumor target regions, and reconstructing contour data of the virtual tissue organs and tumor target regions of the patient; registering the contour data of the tissue organs and tumor target regions in the patient treatment plan with the contour data of the virtual tissue organs and tumor target regions, outputting patient positioning offset parameters, and determining whether a radiotherapy condition is met: if not, guiding the patient to be re-positioned; and if yes, completing the positioning.

Description

三维图像引导摆位的方法、系统及存储介质Three-dimensional image-guided positioning method, system and storage medium 技术领域technical field
本发明是关于一种用于放射治疗中基于人工智能技术和DR系统的三维图像引导摆位的方法、系统及存储介质,涉及放射治疗患者摆位图像引导领域。The invention relates to a method, a system and a storage medium for three-dimensional image-guided placement based on artificial intelligence technology and a DR system in radiotherapy, and relates to the field of image-guided placement of radiotherapy patients.
背景技术Background technique
放射治疗中患者的摆位验证速度和精度是影响患者治疗效率和疗效的重要因素,特别是在粒子精准放射治疗技术中,患者摆位占用了较多的治疗时间,极大地降低了放射治疗的效率,增加了治疗成本,影响患者的放疗效果。因此,如何快速有效地引导患者进行摆位操作及验证,是图像引导放疗技术的关键之一。当前的图像引导系统经常作为一个独立的医疗设备,大多数使用数字X射线成像(DR)系统、锥形束CT(CBCT)成像系统及轨道CT(CT-on-rail)系统获取患者的摆位位置信息,对患者进行摆位引导和验证。The speed and accuracy of patient placement verification in radiotherapy are important factors that affect the efficiency and efficacy of patient treatment. Especially in particle precision radiotherapy technology, patient placement takes up a lot of treatment time, which greatly reduces the cost of radiotherapy. Efficiency increases the cost of treatment and affects the radiotherapy effect of patients. Therefore, how to quickly and effectively guide the patient to perform the positioning operation and verification is one of the keys to the image-guided radiotherapy technology. Current image guidance systems are often used as a stand-alone medical device, and most use digital X-ray imaging (DR) systems, cone beam CT (CBCT) imaging systems, and rail CT (CT-on-rail) systems to obtain patient positioning Position information to guide and verify patient positioning.
常规基于DR图像的引导系统,需要使用两个大角度(接近或者等于90度正交)相交的DR成像设备或者C型臂联接旋转DR设备生成两张大角度相交的DR图像,与患者治疗计划CT图像生成的数字重建放射影像(DRR)进行配准,获得患者的摆位位置偏移量,引导患者摆位,没有实现真正意义上的三维(3D)摆位引导。另外,CBCT及轨道CT成像系统会给患者增加额外的辐射剂量,增加患者并发症发生的风险,而且CBCT及轨道CT成像系统价格昂贵,获得的CBCT图像密度分辨率不高,与患者计划CT配准的精度和速度也不高。Conventional DR image-based guidance systems require the use of two intersecting DR imaging equipment at large angles (close to or equal to 90 degrees orthogonal) or C-arm-connected rotating DR equipment to generate two large-angle intersecting DR images, which are consistent with patient treatment planning CT. The digital reconstructed radiography (DRR) generated by the image is registered to obtain the offset of the patient's positioning position and guide the patient's positioning, but there is no real three-dimensional (3D) positioning guidance. In addition, CBCT and orbital CT imaging systems will add additional radiation dose to patients, increasing the risk of complications for patients, and CBCT and orbital CT imaging systems are expensive, and the obtained CBCT image density resolution is not high. Accuracy and speed are not high.
发明内容SUMMARY OF THE INVENTION
针对上述问题,本发明的目的是提供一种能够实现精准3D图像引导,获得患者摆位信息的基于人工智能技术和DR系统的三维图像引导摆位的方法、系统及存储介质。In view of the above problems, the purpose of the present invention is to provide a method, system and storage medium for 3D image guidance positioning based on artificial intelligence technology and DR system that can achieve accurate 3D image guidance and obtain patient positioning information.
为实现上述目的,本发明采取以下技术方案:To achieve the above object, the present invention adopts the following technical solutions:
第一方面,本发明提供一种三维图像引导摆位的方法,包括:In a first aspect, the present invention provides a three-dimensional image-guided positioning method, comprising:
将患者的3D-CT图像集采用自动分割算法自动分割出组织器官和肿瘤靶区,并 通过组织器官模型重建算法,重建患者治疗计划的组织器官和肿瘤靶区的轮廓数据;The patient's 3D-CT image set is automatically segmented into tissues and organs and tumor target areas by automatic segmentation algorithm, and the contour data of the tissues and organs and tumor target areas of the patient's treatment plan are reconstructed through the tissue-organ model reconstruction algorithm;
基于患者的实时DR图像,采用人工智能网络算法生成患者的虚拟3D-CT图像集;Based on the patient's real-time DR images, the artificial intelligence network algorithm is used to generate the patient's virtual 3D-CT image set;
将患者的虚拟3D-CT图像集采用自动分割算法自动分割出虚拟组织器官和肿瘤靶区,并通过组织器官模型重建算法,重建患者的虚拟组织器官和肿瘤靶区轮廓数据;The patient's virtual 3D-CT image set is automatically segmented into virtual tissues and organs and tumor target areas by an automatic segmentation algorithm, and the patient's virtual tissues and organs and tumor target area contour data are reconstructed through the tissue-organ model reconstruction algorithm;
将患者治疗计划的组织器官和肿瘤靶区轮廓数据和虚拟组织器官和肿瘤靶区轮廓数据进行配准,输出患者摆位偏移量参数,判断偏移量参数是否符合放射治疗条件:如果不符合,则引导患者重新摆位;如果符合条件,则完成摆位。Register the contour data of the tissue and organ and tumor target volume of the patient's treatment plan with the virtual tissue and organ and the contour data of the tumor target volume, output the patient's positioning offset parameter, and determine whether the offset parameter meets the radiotherapy conditions: if not , the patient is guided to reposition; if the conditions are met, the position is completed.
进一步地,患者的实时DR图像通过采用DR成像设备进行获取。Further, the real-time DR image of the patient is acquired by using a DR imaging device.
进一步地,所述DR成像设备包括一套X射线源及与之对应的成像平板;Further, the DR imaging device includes a set of X-ray sources and a corresponding imaging flat panel;
所述X射线源安装在治疗室顶部,所述成像平板安装在治疗室地面部分,各自使用小角度轨道进行运动;或者,The X-ray source is installed on the top of the treatment room, and the imaging plate is installed on the floor portion of the treatment room, and each uses a small-angle track to move; or,
所述X射线源和成像平板使用C型臂连接整体进行小角度运动。The X-ray source and the imaging plate are connected by a C-arm for small-angle movement.
进一步地,人工智能网络算法通过训练验证获得,包括:Further, the artificial intelligence network algorithm is obtained through training and verification, including:
使用DR成像设备拍摄患者的DR图像,同时使用CT系统拍摄同一患者同一部位的3D-CT图像,使该患者的DR图像和3D-CT图像一一对应,建立DR图像及与之对应的3D-CT图像数据集;将建立的数据集中部分数据作为训练数据集,另一部分作为验证数据集,构建神经网络模型进行训练验证,并通过运算不断迭代获得人工智能网络的权重及参数,进而获得训练好的人工智能网络模型。Use the DR imaging equipment to capture the DR image of the patient, and use the CT system to capture the 3D-CT image of the same part of the same patient, so that the DR image of the patient and the 3D-CT image are in one-to-one correspondence, and the DR image and the corresponding 3D-CT image are established. CT image data set; part of the data in the established data set is used as a training data set, and the other part is used as a verification data set, a neural network model is constructed for training and verification, and the weights and parameters of the artificial intelligence network are obtained through continuous iteration through operations, and then the trained artificial intelligence network model.
进一步地,自动分割算法采用基于深度学习卷积神经网络模型,能够根据输入的CT图像自动分割出组织器官及肿瘤靶区。Further, the automatic segmentation algorithm adopts a deep learning-based convolutional neural network model, which can automatically segment tissues, organs and tumor target areas according to the input CT images.
进一步地,组织器官重建算法能够重建出所有或者指定组织器官的3D模型,并能够对不同的组织器官进行不同颜色和模态的渲染显示,便于使用者观察分辨操作。Further, the tissue and organ reconstruction algorithm can reconstruct the 3D models of all or specified tissues and organs, and can render and display different tissues and organs in different colors and modes, which is convenient for users to observe and distinguish operations.
进一步地,配准采用组织器官配准算法进行手动和/或自动3D模型配准。Further, the registration employs a tissue-organ registration algorithm for manual and/or automatic 3D model registration.
第二方面,本发明还提供一种三维图像引导摆位的系统,该系统包括:In a second aspect, the present invention also provides a three-dimensional image-guided positioning system, the system comprising:
器官重建单元,被配置为将患者的3D-CT图像集采用自动分割算法自动分割出组织器官和肿瘤靶区,并通过组织器官模型重建算法,重建患者治疗计划的组织器 官和肿瘤靶区的轮廓数据;The organ reconstruction unit is configured to automatically segment the patient's 3D-CT image set into tissues, organs and tumor target areas by using an automatic segmentation algorithm, and reconstruct the contours of the tissues, organs and tumor target areas of the patient's treatment plan through the tissue-organ model reconstruction algorithm data;
虚拟图像生成单元,基于患者的实时DR图像,采用人工智能网络算法生成患者的虚拟3D-CT图像集;The virtual image generation unit, based on the real-time DR image of the patient, uses the artificial intelligence network algorithm to generate the virtual 3D-CT image set of the patient;
虚拟器官重建单元,将患者的虚拟3D-CT图像集采用自动分割算法自动分割出虚拟组织器官和肿瘤靶区,并通过组织器官模型重建算法,重建患者的虚拟组织器官和肿瘤靶区轮廓数据;The virtual organ reconstruction unit uses an automatic segmentation algorithm to automatically segment the patient's virtual 3D-CT image set into virtual tissue organs and tumor target areas, and reconstructs the patient's virtual tissue organs and tumor target area contour data through the tissue-organ model reconstruction algorithm;
摆位判断单元,将患者治疗计划的组织器官和肿瘤靶区轮廓数据和虚拟组织器官和肿瘤靶区轮廓数据进行配准,输出患者摆位偏移量参数,判断偏移量参数是否符合放射治疗条件:如果不符合,则引导患者重新摆位;如果符合条件,则完成摆位。The positioning judgment unit registers the contour data of the tissue and organ and tumor target area of the patient's treatment plan with the virtual tissue and organ and the contour data of the tumor target area, outputs the patient's positioning offset parameter, and judges whether the offset parameter is in line with the radiation therapy. Conditions: If not, guide the patient to reposition; if eligible, complete the position.
第三方面,本发明还提供一种处理设备,所述处理设备至少包括处理器和存储器,所述存储器上存储有计算机程序,所述处理器运行所述计算机程序时执行以实现本发明第一方面所述三维图像引导摆位的方法。In a third aspect, the present invention further provides a processing device, the processing device includes at least a processor and a memory, and a computer program is stored on the memory, and the processor executes the computer program when running the computer program to realize the first aspect of the present invention The three-dimensional image-guided positioning method of the aspect.
第四方面,本发明还提供一种计算机存储介质,其上存储有计算机可读指令,所述计算机可读指令可被处理器执行以实现本发明第一方面所述三维图像引导摆位的方法。In a fourth aspect, the present invention further provides a computer storage medium having computer-readable instructions stored thereon, and the computer-readable instructions can be executed by a processor to implement the three-dimensional image-guided positioning method described in the first aspect of the present invention .
本发明由于采取以上技术方案,其具有以下优点:The present invention has the following advantages due to taking the above technical solutions:
1、本发明根据少量DR图像生成患者摆位虚拟3D-CT图像,将患者的治疗计划3D-CT和虚拟3D-CT进行3D重建和配准,获得患者摆位信息,实现精准3D图像引导放疗,解决常规DR图像和CBCT图像引导中的缺陷和不足;1. The present invention generates a virtual 3D-CT image of patient placement based on a small number of DR images, performs 3D reconstruction and registration of the patient's treatment plan 3D-CT and virtual 3D-CT, obtains patient placement information, and realizes accurate 3D image-guided radiotherapy , to solve the defects and deficiencies in conventional DR images and CBCT image guidance;
2、本发明使用人工智能技术将实时2D-DR图像转化为虚拟3D-CT图像,将虚拟3D-CT图像和治疗计划3D-CT图像进行3D重建和配准,实现真正意义上的3D引导;2. The present invention uses artificial intelligence technology to convert real-time 2D-DR images into virtual 3D-CT images, and performs 3D reconstruction and registration of virtual 3D-CT images and treatment plan 3D-CT images to realize 3D guidance in the true sense;
3、本发明只需要单个DR成像设备,成本较低;与CBCT系统相比,在降低设备成本实现3D定位引导的同时,成像时对患者的额外辐射剂量也较低。3. The present invention only needs a single DR imaging device, and the cost is low; compared with the CBCT system, while reducing the cost of the device to achieve 3D positioning and guidance, the additional radiation dose to the patient during imaging is also low.
综上,本发明适合任何放射治疗系统的患者摆位引导中。In conclusion, the present invention is suitable for patient positioning guidance of any radiotherapy system.
附图说明Description of drawings
通过阅读下文优选实施方式的详细描述,各种其他的优点和益处对于本领域普 通技术人员将变得清楚明了。附图仅用于示出优选实施方式的目的,而并不认为是对本发明的限制。在整个附图中,用相同的附图标记表示相同的部件。在附图中:Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The drawings are for the purpose of illustrating preferred embodiments only and are not to be considered limiting of the invention. The same reference numerals are used to refer to the same parts throughout the drawings. In the attached image:
图1为本发明实施例提供的3D图像引导摆位的方法流程图;1 is a flowchart of a method for 3D image-guided positioning provided by an embodiment of the present invention;
图2为本发明实施例的DR设备坐标原理图;2 is a schematic diagram of the coordinates of a DR device according to an embodiment of the present invention;
图3为本发明实施例的人工智能网络算法原理图。FIG. 3 is a schematic diagram of an artificial intelligence network algorithm according to an embodiment of the present invention.
具体实施方式Detailed ways
下面将参照附图更详细地描述本发明的示例性实施方式。虽然附图中显示了本发明的示例性实施方式,然而应当理解,可以以各种形式实现本发明而不应被这里阐述的实施方式所限制。相反,提供这些实施方式是为了能够更透彻地理解本发明,并且能够将本发明的范围完整的传达给本领域的技术人员。Exemplary embodiments of the present invention will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present invention are shown in the drawings, it should be understood that the present invention may be embodied in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided so that the present invention will be more thoroughly understood, and will fully convey the scope of the present invention to those skilled in the art.
应理解的是,文中使用的术语仅出于描述特定示例实施方式的目的,而无意于进行限制。除非上下文另外明确地指出,否则如文中使用的单数形式“一”、“一个”以及“所述”也可以表示包括复数形式。术语“包括”、“包含”、“含有”以及“具有”是包含性的,并且因此指明所陈述的特征、步骤、操作、元件和/或部件的存在,但并不排除存在或者添加一个或多个其它特征、步骤、操作、元件、部件、和/或它们的组合。文中描述的方法步骤、过程、以及操作不解释为必须要求它们以所描述或说明的特定顺序执行,除非明确指出执行顺序。还应当理解,可以使用另外或者替代的步骤。It is to be understood that the terminology used herein is for the purpose of describing particular example embodiments only and is not intended to be limiting. As used herein, the singular forms "a," "an," and "the" can also be intended to include the plural forms unless the context clearly dictates otherwise. The terms "comprising", "comprising", "containing" and "having" are inclusive and thus indicate the presence of stated features, steps, operations, elements and/or components, but do not preclude the presence or addition of one or Various other features, steps, operations, elements, components, and/or combinations thereof. Method steps, procedures, and operations described herein are not to be construed as requiring that they be performed in the particular order described or illustrated, unless an order of performance is explicitly indicated. It should also be understood that additional or alternative steps may be used.
为了便于描述,可以在文中使用空间相对关系术语来描述如图中示出的一个元件或者特征相对于另一元件或者特征的关系,这些相对关系术语例如为“内部”、“外部”、“内侧”、“外侧”、“下面”、“上面”等。这种空间相对关系术语意于包括除图中描绘的方位之外的在使用或者操作中装置的不同方位。For ease of description, spatially relative terms may be used herein to describe the relationship of one element or feature to another element or feature as shown in the figures, such as "inner", "outer", "inner" ", "outside", "below", "above", etc. This spatially relative term is intended to include different orientations of the device in use or operation other than the orientation depicted in the figures.
计算机技术特别是人工智能技术在计算机视觉及医学图像处理分割和多模态图像生成上表现出优异的性能,多模态图像的生成和自动分割技术实现的越来越多。因此,研发基于人工智能技术在降低图像引导设备价格的同时实现3D高精度患者摆位图像引导和验证的方法是可行且必要的。Computer technology, especially artificial intelligence technology, has shown excellent performance in computer vision and medical image processing segmentation and multi-modal image generation. More and more multi-modal image generation and automatic segmentation technologies are realized. Therefore, it is feasible and necessary to develop a method based on artificial intelligence technology to achieve 3D high-precision patient positioning image guidance and verification while reducing the price of image-guided equipment.
实施例1Example 1
如图1所示,本实施例提供的基于人工智能技术和DR系统的3D图像引导摆 位的方法,包括内容:As shown in Figure 1, the 3D image-guided positioning method based on artificial intelligence technology and DR system provided by this embodiment includes the following contents:
S1:设置单个DR成像系统设备S1: Setting up a single DR imaging system device
具体地,根据图2所示的DR成像设备原理图,本实施例的DR成像设备包括一套X射线发射源1及与之对应的成像平板2,用于获取患者实时的DR图像。该系统设备可以将X射线源1安装在治疗室顶部,成像平板2安装在治疗室地面部分,各自使用小角度轨道进行运动,运动模式由相应控制系统控制,保证运动方向的一致性和位置的精确性;当然根据需要也可以将X射线源1和成像平板2使用C型臂连接在一起,作为一个整体进行小角度运动。Specifically, according to the schematic diagram of the DR imaging device shown in FIG. 2 , the DR imaging device in this embodiment includes a set of X-ray emission sources 1 and an imaging flat panel 2 corresponding thereto, which are used to obtain real-time DR images of patients. The system equipment can install the X-ray source 1 on the top of the treatment room, and the imaging plate 2 is installed on the ground part of the treatment room, each of which uses a small-angle track to move, and the movement mode is controlled by the corresponding control system to ensure the consistency of the movement direction and position. Accuracy; of course, the X-ray source 1 and the imaging plate 2 can also be connected together using a C-shaped arm according to needs, so as to perform small-angle movements as a whole.
在一些实现中,本实施例的DR成像设备能够以治疗室中心点为原点,进行小角度旋转成像,生成不同角度的DR图像,其中,治疗室坐标轴XYZ中,坐标原点是治疗室的束流等中心点,X轴平行于治疗室地面,指向治疗床零度方向,Y轴平行于治疗室地面,指向治疗床90°方向,Z轴垂直于治疗室地面,指向治疗室顶部。In some implementations, the DR imaging device of this embodiment can take the center point of the treatment room as the origin, perform small-angle rotation imaging, and generate DR images of different angles, wherein, in the treatment room coordinate axis XYZ, the coordinate origin is the beam of the treatment room The isocenter of the flow, the X axis is parallel to the floor of the treatment room and points to the zero degree direction of the treatment bed, the Y axis is parallel to the floor of the treatment room and points to the 90° direction of the treatment bed, and the Z axis is perpendicular to the floor of the treatment room and points to the top of the treatment room.
在另一些实现中,本实施例的小角度定义-15度~+15度之间。In other implementations, the small angle in this embodiment is defined between -15 degrees and +15 degrees.
S2:建设DR图像及与之对应的患者放射治疗用3D-CT图像数据集,该3D-CT图像数据集用于人工智能网络算法模型的训练及验证。S2: Build a DR image and a corresponding 3D-CT image data set for patient radiotherapy. The 3D-CT image data set is used for training and verification of an artificial intelligence network algorithm model.
具体地,使用DR成像设备拍摄患者的DR图像,同时使用CT系统拍摄同一患者同一部位的3D-CT图像,使该患者的DR图像和3D-CT图像一一对应,建立数据集。将建立的数据集中80%数据作为训练数据集,20%作为验证数据集,先构建模型然后训练验证。Specifically, a DR imaging device is used to capture a DR image of a patient, and a CT system is used to capture a 3D-CT image of the same part of the same patient, so that the DR image of the patient and the 3D-CT image are in one-to-one correspondence to establish a data set. Take 80% of the data in the established dataset as the training dataset and 20% as the validation dataset, first build the model and then train and validate.
S3:构建人工智能网络算法模型,算法模型原理如图3所示,该算法采用神经网络进行实现,能够实现输入少量DR图像,输出虚拟3D-CT数据集;S3: Build an artificial intelligence network algorithm model. The principle of the algorithm model is shown in Figure 3. The algorithm is implemented using a neural network, which can input a small number of DR images and output a virtual 3D-CT data set;
S4:以步骤S2的DR图像集及与之对应的3D-CT图像训练验证步骤S3的人工智能网络算法模型,获得人工智能网络模型的权重及参数,该参数包括网络模型每个神经元的权重及神经元参数;S4: Use the DR image set in step S2 and the corresponding 3D-CT image to train and verify the artificial intelligence network algorithm model in step S3, and obtain the weight and parameters of the artificial intelligence network model, and the parameters include the weight of each neuron of the network model. and neuron parameters;
具体地,人工智能网络算法模型,在进行训练验证时,输入的N幅DR图像及与之对应的M层3D-CT图像。其中N的值取值范围大于等于1,每一张DR图像拍摄角度是不同的,虽然在理论上N的值越大越好,但是随着N的值的增大,所要拍摄的DR图像越来越多,给患者增加的额外辐射剂量也越来越多,所产生的经济成本也越大,因此N值不宜超过8。M的层数参考治疗计划CT层数确定,一般M 的层数接近或者等于治疗计划CT,层厚也应该和治疗计划CT层厚相同和尽量接近,以便将虚拟3D-CT和治疗计划3D-CT进行配准。Specifically, when the artificial intelligence network algorithm model is trained and verified, N DR images and the corresponding M-layer 3D-CT images are input. The value range of N is greater than or equal to 1, and the shooting angle of each DR image is different. Although the larger the value of N is in theory, the better, but with the increase of the value of N, the DR image to be shot becomes more and more The more, the more additional radiation dose is added to the patient, and the greater the economic cost is, so the N value should not exceed 8. The number of layers of M is determined with reference to the number of layers of CT in the treatment plan. Generally, the number of layers in M is close to or equal to that of CT in the treatment plan. CT for registration.
S5:获取患者实时DR图像,以实时生成的DR图像,使用人工智能网络算法和人工智能网络权重及参数,生成当前患者的虚拟3D-CT图像,组织器官是根据患者的3D-CT分割生成的;S5: Obtain the real-time DR image of the patient, and use the artificial intelligence network algorithm and artificial intelligence network weights and parameters to generate the virtual 3D-CT image of the current patient with the real-time generated DR image, and the tissues and organs are generated according to the 3D-CT segmentation of the patient. ;
具体地,实时DR图像,是指患者在进行当前分次治疗前或者治疗中所拍摄的DR图像,该DR图像用于引导及验证患者当前的治疗摆位。Specifically, the real-time DR image refers to a DR image taken by a patient before or during the current fractional treatment, and the DR image is used to guide and verify the current treatment setup of the patient.
S6:构建基于深度学习的组织器官自动分割算法,该算法通过使用CT图像及与之对应的医生手动分割组织器官进行训练验证后,可以根据CT图像自动精准分割出CT图像上的组织器官(如,皮肤,骨骼等)和肿瘤靶区;S6: Build an automatic segmentation algorithm for tissues and organs based on deep learning. After training and verification by using CT images and the corresponding doctors to manually segment tissues and organs, the algorithm can automatically and accurately segment the tissues and organs on the CT images according to the CT images (such as , skin, bone, etc.) and tumor target areas;
具体地,基于深度学习的组织之器官自动分割算法,该算法使用深度学习卷积神经网络模型,能够根据输入的CT图像自动分割出组织器官,该算法的训练验证数据来自于有丰富经验的医师手动勾画的组织器官及对应的CT,训练证数据集的质量必须得到保证,该算法能够输出所有或者指定的组织器官和肿瘤靶区轮廓集,用于下一步的三维重建和配准。Specifically, an automatic segmentation algorithm for tissues and organs based on deep learning. This algorithm uses a deep learning convolutional neural network model to automatically segment tissues and organs according to the input CT images. The training and verification data of the algorithm comes from experienced physicians. The quality of the manually delineated tissues and organs and the corresponding CT and training certificate datasets must be guaranteed. The algorithm can output all or specified tissue, organs and tumor target contour sets for the next step of 3D reconstruction and registration.
S7:构建3D组织器官模型重建算法,该算法实现输入3D-CT图像自动生成的组织器官轮廓集,当前患者的治疗计划CT数据和/或组织器官轮廓集能够重建输出3D组织器官(如皮肤、骨骼等)模型,也可以根据需要选择重建CT中的全部器官或者特定器官;S7: Construct a 3D tissue-organ model reconstruction algorithm, which realizes the automatically generated tissue-organ contour set from the input 3D-CT image, and the current patient's treatment plan CT data and/or tissue-organ contour set can reconstruct the output 3D tissue and organ (such as skin, Bone, etc.) model, you can also choose to reconstruct all organs or specific organs in CT according to your needs;
具体地,3D组织器官重建算法,该算法能够重建出指定的所有或者特定组织器官,并对不同的组织器官进行不同颜色不同模态的渲染显示,便于使用者观察分辨操作。Specifically, the 3D tissue and organ reconstruction algorithm can reconstruct all or specific tissues and organs specified, and render and display different tissues and organs in different colors and modes, which is convenient for users to observe and distinguish operations.
S8:使用3D组织器官重建算法,根据患者虚拟CT数据和/或组织器官轮廓集进行三维重建,得到患者虚拟的3D组织器官如皮肤、骨骼等模型;S8: Use a 3D tissue and organ reconstruction algorithm to perform 3D reconstruction according to the patient's virtual CT data and/or tissue and organ contour sets to obtain a patient's virtual 3D tissue and organ such as skin, bone and other models;
S9:构建常规3D模型配准算法,该算法能够将输入的多个3D模型配准,输出配准后3D模型的偏移量;S9: Build a conventional 3D model registration algorithm, which can register multiple input 3D models and output the offset of the 3D models after registration;
具体地,3D组织器官配准算法,可以根据重建出的3D组织器官模型,进行手动和(或)自动3D模型配准,精准输出两个模型之间的偏移量参数。Specifically, the 3D tissue-organ registration algorithm can perform manual and/or automatic 3D model registration according to the reconstructed 3D tissue-organ model, and accurately output the offset parameter between the two models.
S10:使用3D模型配准算法,将患者虚拟的3D组织器官和患者计划和实时的 部分或全部治疗3D组织器官及轮廓集作为输入进行自动和/或手动配准计算。在本发明中,仅在患者完成摆位后或者治疗前计算一次以及在治疗中间隔3-10分钟计算一次验证患者的摆位精度即可,输出当前患者的摆位偏移量数据;S10: Use a 3D model registration algorithm to perform automatic and/or manual registration calculations using the patient's virtual 3D tissue organ and patient plan and real-time partial or full treatment 3D tissue organ and contour set as input. In the present invention, the positioning accuracy of the patient can be verified only by calculating once after the patient completes the positioning or before the treatment, and calculating the positioning accuracy of the patient at an interval of 3-10 minutes during the treatment, and outputting the current positioning offset data of the patient;
S11:判断步骤S10输出的偏移量数据是否符合设定的放射治疗要求:如果不符合患者的治疗要求,则引导患者根据摆位偏移量数据重现摆位,重新摆位后转移到步骤S5,开始继续进行摆位验证流程;如果摆位偏移量数据符合治疗要求,则结束摆位验证,开始实施治疗。其中,是否符合治疗要求的标准,该标准有医师联合研究及工程技术人员根据放疗法律法规和行业标准制定获得。S11: Determine whether the offset data output in step S10 meets the set radiation therapy requirements: if it does not meet the patient's treatment requirements, guide the patient to re-setup according to the set-up offset data, and move to step after re-setting S5, start to continue the setup verification process; if the setup offset data meets the treatment requirements, end the setup validation and start the treatment. Among them, whether it meets the standard of treatment requirements, the standard is obtained by the joint research of doctors and engineering technicians according to the laws and regulations of radiotherapy and industry standards.
综上所述,本发明使用人工智能技术将简单2D-DR图像进行3D重建,得到患者实时的虚拟3D-CT图像,将重建的虚拟3D-CT和患者治疗计划3D-CT图像三维重建和配准,得到患者精准的3D摆位偏移量参数,引导并验证患者摆位,保证放射治疗的效果。To sum up, the present invention uses artificial intelligence technology to perform 3D reconstruction on a simple 2D-DR image, obtains a real-time virtual 3D-CT image of the patient, and reconstructs and matches the reconstructed virtual 3D-CT and the 3D-CT image of the patient treatment plan in three dimensions. Accurate, obtain the patient's precise 3D positioning offset parameters, guide and verify the patient's positioning, and ensure the effect of radiation therapy.
实施例2Example 2
基于上述实施例1内容,本实施例对基于人工智能技术和DR系统的3D图像引导摆位的方法的具体应用过程进行详细说明,具体过程为:Based on the content of the above-mentioned Embodiment 1, this embodiment describes in detail the specific application process of the method for 3D image-guided positioning based on artificial intelligence technology and DR system, and the specific process is as follows:
第一,在治疗室内安装一套可以小角度[-15°,+15°]运动的DR成像系统,设备以治疗之中心点为轴心运动。First, a DR imaging system that can move at a small angle [-15°, +15°] is installed in the treatment room, and the equipment moves around the center of the treatment.
第二,使用构建的人工智能神经网络,该网络能够将N[1~8]张DR图像重建出患者的虚拟3D-CT图像。使用标注好的DR图像及对应的3D-CT图像进行训练验证,得到该人工智能神经网络模型的权重参数。Second, using the constructed artificial intelligence neural network, the network can reconstruct the virtual 3D-CT image of the patient from N[1~8] DR images. The labeled DR images and corresponding 3D-CT images are used for training and verification, and the weight parameters of the artificial intelligence neural network model are obtained.
第三,使用构建的深度学习卷积神经网络,该网络能够自动精准分割CT图像,得到CT图像中的组织器官和肿瘤靶区。使用经验丰富的医生手动分割的CT图像进行训练验证,得到该网络模型的权重参数。Third, using the constructed deep learning convolutional neural network, the network can automatically and accurately segment CT images, and obtain the tissues, organs and tumor target areas in the CT images. Using the CT images manually segmented by experienced doctors for training and validation, the weight parameters of the network model are obtained.
第四,在患者开始本次治疗时或者在治疗过程中,使用上述安装的DR成像系统,拍摄N[1~8]张实时DR图像,将该图像导入第二步建设并训练后的人工智能神经网络中,输出虚拟3D-CT图像。Fourth, when the patient starts this treatment or during the treatment, use the DR imaging system installed above to take N[1-8] real-time DR images, and import the images into the artificial intelligence constructed and trained in the second step. In the neural network, virtual 3D-CT images are output.
第五,将第四步输出的虚拟3D-CT和患者治疗计划3D-CT图像进行自动组织器官分割,获得组织器官和肿瘤靶区的轮廓数据。Fifth, perform automatic tissue and organ segmentation on the virtual 3D-CT and 3D-CT images of the patient treatment plan output in the fourth step to obtain contour data of the tissue, organ and tumor target area.
第六,将第五步输出的组织器管和肿瘤靶区进行三维重建,重建后进行三维配 准计算,输出患者摆位偏移量参数。判断是否符合放射治疗条件:如果不符合,则根据输出参数引导患者重新摆位,重新进入第四步;如果符合条件,则完成摆位,可以开始治疗。Sixth, perform three-dimensional reconstruction of the organizer tube and tumor target area output in the fifth step, perform three-dimensional registration calculation after reconstruction, and output the parameters of patient placement offset. Determine whether the radiotherapy conditions are met: if not, guide the patient to re-position according to the output parameters, and re-enter the fourth step; if the conditions are met, the position is completed and the treatment can be started.
实施例3Example 3
上述实施例1提供了3D图像引导摆位的方法,与之相对应地,本实施例提供一种3D图像引导摆位的系统。本实施例提供的引导系统可以实施实施例1的3D图像引导摆位的方法,该引导系统可以通过软件、硬件或软硬结合的方式来实现。例如,该引导系统可以包括集成的或分开的功能模块或功能单元来执行实施例1各方法中的对应步骤。由于本实施例的引导系统基本相似于方法实施例,所以本实施例描述过程比较简单,相关之处可以参见实施例1的部分说明即可,本实施例的引导系统的实施例仅仅是示意性的。The above-mentioned Embodiment 1 provides a 3D image-guided positioning method. Correspondingly, this embodiment provides a 3D image-guided positioning system. The guidance system provided in this embodiment may implement the 3D image guidance placement method of Embodiment 1, and the guidance system may be implemented by software, hardware, or a combination of software and hardware. For example, the guidance system may include integrated or separate functional modules or functional units to perform corresponding steps in each method of Embodiment 1. Since the guidance system of this embodiment is basically similar to the method embodiment, the description process of this embodiment is relatively simple, and the relevant parts may refer to the partial description of Embodiment 1, and the embodiment of the guidance system of this embodiment is only illustrative of.
本实施例提供一种三维图像引导摆位的系统,该系统包括:This embodiment provides a three-dimensional image-guided positioning system, which includes:
器官重建单元,被配置为将患者的3D-CT图像集采用自动分割算法自动分割出组织器官和肿瘤靶区,并通过组织器官模型重建算法,重建患者治疗计划的组织器官和肿瘤靶区的轮廓数据;The organ reconstruction unit is configured to automatically segment the patient's 3D-CT image set into tissues, organs and tumor target areas by using an automatic segmentation algorithm, and reconstruct the contours of the tissues, organs and tumor target areas of the patient's treatment plan through the tissue-organ model reconstruction algorithm data;
虚拟图像生成单元,基于患者的实时DR图像,采用人工智能网络算法生成患者的虚拟3D-CT图像集;The virtual image generation unit, based on the real-time DR image of the patient, uses the artificial intelligence network algorithm to generate the virtual 3D-CT image set of the patient;
虚拟器官重建单元,将患者的虚拟3D-CT图像集采用自动分割算法自动分割出虚拟组织器官和肿瘤靶区,并通过组织器官模型重建算法,重建患者的虚拟组织器官和肿瘤靶区轮廓数据;The virtual organ reconstruction unit uses an automatic segmentation algorithm to automatically segment the patient's virtual 3D-CT image set into virtual tissue organs and tumor target areas, and reconstructs the patient's virtual tissue organs and tumor target area contour data through the tissue-organ model reconstruction algorithm;
摆位判断单元,将患者治疗计划的组织器官和肿瘤靶区轮廓数据和虚拟组织器官和肿瘤靶区轮廓数据进行配准,输出患者摆位偏移量参数,判断偏移量参数是否符合放射治疗条件:如果不符合,则引导患者重新摆位;如果符合条件,则完成摆位。The positioning judgment unit registers the contour data of the tissue and organ and tumor target area of the patient's treatment plan with the virtual tissue and organ and the contour data of the tumor target area, outputs the patient's positioning offset parameter, and judges whether the offset parameter is in line with the radiation therapy. Conditions: If not, guide the patient to reposition; if eligible, complete the position.
实施例4Example 4
本实施例提供一种与本实施例1所提供的3D图像引导摆位的方法对应的处理设备,处理设备可以是用于客户端的电子设备,例如手机、笔记本电脑、平板电脑、台式机电脑等,以执行实施例1的方法。This embodiment provides a processing device corresponding to the 3D image-guided positioning method provided in Embodiment 1, and the processing device may be an electronic device used for a client, such as a mobile phone, a notebook computer, a tablet computer, a desktop computer, etc. , to perform the method of Example 1.
所述处理设备包括处理器、存储器、通信接口和总线,处理器、存储器和通信 接口通过总线连接,以完成相互间的通信。总线可以是工业标准体系结构(ISA,Industry Standard Architecture)总线,外部设备互连(PCI,Peripheral Component)总线或扩展工业标准体系结构(EISA,Extended Industry Standard Component)总线等等。存储器中存储有可在所述处理器上运行的计算机程序,所述处理器运行所述计算机程序时执行本实施例1所提供的3D图像引导摆位的方法。The processing device includes a processor, a memory, a communication interface and a bus, and the processor, the memory and the communication interface are connected through the bus to complete mutual communication. The bus can be an industry standard architecture (ISA, Industry Standard Architecture) bus, a peripheral device interconnect (PCI, Peripheral Component) bus or an extended industry standard architecture (EISA, Extended Industry Standard Component) bus and so on. A computer program that can be run on the processor is stored in the memory, and the processor executes the 3D image-guided positioning method provided in Embodiment 1 when the processor runs the computer program.
在一些实现中,存储器可以是高速随机存取存储器(RAM:Random Access Memory),也可能还包括非不稳定的存储器(non-volatile memory),例如至少一个磁盘存储器。In some implementations, the memory may be a high-speed random access memory (RAM: Random Access Memory), and may also include a non-volatile memory (non-volatile memory), such as at least one disk memory.
在另一些实现中,处理器可以为中央处理器(CPU)、数字信号处理器(DSP)等各种类型通用处理器,在此不做限定。In other implementations, the processor may be various types of general-purpose processors such as a central processing unit (CPU) and a digital signal processor (DSP), which are not limited herein.
实施例5Example 5
本实施例1的3D图像引导摆位的方法可被具体实现为一种计算机程序产品,计算机程序产品可以包括计算机可读存储介质,其上载有用于执行本实施例1所述的方法的计算机可读程序指令。The method for 3D image-guided positioning in Embodiment 1 may be embodied as a computer program product, and the computer program product may include a computer-readable storage medium on which a computer-readable storage medium for executing the method described in Embodiment 1 is uploaded. Read program instructions.
计算机可读存储介质可以是保持和存储由指令执行设备使用的指令的有形设备。计算机可读存储介质例如可以是但不限于电存储设备、磁存储设备、光存储设备、电磁存储设备、半导体存储设备或者上述的任意组合。A computer-readable storage medium may be a tangible device that retains and stores instructions for use by the instruction execution device. The computer-readable storage medium may be, for example, but not limited to, an electrical storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any combination of the above.
需要说明的是,附图中的流程图和框图显示了根据本申请的多个实施例的系统、方法和计算机程序产品的可能实现的体系架构、功能和操作。流程图或框图中的每个方框可以代表一个模块、程序段或代码的一部分,所述模块、程序段或代码的一部分包含一个或多个用于实现规定的逻辑功能的可执行指令。最后应当说明的是:以上实施例仅用以说明本发明的技术方案而非对其限制,尽管参照上述实施例对本发明进行了详细的说明,所属领域的普通技术人员应当理解:依然可以对本发明的具体实施方式进行修改或者等同替换,而未脱离本发明精神和范围的任何修改或者等同替换,其均应涵盖在本发明的权利要求保护范围之内。上述内容仅为本申请的具体实施方式,但本申请的保护范围并不局限于此,任何熟悉本技术领域的技术人员在本申请揭露的技术范围内,可轻易想到变化或替换,都应涵盖在本申请的保护范围之内。因此,本申请的保护范围应以权利要求的保护范围。It should be noted that the flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present application. Each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which contains one or more executable instructions for implementing the specified logical function(s). Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention rather than to limit them. Although the present invention has been described in detail with reference to the above embodiments, those of ordinary skill in the art should understand that: the present invention can still be Modifications or equivalent replacements are made to the specific embodiments of the present invention, and any modifications or equivalent replacements that do not depart from the spirit and scope of the present invention shall be included within the protection scope of the claims of the present invention. The above contents are only specific embodiments of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the technical scope disclosed in the present application can easily think of changes or replacements, which should cover within the scope of protection of this application. Therefore, the protection scope of the present application should be the protection scope of the claims.

Claims (10)

  1. 一种三维图像引导摆位的方法,其特征在于包括:A three-dimensional image-guided positioning method, comprising:
    将患者的3D-CT图像集采用自动分割算法自动分割出组织器官和肿瘤靶区,并通过组织器官模型重建算法,重建患者治疗计划的组织器官和肿瘤靶区的轮廓数据;The patient's 3D-CT image set is automatically segmented into tissues, organs and tumor target areas by an automatic segmentation algorithm, and the contour data of the tissues, organs and tumor target areas of the patient's treatment plan are reconstructed through the tissue-organ model reconstruction algorithm;
    基于患者的实时DR图像,采用人工智能网络算法生成患者的虚拟3D-CT图像集;Based on the patient's real-time DR images, the artificial intelligence network algorithm is used to generate the patient's virtual 3D-CT image set;
    将患者的虚拟3D-CT图像集采用自动分割算法自动分割出虚拟组织器官和肿瘤靶区,并通过组织器官模型重建算法,重建患者的虚拟组织器官和肿瘤靶区轮廓数据;The patient's virtual 3D-CT image set is automatically segmented into virtual tissues and organs and tumor target areas by an automatic segmentation algorithm, and the patient's virtual tissues and organs and tumor target area contour data are reconstructed through the tissue-organ model reconstruction algorithm;
    将患者治疗计划的组织器官和肿瘤靶区轮廓数据和虚拟组织器官和肿瘤靶区轮廓数据进行配准,输出患者摆位偏移量参数,判断偏移量参数是否符合放射治疗条件:如果不符合,则引导患者重新摆位;如果符合条件,则完成摆位。Register the contour data of the tissue and organ and tumor target volume of the patient's treatment plan with the virtual tissue and organ and the contour data of the tumor target volume, output the patient's positioning offset parameter, and determine whether the offset parameter meets the radiotherapy conditions: if not , the patient is guided to reposition; if the conditions are met, the position is completed.
  2. 根据权利要求1所述的三维图像引导摆位的方法,其特征在于,患者的实时DR图像通过采用DR成像设备进行获取。The method according to claim 1, wherein the real-time DR image of the patient is acquired by using a DR imaging device.
  3. 根据权利要求2所述的三维图像引导摆位的方法,其特征在于,所述DR成像设备包括一套X射线源及与之对应的成像平板;The three-dimensional image-guided positioning method according to claim 2, wherein the DR imaging device comprises a set of X-ray sources and an imaging flat panel corresponding thereto;
    所述X射线源安装在治疗室顶部,所述成像平板安装在治疗室地面部分,各自使用小角度轨道进行运动;或者,The X-ray source is installed on the top of the treatment room, and the imaging plate is installed on the floor portion of the treatment room, and each uses a small-angle track to move; or,
    所述X射线源和成像平板使用C型臂连接整体进行小角度运动。The X-ray source and the imaging plate are connected by a C-arm for small-angle movement.
  4. 根据权利要求1所述的三维图像引导摆位的方法,其特征在于,人工智能网络算法通过训练验证获得,包括:The three-dimensional image-guided positioning method according to claim 1, wherein the artificial intelligence network algorithm is obtained through training and verification, comprising:
    使用DR成像设备拍摄患者的DR图像,同时使用CT系统拍摄同一患者同一部位的3D-CT图像,使该患者的DR图像和3D-CT图像一一对应,建立DR图像及与之对应的3D-CT图像数据集;将建立的数据集中部分数据作为训练数据集,另一部分作为验证数据集,构建神经网络模型进行训练验证,并通过运算不断迭代获得人工智能网络的权重及参数,进而获得训练好的人工智能网络模型。Use the DR imaging equipment to capture the DR image of the patient, and use the CT system to capture the 3D-CT image of the same part of the same patient, so that the DR image of the patient and the 3D-CT image are in one-to-one correspondence, and the DR image and the corresponding 3D-CT image are established. CT image data set; part of the data in the established data set is used as a training data set, and the other part is used as a verification data set, a neural network model is constructed for training and verification, and the weights and parameters of the artificial intelligence network are obtained through continuous iteration through operations, and then the trained artificial intelligence network model.
  5. 根据权利要求1所述的三维图像引导摆位的方法,其特征在于,自动分割算法采用基于深度学习卷积神经网络模型,能够根据输入的CT图像自动分割出组织器 官及肿瘤靶区。The method of three-dimensional image-guided placement according to claim 1, wherein the automatic segmentation algorithm adopts a deep learning convolutional neural network model, and can automatically segment tissues and organs and tumor target areas according to the input CT image.
  6. 根据权利要求1所述的三维图像引导摆位的方法,其特征在于,组织器官重建算法能够重建出所有或者指定组织器官的3D模型,并能够对不同的组织器官进行不同颜色和模态的渲染显示,便于使用者观察分辨操作。The three-dimensional image-guided positioning method according to claim 1, wherein the tissue-organ reconstruction algorithm can reconstruct 3D models of all or specified tissues and organs, and can render different tissues and organs with different colors and modes. The display is convenient for users to observe and distinguish operations.
  7. 根据权利要求1所述的三维图像引导摆位的方法,其特征在于,配准采用组织器官配准算法进行手动和/或自动3D模型配准。The three-dimensional image-guided positioning method according to claim 1, wherein the registration adopts a tissue-organ registration algorithm to perform manual and/or automatic 3D model registration.
  8. 一种三维图像引导系统,其特征在于,该系统包括:A three-dimensional image guidance system, characterized in that the system includes:
    器官重建单元,被配置为将患者的3D-CT图像集采用自动分割算法自动分割出组织器官和肿瘤靶区,并通过组织器官模型重建算法,重建患者治疗计划的组织器官和肿瘤靶区的轮廓数据;The organ reconstruction unit is configured to automatically segment the patient's 3D-CT image set into tissues, organs and tumor target areas by using an automatic segmentation algorithm, and reconstruct the contours of the tissues, organs and tumor target areas of the patient's treatment plan through the tissue-organ model reconstruction algorithm data;
    虚拟图像生成单元,基于患者的实时DR图像,采用人工智能网络算法生成患者的虚拟3D-CT图像集;The virtual image generation unit, based on the real-time DR image of the patient, uses the artificial intelligence network algorithm to generate the virtual 3D-CT image set of the patient;
    虚拟器官重建单元,将患者的虚拟3D-CT图像集采用自动分割算法自动分割出虚拟组织器官和肿瘤靶区,并通过组织器官模型重建算法,重建患者的虚拟组织器官和肿瘤靶区轮廓数据;The virtual organ reconstruction unit uses an automatic segmentation algorithm to automatically segment the patient's virtual 3D-CT image set into virtual tissue organs and tumor target areas, and reconstructs the patient's virtual tissue organs and tumor target area contour data through the tissue-organ model reconstruction algorithm;
    摆位判断单元,将患者治疗计划的组织器官和肿瘤靶区轮廓数据和虚拟组织器官和肿瘤靶区轮廓数据进行配准,输出患者摆位偏移量参数,判断偏移量参数是否符合放射治疗条件:如果不符合,则引导患者重新摆位;如果符合条件,则完成摆位。The positioning judgment unit registers the contour data of the tissue and organ and tumor target area of the patient's treatment plan with the virtual tissue and organ and the contour data of the tumor target area, outputs the patient's positioning offset parameter, and judges whether the offset parameter is in line with the radiation therapy. Conditions: If not, guide the patient to reposition; if eligible, complete the position.
  9. 一种处理设备,所述处理设备至少包括处理器和存储器,所述存储器上存储有计算机程序,其特征在于,所述处理器运行所述计算机程序时执行以实现根据权利要求1到7任一项所述三维图像引导摆位的方法。A processing device, the processing device includes at least a processor and a memory, and a computer program is stored on the memory, wherein the processor executes the computer program when running the computer program to realize any one of claims 1 to 7 The three-dimensional image-guided positioning method described in item.
  10. 一种计算机存储介质,其特征在于,其上存储有计算机可读指令,所述计算机可读指令可被处理器执行以实现权利要求1到7任一项所述三维图像引导摆位的方法。A computer storage medium, characterized in that computer-readable instructions are stored thereon, and the computer-readable instructions can be executed by a processor to implement the three-dimensional image-guided positioning method according to any one of claims 1 to 7.
PCT/CN2021/082938 2021-03-25 2021-03-25 Three-dimensional image-guided positioning method and system, and storage medium WO2022198553A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/CN2021/082938 WO2022198553A1 (en) 2021-03-25 2021-03-25 Three-dimensional image-guided positioning method and system, and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2021/082938 WO2022198553A1 (en) 2021-03-25 2021-03-25 Three-dimensional image-guided positioning method and system, and storage medium

Publications (1)

Publication Number Publication Date
WO2022198553A1 true WO2022198553A1 (en) 2022-09-29

Family

ID=83395150

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/082938 WO2022198553A1 (en) 2021-03-25 2021-03-25 Three-dimensional image-guided positioning method and system, and storage medium

Country Status (1)

Country Link
WO (1) WO2022198553A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116370848A (en) * 2023-06-07 2023-07-04 浙江省肿瘤医院 Positioning method and system for radiotherapy
CN116740768A (en) * 2023-08-11 2023-09-12 南京诺源医疗器械有限公司 Navigation visualization method, system, equipment and storage medium based on nasoscope

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090110145A1 (en) * 2007-10-25 2009-04-30 Tomotherapy Incorporated Method for adapting fractionation of a radiation therapy dose
CN102306239A (en) * 2011-07-22 2012-01-04 李宝生 Method for evaluating and optimizing radiotherapy dose based on cone beam CT (Computer Tomography) image CT value correction technology
CN106097347A (en) * 2016-06-14 2016-11-09 福州大学 A kind of multimodal medical image registration and method for visualizing
CN106408509A (en) * 2016-04-29 2017-02-15 上海联影医疗科技有限公司 Registration method and apparatus
CN111968110A (en) * 2020-09-02 2020-11-20 广州海兆印丰信息科技有限公司 CT imaging method, device, storage medium and computer equipment
CN112348857A (en) * 2020-11-06 2021-02-09 苏州雷泰医疗科技有限公司 Radiotherapy positioning offset calculation method and system based on deep learning

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090110145A1 (en) * 2007-10-25 2009-04-30 Tomotherapy Incorporated Method for adapting fractionation of a radiation therapy dose
CN102306239A (en) * 2011-07-22 2012-01-04 李宝生 Method for evaluating and optimizing radiotherapy dose based on cone beam CT (Computer Tomography) image CT value correction technology
CN106408509A (en) * 2016-04-29 2017-02-15 上海联影医疗科技有限公司 Registration method and apparatus
CN106097347A (en) * 2016-06-14 2016-11-09 福州大学 A kind of multimodal medical image registration and method for visualizing
CN111968110A (en) * 2020-09-02 2020-11-20 广州海兆印丰信息科技有限公司 CT imaging method, device, storage medium and computer equipment
CN112348857A (en) * 2020-11-06 2021-02-09 苏州雷泰医疗科技有限公司 Radiotherapy positioning offset calculation method and system based on deep learning

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116370848A (en) * 2023-06-07 2023-07-04 浙江省肿瘤医院 Positioning method and system for radiotherapy
CN116370848B (en) * 2023-06-07 2023-09-01 浙江省肿瘤医院 Positioning method and system for radiotherapy
CN116740768A (en) * 2023-08-11 2023-09-12 南京诺源医疗器械有限公司 Navigation visualization method, system, equipment and storage medium based on nasoscope
CN116740768B (en) * 2023-08-11 2023-10-20 南京诺源医疗器械有限公司 Navigation visualization method, system, equipment and storage medium based on nasoscope

Similar Documents

Publication Publication Date Title
AU2019262836B2 (en) Phantom for adaptive radiotherapy
JP6886565B2 (en) Methods and devices for tracking surface movements
EP2931371B1 (en) Real-time adaptive dose computation radiation therapy
Aird et al. CT simulation for radiotherapy treatment planning
US10134155B2 (en) Systems and methods for real-time imaging
JP2020503148A (en) Image registration of treatment plan images, 3D images within fragments, and 2DX X-ray images within fragments
CN113041516B (en) Method, system, processing equipment and storage medium for guiding positioning of three-dimensional image
JP2018504969A (en) 3D localization and tracking for adaptive radiation therapy
WO2022198553A1 (en) Three-dimensional image-guided positioning method and system, and storage medium
WO2010039404A1 (en) Subtraction of a segmented anatomical feature from an acquired image
WO2020087257A1 (en) Image guidance method and device, and medical equipment and computer readable storage medium
AU2018266458B2 (en) Systems and methods of accounting for shape change during radiotherapy
US20210121715A1 (en) Cardiac ablation using an mr linac
Zhou et al. Feasibility study of deep learning‐based markerless real‐time lung tumor tracking with orthogonal X‐ray projection images
CN113041515A (en) Three-dimensional image guided moving organ positioning method, system and storage medium
WO2022198554A1 (en) Method and system for three-dimensional image guided positioning of organs in motion, and storage medium
US20210295542A1 (en) Method, radiotherapy device, and computer-readable storage medium for image registration
Mestrovic et al. Integration of on-line imaging, plan adaptation and radiation delivery: proof of concept using digital tomosynthesis
CN116322902A (en) Image registration system and method
Santhanam et al. A multi-GPU real-time dose simulation software framework for lung radiotherapy
US20240001151A1 (en) Methods, systems and computer readable mediums for determining a region-of-interest in surface-guided monitoring
Sumida et al. Introduction to CT/MR simulation in radiotherapy
US11712584B1 (en) Prospective and retrospective on-line adaptive radiotherapy
AU2019453270B2 (en) Geometry-based real-time adaptive radiotherapy
US20240108915A1 (en) Virtual portal image for treatment setup in a radiation therapy system

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21932181

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21932181

Country of ref document: EP

Kind code of ref document: A1