WO2022082533A1 - 医学图像处理方法、设备及放疗系统 - Google Patents
医学图像处理方法、设备及放疗系统 Download PDFInfo
- Publication number
- WO2022082533A1 WO2022082533A1 PCT/CN2020/122593 CN2020122593W WO2022082533A1 WO 2022082533 A1 WO2022082533 A1 WO 2022082533A1 CN 2020122593 W CN2020122593 W CN 2020122593W WO 2022082533 A1 WO2022082533 A1 WO 2022082533A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- dimensional image
- medical multi
- medical
- image
- control operation
- Prior art date
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 16
- 238000001959 radiotherapy Methods 0.000 title claims abstract description 15
- 238000000034 method Methods 0.000 claims abstract description 45
- 230000008569 process Effects 0.000 claims abstract description 20
- 238000005516 engineering process Methods 0.000 claims abstract description 13
- 238000001514 detection method Methods 0.000 claims description 10
- 230000003993 interaction Effects 0.000 claims description 10
- 230000003190 augmentative effect Effects 0.000 claims description 8
- 238000004590 computer program Methods 0.000 claims description 7
- 230000006870 function Effects 0.000 claims description 7
- 230000002452 interceptive effect Effects 0.000 claims description 4
- 238000006243 chemical reaction Methods 0.000 claims description 3
- 238000004891 communication Methods 0.000 claims description 3
- 230000009471 action Effects 0.000 claims description 2
- 230000001939 inductive effect Effects 0.000 claims 2
- 206010028980 Neoplasm Diseases 0.000 description 8
- 230000000694 effects Effects 0.000 description 4
- 239000011521 glass Substances 0.000 description 4
- 230000005855 radiation Effects 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 238000003860 storage Methods 0.000 description 3
- 238000002591 computed tomography Methods 0.000 description 2
- 230000006698 induction Effects 0.000 description 2
- 238000002595 magnetic resonance imaging Methods 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 238000004088 simulation Methods 0.000 description 2
- 238000005481 NMR spectroscopy Methods 0.000 description 1
- 239000006227 byproduct Substances 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000003902 lesion Effects 0.000 description 1
- 230000004807 localization Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 210000000056 organ Anatomy 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
- 238000002604 ultrasonography Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/04—Forecasting or optimisation specially adapted for administrative or management purposes, e.g. linear programming or "cutting stock problem"
Definitions
- the embodiments of the present application relate to the field of radiotherapy, and in particular, to a medical image processing method, device, and radiotherapy system.
- One of the key techniques of radiation therapy is to maintain precise localization of the tumor during radiation therapy.
- the radiation emitted by the radiation source is used to treat the tumor in the body tissue, and the radiation needs to be accurately positioned on the tumor. If the radiation cannot be accurately positioned, it will cause damage to the normal tissue around the tumor.
- tumors are three-dimensional objects, and medical personnel need to locate and treat tumors through two-dimensional images, which is prone to errors and affects the treatment effect.
- one of the technical problems solved by the embodiments of the present invention is to provide a medical image processing method, equipment and radiotherapy system to overcome the defect of the prior art that the tumor cannot be located in real time and the treatment effect is affected.
- the embodiments of the present application provide a medical image processing method, which includes: acquiring a first medical multi-dimensional image of a target object, and displaying the first medical multi-dimensional image through a display device; detecting a control operation, and generating a control operation according to the control operation information; processing the first medical multi-dimensional image according to the control information to generate a second medical multi-dimensional image to be displayed; displaying the second medical multi-dimensional image through a display device.
- the embodiments of the present application provide a medical image processing device, which includes: an acquisition module, a detection module, and an image processing module;
- the acquisition module is used to acquire the first medical multi-dimensional image of the target object, and display the first medical multi-dimensional image through the display device;
- the detection module is used to detect the control operation and generate control information according to the control operation
- the image processing module is configured to process the first medical multi-dimensional image according to the control information to generate a second medical multi-dimensional image to be displayed; and display the second medical multi-dimensional image through a display device.
- an embodiment of the present application provides an electronic device, including a processor and a memory, the processor and the memory are communicatively connected, and a computer program is stored thereon;
- the processor is configured to execute the computer program to implement the tracking method as described in the first aspect.
- an embodiment of the present application provides a medical image display system, characterized in that the medical image display system includes: a processing device, an interaction device, and a display device, and the interaction device and the display device are communicatively connected;
- a processing device for acquiring a first medical multi-dimensional image of the target object, and displaying the first medical multi-dimensional image through a display device;
- An interactive device for detecting the control operation, generating control information according to the control operation, and transmitting the control information to the processing device;
- the processing device is configured to process the first medical multi-dimensional image according to the control information to generate a second medical multi-dimensional image to be displayed; and display the second medical multi-dimensional image through the display device.
- the medical image processing method, device, and radiotherapy system acquire a first medical multi-dimensional image of a target object, and display the first medical multi-dimensional image through a display device; detect a control operation, and generate control information according to the control operation; The control information processes the first medical multi-dimensional image to generate a second medical multi-dimensional image to be displayed; and displays the second medical multi-dimensional image through the display device. Because the first medical multi-dimensional image and the second medical multi-dimensional image are both displayed by the three-dimensional image display technology, the user's viewing is more intuitive, and the first medical multi-dimensional image can be processed through a control operation, and the operation is more intuitive and convenient.
- FIG. 1 is a flowchart of a medical image processing method provided in Embodiment 1 of the present application.
- FIG. 2 is a structural block diagram of a medical image processing device according to Embodiment 2 of the present application.
- FIG. 3 is a structural block diagram of an electronic device according to Embodiment 3 of the present application.
- FIG. 4 is a structural block diagram of a medical image processing system according to Embodiment 3 of the present application.
- FIG. 1 is a flowchart of a medical image processing method provided by an embodiment of the present application.
- the medical image processing method includes the following steps:
- Step 101 Acquire a first medical multi-dimensional image of the target object, and display the first medical multi-dimensional image through a display device.
- the target object may be a key part in the first medical multi-dimensional image, for example, the target object is a key organ, a tumor, a lesion area, and the like.
- the display device may be a device with a three-dimensional display function, for example, a display with a three-dimensional display function, a virtual reality (English: Virtual Reality, VR) device (eg: virtual reality glasses) or an augmented reality (English: Augmented Reality, AR) device (Example: augmented reality glasses).
- the medical multi-dimensional image may be a three-dimensional image or a four-dimensional image
- the first medical multi-dimensional image may be a first medical three-dimensional image or a first medical four-dimensional image.
- the first medical multi-dimensional image is a three-dimensional image, obtaining the first medical multi-dimensional image of the target object, and displaying the first medical multi-dimensional image through a display device, including: obtaining the body tissue where the target object is located. at least one two-dimensional image; perform three-dimensional modeling according to the at least one two-dimensional image, and obtain a first medical multi-dimensional image; control the display device to display the first medical multi-dimensional image by using virtual reality technology or augmented reality technology.
- the at least one two-dimensional image may include a computed tomography (English: Computed Tomography, CT) image, a nuclear magnetic resonance (English: Magnetic Resonance Imaging, MRI) image, or an ultrasound image, and the like.
- the at least one two-dimensional image may be transmitted by an image acquisition device or acquired by a medical image processing device. Of course, this is just an exemplary illustration.
- acquiring the first medical multi-dimensional image of the target object and displaying the first medical multi-dimensional image through a display device includes: receiving the first medical multi-dimensional image transmitted by the image acquisition device.
- obtaining the first medical multi-dimensional image of the target object and controlling the display device to display the first medical multi-dimensional image includes: obtaining the initial medical image of the target object. Medical multi-dimensional image; automatically process the target object in the initial medical multi-dimensional image, and use the medical multi-dimensional image combined with the first processing result as the first medical multi-dimensional image; control the display device to display the first medical multi-dimensional image.
- Automatic processing of initial medical multi-dimensional medical images makes it more convenient for users to use.
- the automatic processing may include automatic contouring, automatic calculation of metering distribution, etc.
- the first processing result may include contours, dose maps, and the like.
- Step 102 Detect a control operation, and generate control information according to the control operation.
- the control operation may include the operation of the induction handle or the induction glove in the three-dimensional virtual space, and may also include gesture operation and the like.
- an operation position and a movement trajectory may be detected in a preset area, and at least one corresponding physical coordinate may be determined in the actual coordinate system according to the operation position and movement trajectory;
- the at least one physical coordinate and the preset coordinate transformation relationship determine at least one virtual coordinate corresponding to the at least one physical coordinate in the virtual display coordinate system;
- the operation object is determined in the initial three-dimensional medical image according to the at least one virtual coordinate and control information is generated.
- the user can control the operation through gestures, which is more flexible and accurate, and better meets the user's refined processing on medical images.
- the virtual control operation may be detected by the sensing handle, and control information may be generated, where the control information includes the virtual control operation.
- control information includes the virtual control operation.
- Different values of virtual control operations correspond to different control operations.
- the user's operation is more convenient.
- Step 103 Process the first medical multi-dimensional image according to the control information to generate a second medical multi-dimensional image to be displayed.
- the processing of the first medical multi-dimensional image may include contour adjustment or window width/window level adjustment, and the like.
- contour adjustment or window width/window level adjustment and the like.
- two specific examples are listed here to describe in detail how to process the first medical multi-dimensional image.
- a virtual control operation may be used to detect a user operation and process the first medical multi-dimensional image. Detecting the control operation, and generating control information according to the control operation, including: detecting the virtual control operation of the external device on the target object in the first medical multi-dimensional image, and generating the control information, and the control information is used to indicate the virtual control operation;
- Processing the first medical multi-dimensional image according to the control information to generate the second medical multi-dimensional image includes: determining a second processing result of processing the target object under the influence of the virtual control operation indicated by the control information; The first processing result in a medical multi-dimensional image is updated to obtain a second medical multi-dimensional image.
- the first processing result is obtained by processing the first medical multi-dimensional image according to the virtual control operation, the user operation is more convenient, and the detection is more accurate.
- the second processing result may include manually adjusted contours, dose maps, and the like.
- the control information may include the force of the virtual control operation, the direction of the force, the moving distance and direction, and the like.
- the external device may include, for example, a mouse, a keyboard, a handle and other devices; further, determining the second processing result of processing the target object under the influence of the virtual control operation indicated by the control information includes: according to the The virtual control operation acquires adjustment information, and determines the second processing result, the adjustment information includes virtual control operations with different adjustment strengths, automatic processing operations matching the virtual control operations, and corresponding automatic processing results; according to the adjustment The information performs multiple iterations on the second processing result. Performing multiple iterations on the second processing result can make the processing result more accurate and improve the processing effect.
- the user's gesture operation can be detected, and the first medical multi-dimensional image can be processed, the control information includes the target adjustment instruction for the medical multi-dimensional image, the control operation is detected, and the control operation is generated according to the control operation.
- information including: detecting the operation position and movement trajectory in the preset area; determining the position of the target area to be adjusted in the target object according to the operation position, and determining the adjustment range and direction of the target area according to the movement trajectory; according to the position of the target area and The adjustment range and direction of the target area generate target adjustment instructions;
- Processing the first medical multi-dimensional image according to the control information to generate the second medical multi-dimensional image to be displayed includes: adjusting and updating the target object in the first medical multi-dimensional image according to the target adjustment instruction to obtain the second medical multi-dimensional image.
- the first medical multi-dimensional image is processed according to the operation position and movement trajectory of the gesture operation, the user does not need to rely on other external devices, and the operation is more convenient.
- the outline is taken as an example here, and in combination with step 102, two specific application scenarios are listed to describe in detail how to adjust the outline of the outline.
- detecting a control operation and generating control information according to the control operation, including: detecting a virtual control operation on the contour surface of the target object, and generating control information, where the control information includes the virtual control operation;
- Processing the first medical multi-dimensional image to generate the second medical multi-dimensional image according to the control information including: determining the deformed contour under the influence of the virtual control operation; adjusting the shape of the target object in the first medical multi-dimensional image according to the deformed contour
- the contour is obtained, and a second medical multi-dimensional image is obtained according to the result of contour adjustment (ie, the second processing result).
- the contour may represent the curved surface of the contour of the target object, may be the curved surface of the partial contour of the target object, or may be the curved surface of the entire contour.
- the control information includes a contour adjustment instruction
- the control operation is detected
- the control information is generated according to the control operation, including: detecting the operation position and the movement trajectory in the preset area; Determine the position of the target contour area to be adjusted in the contour of the target contour area, and determine the adjustment range and direction of the target contour area according to the movement trajectory; instruction);
- Processing the first medical multi-dimensional image according to the control information to generate the second medical multi-dimensional image to be displayed includes: adjusting and updating the contour of the target object in the first medical multi-dimensional image according to the contour adjustment instruction to obtain the second medical multi-dimensional image .
- the position change amount of the target contour area is determined by detecting the operation position and the movement track, so as to realize the purpose of adjusting the contour, and the user operation is more flexible.
- Step 104 Display the second medical multi-dimensional image through the display device.
- Displaying the second medical multi-dimensional image is similar to displaying the first medical multi-dimensional image, and both may be three-dimensional image display using a three-dimensional display technology, or four-dimensional image display using a four-dimensional display technology.
- the method further includes: acquiring a registration instruction, where the registration instruction is used to instruct to perform three-dimensional registration on the second medical multi-dimensional image; 3D registration obtains the offset of the target object. Using three-dimensional images for registration can obtain the three-dimensional offset more intuitively, which is convenient for users to watch, and improves the accuracy of registration.
- the method further includes:
- the simulated collision instruction is obtained, and the simulated collision instruction is used to instruct the simulated collision of the body where the target object is located; according to the simulated collision instruction, the three-dimensional image of the body and the three-dimensional image of the radiotherapy equipment are displayed through the display device, and the process of the body entering the radiotherapy equipment is simulated and displayed.
- the process of the body entering the radiotherapy equipment is simulated and displayed.
- the medical image processing method acquires a first medical multi-dimensional image of a target object, and displays the first medical multi-dimensional image through a display device; detects a control operation, and generates control information according to the control operation; The medical multi-dimensional image is processed to generate a second medical multi-dimensional image to be displayed; the second medical multi-dimensional image is displayed through a display device. Because the first medical multi-dimensional image and the second medical multi-dimensional image are both displayed by the three-dimensional image display technology, the user's viewing is more intuitive, and the first medical multi-dimensional image can be processed through a control operation, and the operation is more intuitive and convenient.
- the second embodiment of the present application provides a medical image processing device for executing the method described in the above-mentioned first embodiment.
- the medical image processing device 20 includes: an acquisition module 201 , a detection module 202 and an image processing module 203;
- the acquisition module 201 is used to acquire the first medical multi-dimensional image of the target object, and display the first medical multi-dimensional image through the display device;
- a detection module 202 configured to detect a control operation, and generate control information according to the control operation
- the image processing module 203 is configured to process the first medical multi-dimensional image according to the control information to generate a second medical multi-dimensional image to be displayed; and display the second medical multi-dimensional image through a display device.
- the acquisition module 201 is configured to acquire an initial medical multi-dimensional image of the target object; the target object is automatically processed in the initial medical multi-dimensional image, and the first processing result is combined
- the medical multi-dimensional image is used as the first medical multi-dimensional image; the display device is controlled to display the first medical multi-dimensional image.
- the detection module 202 is configured to detect the virtual control operation of the external device on the target object in the first medical multi-dimensional image, and generate control information, where the control information includes the virtual control operation;
- the image processing module 203 is configured to determine a second processing result under the influence of the virtual control operation; update the first processing result in the first medical multidimensional image according to the second processing result to obtain a second medical multidimensional image.
- the image processing module 203 is configured to obtain adjustment information according to the virtual control operation, and determine the second processing result, the adjustment information includes virtual control operations with different adjustment strengths, automatic processing operations matched with the virtual control operation, and Corresponding automatic processing result; performing multiple iterations on the second processing result according to the adjustment information.
- the detection module 202 is configured to detect the operation position and the movement trajectory in the preset area; determine the position of the target area to be adjusted in the target object according to the operation position, and determine the position of the target area to be adjusted according to the movement position.
- the trajectory determines the adjustment range and direction of the target area; generates target adjustment instructions according to the position of the target area and the adjustment range and direction of the target area;
- the image processing module 203 is configured to adjust and update the target object in the first medical multi-dimensional image according to the target adjustment instruction to obtain the second medical multi-dimensional image.
- the second medical multi-dimensional image is a three-dimensional image
- the image processing module 203 is further configured to obtain a registration instruction
- the registration instruction is used to instruct the second medical multi-dimensional image to perform three-dimensional image processing.
- Registration performing three-dimensional registration on the second medical multi-dimensional image and the medical three-dimensional reference image to obtain the offset of the target object.
- the image processing module 203 is further configured to obtain a simulated collision instruction, and the simulated collision instruction is used to instruct to perform simulated collision on the body where the target object is located; Display the 3D image of the body and the 3D image of the radiotherapy equipment, simulate and display the process of the body entering the radiotherapy equipment.
- the first medical multi-dimensional image is a three-dimensional image
- the acquiring module 201 is further configured to acquire at least one two-dimensional image of the body tissue where the target object is located; Three-dimensional modeling is performed, and the first medical multi-dimensional image is obtained; the display device is controlled to display the first medical multi-dimensional image by using the virtual reality VR technology or the augmented reality AR technology.
- the detection module 202 is configured to detect the operation position and the movement trajectory in the preset area, and determine the corresponding at least one physical coordinate in the actual coordinate system according to the operation position and the movement trajectory. determine at least one virtual coordinate corresponding to at least one physical coordinate in the virtual display coordinate system according to at least one physical coordinate and a preset coordinate conversion relationship; determine an operation object and an operation action in the first medical multi-dimensional image according to at least one virtual coordinate , and generate control information.
- the medical image processing device acquires a first medical multi-dimensional image of a target object, and displays the first medical multi-dimensional image through a display device; detects a control operation, and generates control information according to the control operation; The medical multi-dimensional image is processed to generate a second medical multi-dimensional image to be displayed; the second medical multi-dimensional image is displayed through a display device. Because the first medical multi-dimensional image and the second medical multi-dimensional image are both displayed by the three-dimensional image display technology, the user's viewing is more intuitive, and the first medical multi-dimensional image can be processed through a control operation, and the operation is more intuitive and convenient.
- Embodiment 3 of the present application provides an electronic device for executing the medical image processing method described in Embodiment 1 above.
- the electronic device 30 It includes: at least one processor (processor) 302 and memory (memory) 304, and the processor 302 and the memory 304 are connected in communication.
- a computer program 306 is stored on the memory 304;
- the processor 302 is configured to execute the program 306, and may specifically execute the above embodiments and the relevant steps in the methods described in the second embodiment.
- the program 306 may include program code including computer operation instructions.
- the processor 302 may be a central processing unit CPU, or an Application Specific Integrated Circuit (ASIC), or one or more integrated circuits configured to implement embodiments of the present invention.
- the one or more processors included in the electronic device may be the same type of processors, such as one or more CPUs; or may be different types of processors, such as one or more CPUs and one or more ASICs.
- the memory 304 may include high-speed RAM memory, and may also include non-volatile memory, such as at least one disk memory.
- the electronic device acquires a first medical multi-dimensional image of a target object, and displays the first medical multi-dimensional image through a display device; detects a control operation, and generates control information according to the control operation; The image is processed to generate a second medical multi-dimensional image to be displayed; the second medical multi-dimensional image is displayed through a display device. Because the first medical multi-dimensional image and the second medical multi-dimensional image are both displayed by the three-dimensional image display technology, the user's viewing is more intuitive, and the first medical multi-dimensional image can be processed through a control operation, and the operation is more intuitive and convenient.
- Embodiment 4 of the present application provides a medical image display system for executing the method described in Embodiment 1.
- the medical image display system 40 includes: a processing device 401, an interaction device 402 and a display device 403, and the interaction device 402 and the display device 403 are connected in communication;
- a processing device 401 for acquiring a first medical multi-dimensional image of the target object, and displaying the first medical multi-dimensional image through a display device 403;
- the interaction device 402 is used to detect the control operation, generate control information according to the control operation, and transmit the control information to the processing device 401;
- the processing device 401 is configured to process the first medical multi-dimensional image according to the control information to generate a second medical multi-dimensional image to be displayed; and display the second medical multi-dimensional image through the display device 403 .
- the display device 403 includes a display with a three-dimensional display function, virtual reality glasses or augmented reality glasses.
- the interaction device 402 includes a sensing handle, a sensing glove, a position sensor or a gesture interaction device 402 for the three-dimensional virtual space.
- the gesture interaction device 402 may include a camera device or an infrared sensor device, and the camera device or the infrared sensor device may be used to detect the operation position and the movement trajectory.
- the devices, modules or units described in the above embodiments may be specifically implemented by computer chips or entities, or by products with certain functions.
- a typical implementation device is a computer.
- the computer may be, for example, a personal computer, a laptop computer, a cellular phone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email device, a game console, a tablet computer, a wearable device, or A combination of any of these devices.
- the embodiments of the present application may be provided as a method, an apparatus, or a computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.
- computer-usable storage media including, but not limited to, disk storage, CD-ROM, optical storage, etc.
Landscapes
- Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- Human Resources & Organizations (AREA)
- Economics (AREA)
- Strategic Management (AREA)
- Marketing (AREA)
- Game Theory and Decision Science (AREA)
- Entrepreneurship & Innovation (AREA)
- Development Economics (AREA)
- Operations Research (AREA)
- Quality & Reliability (AREA)
- Tourism & Hospitality (AREA)
- Physics & Mathematics (AREA)
- General Business, Economics & Management (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Apparatus For Radiation Diagnosis (AREA)
Abstract
本申请实施例提供一种医学图像处理方法、设备及放疗系统，医学图像处理方法包括：获取目标对象的第一医学多维图像，并通过显示设备显示第一医学多维图像；检测控制操作，并根据控制操作生成控制信息；根据控制信息对第一医学多维图像进行处理生成待显示的第二医学多维图像；通过显示设备显示第二医学多维图像。因为第一医学多维图像和第二医学多维图像都是通过三维图像显示技术显示，用户观看更加直观，而且可以通过控制操作对第一医学多维图像进行处理，操作更加直观便捷。
Description
本申请实施例涉及放射治疗领域，尤其涉及一种医学图像处理方法、设备及放疗系统。
放射治疗的关键技术之一，是在放射治疗中保持对肿瘤的精确定位。在放射治疗的过程中，利用射线源发出的射线对身体组织中的肿瘤进行治疗，需要射线能够准确定位到肿瘤上，如果不能准确定位，就会对肿瘤周围的正常组织产生损害。但是，肿瘤是三维物体，而医务人员需要通过二维图像对肿瘤进行定位和治疗，容易产生误差，影响治疗效果。
发明内容
有鉴于此，本发明实施例所解决的技术问题之一在于提供一种医学图像处理方法、设备及放疗系统，用以克服现有技术中不能对肿瘤进行实时定位，影响治疗效果的缺陷。
第一方面，本申请实施例提供一种医学图像处理方法，其包括：获取目标对象的第一医学多维图像，并通过显示设备显示第一医学多维图像；检测控制操作，并根据控制操作生成控制信息；根据控制信息对第一医学多维图像进行处理生成待显示的第二医学多维图像；通过显示设备显示第二医学多维图像。
第二方面，本申请实施例提供一种医学图像处理设备，其包括：获取模块、检测模块和图像处理模块；
其中，获取模块，用于获取目标对象的第一医学多维图像，并通过显示设备显示第一医学多维图像；
检测模块，用于检测控制操作，并根据控制操作生成控制信息；
图像处理模块，用于根据控制信息对第一医学多维图像进行处理生成待显示的第二医学多维图像；通过显示设备显示第二医学多维图像。
第三方面，本申请实施例提供一种电子设备，包括处理器和存储器，处理器和存储器通信连接，存储其上存储有计算机程序；
处理器用于执行计算机程序实现如第一方面所描述的追踪方法。
第四方面，本申请实施例提供一种医学图像显示系统，其特征在于，医学图像显示系统包括：处理设备、交互设备和显示设备，交互设备和显示设备通信连接；
处理设备，用于获取目标对象的第一医学多维图像，并通过显示设备显示第一医学多维图像；
交互设备，用于检测控制操作，并根据控制操作生成控制信息，将控制信息传输至处理设备；
处理设备，用于根据控制信息对第一医学多维图像进行处理生成待显示的第二医学多维图像；通过显示设备显示第二医学多维图像。
本申请实施例提供的医学图像处理方法、设备及放疗系统，获取目标对象的第一医学多维图像，并通过显示设备显示第一医学多维图像；检测控制操作，并根据控制操作生成控制信息；根据控制信息对第一医学多维图像进行处理生成待显示的第二医学多维图像；通过显示设备显示第二医学多维图像。因为第一医学多维图像和第二医学多维图像都是通过三维图像显示技术显示，用户观看更加直观，而且可以通过控制操作对第一医学多维图像进行处理，操作更加直观便捷。
后文将参照附图以示例性而非限制性的方式详细描述本申请实施例的一些具体实施例。附图中相同的附图标记标示了相同或类似的部件或部分。本领域技术人员应该理解，这些附图未必是按比值绘制的。附图中：
图1为本申请实施例一提供的一种医学图像处理方法的流程图；
图2为本申请实施例二提供的一种医学图像处理设备的结构框图；
图3为本申请实施例三提供的一种电子设备的结构框图；
图4为本申请实施例三提供的一种医学图像处理系统的结构框图。
下面结合本发明实施例附图进一步说明本发明实施例具体实现。
实施例一、
本申请实施例提供一种医学图像处理方法，应用于医学图像处理设备，如图1所示，图1为本申请实施例提供的一种医学图像处理方法的流程图。该 医学图像处理方法包括以下步骤：
步骤101、获取目标对象的第一医学多维图像，并通过显示设备显示第一医学多维图像。
需要说明的是，本申请中“第一”、“第二”只用于进行区分，不表示任何限定。
可选地，目标对象可以是第一医学多维图像中的关键部位，例如，目标对象是关键器官、肿瘤、病灶区等。显示设备可以是具有三维显示功能的设备，例如，具有三维显示功能的显示器、虚拟现实(英文：Virtual Reality，VR)设备(例如：虚拟现实眼镜)或增强现实(英文：Augmented Reality，AR)设备(例如：增强现实眼镜)。本申请中，医学多维图像可以是三维图像或四维图像等，例如，第一医学多维图像可以是第一医学三维图像或第一医学四维图像。
可选地，在一种实现方式中，第一医学多维图像是三维图像，获取目标对象的第一医学多维图像，并通过显示设备显示第一医学多维图像，包括：获取目标对象所在身体组织的至少一个二维图像；根据至少一个二维图像进行三维建模，并得到第一医学多维图像；控制显示设备利用虚拟现实技术或增强现实技术显示第一医学多维图像。其中，至少一个二维图像可以包括电子计算机断层扫描(英文：Computed Tomography，CT)图像、核磁共振(英文：Magnetic Resonance Imaging，MRI)图像或超声图像等。至少一个二维图像可以是图像采集设备传输的，也可以是医学图像处理设备采集的。当然，此处只是示例性说明。
可选地，在另一种实现方式中，获取目标对象的第一医学多维图像，并通过显示设备显示第一医学多维图像，包括：接收图像采集设备传输的第一医学多维图像。
此处，列举一个具体的应用场景，对第一医学图像进行说明，可选地，获取目标对象的第一医学多维图像，并控制显示设备显示第一医学多维图像，包括：获取目标对象的初始医学多维图像；在初始医学多维图像中对目标对象进行自动处理，并将结合了第一处理结果的医学多维图像作为第一医学多维图像；控制显示设备显示第一医学多维图像。对初始医学多维医学图像进行自动处理，用户使用更加便捷。示例性地，自动处理可以包括自动勾画轮廓、自动计算计量分布等，第一处理结果可以包括轮廓，剂量图等。
步骤102、检测控制操作，并根据控制操作生成控制信息。
控制操作可以包括对三维虚拟空间的感应手柄或感应手套的操作，也可以包括手势操作等。
可选地，以手势操作为例，在一种实现方式中，可以在预设区域检测操作位置及移动轨迹，并根据操作位置及移动轨迹在实际坐标系中确定对应的至少一个物理坐标；根据至少一个物理坐标以及预先设定的坐标转换关系确定至少一个物理坐标在虚拟显示坐标系中对应的至少一个虚拟坐标；根据至少一个虚拟坐标在初始三维医学图像中确定操作对象并生成控制信息。利用物理坐标系和虚拟显示坐标系之间的转换关系，用户可以通过手势进行控制操作，更加灵活、精准，更好地满足用户在医学图像上的精细化处理。
可选地，以感应手套或感应手柄为例，在另一种实现方式中，可以通过感应手柄检测虚拟控制操作，并生成控制信息，控制信息包括虚拟控制操作。虚拟控制操作不同地数值对应不同的控制操作。利用感应手套或感应手柄，用户操作更加便捷。
步骤103、根据控制信息对第一医学多维图像进行处理生成待显示的第二医学多维图像。
对第一医学多维图像的处理可以包括轮廓调整或窗宽/窗位调整等。结合步骤102，此处列举两个具体示例详细说明如何对第一医学多维图像进行处理。
可选地，在第一个示例中，可以利用虚拟控制操作检测用户操作，并对第一医学多维图像进行处理。检测控制操作，并根据控制操作生成控制信息，包括：检测外接设备对于第一医学多维图像中目标对象的虚拟控制操作，并生成控制信息，控制信息用于指示虚拟控制操作；
根据控制信息对第一医学多维图像进行处理生成第二医学多维图像，包括：确定在控制信息指示的虚拟控制操作的影响下对目标对象进行处理的第二处理结果；根据第二处理结果对第一医学多维图像中的第一处理结果进行更新得到第二医学多维图像。根据虚拟控制操作对第一医学多维图像进行处理得到第一处理结果，用户操作更为方便，检测也更加准确。第二处理结果可以包括手动调整后的轮廓、剂量图等。控制信息可以包括虚拟控制操作的力度、力的方向、移动距离和方向等。
需要说明的是，外接设备可以包括例如，鼠标，键盘，手柄等设备；进一步地，确定在控制信息指示的虚拟控制操作的影响下对目标对象进行处理的第二处理结果，包括：根据所述虚拟控制操作获取调整信息，并确定所述第二 处理结果，所述调整信息包括不同调整力度的虚拟控制操作、与虚拟控制操作匹配的自动处理操作，以及对应的自动处理结果；根据所述调整信息对所述第二处理结果进行多次迭代。对第二处理结果进行多次迭代，可以使得处理结果更加准确，提高处理效果。
可选地，在第二个示例中，可以检测用户的手势操作，并对第一医学多维图像进行处理，控制信息包括对医学多维图像的目标调整指令，检测控制操作，并根据控制操作生成控制信息，包括：在预设区域检测操作位置以及移动轨迹；根据操作位置在目标对象中确定待调整的目标区域的位置，并根据移动轨迹确定目标区域的调整幅度和方向；根据目标区域的位置以及目标区域的调整幅度和方向生成目标调整指令；
根据控制信息对第一医学多维图像进行处理生成待显示的第二医学多维图像，包括：根据目标调整指令，在第一医学多维图像中调整目标对象并进行更新，得到第二医学多维图像。根据手势操作的操作位置以及移动轨迹对第一医学多维图像进行处理，用户不需要依赖其他外接设备，操作更为便捷。
基于上述两个示例，此处以轮廓勾画为例，结合步骤102，列举两个具体应用场景详细说明如何调整勾画的轮廓。
可选地，在第一个应用场景中，检测控制操作，并根据控制操作生成控制信息，包括：检测对于目标对象的轮廓面的虚拟控制操作，并生成控制信息，控制信息包括虚拟控制操作；
根据控制信息对第一医学多维图像进行处理生成第二医学多维图像，包括：确定在虚拟控制操作的影响下发生形变后的轮廓；根据发生形变后的轮廓调整第一医学多维图像中目标对象的轮廓，并根据轮廓调整的结果(即第二处理结果)得到第二医学多维图像。需要说明的是，轮廓可以表示目标对象轮廓的曲面，可以是目标对象的局部轮廓的曲面，也可以是全部轮廓的曲面。
可选地，在第二个应用场景中，控制信息包括轮廓调整指令，检测控制操作，并根据控制操作生成控制信息，包括：在预设区域检测操作位置以及移动轨迹；根据操作位置在目标对象的轮廓中确定待调整的目标轮廓区域的位置，并根据移动轨迹确定目标轮廓区域的调整幅度和方向；根据目标轮廓区域的位置以及目标轮廓区域的调整幅度和方向生成轮廓调整指令(即目标调整指令)；
根据控制信息对第一医学多维图像进行处理生成待显示的第二医学多维图像，包括：根据轮廓调整指令，在第一医学多维图像中调整目标对象的轮廓 并进行更新，得到第二医学多维图像。通过检测操作位置和移动轨迹确定目标轮廓区域的位置变化量，从而实现调整轮廓的目的，用户操作更加灵活。
步骤104、通过显示设备显示第二医学多维图像。
显示第二医学多维图像和显示第一医学多维图像类似，都可以是通过三维显示技术进行三维图像显示，或者，通过四维显示技术进行四维图像显示。
结合步骤101-104，需要说明的是，在显示第二医学多维图像之后，还可以进行配准和碰撞模拟，此处列举两个示例进行说明：
可选地，在第一个示例中，该方法还包括：获取配准指令，配准指令用于指示对第二医学多维图像进行三维配准；将第二医学多维图像与医学三维参考图像进行三维配准得到目标对象的偏移量。利用三维图像进行配准，可以更加直观地得到三维的偏移量，也便于用户观看，提高了配准的精准度。
可选地，在第二个示例中，该方法还包括：
获取模拟碰撞指令，模拟碰撞指令用于指示对目标对象所在的身体进行模拟碰撞；根据模拟碰撞指令通过显示设备显示身体的三维图像以及放疗设备的三维图像，模拟并显示身体进入放疗设备的过程。利用三维图像进行碰撞模拟，用户可以更加直观地看到效果。
本申请实施例提供的医学图像处理方法，获取目标对象的第一医学多维图像，并通过显示设备显示第一医学多维图像；检测控制操作，并根据控制操作生成控制信息；根据控制信息对第一医学多维图像进行处理生成待显示的第二医学多维图像；通过显示设备显示第二医学多维图像。因为第一医学多维图像和第二医学多维图像都是通过三维图像显示技术显示，用户观看更加直观，而且可以通过控制操作对第一医学多维图像进行处理，操作更加直观便捷。
实施例二、
本申请实施例二提供一种医学图像处理设备，用于执行上述实施例一所描述的方法，参照图2所示，该医学图像处理设备20包括：获取模块201、检测模块202和图像处理模块203；
其中，获取模块201，用于获取目标对象的第一医学多维图像，并通过显示设备显示第一医学多维图像；
检测模块202，用于检测控制操作，并根据控制操作生成控制信息；
图像处理模块203，用于根据控制信息对第一医学多维图像进行处理生成待显示的第二医学多维图像；通过显示设备显示第二医学多维图像。
可选地，在本申请的一种实施例中，获取模块201，用于获取目标对象的初始医学多维图像；在初始医学多维图像中对目标对象进行自动处理，并将结合了第一处理结果的医学多维图像作为第一医学多维图像；控制显示设备显示第一医学多维图像。
可选地，在本申请的一种实施例中，检测模块202，用于检测外接设备对于第一医学多维图像中目标对象的虚拟控制操作，并生成控制信息，控制信息包括虚拟控制操作；
图像处理模块203，用于确定在虚拟控制操作的影响下的第二处理结果；根据第二处理结果对第一医学多维图像中的第一处理结果进行更新得到第二医学多维图像。
图像处理模块203，用于根据所述虚拟控制操作获取调整信息，并确定所述第二处理结果，所述调整信息包括不同调整力度的虚拟控制操作、与虚拟控制操作匹配的自动处理操作，以及对应的自动处理结果；根据所述调整信息对所述第二处理结果进行多次迭代。
可选地，在本申请的一种实施例中，检测模块202，用于在预设区域检测操作位置以及移动轨迹；根据操作位置在目标对象中确定待调整的目标区域的位置，并根据移动轨迹确定目标区域的调整幅度和方向；根据目标区域的位置以及目标区域的调整幅度和方向生成目标调整指令；
图像处理模块203，用于根据目标调整指令，在第一医学多维图像中调整目标对象并进行更新，得到第二医学多维图像。
可选地，在本申请的一种实施例中，第二医学多维图像是三维图像，图像处理模块203，还用于获取配准指令，配准指令用于指示对第二医学多维图像进行三维配准；将第二医学多维图像与医学三维参考图像进行三维配准得到目标对象的偏移量。
可选地，在本申请的一种实施例中，图像处理模块203，还用于获取模拟碰撞指令，模拟碰撞指令用于指示对目标对象所在的身体进行模拟碰撞；根据模拟碰撞指令通过显示设备显示身体的三维图像以及放疗设备的三维图像，模拟并显示身体进入放疗设备的过程。
可选地，在本申请的一种实施例中，第一医学多维图像是三维图像，获取模块201，还用于获取目标对象所在身体组织的至少一个二维图像；根据至少一个二维图像进行三维建模，并得到第一医学多维图像；控制显示设备利用 虚拟现实VR技术或增强现实AR技术显示第一医学多维图像。
可选地，在本申请的一种实施例中，检测模块202，用于在预设区域检测操作位置及移动轨迹，并根据操作位置及移动轨迹在实际坐标系中确定对应的至少一个物理坐标；根据至少一个物理坐标以及预先设定的坐标转换关系确定至少一个物理坐标在虚拟显示坐标系中对应的至少一个虚拟坐标；根据至少一个虚拟坐标在第一医学多维图像中确定操作对象及操作动作，并生成控制信息。
本申请实施例提供的医学图像处理设备，获取目标对象的第一医学多维图像，并通过显示设备显示第一医学多维图像；检测控制操作，并根据控制操作生成控制信息；根据控制信息对第一医学多维图像进行处理生成待显示的第二医学多维图像；通过显示设备显示第二医学多维图像。因为第一医学多维图像和第二医学多维图像都是通过三维图像显示技术显示，用户观看更加直观，而且可以通过控制操作对第一医学多维图像进行处理，操作更加直观便捷。
实施例三、
基于上述实施例一所描述的医学图像处理方法，本申请实施例三提供了一种电子设备，用于执行上述实施例一所描述的医学图像处理方法，如图3所示，该电子设备30包括：至少一个处理器(processor)302和存储器(memory)304，处理器302和存储器304通信连接。
其中：存储器304上存储有计算机程序306；
处理器302，用于执行程序306，具体可以执行上述实施例和到实施例二所描述的方法中的相关步骤。
具体地，程序306可以包括程序代码，该程序代码包括计算机操作指令。
处理器302可能是中央处理器CPU，或者是特定集成电路ASIC(Application Specific Integrated Circuit)，或者是被配置成实施本发明实施例的一个或多个集成电路。电子设备包括的一个或多个处理器，可以是同一类型的处理器，如一个或多个CPU；也可以是不同类型的处理器，如一个或多个CPU以及一个或多个ASIC。
存储器304，可以包含高速RAM存储器，也可能还包括非易失性存储器(non-volatile memory)，例如至少一个磁盘存储器。
本申请实施例提供的电子设备，获取目标对象的第一医学多维图像，并通过显示设备显示第一医学多维图像；检测控制操作，并根据控制操作生成控 制信息；根据控制信息对第一医学多维图像进行处理生成待显示的第二医学多维图像；通过显示设备显示第二医学多维图像。因为第一医学多维图像和第二医学多维图像都是通过三维图像显示技术显示，用户观看更加直观，而且可以通过控制操作对第一医学多维图像进行处理，操作更加直观便捷。
实施例四、
基于上述实施例一所描述的医学图像处理方法，本申请实施例四提供一种医学图像显示系统，用于执行实施例一所描述的方法。参照图4所示，该医学图像显示系统40包括：处理设备401、交互设备402和显示设备403，交互设备402和显示设备403通信连接；
处理设备401，用于获取目标对象的第一医学多维图像，并通过显示设备403显示第一医学多维图像；
交互设备402，用于检测控制操作，并根据控制操作生成控制信息，将控制信息传输至处理设备401；
处理设备401，用于根据控制信息对第一医学多维图像进行处理生成待显示的第二医学多维图像；通过显示设备403显示第二医学多维图像。
可选地，显示设备403包括具有三维显示功能的显示器、虚拟现实眼镜或增强现实眼镜。
可选地，交互设备402包括对三维虚拟空间的感应手柄、感应手套、位置传感器或手势交互设备402。需要说明的是，手势交互设备402可以包括摄像装置或者红外感应装置，利用摄像装置或者红外感应装置可以检测操作位置以及移动轨迹。
上述实施例阐明的设备、模块或单元，具体可以由计算机芯片或实体实现，或者由具有某种功能的产品来实现。一种典型的实现设备为计算机。具体的，计算机例如可以为个人计算机、膝上型计算机、蜂窝电话、相机电话、智能电话、个人数字助理、媒体播放器、导航设备、电子邮件设备、游戏控制台、平板计算机、可穿戴设备或者这些设备中的任何设备的组合。
为了描述的方便，描述以上装置时以功能分为各种单元分别描述。当然，在实施本申请时可以把各单元的功能在同一个或多个软件和/或硬件中实现。
本领域内的技术人员应明白，本申请的实施例可提供为方法、设备、或计算机程序产品。因此，本申请可采用完全硬件实施例、完全软件实施例、或结合软件和硬件方面的实施例的形式。而且，本申请可采用在一个或多个其中 包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器、CD-ROM、光学存储器等)上实施的计算机程序产品的形式。
还需要说明的是，术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含，从而使得包括一系列要素的过程、方法、商品或者设备不仅包括那些要素，而且还包括没有明确列出的其他要素，或者是还包括为这种过程、方法、商品或者设备所固有的要素。在没有更多限制的情况下，由语句“包括一个……”限定的要素，并不排除在包括所述要素的过程、方法、商品或者设备中还存在另外的相同要素。
本说明书中的各个实施例均采用递进的方式描述，各个实施例之间相同相似的部分互相参见即可，每个实施例重点说明的都是与其他实施例的不同之处。尤其，对于设备实施例而言，由于其基本相似于方法实施例，所以描述的比较简单，相关之处参见方法实施例的部分说明即可。
以上所述仅为本申请的实施例而已，并不用于限制本申请。对于本领域技术人员来说，本申请可以有各种更改和变化。凡在本申请的精神和原理之内所作的任何修改、等同替换、改进等，均应包含在本申请的权利要求范围之内。
Claims (14)
- 一种医学图像处理方法，其特征在于，包括：获取目标对象的第一医学多维图像，并通过显示设备显示所述第一医学多维图像；检测控制操作，并根据所述控制操作生成控制信息；根据所述控制信息对所述第一医学多维图像进行处理生成待显示的第二医学多维图像；通过所述显示设备显示所述第二医学多维图像。
- 根据权利要求1所述的方法，其特征在于，所述获取目标对象的第一医学多维图像，并控制显示设备显示所述第一医学多维图像，包括：获取所述目标对象的初始医学多维图像；在所述初始医学多维图像中对所述目标对象进行自动处理，并将结合了第一处理结果的医学多维图像作为所述第一医学多维图像；控制所述显示设备显示所述第一医学多维图像。
- 根据权利要求2所述的方法，其特征在于，所述检测控制操作，并根据所述控制操作生成控制信息，包括：检测外接设备对于所述第一医学多维图像中目标对象的虚拟控制操作控制操作，并生成所述控制信息，所述控制信息用于指示所述虚拟控制操作；所述根据所述控制信息对所述第一医学多维图像进行处理生成第二医学多维图像，包括：确定在所述控制信息指示的所述虚拟控制操作的影响下对所述目标对象进行处理的第二处理结果；根据所述第二处理结果对所述第一医学多维图像中的第一处理结果进行更新得到所述第二医学多维图像。
- 根据权利要求3所述的方法，其特征在于，所述确定在所述控制信息指示的所述虚拟控制操作的影响下对所述目标对象进行处理的第二处理结果，包括：根据所述虚拟控制操作获取调整信息，并确定所述第二处理结果，所述调整信息包括不同调整力度的虚拟控制操作、与虚拟控制操作匹配的自动处理操作，以及对应的自动处理结果；根据所述调整信息对所述第二处理结果进行多次迭代。
- 虚拟控制操作虚拟控制操作根据权利要求1所述的方法，其特征在于， 所述控制信息包括对所述医学多维图像的目标调整指令；所述检测控制操作，并根据所述控制操作生成控制信息，包括：在预设区域检测操作位置以及移动轨迹；根据所述操作位置在所述目标对象中确定待调整的目标区域的位置，并根据所述移动轨迹确定所述目标区域的调整幅度和方向；根据所述目标区域的位置以及所述目标区域的调整幅度和方向生成所述目标调整指令；所述根据所述控制信息对所述第一医学多维图像进行处理生成待显示的第二医学多维图像，包括：根据所述目标调整指令，在所述第一医学多维图像中调整所述目标对象并进行更新，得到所述第二医学多维图像。
- 根据权利要求1所述的方法，其特征在于，所述第二医学多维图像是三维图像，所述方法还包括：获取配准指令，所述配准指令用于指示对所述第二医学多维图像进行三维配准；将所述第二医学多维图像与医学三维参考图像进行三维配准得到所述目标对象的偏移量。
- 根据权利要求1所述的方法，其特征在于，所述方法还包括：获取模拟碰撞指令，所述模拟碰撞指令用于指示对所述目标对象所在的身体进行模拟碰撞；根据所述模拟碰撞指令通过所述显示设备显示所述身体的三维图像以及放疗设备的三维图像，模拟并显示所述身体进入所述放疗设备的过程。
- 根据权利要求1所述的方法，其特征在于，所述第一医学多维图像是三维图像，所述获取目标对象的第一医学多维图像，并通过显示设备显示所述第一医学多维图像，包括：获取目标对象所在身体组织的至少一个二维图像；根据所述至少一个二维图像进行三维建模，并得到所述第一医学多维图像；控制所述显示设备利用虚拟现实VR技术或增强现实AR技术显示所述第一医学多维图像。
- 根据权利要求1所述的方法，其特征在于，所述检测控制操作，并根据所述控制操作生成控制信息，包括：在预设区域检测操作位置及移动轨迹，并根据所述操作位置及所述移动轨 迹在实际坐标系中确定对应的至少一个物理坐标；根据所述至少一个物理坐标以及预先设定的坐标转换关系确定所述至少一个物理坐标在虚拟显示坐标系中对应的至少一个虚拟坐标；根据所述至少一个虚拟坐标在所述第一医学多维图像中确定操作对象及操作动作，并生成所述控制信息。
- 一种医学图像处理设备，其特征在于，包括：获取模块、检测模块和图像处理模块；其中，所述获取模块，用于获取目标对象的第一医学多维图像，并通过显示设备显示所述第一医学多维图像；所述检测模块，用于检测控制操作，并根据所述控制操作生成控制信息；所述图像处理模块，用于根据所述控制信息对所述第一医学多维图像进行处理生成待显示的第二医学多维图像；通过所述显示设备显示所述第二医学多维图像。
- 一种电子设备，其特征在于，包括处理器和存储器，所述处理器和所述存储器通信连接，所述存储其上存储有计算机程序；所述处理器用于执行所述计算机程序实现如权利要求1-9任一项所述的追踪方法。
- 一种医学图像显示系统，其特征在于，所述医学图像显示系统包括：处理设备、交互设备和显示设备，所述交互设备和所述显示设备通信连接；所述处理设备，用于获取目标对象的第一医学多维图像，并通过显示设备显示所述第一医学多维图像；所述交互设备，用于检测控制操作，并根据所述控制操作生成控制信息，将所述控制信息传输至所述处理设备；所述处理设备，用于根据所述控制信息对所述第一医学多维图像进行处理生成待显示的第二医学多维图像；通过所述显示设备显示所述第二医学多维图像。
- 根据权利要求12所述的医学图像显示系统，其特征在于，所述显示设备包括具有三维显示功能的显示器、虚拟现实设备或增强现实设备。
- 根据权利要求12所述的医学图像显示系统，其特征在于，所述交互设备包括对三维虚拟空间的感应手柄、感应手套、位置传感器或 手势交互设备。
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2020/122593 WO2022082533A1 (zh) | 2020-10-21 | 2020-10-21 | 医学图像处理方法、设备及放疗系统 |
| CN202080106385.3A CN116490884A (zh) | 2020-10-21 | 2020-10-21 | 医学图像处理方法、设备及放疗系统 |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2020/122593 WO2022082533A1 (zh) | 2020-10-21 | 2020-10-21 | 医学图像处理方法、设备及放疗系统 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2022082533A1 true WO2022082533A1 (zh) | 2022-04-28 |
Family
ID=81291392
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2020/122593 WO2022082533A1 (zh) | 2020-10-21 | 2020-10-21 | 医学图像处理方法、设备及放疗系统 |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN116490884A (zh) |
| WO (1) | WO2022082533A1 (zh) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110107270A1 (en) * | 2009-10-30 | 2011-05-05 | Bai Wang | Treatment planning in a virtual environment |
| CN102961187A (zh) * | 2012-10-26 | 2013-03-13 | 深圳市旭东数字医学影像技术有限公司 | 经皮穿刺的手术规划方法及其系统 |
| CN107452074A (zh) * | 2017-07-31 | 2017-12-08 | 上海联影医疗科技有限公司 | 一种图像处理方法及系统 |
| WO2020102665A1 (en) * | 2018-11-16 | 2020-05-22 | Lang Philipp K | Augmented reality guidance for surgical procedures with adjustment of scale, convergence and focal plane or focal point of virtual data |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10758315B2 (en) * | 2012-06-21 | 2020-09-01 | Globus Medical Inc. | Method and system for improving 2D-3D registration convergence |
| CN110163942B (zh) * | 2018-07-18 | 2023-02-14 | 腾讯科技（深圳）有限公司 | 一种图像数据处理方法和装置 |
-
2020
- 2020-10-21 CN CN202080106385.3A patent/CN116490884A/zh active Pending
- 2020-10-21 WO PCT/CN2020/122593 patent/WO2022082533A1/zh active Application Filing
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110107270A1 (en) * | 2009-10-30 | 2011-05-05 | Bai Wang | Treatment planning in a virtual environment |
| CN102961187A (zh) * | 2012-10-26 | 2013-03-13 | 深圳市旭东数字医学影像技术有限公司 | 经皮穿刺的手术规划方法及其系统 |
| CN107452074A (zh) * | 2017-07-31 | 2017-12-08 | 上海联影医疗科技有限公司 | 一种图像处理方法及系统 |
| WO2020102665A1 (en) * | 2018-11-16 | 2020-05-22 | Lang Philipp K | Augmented reality guidance for surgical procedures with adjustment of scale, convergence and focal plane or focal point of virtual data |
Also Published As
| Publication number | Publication date |
|---|---|
| CN116490884A (zh) | 2023-07-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20230072188A1 (en) | Calibration for Augmented Reality | |
| US11759261B2 (en) | Augmented reality pre-registration | |
| US10987190B2 (en) | Generation of augmented reality image of a medical device | |
| Wang et al. | Video see‐through augmented reality for oral and maxillofacial surgery | |
| de Oliveira et al. | A hand‐eye calibration method for augmented reality applied to computer‐assisted orthopedic surgery | |
| CN105611877A (zh) | 引导超声图像采集的方法和系统 | |
| WO2007084272A1 (en) | Real-time target confirmation for radiation therapy | |
| US10433725B2 (en) | System and method for capturing spatially and temporally coherent eye gaze and hand data during performance of a manual task | |
| US20160299565A1 (en) | Eye tracking for registration of a haptic device with a holograph | |
| Cai et al. | Tracking multiple surgical instruments in a near-infrared optical system | |
| US11398035B2 (en) | Partitioning a medical image | |
| WO2022082533A1 (zh) | 医学图像处理方法、设备及放疗系统 | |
| US20240054745A1 (en) | Systems and methods for registering a 3d representation of a patient with a medical device for patient alignment | |
| Ma et al. | Ultrasound calibration using intensity-based image registration: for application in cardiac catheterization procedures | |
| Cattari et al. | Wearable AR and 3D ultrasound: Towards a novel way to guide surgical dissections | |
| Yano et al. | Accuracy verification of knife tip positioning with position and orientation estimation of the actual liver for liver surgery support system | |
| EP3917430B1 (en) | Virtual trajectory planning | |
| Koeda et al. | DICOM depth image generation using GPGPU for fast position and orientation estimation on liver surgery support system | |
| CN112397189A (zh) | 一种医用导引装置及其使用方法 | |
| US20230372023A1 (en) | Methods and systems for tool tracking | |
| EP3800617B1 (en) | A computer-implemented method for registering low dimensional images with a high dimensional image, a method for training an artificial neural network useful in finding landmarks in low dimensional images, a computer program and a system for registering low dimensional images with a high dimensional image | |
| WO2024064111A1 (en) | Systems and methods of aligning a patient with a medical device leveraging outside-in tracking | |
| US20230237711A1 (en) | Augmenting a medical image with an intelligent ruler | |
| WO2022187574A1 (en) | System and method for tracking an object based on skin images |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 20958116 Country of ref document: EP Kind code of ref document: A1 |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 202080106385.3 Country of ref document: CN |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 20958116 Country of ref document: EP Kind code of ref document: A1 |