CN113689375A - Image presentation method, system, imaging system and storage medium in interventional therapy - Google Patents
Image presentation method, system, imaging system and storage medium in interventional therapy Download PDFInfo
- Publication number
- CN113689375A CN113689375A CN202010418631.0A CN202010418631A CN113689375A CN 113689375 A CN113689375 A CN 113689375A CN 202010418631 A CN202010418631 A CN 202010418631A CN 113689375 A CN113689375 A CN 113689375A
- Authority
- CN
- China
- Prior art keywords
- image
- interest
- user
- region
- processing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 39
- 238000002560 therapeutic procedure Methods 0.000 title claims abstract description 29
- 238000003384 imaging method Methods 0.000 title claims abstract description 16
- 238000012545 processing Methods 0.000 claims abstract description 71
- 238000012805 post-processing Methods 0.000 claims abstract description 58
- 238000009877 rendering Methods 0.000 claims description 23
- 238000004590 computer program Methods 0.000 claims description 13
- 230000003993 interaction Effects 0.000 claims description 12
- 238000013152 interventional procedure Methods 0.000 claims description 10
- 238000010606 normalization Methods 0.000 claims description 7
- 230000008569 process Effects 0.000 claims description 7
- 239000013077 target material Substances 0.000 description 6
- 238000010586 diagram Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 238000004891 communication Methods 0.000 description 3
- 230000009467 reduction Effects 0.000 description 3
- ZCYVEMRRCGMTRW-UHFFFAOYSA-N 7553-56-2 Chemical compound [I] ZCYVEMRRCGMTRW-UHFFFAOYSA-N 0.000 description 2
- 230000000994 depressogenic effect Effects 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 229910052740 iodine Inorganic materials 0.000 description 2
- 239000011630 iodine Substances 0.000 description 2
- 206010053648 Vascular occlusion Diseases 0.000 description 1
- 238000002583 angiography Methods 0.000 description 1
- 238000002399 angioplasty Methods 0.000 description 1
- 210000004204 blood vessel Anatomy 0.000 description 1
- 230000000747 cardiac effect Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 208000014674 injury Diseases 0.000 description 1
- 230000001788 irregular Effects 0.000 description 1
- 238000012978 minimally invasive surgical procedure Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000002673 radiosurgery Methods 0.000 description 1
- 230000011218 segmentation Effects 0.000 description 1
- 230000008733 trauma Effects 0.000 description 1
- 238000002604 ultrasonography Methods 0.000 description 1
- 238000004148 unit process Methods 0.000 description 1
- 208000021331 vascular occlusion disease Diseases 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0012—Biomedical image inspection
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/36—Image-producing devices or illumination devices not otherwise provided for
- A61B90/37—Surgical systems with images on a monitor during operation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/11—Region-based segmentation
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/36—Image-producing devices or illumination devices not otherwise provided for
- A61B90/37—Surgical systems with images on a monitor during operation
- A61B2090/376—Surgical systems with images on a monitor during operation using X-rays, e.g. fluoroscopy
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10116—X-ray image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- General Health & Medical Sciences (AREA)
- Theoretical Computer Science (AREA)
- Radiology & Medical Imaging (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Surgery (AREA)
- Life Sciences & Earth Sciences (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Medical Informatics (AREA)
- Heart & Thoracic Surgery (AREA)
- Animal Behavior & Ethology (AREA)
- Molecular Biology (AREA)
- Public Health (AREA)
- Veterinary Medicine (AREA)
- Biomedical Technology (AREA)
- Pathology (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Gynecology & Obstetrics (AREA)
- Quality & Reliability (AREA)
- Apparatus For Radiation Diagnosis (AREA)
Abstract
The embodiment of the invention provides an image presentation method and system, an imaging system and a storage medium in interventional therapy. The method comprises the following steps: acquiring an image sequence and determining a reference image selected from the image sequence; determining a region of interest in a reference image; dividing an image part corresponding to the attention area from each image in the image sequence to obtain an image sequence corresponding to the attention area and an attention area reference image from the reference image; identifying a target which is interested by a user from a reference image of the attention area; acquiring a personalized image processing algorithm aiming at the identified user interest target, processing an image sequence corresponding to the interest area, generating a post-processing image sequence, and/or generating a post-processing image; and stretching and amplifying the post-processing image or the post-processing image sequence according to the presenting size, and presenting the post-processing image or the post-processing image sequence. The technical scheme in the embodiment of the invention can improve the intelligence, flexibility and definition of image presentation.
Description
Technical Field
The invention relates to the medical field, in particular to an image presentation method and system in interventional therapy, an imaging system and a computer readable storage medium.
Background
Interventional procedures, also known as radiosurgery, are radiological image-guided minimally invasive surgical procedures that minimize risk and trauma from invasive medical techniques. Can be used for angioplasty, catheter delivery stent and the like. It is commonly treated surgically using X-ray, CT, ultrasound, MRI and other imaging modalities, using needles and catheters, rather than through incisions into the body.
Stent placement procedures, such as in cardiac interventional procedures, typically require the use of catheters and guidewires to deliver a stent to a location with a vascular occlusion under guidance of X-ray or CT images, and then to expand and release the stent. Typically, the images used to guide the interventional procedure are displayed via a real-time screen. In addition, sometimes the doctor needs to view a previous image or a sequence of images simultaneously for comparison reference. For example, when a stent is required to be placed beside a coil, it may be necessary to present an image in which the coil is placed as a reference image, and it is common to display the real-time image and the reference image or the reference image sequence separately in a split-screen manner, i.e., simultaneously display the reference image or the reference image sequence through a reference screen.
Disclosure of Invention
In view of the above, embodiments of the present invention provide an image rendering method in interventional therapy, and provide an image rendering system, an imaging system and a computer-readable storage medium in interventional therapy to improve the intelligence, flexibility and definition of image rendering.
The image presentation method in the interventional therapy provided by the embodiment of the invention comprises the following steps: after an X-ray image sequence is obtained, determining a reference image selected by a user from the image sequence; determining a region of interest in the reference image; dividing an image part corresponding to the attention region from each image in the image sequence to obtain an image sequence corresponding to the attention region, and taking the image part divided from the reference image as a reference image of the attention region; identifying a target which is interested by a user from the reference image of the attention area; the target of interest of the user is a predetermined intervention consumable, intervention equipment or human tissue target applied to interventional therapy; acquiring a personalized image processing algorithm for the identified user interest target from preset personalized image processing algorithms for various user interest targets; processing the image sequence corresponding to the attention area by using the acquired personalized image processing algorithm to generate a corresponding post-processing image sequence, and/or combining the post-processing image sequence to generate a post-processing image; and stretching and amplifying the post-processing image or the post-processing image sequence according to the presentation size, and presenting the post-processing image or the post-processing image sequence as a reference image or a reference image sequence.
In one embodiment, the determining the region of interest in the reference image comprises: determining a set region in the reference image as a region of interest; or comprises the following steps: and acquiring a region manually selected by a user in the reference image, and performing standardization processing on the acquired region according to a set standardized size to obtain a region of interest.
In one embodiment, the method further comprises: providing a service interface of one-man-machine interaction of a user, receiving configuration information of a focus area input by the user through the service interface, and obtaining the set area according to the configuration information.
In one embodiment, the identifying the user's object of interest from the region of interest image comprises: and matching the attention area image with templates of various predetermined user interest targets, and obtaining the user interest targets in the attention area image according to matching results.
In one embodiment, the obtaining of the user interest target in the region of interest image according to the matching result includes: and taking the user interest target corresponding to the template with the matching degree meeting the set requirement as a candidate user interest target in the attention area image, if the number of the obtained candidate user interest targets is 1, determining the candidate user interest target as an identified user interest target, and if the number of the obtained candidate user interest targets is more than 1, determining the target with the highest imaging requirement in the candidate user interest targets as the identified user interest target.
In one embodiment, the method further comprises: and if the target which is interested by the user is not identified from the attention area image, processing the image sequence corresponding to the attention area by utilizing a preset general image processing algorithm.
In one embodiment, the method further comprises: and receiving the adjustment of the attention area by the user, standardizing the adjusted attention area according to a set standardized size to obtain an updated attention area, and returning to execute the operation of segmenting the image part corresponding to the attention area from each image in the image sequence.
The image presentation system in interventional therapy provided in the embodiment of the present invention includes: the device comprises a first determining unit, a second determining unit and a third determining unit, wherein the first determining unit is used for acquiring an X-ray image sequence and determining a reference image selected by a user from the image sequence; a second determination unit configured to determine a region of interest in the reference image; a dividing unit, configured to divide an image portion corresponding to the region of interest from each image in the image sequence to obtain an image sequence corresponding to the region of interest, and use the image portion divided from the reference image as a reference image of the region of interest; the identification unit is used for identifying a target which is interested by a user from the reference image of the attention area; the target of interest of the user is a predetermined intervention consumable, intervention equipment or human tissue target applied to interventional therapy; the acquisition unit is used for acquiring the personalized image processing algorithm aiming at the identified user interest target from the preset personalized image processing algorithms aiming at various user interest targets; the processing unit is used for processing the image sequence corresponding to the attention area by using the acquired personalized image processing algorithm to generate a corresponding post-processing image sequence and/or combining the post-processing image sequence to generate a post-processing image; and the stretching presenting unit is used for stretching and amplifying the post-processing image or the post-processing image sequence according to the presenting size and presenting the post-processing image or the post-processing image sequence as a reference image or a reference image sequence.
In one embodiment, the second determination unit determines a set region in the reference image as a region of interest; alternatively, a region manually selected by the user in the reference image is acquired, and the acquired region is normalized according to a set normalization size to obtain a region of interest.
In one embodiment, further comprising: the human-computer interaction unit is used for providing a human-computer interaction service interface for a user and receiving the configuration information of the concerned area input by the user through the service interface; the second determining unit obtains the setting area according to the configuration information.
In one embodiment, the identification unit matches the attention area image with templates of various types of user interest targets determined in advance, and obtains the user interest target in the attention area image according to a matching result.
In one embodiment, the identification unit takes the user interest target corresponding to the template whose matching degree meets the set requirement as the candidate user interest target in the attention area image, determines the candidate user interest target as the identified user interest target if the number of the obtained candidate user interest targets is 1, and determines the target with the highest imaging requirement in the candidate user interest targets as the identified user interest target if the number of the obtained candidate user interest targets is greater than 1.
In one embodiment, if the identification unit does not identify the target of interest to the user from the attention area image, the acquisition unit acquires a preset general image processing algorithm and provides the preset general image processing algorithm to the processing unit, and the processing unit processes the image sequence corresponding to the attention area by using the general image processing algorithm.
In one embodiment, the second determining unit receives an adjustment of the attention area by the user, and performs a normalization process on the adjusted attention area according to a set normalization size to obtain an updated attention area.
An image presenting system in interventional therapy provided in an embodiment of the present invention includes: at least one memory and at least one processor, wherein: the at least one memory is for storing a computer program; the at least one processor is configured to invoke a computer program stored in the at least one memory to perform the method for image rendering in interventional procedures as described in any of the above embodiments.
An imaging system proposed in an embodiment of the present invention is characterized by comprising an X-ray device and an in-interventional-treatment image rendering system as described in any one of the above embodiments.
A computer-readable storage medium provided in an embodiment of the present invention, on which a computer program is stored; the computer program can be executed by a processor and implements the method for image presentation in interventional procedures as described in any of the embodiments above.
It can be seen from the above solutions that, in the embodiment of the present invention, an image portion corresponding to a user attention region is segmented from an X-ray image sequence, the segmented image sequence is subjected to image processing based on a user interest target in the attention region, and a processed post-processing image sequence or a post-processing image synthesized by the post-processing image sequence is subjected to stretch display, so that the user attention region can be highlighted, the definition of an image in the user attention region is ensured, and the intelligence and flexibility of image presentation can be improved.
Drawings
The foregoing and other features and advantages of the invention will become more apparent to those skilled in the art to which the invention relates upon consideration of the following detailed description of a preferred embodiment of the invention with reference to the accompanying drawings, in which:
fig. 1 is an exemplary flowchart of an image presenting method in interventional therapy in an embodiment of the present invention.
Fig. 2 is an exemplary block diagram of an image rendering system in an interventional procedure in accordance with an embodiment of the present invention.
Fig. 3 is an exemplary block diagram of an image rendering system in accordance with yet another embodiment of the present invention.
Wherein the reference numbers are as follows:
Detailed Description
In the embodiment of the present invention, it is considered that when presenting a reference image or a reference image sequence, a user may be more interested in a certain partial region, that is, an attention region, but in the current image presentation technology, the whole reference image or the whole reference image sequence is taken into consideration as a whole, for example, a set of unified image processing algorithms is used to perform processing such as noise reduction, sharpness, contrast, integrity and the like on the reference image. It does not identify which areas are of interest to the user, and therefore does not guarantee the sharpness of the image of the areas of interest to the user, nor does it highlight the areas of interest to the user. Therefore, in the embodiment of the present invention, it is considered to acquire the attention area of the user, segment the image portion corresponding to the attention area of the user for each image in the same sequence, and perform image post-processing, merging, and stretch display on the segmented image sequence.
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is further described in detail by referring to the following examples.
Fig. 1 is an exemplary flowchart of a reference image presenting method in interventional therapy according to an embodiment of the present invention. As shown in fig. 1, the method may include the steps of:
Wherein one image sequence comprises all images acquired during a set exposure period. For example, taking an X-ray device as an example, one image sequence includes all images acquired by the X-ray device from the time when the exposure foot-gate switch is depressed or the hand-gate switch is depressed (exposure start) until the exposure foot-gate switch is released or the hand-gate switch is released (exposure end).
Typically, more than one target object may be included in an image, such as a guidewire, catheter, stent, etc., may be included in a single image. There is therefore a need to determine the region of interest in order to more accurately determine the target of interest to the user.
Specifically, the region of interest may be automatically selected by the system, for example, a fixed region, such as a region in the middle of the image, may be set in the image, and then the set region in the reference image may be determined as the region of interest. In the embodiment of the present invention, the set region may be a default initial region, or may be set by a user before or during the examination or treatment. For example, the method may further comprise: providing a service interface of one-man-machine interaction of a user, receiving configuration information of a focus area input by the user through the service interface, and obtaining the set area according to the configuration information.
Alternatively, the region of interest may be manually selected by the user from the reference image and then the region manually selected by the user may be acquired, and therefore, in consideration of the possibility that the region manually selected by the user may be irregular, a standardized size may be determined in advance for the convenience of subsequent image processing, and then the acquired region may be standardized to the set standardized size to obtain the region of interest. In a specific implementation, more than one standardized size may be set, for example, three standardized sizes, i.e., a large standardized size, a medium standardized size, and a small standardized size, and the region of interest is obtained by performing the standardization process according to the closest standardized size according to the size of the region manually selected by the user.
In this step, an image portion corresponding to the region of interest is extracted from each image in the image sequence for subsequent processing, and an object of interest of the user is identified based on the image portion extracted from the reference image.
In this step, during specific implementation, there may be multiple implementation manners, for example, a template of each user interest target may be predetermined, such as a template of a guide wire type intervention consumable, a template of a catheter type intervention consumable, a template of a stent type intervention device, a template of a spring coil type intervention device, a template of an iodine oil type intervention consumable, and the like, then the reference image of the interest region is matched with the predetermined template of each user interest target, and then the user interest target in the reference image of the interest region is obtained according to a matching result, for example, the user interest target corresponding to the template whose matching degree meets a set requirement is used as a candidate user interest target in the reference image of the interest region.
If the number of the obtained candidate user interest targets is 1, the candidate user interest targets are directly determined as the identified user interest targets, and if the number of the obtained candidate user interest targets is greater than 1, the candidate user interest target with the highest imaging requirement (for example, in X-ray imaging, the image signal-to-noise ratio is relatively worst) among the candidate user interest targets can be determined as the identified user interest target.
In addition, in consideration of the possibility of a failure in recognition of the user interest target, that is, the matching degree between the reference image of the attention area and all the templates fails to meet the setting requirement, in this embodiment, a default target material, such as a guide wire, may be preset, and in this step, if the user interest target fails to be recognized, the preset default target material may be used as the recognized user interest target. Or, in this embodiment, a default target material may not be set, and in this step, if the target identification interested by the user fails, a message indicating that the identification fails may be returned.
And 105, acquiring a personalized image processing algorithm aiming at the identified user interest target from the preset personalized image processing algorithms aiming at the user interest targets.
In this embodiment, it is considered that the image processing emphasis points of the objects of interest of different users may be different, for example, the guide wire may adopt a somewhat simpler personalized image processing algorithm, such as edge sharpening and contrast enhancement. The iodine oil needs to have a layering effect, and needs to perform some rendering effects. Therefore, in the embodiment, different image processing can be preset for various targets of interest of different users, and corresponding personalized image processing algorithms can be preset. Correspondingly, in the step, only the personalized image processing algorithm aiming at the identified user interest target needs to be obtained.
And 106, processing the image sequence corresponding to the attention area by using the acquired personalized image processing algorithm to generate a corresponding post-processing image sequence, and/or combining the post-processing image sequences to generate a post-processing image.
In this step, an image sequence corresponding to the attention area is processed by using a personalized image processing algorithm for the user interest target identified from the attention area reference image.
And 107, stretching and amplifying the post-processing image or the post-processing image sequence according to the presentation size, and presenting the post-processing image or the post-processing image sequence as a reference image or a reference image sequence.
In the step, the post-processing image or the post-processing image sequence can be stretched and amplified according to the proportion until the reference screen is filled as much as possible, and a specific stretching and amplifying algorithm can be set according to actual conditions. It is not limited herein. Wherein, the reference screen refers to a screen/display or a part of area in the screen/display for displaying the reference image.
Therefore, the processing such as noise reduction, sharpness, contrast, integrity and the like can be performed on the attention area of the user in a targeted manner, and the presentation definition of the user interest target in the attention area of the user is ensured.
In addition, in consideration of the possibility of a failure in identifying the target of interest of the user, that is, the matching degree between the image of the region of interest and all the templates fails to meet the set requirement, in this embodiment, a default target material, such as a guide wire, may be preset, and in this step, if the identification of the target of interest of the user fails, the preset default target material may be used as the identified target of interest of the user. Alternatively, in this embodiment, a default target material may not be set, and in step 104, if the target of interest of the user fails to be identified, a message indicating that the identification fails may be returned. Accordingly, in this embodiment, a general image processing algorithm may be preset, and when a message indicating that the identification fails is returned in step 104, the image sequence corresponding to the attention area is processed by using the general image processing algorithm. The general image processing algorithm may include some processes such as noise reduction, edge sharpening, and contrast enhancement.
Since the reference image is a selected image from the previous image sequence, the information integrity or definition is poor. Therefore, the personalized image processing on the reference image is the image post-processing for the segmented image sequence, and the corresponding personalized image processing algorithm can be a more complex image processing algorithm which takes the improvement of integrity, definition and the like as the principles.
The image presenting method in the interventional therapy in the embodiment of the present invention is described in detail above, and the image presenting system in the interventional therapy in the embodiment of the present invention is described in detail below. The image presenting system in interventional therapy in the embodiment of the present invention can be used for implementing the image presenting method in interventional therapy in the embodiment of the present invention, and details which are not disclosed in detail in the embodiment of the system of the present invention can be referred to in the corresponding description in the embodiment of the method of the present invention, and are not described herein again.
Fig. 2 is an exemplary block diagram of an image rendering system in interventional therapy in accordance with an embodiment of the present invention. As shown in fig. 2, the system may include: a first determination unit 201, a second determination unit 202, a segmentation unit 203, a recognition unit 204, an acquisition unit 205, a processing unit 206, and a stretch presentation unit 207.
The first determining unit 201 is configured to acquire an X-ray image sequence and determine a reference image selected by a user from the image sequence.
The second determination unit 202 is configured to determine a region of interest in the reference image.
The segmenting unit 203 is configured to segment an image portion corresponding to the region of interest from each image in the image sequence to obtain an image sequence corresponding to the region of interest, and use the image portion segmented from the reference image as a reference image of the region of interest.
The identifying unit 204 is configured to identify an object of interest to the user from the reference image of the region of interest; the target of interest of the user is a predetermined intervention consumable, intervention equipment and a human tissue target applied to interventional therapy.
The obtaining unit 205 is configured to obtain a personalized image processing algorithm for the identified user interest target from the preset personalized image processing algorithms for various user interest targets.
The processing unit 206 is configured to process the image sequence corresponding to the attention area by using the acquired personalized image processing algorithm to generate a corresponding post-processing image sequence, and/or combine the post-processing image sequences to generate a post-processing image.
The stretching presentation unit 207 is configured to stretch and enlarge the post-processing image or the post-processing image sequence according to a presentation size, and then present the post-processing image or the post-processing image sequence as a reference image or a reference image sequence.
In one embodiment, the second determining unit 202 determines a set region in the reference image as a region of interest; alternatively, a region manually selected by the user in the reference image is acquired, and the acquired region is normalized according to a set normalization size to obtain a region of interest.
In one embodiment, the system may further comprise: and the human-computer interaction unit 208 is used for providing a service interface for human-computer interaction of the user and receiving the configuration information of the attention area input by the user through the service interface. Accordingly, the second determining unit 202 obtains the setting area according to the configuration information. In addition, the human-computer interaction unit 208 may also provide other human-computer interaction functions.
In one embodiment, the identifying unit 204 matches the attention area image with templates of various types of user interest objects determined in advance, and obtains the user interest object in the attention area image according to a matching result.
In an embodiment, the identifying unit 204 takes the user interest target corresponding to the template whose matching degree meets the setting requirement as the candidate user interest target in the attention area image, determines the candidate user interest target as the identified user interest target if the number of the obtained candidate user interest targets is 1, and determines the target with the highest imaging requirement among the candidate user interest targets as the identified user interest target if the number of the obtained candidate user interest targets is greater than 1.
In one embodiment, if the recognition unit 204 does not recognize the target of interest of the user from the attention area image, the obtaining unit 205 may obtain a preset general image processing algorithm to provide to the processing unit 206. Accordingly, the processing unit 206 processes the image sequence corresponding to the region of interest using the general image processing algorithm.
In one embodiment, second determining section 202 receives an adjustment of the region of interest by the user, and performs normalization processing on the adjusted region of interest according to a set normalization size to obtain an updated region of interest.
Fig. 3 is a schematic structural diagram of an image rendering system in interventional therapy according to another embodiment of the present invention, as shown in fig. 3, the system may include: at least one memory 31, at least one processor 32, at least one database 33, and at least one display 34. In addition, some other components may be included, such as a communications port, etc. These components communicate via a bus 35.
Wherein the at least one memory 31 is adapted to store a computer program. In one embodiment, the computer program may be understood to comprise the various modules of the in-intervention image rendering system shown in fig. 2. In addition, the at least one memory 31 may also store an operating system and the like. Operating systems include, but are not limited to: an Android operating system, a Symbian operating system, a Windows operating system, a Linux operating system, and the like.
At least one database 33 is used to store individual personalized image processing algorithms, general purpose image processing algorithms, and the like.
At least one display 34 is used to display the post-processed image or sequence of post-processed images, as well as human-computer interaction information and the like.
The at least one processor 32 is configured to invoke the computer program stored in the at least one memory 31 to perform the method for image rendering in interventional procedures described in the embodiments of the present invention. The processor 32 may be a CPU, processing unit/module, ASIC, logic module, or programmable gate array, etc. Which can receive and transmit data through the communication port.
In an embodiment of the present invention, an imaging system is further provided, which includes an X-ray apparatus such as a medical angiography X-ray machine and the image rendering system in the interventional therapy in any one of the above embodiments.
It should be noted that not all steps and modules in the above flows and structures are necessary, and some steps or modules may be omitted according to actual needs. The execution order of the steps is not fixed and can be adjusted as required. The division of each module is only for convenience of describing adopted functional division, and in actual implementation, one module may be divided into multiple modules, and the functions of multiple modules may also be implemented by the same module, and these modules may be located in the same device or in different devices.
It is understood that the hardware modules in the above embodiments may be implemented mechanically or electronically. For example, a hardware module may include a specially designed permanent circuit or logic device (e.g., a special purpose processor such as an FPGA or ASIC) for performing specific operations. A hardware module may also include programmable logic devices or circuits (e.g., including a general-purpose processor or other programmable processor) that are temporarily configured by software to perform certain operations. The implementation of the hardware module in a mechanical manner, or in a dedicated permanent circuit, or in a temporarily configured circuit (e.g., configured by software), may be determined based on cost and time considerations.
Furthermore, a computer-readable storage medium is provided in an embodiment of the present invention, and a computer program is stored thereon, where the computer program can be executed by a processor and implements the image rendering method in interventional therapy described in the embodiment of the present invention. Specifically, a system or an apparatus equipped with a storage medium on which a software program code that realizes the functions of any of the embodiments described above is stored may be provided, and a computer (or a CPU or MPU) of the system or the apparatus is caused to read out and execute the program code stored in the storage medium. Further, part or all of the actual operations may be performed by an operating system or the like operating on the computer by instructions based on the program code. The functions of any of the above-described embodiments may also be implemented by writing the program code read out from the storage medium to a memory provided in an expansion board inserted into the computer or to a memory provided in an expansion unit connected to the computer, and then causing a CPU or the like mounted on the expansion board or the expansion unit to perform part or all of the actual operations based on the instructions of the program code. Examples of the storage medium for supplying the program code include floppy disks, hard disks, magneto-optical disks, optical disks (e.g., CD-ROMs, CD-R, CD-RWs, DVD-ROMs, DVD-RAMs, DVD-RWs, DVD + RWs), magnetic tapes, nonvolatile memory cards, and ROMs. Alternatively, the program code may be downloaded from a server computer via a communications network.
It can be seen from the above solutions that, in the embodiment of the present invention, an image portion corresponding to a user attention region is segmented from an X-ray image sequence, the segmented image sequence is subjected to image processing based on a user interest target in the attention region, and a processed post-processing image sequence or a post-processing image synthesized by the post-processing image sequence is subjected to stretch display, so that the user attention region can be highlighted, the definition of an image in the user attention region is ensured, and the intelligence and flexibility of image presentation can be improved.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents, improvements and the like that fall within the spirit and principle of the present invention are intended to be included therein.
Claims (17)
1. An image rendering method in interventional therapy, comprising:
after an X-ray image sequence is acquired, determining a reference image (101) selected by a user from the image sequence;
determining a region of interest (102) in the reference image;
dividing an image part corresponding to the attention area from each image in the image sequence to obtain an image sequence corresponding to the attention area, and taking the image part divided from the reference image as an attention area reference image (103);
identifying a user interest object (104) from the reference image of the region of interest; the target of interest of the user is a predetermined intervention consumable, intervention equipment or human tissue target applied to interventional therapy;
acquiring a personalized image processing algorithm (105) aiming at the identified user interest target from preset personalized image processing algorithms aiming at various user interest targets;
processing the image sequence corresponding to the attention area by using the acquired personalized image processing algorithm to generate a corresponding post-processing image sequence, and/or combining the post-processing image sequence to generate a post-processing image (106);
and stretching and amplifying the post-processing image or the post-processing image sequence according to the presenting size, and presenting the post-processing image or the post-processing image sequence as a reference image or a reference image sequence (107).
2. The method of in-intervention image rendering as set forth in claim 1, wherein the determining a region of interest (102) in the reference image comprises:
determining a set region in the reference image as a region of interest; or comprises the following steps:
and acquiring a region manually selected by a user in the reference image, and performing standardization processing on the acquired region according to a set standardized size to obtain a region of interest.
3. The method of claim 2, further comprising: providing a service interface of one-man-machine interaction of a user, receiving configuration information of a focus area input by the user through the service interface, and obtaining the set area according to the configuration information.
4. The method of in-intervention image rendering as set forth in claim 1, wherein the identifying a user object of interest (104) from the region-of-interest image includes:
and matching the attention area image with templates of various predetermined user interest targets, and obtaining the user interest targets in the attention area image according to matching results.
5. The method of image rendering in interventional therapy according to claim 4, wherein the deriving the user interest object in the region of interest image according to the matching result comprises: and taking the user interest target corresponding to the template with the matching degree meeting the set requirement as a candidate user interest target in the attention area image, if the number of the obtained candidate user interest targets is 1, determining the candidate user interest target as an identified user interest target, and if the number of the obtained candidate user interest targets is more than 1, determining the target with the highest imaging requirement in the candidate user interest targets as the identified user interest target.
6. The method of claim 1, further comprising: and if the target which is interested by the user is not identified from the attention area image, processing the image sequence corresponding to the attention area by utilizing a preset general image processing algorithm.
7. The method of claim 1, further comprising:
and receiving the adjustment of the attention area by the user, standardizing the adjusted attention area according to a set standardized size to obtain an updated attention area, and returning to execute the operation of segmenting the image part corresponding to the attention area from each image in the image sequence.
8. An image rendering system in interventional procedures, comprising:
a first determination unit (201) for acquiring an X-ray image sequence and determining a reference image selected by a user from the image sequence;
a second determination unit (202) for determining a region of interest in the reference image;
a dividing unit (203) for dividing an image portion corresponding to the region of interest from each image in the image sequence to obtain an image sequence corresponding to the region of interest, and using the image portion divided from the reference image as a reference image of the region of interest;
an identification unit (204) for identifying an object of interest of a user from the reference image of the region of interest; the target of interest of the user is a predetermined intervention consumable, intervention equipment or human tissue target applied to interventional therapy;
an acquisition unit (205) for acquiring a personalized image processing algorithm for the identified user interest target from preset personalized image processing algorithms for various user interest targets;
a processing unit (206) configured to process the image sequence corresponding to the region of interest by using the acquired personalized image processing algorithm to generate a corresponding post-processing image sequence, and/or combine the post-processing image sequences to generate a post-processing image;
and the stretching presenting unit (207) is used for stretching and amplifying the post-processing image or the post-processing image sequence according to the presenting size and presenting the post-processing image or the post-processing image sequence as a reference image or a reference image sequence.
9. The in-intervention image presentation system as set forth in claim 8, wherein the second determination unit (202) determines a set region in the reference image as a region of interest; alternatively, a region manually selected by the user in the reference image is acquired, and the acquired region is normalized according to a set normalization size to obtain a region of interest.
10. The in-intervention image rendering system of claim 9, further comprising: the human-computer interaction unit (208) is used for providing a service interface for human-computer interaction of a user and receiving the configuration information of the attention area input by the user through the service interface; the second determining unit obtains the setting area according to the configuration information.
11. The system for image presentation during interventional therapy as set forth in claim 8, characterized in that the recognition unit (204) matches the region of interest image with pre-determined templates of various types of user objects of interest, and obtains the user objects of interest in the region of interest image according to the matching result.
12. The system for image presentation in interventional therapy as defined in claim 11, wherein the identifying unit (204) takes the user interest objects corresponding to the templates whose matching degree meets the set requirement as the candidate user interest objects in the attention area image, determines the candidate user interest objects as the identified user interest objects if the number of the obtained candidate user interest objects is 1, and determines the object with the highest imaging requirement among the candidate user interest objects as the identified user interest objects if the number of the obtained candidate user interest objects is greater than 1.
13. The system of claim 8, wherein if the recognition unit (204) does not recognize the target of interest of the user from the image of the region of interest, the obtaining unit (205) obtains a preset general image processing algorithm and provides the preset general image processing algorithm to the processing unit, and the processing unit (206) processes the image sequence corresponding to the region of interest by using the general image processing algorithm.
14. The system for image presentation during interventional therapy according to claim 8, characterized in that the second determination unit (202) receives an adjustment of the region of interest by the user, and normalizes the adjusted region of interest according to a set normalized size to obtain an updated region of interest.
15. An image rendering system in interventional procedures, comprising: at least one memory (31) and at least one processor (32), wherein:
the at least one memory (31) is for storing a computer program;
the at least one processor (32) is configured to invoke a computer program stored in the at least one memory (31) to perform the in-intervention image rendering method according to any of claims 1 to 7.
16. An imaging system comprising an X-ray device and an in-intervention image rendering system as claimed in any one of claims 8 to 15.
17. A computer-readable storage medium having stored thereon a computer program; characterized in that the computer program is executable by a processor and implements the method of image presentation in an interventional procedure according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010418631.0A CN113689375A (en) | 2020-05-18 | 2020-05-18 | Image presentation method, system, imaging system and storage medium in interventional therapy |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010418631.0A CN113689375A (en) | 2020-05-18 | 2020-05-18 | Image presentation method, system, imaging system and storage medium in interventional therapy |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113689375A true CN113689375A (en) | 2021-11-23 |
Family
ID=78575444
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010418631.0A Pending CN113689375A (en) | 2020-05-18 | 2020-05-18 | Image presentation method, system, imaging system and storage medium in interventional therapy |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113689375A (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20160232703A1 (en) * | 2014-07-11 | 2016-08-11 | Shanghai United Imaging Healthcare Co., Ltd. | System and method for image processing |
| US20160317245A1 (en) * | 2013-12-24 | 2016-11-03 | General Electric Company | Method for medical image processing |
| CN106796344A (en) * | 2014-10-07 | 2017-05-31 | 艾尔比特系统有限公司 | The wear-type of the enlarged drawing being locked on object of interest shows |
| CN107077731A (en) * | 2014-10-22 | 2017-08-18 | 皇家飞利浦有限公司 | The probabilistic visualization of imaging |
| CN109472835A (en) * | 2017-09-07 | 2019-03-15 | 西门子保健有限责任公司 | Handle the method for medical image and the image processing system of medical image |
| CN109509197A (en) * | 2018-09-26 | 2019-03-22 | 沈阳东软医疗系统有限公司 | A kind of method, apparatus, equipment and storage medium for dividing area-of-interest |
| CN109559801A (en) * | 2017-09-26 | 2019-04-02 | 西门子保健有限责任公司 | The intelligent editing of processing result image |
| US20200134825A1 (en) * | 2018-10-29 | 2020-04-30 | Hitachi, Ltd. | Medical imaging apparatus, image processing apparatus, and image processing method |
-
2020
- 2020-05-18 CN CN202010418631.0A patent/CN113689375A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20160317245A1 (en) * | 2013-12-24 | 2016-11-03 | General Electric Company | Method for medical image processing |
| US20160232703A1 (en) * | 2014-07-11 | 2016-08-11 | Shanghai United Imaging Healthcare Co., Ltd. | System and method for image processing |
| CN106796344A (en) * | 2014-10-07 | 2017-05-31 | 艾尔比特系统有限公司 | The wear-type of the enlarged drawing being locked on object of interest shows |
| CN107077731A (en) * | 2014-10-22 | 2017-08-18 | 皇家飞利浦有限公司 | The probabilistic visualization of imaging |
| CN109472835A (en) * | 2017-09-07 | 2019-03-15 | 西门子保健有限责任公司 | Handle the method for medical image and the image processing system of medical image |
| CN109559801A (en) * | 2017-09-26 | 2019-04-02 | 西门子保健有限责任公司 | The intelligent editing of processing result image |
| CN109509197A (en) * | 2018-09-26 | 2019-03-22 | 沈阳东软医疗系统有限公司 | A kind of method, apparatus, equipment and storage medium for dividing area-of-interest |
| US20200134825A1 (en) * | 2018-10-29 | 2020-04-30 | Hitachi, Ltd. | Medical imaging apparatus, image processing apparatus, and image processing method |
Non-Patent Citations (2)
| Title |
|---|
| RUEDIGER E.SCHERNTHANER 等: "Characteristics of a New X-Ray Imaging System for Interventional Procedures:Improved Image Quality and Reduced Radiation Dose", 《CARDIOVASCULAR AND INTERVENTIONAL RADIOLOGY》, vol. 41, 31 October 2017 (2017-10-31), pages 502 - 508, XP036416286, DOI: 10.1007/s00270-017-1821-z * |
| 朱翔宇;葛中芹;张冰清;黄晓林;陈颖;金建华;蔡晶;储开岳;葛云;曹悦;陈韵霞;: "基于图像处理的医学影像处理平台系统设计", 《中国医学物理学杂志》, vol. 34, no. 04, 25 April 2017 (2017-04-25), pages 70 - 74 * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP2823463B1 (en) | Method and system to assist 2d-3d image registration | |
| US9619879B2 (en) | Apparatus and method for detecting lesion and lesion diagnosis apparatus | |
| CN107809955B (en) | Real-time collimation and ROI-filter localization in X-ray imaging via automatic detection of landmarks of interest | |
| CN107787203B (en) | Image registration | |
| CN110123453B (en) | Operation navigation system based on unmarked augmented reality | |
| WO2016064921A1 (en) | Automatic detection of regions of interest in 3d space | |
| CN108430376B (en) | Providing a projection data set | |
| US20220172366A1 (en) | Medical support device, operation method of medical support device, non-transitory computer readable medium, and medical support system | |
| JP4915836B2 (en) | Method, program, and apparatus for operating image processing apparatus | |
| US20210174523A1 (en) | Method for registration of image data and for provision of corresponding trained facilities, apparatus for doing so and corresponding computer program product | |
| US9872655B2 (en) | PAE treatment for BPH | |
| US11534623B2 (en) | Determining at least one final two-dimensional image for visualizing an object of interest in a three dimensional ultrasound volume | |
| CN113679400A (en) | Image presentation method, system, imaging system and storage medium in interventional therapy | |
| WO2011065414A1 (en) | Image processing method, image processing apparatus and program | |
| US10453184B2 (en) | Image processing apparatus and X-ray diagnosis apparatus | |
| CN113689375A (en) | Image presentation method, system, imaging system and storage medium in interventional therapy | |
| US20090198124A1 (en) | Workflow to enhance a transjugular intrahepatic portosystemic shunt procedure | |
| CN113679401A (en) | Imaging control method and system, imaging system and storage medium | |
| US20230138666A1 (en) | Intraoperative 2d/3d imaging platform | |
| JP7261576B2 (en) | Medical image processing device, X-ray diagnostic device and medical image processing program | |
| US11257251B2 (en) | Methods and devices for guiding a patient | |
| CN116012286B (en) | Surgical risk area determination method, device, electronic equipment and readable storage medium | |
| EP3933765A1 (en) | Stenosis localization | |
| EP2824636B1 (en) | Method and corresponding system for automatically classifying at least one angiographic video recording of a part of a region comprising a human heart | |
| JP2018175847A (en) | Medical image processing device, control method thereof, and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |