CN113506262A - Image processing method, image processing device, related equipment and storage medium - Google Patents

Image processing method, image processing device, related equipment and storage medium Download PDF

Info

Publication number
CN113506262A
CN113506262A CN202110768694.3A CN202110768694A CN113506262A CN 113506262 A CN113506262 A CN 113506262A CN 202110768694 A CN202110768694 A CN 202110768694A CN 113506262 A CN113506262 A CN 113506262A
Authority
CN
China
Prior art keywords
image
blood vessel
information
lesion
curved surface
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
CN202110768694.3A
Other languages
Chinese (zh)
Inventor
宋涛
徐韵成
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Sensetime Intelligent Technology Co Ltd
Original Assignee
Shanghai Sensetime Intelligent Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Sensetime Intelligent Technology Co Ltd filed Critical Shanghai Sensetime Intelligent Technology Co Ltd
Priority to CN202110768694.3A priority Critical patent/CN113506262A/en
Publication of CN113506262A publication Critical patent/CN113506262A/en
Withdrawn legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • G06T7/0012Biomedical image inspection
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/60Analysis of geometric attributes
    • G06T7/68Analysis of geometric attributes of symmetry
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H30/00ICT specially adapted for the handling or processing of medical images
    • G16H30/40ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20081Training; Learning
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20084Artificial neural networks [ANN]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30004Biomedical image processing
    • G06T2207/30101Blood vessel; Artery; Vein; Vascular

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Radiology & Medical Imaging (AREA)
  • Medical Informatics (AREA)
  • General Health & Medical Sciences (AREA)
  • Quality & Reliability (AREA)
  • Geometry (AREA)
  • Epidemiology (AREA)
  • Primary Health Care (AREA)
  • Public Health (AREA)
  • Magnetic Resonance Imaging Apparatus (AREA)
  • Apparatus For Radiation Diagnosis (AREA)

Abstract

The application discloses an image processing method, an image processing device, related equipment and a storage medium, wherein the method comprises the following steps: acquiring information about at least one focus of a blood vessel in a medical scanning image, wherein the information about the at least one focus is detected based on the medical scanning image; information is suggested of at least one lesion in the medical scan image, wherein the at least one lesion includes an aneurysm. Through the mode, the system and the method can realize the prompt of the focus of the blood vessel such as the aneurysm, so that the system and the method can assist a user in diagnosing the focus of the blood vessel, and the diagnosis efficiency and accuracy are improved.

Description

Image processing method, image processing device, related equipment and storage medium
Technical Field
The present application relates to the field of medical image processing technologies, and in particular, to an image processing method and apparatus, and related devices and storage media.
Background
In the field of medical technology, it is often necessary to identify a lesion from a medical image and then perform a subsequent medical treatment on a patient based on the identified lesion. The prior art method for determining the focus of blood vessels (such as aneurysm) is usually determined manually, i.e. the focus in medical images needs to be determined by a doctor through naked eyes. However, in some cases, a doctor needs to screen a large amount of medical images, and the workload of the doctor is greater, so that the manual determination method is time-consuming and labor-consuming, the efficiency is low, the manual screening subjectivity is strong, and missed diagnosis and misdiagnosis are easily caused by fatigue.
Disclosure of Invention
The application provides an image processing method and device, and related equipment and storage medium thereof.
In order to solve the technical problem, the application adopts a technical scheme that: there is provided an image processing method including: acquiring information about at least one focus of a blood vessel in a medical scanning image, wherein the information about the at least one focus is detected based on the medical scanning image; information is suggested of at least one lesion in the medical scan image, wherein the at least one lesion includes an aneurysm.
By automatically acquiring and prompting the focus information of the blood vessel, the intelligent determination and prompting of the blood vessel focus such as aneurysm can be realized, and compared with a mode that a user directly judges whether the focus exists in the blood vessel based on a medical scanning image through naked eyes, the speed and the accuracy of determining the focus are improved, and misdiagnosis or missed diagnosis is avoided; and after the information about at least one focus of the blood vessel in the medical scanning image is acquired, the information about the at least one focus in the medical scanning image is prompted to the user, that is, the user is informed of the relevant information about the at least one focus, and the relevant information about the focus can help the user to evaluate the risk of the focus, so that the diagnosis of the user on the focus is assisted, and the diagnosis efficiency and accuracy of the user are improved.
Wherein the at least one lesion further comprises a plaque of a blood vessel; the information of the lesion includes at least one of: the type of the focus, the name of a blood vessel where the focus is located, the position of the focus in the blood vessel and morphological parameters of the focus, wherein the morphological parameters comprise at least one of the following parameters: major diameter, minor diameter, volume, cross-sectional area, and shape.
Therefore, the intelligent determination and prompting of the vascular plaque can be realized, and the intelligent prompting of various focuses of the blood vessel can be realized. In addition, the information of the focus is diversified, so that under the condition that the prompted information of the focus is diversified, abundant diagnosis information can be provided for a user, and the user is assisted to make a related treatment scheme in time.
Wherein the information of the plaque further comprises the degree of stenosis caused by the plaque to the blood vessel.
Therefore, intelligent determination and prompting of the stenosis degree of the blood vessel can be realized.
Wherein, the information for prompting at least one focus in the medical scanning image comprises: displaying the medical scanning image and first auxiliary information in response to a first display operation of a user, wherein the first auxiliary information comprises information of the aneurysm; and/or, in the case that the at least one lesion further includes a plaque of the blood vessel, displaying a reconstructed image and second auxiliary information in response to a second display operation of the user, wherein the second auxiliary information includes information of the plaque, and the reconstructed image includes at least one of: a curved surface reconstruction image and a blood vessel straightening image of the curved surface reconstruction image.
Therefore, the information of at least one focus in the medical scanning image is prompted in a display mode, and the medical image corresponding to the focus type and the information of the focus can be displayed specifically according to the type of the focus, so that the display content on the display interface is clear and intuitive, and the display content is prevented from being mixed and masoned.
Before displaying the curved surface reconstruction image, the image processing method further comprises the following steps: displaying a blood vessel three-dimensional image corresponding to the medical scanning image, and displaying a central line of the blood vessel in the blood vessel three-dimensional image; determining position information of the adjusted central line in the blood vessel in response to the adjustment operation of the central line by the user; acquiring a curved surface reconstruction image generated based on the adjusted position information of the central line; and/or after the curved surface reconstruction image is displayed, the image processing method further comprises the following steps: responding to the preset operation of a user on the curved surface reconstruction image, determining a display angle matched with the preset operation, and displaying the curved surface reconstruction image matched with the display angle again; and responding to a third display operation of the user, and displaying the straightening graph and the second auxiliary information corresponding to the curved surface reconstruction image.
Therefore, since the information of the plaque is obtained based on the curved surface reconstructed image after the medical scanning image processing, steps such as blood vessel segmentation and centerline extraction are required to construct the curved surface reconstructed image before the curved surface reconstructed image is displayed; in addition, in order to make the displayed curved surface reconstructed image more favorable for the diagnosis of the focus, the curved surface reconstructed image may be adjusted after being displayed
The method for displaying the blood vessel three-dimensional image corresponding to the medical scanning image and displaying the center line of the blood vessel in the blood vessel three-dimensional image comprises the following steps: generating and displaying a blood vessel three-dimensional image based on a blood vessel segmentation result of the medical scanning image, wherein the blood vessel segmentation result is obtained by processing the medical scanning image in a first deep learning mode; displaying the center line of the blood vessel in the three-dimensional image of the blood vessel based on the result of extracting the center line of the blood vessel, wherein the result of extracting the center line is obtained by processing the three-dimensional image of the blood vessel by using a second deep learning mode; acquiring a curved surface reconstruction image generated based on the adjusted position information of the center line, including: responding to the confirmation operation of a user, and generating a curved surface reconstruction image based on a preset film reading rule, the medical scanning image and the position information of the adjusted central line; or responding to the confirmation operation of the user, sending the position information of the adjusted central line to the server, and receiving the curved surface reconstruction image generated by the server based on the preset film reading rule, the medical scanning image and the position information of the adjusted central line.
Therefore, the blood vessel three-dimensional image is processed by utilizing a deep learning mode, so that the finally obtained curved surface reconstruction image is more accurate, and the efficiency of generating the curved surface reconstruction image is higher; in addition, the curved surface reconstruction image can be generated according to the preset film reading rule, so that the film reading habit of a user is better met, and the efficiency and the accuracy of the user on focus diagnosis are improved.
Wherein the first auxiliary information further comprises a name of a blood vessel in the medical scanning image; the second auxiliary information further comprises the name of the blood vessel in the curved surface reconstructed image and/or a blood vessel sectional view corresponding to the specified position of the blood vessel in the curved surface reconstructed image, wherein the plane of the blood vessel sectional view is perpendicular to the plane of the curved surface reconstructed image.
Therefore, by displaying the vessel name on the medical scanning image, the user can distinguish each vessel on the medical scanning image to determine the position of the aneurysm; and displaying the name of the blood vessel on the curved surface reconstruction image so as to facilitate a user to distinguish the blood vessels on the curved surface reconstruction image to determine the position of the plaque
Wherein, the medical scanning image is obtained by scanning the head and neck; and/or the medical scan image is an electron computed tomography angiography image.
Therefore, the medical scanning image is obtained based on head and neck scanning, the human body area of the medical scanning image is small, and subsequent detection or processing and the like of the medical scanning image are facilitated; the computed tomography angiographic images can enhance the display of blood vessels, facilitating detection based on medical scan images.
In order to solve the above technical problem, another technical solution adopted by the present application is: provided is an image processing apparatus including: the acquisition module is used for acquiring information about at least one focus of a blood vessel in a medical scanning image, wherein the information about the at least one focus is detected based on the medical scanning image; a prompt module for prompting information of at least one lesion in the medical scan image, wherein the at least one lesion comprises an aneurysm.
In order to solve the above technical problem, another technical solution adopted by the present application is: there is provided an image processing apparatus comprising a processor and a memory for storing program instructions, the processor being arranged to execute the program instructions to implement the image processing method described above.
In order to solve the above technical problem, another technical solution adopted by the present application is: there is provided a computer-readable storage medium storing program instructions that can be executed to implement the image processing method described above.
According to the scheme, the intelligent determination and prompting of the vascular lesions such as aneurysms can be realized by automatically acquiring and prompting the lesion information of the blood vessels, and compared with a mode that a user directly judges whether lesions exist in the blood vessels through naked eyes based on medical scanning images, the speed and the accuracy of determining the lesions are improved, and misdiagnosis or missed diagnosis is avoided; and after the information about at least one focus of the blood vessel in the medical scanning image is acquired, the information about the at least one focus in the medical scanning image is prompted to the user, that is, the user is informed of the relevant information about the at least one focus, and the relevant information about the focus can help the user to evaluate the risk of the focus, so that the diagnosis of the user on the focus is assisted, and the diagnosis efficiency and accuracy of the user are improved. In addition, the information of the focus prompted to the user can be diversified, so that under the condition that the prompted focus information is diversified, abundant diagnosis information can be provided for the user, and the user is assisted to make a related treatment scheme in time.
Drawings
FIG. 1 is a schematic flowchart of an embodiment of an image processing method provided in the present application;
FIG. 2 is a schematic flow chart diagram illustrating an image processing method according to another embodiment of the present disclosure;
FIG. 3 is a schematic view of an embodiment of a medical scan image provided herein;
FIG. 4 is a schematic diagram of an embodiment of a surface reconstructed image provided herein;
FIG. 5 is a schematic view of an embodiment of a vessel alignment map of the curved reconstruction map provided by the present application;
FIG. 6 is a schematic diagram of one embodiment of a three-dimensional image of a blood vessel provided by the present application;
FIG. 7 is a schematic diagram of one embodiment of a display interface provided herein;
FIG. 8 is a flowchart illustrating steps related to displaying a curved reconstructed image according to another embodiment of the image processing method provided by the present application;
FIG. 9 is a schematic structural diagram of an embodiment of an image processing apparatus provided in the present application;
FIG. 10 is a schematic structural diagram of an embodiment of an image processing apparatus provided in the present application;
FIG. 11 is a schematic structural diagram of an embodiment of a computer-readable storage medium provided in the present application.
Detailed Description
In order to make the purpose, technical solution and effect of the present application clearer and clearer, the present application is further described in detail below with reference to the accompanying drawings and examples.
The image processing method described in the present application may be executed by a terminal device or a server or other processing device, where the terminal device may be a User Equipment (UE), a mobile device, a User terminal, a Personal Digital Assistant (PDA), a handheld device, a computing device, a specific function device (e.g., a device for medical image processing), or the like. For convenience of description, apparatuses for performing an image processing method are collectively referred to herein as an image processing apparatus. The image processing apparatus may perform, but is not limited to, the image processing method described below by running a client installed in the apparatus.
Referring to fig. 1, fig. 1 is a schematic flowchart illustrating an image processing method according to an embodiment of the present disclosure. It should be noted that, if the result is substantially the same, the flow sequence shown in fig. 1 is not limited in this embodiment. As shown in fig. 1, the present embodiment includes:
step S11: information about at least one lesion of a blood vessel in a medical scan image is acquired.
The method of the embodiment is used for prompting at least one kind of lesion information about blood vessels in a medical scanning image of a user, the medical scanning image is an image obtained by imaging the blood vessels through an imaging technology in the medical technology field, some diseases related to the blood vessels can be checked based on the medical scanning image, and the medical scanning image is obtained by scanning the head and neck positions when the blood vessels of the head and neck need to be diagnosed. In one embodiment, the medical scan image may be an angiographic image obtained by Computed Tomography (CT) techniques, which may also be referred to as a Computed Tomography Angiography (CTA) image; of course, the medical scan image may also be an angiographic image obtained by Magnetic Resonance Angiography (MRA) technique. It is understood that in other embodiments, the angiographic image may be obtained by other vessel imaging techniques, and is not limited in any way.
In this embodiment, when the medical scan image about the blood vessel is acquired, information of at least one kind of lesion may be obtained by automatically detecting a lesion on the medical scan image. The server may detect the acquired medical scanning image to obtain information of at least one type of lesion, and the server transmits the detection result, the medical scanning image and the like to the image processing device so that the image processing device obtains the information of at least one type of lesion about the blood vessel in the medical scanning image; it is also possible that the image processing device itself detects the medical scan image for information about at least one lesion of the blood vessel. The server or the image processing device can detect the medical scanning image in a preset deep learning mode to obtain information of at least one focus. Compared with the method that a user directly judges whether a focus exists in a blood vessel through naked eyes based on a medical scanning image, the method and the device can automatically detect the focus when the medical scanning image of the blood vessel is obtained, can improve the speed and accuracy of focus detection, and avoid misdiagnosis or missed diagnosis; in addition, the relevant information of the focus can be automatically acquired while the focus is detected, so that the risk of the focus can be evaluated by a user, and the user can be assisted to make a relevant treatment scheme.
Wherein, the at least one focus comprises an aneurysm, and if the focus is the aneurysm, the information of the aneurysm can be directly detected from the medical scanning image. In other embodiments, the lesion related to the blood vessel may further include a plaque of the blood vessel, and information of the plaque may also be obtained based on the detection of the medical scanning image, for example, the medical scanning image is processed to obtain a three-dimensional reconstructed image, for example, the medical scanning image is processed by using a CTA three-dimensional reconstruction technique to obtain a Curved surface reconstruction (CPR) image or a blood vessel straightening graph of the Curved surface reconstruction. It is to be understood that, in other embodiments, when the lesion is of another type, the medical image obtained by directly performing the medical scanning image or performing the post-processing on the medical scanning image may be selected to perform the relevant lesion detection to obtain the information of the other type of lesion according to the characteristics of the other type of lesion, and the processing form of the medical scanning image may be specifically selected according to the actual application scenario, which is not limited herein.
In one embodiment, the information of the lesion may include a type of the lesion, a name of a blood vessel where the lesion is located, a position of the lesion in the blood vessel where the lesion is located, or a morphological parameter of the lesion, and the information of the lesion may be obtained as needed. In other embodiments, the information of the lesion may also include other information such as a density of the lesion, which may be specifically set according to actual needs, and is not specifically limited herein. The morphological parameters of the lesion may include a volume, a cross-sectional area, a major axis, a minor axis, and the like, wherein the major axis is a longest distance from one edge of the lesion to the opposite edge, and the minor axis is a shortest distance from one edge of the lesion to the opposite edge. It is understood that in other embodiments, the morphological parameters of the lesion may include other parameters, and the like, and are not specifically limited herein.
When the lesion is an aneurysm of a blood vessel, the information of the aneurysm may include the above-mentioned lesion information, and of course, may also include information related to other aneurysms not mentioned above. Similarly, when the lesion is a plaque of a blood vessel, the information of the plaque may also include the above-mentioned lesion information, and in addition, the information of the plaque may also include other information such as a degree of stenosis of the blood vessel caused by the plaque, which is not specifically limited herein.
Step S12: information of at least one lesion in the medical scan image is suggested.
In this embodiment, after the information about at least one type of lesion of a blood vessel in the medical scanning image is acquired, the information about at least one type of lesion in the medical scanning image is presented to the user, so that the user can obtain information related to the lesion while viewing the lesion in the medical scanning image, for example, morphological parameters of the lesion, a type of the lesion, and the like, thereby assisting the user in diagnosing the lesion and improving the diagnosis efficiency and accuracy of the user; in addition, the information of the focus prompted to the user can be diversified, rich diagnosis information can be provided, and the time for the user to make a focus treatment scheme is shortened.
Optionally, in an embodiment, information of at least one lesion in the medical scan image may be prompted by a display. For example, when the display interface of the image processing apparatus displays the medical scanning image, at least one type of information of the lesion is displayed on the display interface, and the information of the lesion may be displayed in the same region as the medical scanning image or in different regions from the medical scanning image, which is not limited herein. It is to be understood that, in other embodiments, information of at least one type of lesion in the medical scanning image may also be prompted by voice broadcast or other methods, and may be specifically set according to actual use needs, which is not specifically limited herein.
In some embodiments, in displaying the information of the lesion, the information of the lesion may be displayed together with the medical image. In other embodiments, the information of the lesion may be displayed alone, that is, the information of the lesion is not displayed together with the medical image. How to display the information of the focus can be specifically set according to actual use needs, and is not specifically limited herein.
In some embodiments, the information of the lesion may be displayed together with the medical scanning image or a post-processing medical image generated based on the medical scanning image, wherein the post-processing medical image may be a three-dimensional image of a blood vessel, a curved surface reconstruction image, a blood vessel straightening map of a curved surface reconstruction image, or a maximum density projection reconstruction image, and the like, and is not limited in particular. In some embodiments, information of the lesion may be displayed together with a medical image corresponding to the lesion, so that a user may quickly diagnose the lesion based on the lesion information of the corresponding medical image. For example, since an aneurysm is detected based on a medical scan image, a plaque is detected based on a curved surface reconstructed image, that is, a medical image corresponding to the aneurysm is a medical scan image, and a medical image corresponding to the plaque is a curved surface reconstructed image, information on the aneurysm and information on the plaque can be displayed together with the medical scan image and the curved surface reconstructed image. Note that, the information on the lesion may not be displayed together with the medical image corresponding to the lesion, and for example, when a plurality of lesions are included, the information on the plurality of lesions may be displayed together with a certain medical image. Specifically, if the lesion includes plaque and aneurysm, information on the plaque and aneurysm is displayed together with the medical scan image.
It can be understood that, in the above embodiment, when the information of the lesion and the medical image are displayed on the display interface together, the information of the lesion and the medical image may be displayed in different regions on the same display interface, so that the display interface is clear and intuitive, and the user can diagnose the lesion conveniently. In other embodiments, the information of the lesion may also be displayed in the same region as the medical image, that is, the information of the lesion is displayed on the medical image, for example, the information of the lesion may be displayed at a position on a blood vessel of the medical image corresponding to the lesion, specifically, the region of the lesion may be highlighted, and/or the display of the relevant lesion may be displayed in text, and how to display the information may not be limited.
In the above embodiment, when the medical scan image about the blood vessel is acquired, information of at least one kind of lesion is obtained by automatically detecting the lesion on the medical scan image. Compared with the method that a user directly judges whether a focus exists in a blood vessel through naked eyes based on a medical scanning image, the method and the device can automatically detect the focus when the medical scanning image of the blood vessel is obtained, so that the speed and the accuracy of focus detection can be improved, and misdiagnosis or missed diagnosis is avoided; in addition, the method can help the user to evaluate the risk of the focus and assist the user to make a related treatment scheme by acquiring the related parameter information of the focus. In addition, after the information about at least one focus of the blood vessel in the medical scanning image is acquired, the information about at least one focus in the medical scanning image is prompted to a user, so that the user can obtain information related to the focus while viewing the focus in the medical scanning image, the diagnosis of the user on the focus is assisted, and the diagnosis efficiency and accuracy of the user are improved; in addition, the information of the focus prompted to the user can be diversified, rich diagnosis information can be provided, and the time for the user to make a focus treatment scheme is shortened.
Referring to fig. 2 to 7, fig. 2 is a schematic flowchart of another embodiment of an image processing method provided by the present application, fig. 3 is a schematic diagram of an embodiment of a medical scan image provided by the present application, fig. 4 is a schematic diagram of an embodiment of a curved surface reconstruction image provided by the present application, fig. 5 is a schematic diagram of an embodiment of a vessel straightening graph of the curved surface reconstruction image provided by the present application, fig. 6 is a schematic diagram of an embodiment of a three-dimensional image of a vessel provided by the present application, and fig. 7 is a schematic diagram of an embodiment of a display interface provided by the present application. It should be noted that, if the result is substantially the same, the flow sequence shown in fig. 2 is not limited in this embodiment. As shown in fig. 2, in this embodiment, the prompting information of the lesion in the medical scanning image in a display manner specifically includes:
step S21: information about at least one lesion of a blood vessel in a medical scan image is acquired.
Step S21 is similar to step S11 in the above embodiment, and is not repeated here.
Step S221: the medical scan image and the first auxiliary information are displayed in response to a first display operation of a user.
In this embodiment, information of at least one type of lesion in the medical scan image is presented in a display manner, and specifically, the medical image corresponding to the type of the lesion and the information of the lesion may be displayed according to the type of the lesion.
As shown in fig. 3, in an embodiment, when the lesion includes an aneurysm, the medical scan image and the first auxiliary information are displayed in response to a first display operation by a user. The user can display the medical scanning image and the first auxiliary information on the display interface by performing display operation on the image processing equipment, namely, the first auxiliary information related to the focus can be displayed while the medical scanning image is displayed on the display interface, so that the diagnosis of the focus by the user is assisted, the diagnosis efficiency and accuracy of the user are improved, and misdiagnosis or missed diagnosis is avoided. It is understood that, in other embodiments, the first display operation of the user may be to display only the medical scan image or the first auxiliary information, etc., and is not limited in particular herein.
The lesion in the blood vessel is determined to be an aneurysm through the detection of the medical scanning image in step S21, at this time, the first auxiliary information includes information of the aneurysm, the information of the aneurysm may be a morphological parameter of the aneurysm, a name of the blood vessel where the aneurysm is located, or a position of the aneurysm in the blood vessel, or the like, that is, the user may obtain information of the number of aneurysms in the medical scanning image, a position of each aneurysm, a morphological parameter, or the like through the information of the aneurysm, and the information of the aneurysm is obtained through the detection in a deep learning manner, so that the accuracy is high, the variety is rich, the user can be well assisted in making a treatment plan for the aneurysm, and the time for making the treatment plan is shortened.
In order to facilitate the user to distinguish the blood vessels on the medical scanning image to determine the location of the aneurysm, in an embodiment, the first auxiliary information further includes names of the blood vessels in the medical scanning image, the blood vessels may be named in a preset deep learning manner, and the names corresponding to the blood vessels are marked on the medical scanning image, that is, the user may intuitively know which blood vessel each blood vessel is from the medical scanning image.
Step S222: and displaying the reconstructed image and the second auxiliary information in response to a second display operation of the user.
In an embodiment, when the lesion further includes a plaque of a blood vessel, the reconstructed image and the second auxiliary information are displayed in response to a second display operation of the user. The second auxiliary information is information of a plaque, and the detection of the plaque is based on a reconstructed image after medical scanning image processing, so that when the lesion includes the plaque, the reconstructed image of the blood vessel is displayed under the second display operation of the user. It is to be understood that, in other embodiments, the reconstructed image or the second auxiliary information may also be displayed singly in response to the second display operation of the user, which is not limited herein.
In other embodiments, the blood vessel further comprises other types of lesions, and information about the other types of lesions and medical images that can be used to detect the type of lesion may be displayed with the plaque in response to the second display operation, or may be displayed with the aneurysm in response to the first display operation, or in response to other display operations. In addition, the lesion information and the medical image corresponding to each lesion may be displayed in response to the same display operation. It is to be understood that how to trigger the command to display the lesion information is not limited in this embodiment, and the trigger is specifically set according to actual use needs.
As shown in fig. 4, the displayed reconstructed image may be a curved surface reconstructed image, or as shown in fig. 5, the displayed reconstructed image may also be a blood vessel straightening graph of the curved surface reconstructed image, or may also be a blood vessel straightening graph in which the curved surface reconstructed image and the curved surface reconstructed image are simultaneously displayed. The curved surface reconstructed image is obtained by performing curved surface reconstruction on one or more blood vessels in the medical scanning image, that is, the curved surface reconstructed image can be obtained by performing curved surface reconstruction on one blood vessel in the medical scanning image, and at this time, the curved surface reconstructed image only includes the blood vessel; the curved surface reconstructed image may also be a curved surface reconstructed image of a plurality of blood vessels in the medical scanning image, at this time, the curved surface reconstructed image includes the plurality of blood vessels, and whether plaque or not exists in the plurality of blood vessels can be checked through the curved surface reconstructed image. The blood vessel straightening image of the curved surface reconstruction image is an image obtained by straightening a certain blood vessel on the curved surface reconstruction image, and the blood vessel straightening image of the curved surface reconstruction image is beneficial to diagnosing and analyzing the stenosis degree of the plaque.
In order to facilitate the user to distinguish the blood vessels on the reconstructed image to determine the location of the plaque, in an embodiment, as shown in fig. 5 and fig. 6, the second auxiliary information further includes a blood vessel name 21, specifically, the blood vessels may be classified in a preset deep learning manner, the blood vessel name 21 of each blood vessel is determined based on the classification, and the blood vessel name 21 corresponding to each blood vessel is marked on the reconstructed image. In a specific embodiment, the medical image includes four blood vessels, the four blood vessels are determined to be a Left Internal Carotid Artery (L-ICA), a Right Internal Carotid Artery (R-ICA), a Left vertebral Artery (L-VA), and a Right vertebral Artery (R-VA) in the medical image in a preset deep learning manner, and the blood vessel names 21 are labeled at the corresponding blood vessels in the medical image, so that the user can distinguish the blood vessels on the medical image, thereby assisting the user in diagnosing the focus of the blood vessel. Fig. 6 is a three-dimensional image of a blood vessel including a center line 22 on which a reconstructed image is generated, that is, the reconstructed image is a three-dimensional image generated based on the center line 22 and fully combining body state parameters of the blood vessel and the like.
In other embodiments, as shown in fig. 4 and 5, the second auxiliary information further includes a vascular section plane corresponding to the specified position of the blood vessel in the reconstructed image, where the vascular section plane is located on a plane perpendicular to the plane of the curved surface reconstructed image, i.e., the left-most sub-regions 11 in fig. 4 and 5. The blood vessel cutting plane comprises a plurality of sub-areas positioned on the leftmost side, a sub-area comprising a white outer frame is a blood vessel cutting plane corresponding to the specified position of the blood vessel, a sub-area positioned on the upper part of the sub-area comprising the white outer frame is a blood vessel cutting plane corresponding to the upper part of the specified position of the blood vessel, and a sub-area positioned on the lower part of the sub-area comprising the white outer frame is a blood vessel cutting plane corresponding to the lower part of the specified position of the blood vessel.
In a specific embodiment, the related contents of a plurality of lesions are displayed on the display interface at the same time, for example, the lesions include aneurysms and plaques, as shown in fig. 7, in this case, the curved reconstructed image corresponding to the plaques, information of the plaques (not shown), medical scanned image corresponding to the aneurysms, and information of the aneurysms (not shown) are displayed on the display interface, that is, fig. 3, 4, and 6 are displayed on the display interface at the same time. Specifically, a medical scanning image is displayed in a first area 31 of the display interface, a curved reconstructed image is displayed in a second area 32, a three-dimensional image of a blood vessel is displayed in a third area 33, and a fourth area 34 can be used for displaying plaque information and aneurysm information (the fourth area 34 is not shown in the figure). In other embodiments, the information for displaying the plaque and the information for displaying the aneurysm may be displayed in regions, that is, the information for displaying the aneurysm and the plaque may be displayed in two different regions. By displaying the medical image and the information of the focus in different areas, the display content on the display interface is clear and visual, and the display content is prevented from being mixed. It is to be understood that, in other embodiments, the medical image and the information of the corresponding lesion may also be displayed in the same region or in three, four, or more regions as needed, and may be specifically set according to an actual usage scenario, which is not specifically limited herein.
In another specific embodiment, the information of each lesion and the medical image corresponding to the lesion are displayed simultaneously and regionally in the display interface, and the medical images corresponding to different lesions and the lesion information thereof may be displayed in a switched manner on the display interface, that is, only the related content of one lesion is displayed on the display interface. Specifically, a region of the display interface displays a medical scanning image corresponding to the aneurysm and displays the name of each blood vessel on the medical scanning image, so that each blood vessel can be directly distinguished from the medical scanning image; and information of the aneurysm is displayed on an adjacent area of the medical scan image display area. When a user needs to view the related content of the plaque, the related information content of the plaque can be displayed by switching the display content of the display interface, at the moment, a region of the display interface displays the curved surface reconstruction image and the name of each blood vessel, and the information of the plaque is displayed on an adjacent region of the curved surface reconstruction image display region, wherein a blood vessel straightening graph of the curved surface reconstruction image can be displayed on the display interface in a switching mode, or the curved surface reconstruction image and the blood vessel straightening graph of the curved surface reconstruction image are displayed at the same time.
When a curved reconstructed image is displayed in a region of the display interface and information of a plaque is displayed in an adjacent region, the display formation of the plaque on the region may be: displaying information of each plaque in the area; or, the order names of each plaque, for example, "first plaque", "second plaque" to "third plaque", may be displayed on the region, when the user clicks the "first plaque" in the region, the information of the first plaque may be displayed in the sub-display region corresponding to the lower part of the "first plaque", and when the user clicks other plaques, the information of the first plaque is hidden, so as to avoid that the information of the focus is displayed too much on the display interface, which is not favorable for the user to view; or, labeling the plaque position corresponding to the curved surface reconstruction image to inform the user that the plaque is positioned at the position of the blood vessel, and when the user clicks the plaque at the labeled position, displaying the information related to the clicked plaque on the area of the display interface displaying the information of the plaque. It is understood that the information of the plaque may be displayed in other forms, and is not limited in particular.
It is understood that in other embodiments, the medical image corresponding to the lesion and the information of the lesion may also be displayed in the same region, that is, the information of the lesion is displayed on the medical image.
Because the information of the plaque is obtained based on the curved surface reconstruction image processed by the medical scanning image, the steps of blood vessel segmentation, central line extraction and the like are required to construct the curved surface reconstruction image before the curved surface reconstruction image is displayed; in addition, in order to make the displayed curved surface reconstructed image more favorable for the diagnosis of the lesion, the curved surface reconstructed image may be adjusted after being displayed. Referring to fig. 8, fig. 8 is a flowchart illustrating steps related to displaying a curved reconstructed image according to another embodiment of the image processing method provided by the present application. It should be noted that, if the result is substantially the same, the flow sequence shown in fig. 8 is not limited in this embodiment. As shown in fig. 8, the present embodiment includes:
step S41: and displaying a blood vessel three-dimensional image corresponding to the medical scanning image, and displaying the central line of the blood vessel in the blood vessel three-dimensional image.
In one embodiment, the three-dimensional image of the blood vessel is a three-dimensional image generated based on the result of segmenting the blood vessel in the medical scanning image, that is, the blood vessel in the three-dimensional image of the blood vessel includes only the blood vessel required for diagnosis or only the blood vessel of a certain part. Because the blood vessels of each part in the human body are connected or intertwined, for example, the blood vessels of the neck of the human body need to be diagnosed, and a medical scanning image of the blood vessels of the brain and the neck of the human body needs to be actually acquired to ensure the integrity of the blood vessels, while in the process of actually constructing the curved surface reconstruction image, the blood vessels of other parts may affect the curved surface reconstruction image for constructing the blood vessels of the neck, so that the blood vessels on the medical scanning image need to be segmented first, and the influence of the blood vessels of other parts on the construction of the curved surface reconstruction image for the blood vessels needing to be diagnosed is avoided. It is understood that in other embodiments, the blood vessel three-dimensional image may also be a three-dimensional image generated directly based on a medical scanning image, and is not limited in detail herein.
Wherein, the result of the blood vessel segmentation is obtained by processing the medical scanning image by using the first deep learning mode. In the traditional blood vessel segmentation, the image before the blood vessel enhancement is subtracted from the image after the blood vessel enhancement to obtain a blood vessel segmentation result, so that a patient needs to receive scanning radiation twice; compare in traditional blood vessel segmentation, this application can directly utilize first degree of deep learning mode to handle the result that obtains blood vessel segmentation based on medical scanning image is automatic, that is to say, adopt the mode of this application to obtain the result that blood vessel segmentation, the reducible radiation of patient has reduced the required time of constructing curved surface reconstruction image, in addition, the blood vessel segmentation result that obtains through degree of deep learning mode is more accurate, is favorable to the construction of curved surface reconstruction image. The algorithm or the network model related to the first deep learning manner is not specifically limited herein, and may be specifically set according to actual use requirements.
In one embodiment, the centerline extraction result of the blood vessel is obtained by performing centerline extraction on the blood vessel three-dimensional image. For example, if the carotid artery and the vertebral artery need to be diagnosed, the starting point and the ending point in the carotid artery and the vertebral artery are found on the blood vessel three-dimensional image, the central line of the carotid artery is generated based on the starting point and the ending point of the carotid artery, and the central line of the vertebral artery is generated based on the starting point and the ending point of the vertebral artery, so that the central line extraction result of the carotid artery and the vertebral artery is obtained.
And the extraction result of the central line is obtained by processing the blood vessel three-dimensional image by using a second deep learning mode. The traditional center line extraction process is that the user edits in the workstation with semi-automatic mode and obtains, compares in traditional center line extraction mode, and this application can directly utilize the second degree of deep learning mode to extract based on the blood vessel three-dimensional image is automatic and obtains the center line, has improved the precision and the efficiency that the center line drawed. The algorithm or the network model related to the second deep learning manner is not specifically limited herein, and may be specifically set according to actual use requirements.
In the present embodiment, as shown in fig. 6, a blood vessel three-dimensional image corresponding to the medical scan image is displayed, and the center line of the blood vessel is displayed in the blood vessel three-dimensional image. The blood vessel three-dimensional image is displayed in a volume rendering mode, and the center line is displayed in the blood vessel three-dimensional image by adjusting the brightness, the contrast and the like of the center line relative to the blood vessel, so that a user can more intuitively observe the segmentation condition of the blood vessel and the extraction condition of the center line. Specifically, as shown in FIG. 6, a blood vessel three-dimensional image and a center line 22 corresponding to the blood vessel are displayed in the right region of the display interface, a list of blood vessel names "L-ICA, R-ICA, L-RA, R-VA" is displayed in a result column 23 in the left region of the display interface, and when one blood vessel is selected in the list of blood vessel names, the corresponding center line on the blood vessel three-dimensional image is highlighted, for example, in a highlighted form.
In other embodiments, a thumbnail of the medical scan image, "tool" bar, confirmation port "send", or display interface print port "film" may also be displayed in the left area of the display interface, and the display content of the display interface may be specifically set according to an actual usage scenario, which is not specifically limited herein. The confirmation port is used for sending the display content of the display interface to the medical imaging system when the user confirms that the display content of the display interface is correct, so that other users except the user can view the display content, and after the user adjusts the display content of the display interface, the sending port can be used for sending the adjusted three-dimensional image to the server to regenerate the three-dimensional image.
Further, in order to avoid errors in the blood vessel segmentation result and the center line extraction result obtained by the deep learning method, in an embodiment, a modification tool of the segmentation result and a modification tool of the center line are provided in a tool column of the display interface, so that a user can modify the blood vessel segmentation result and the center line conveniently. The modifying tool for the blood vessel segmentation comprises region growing, cutting or erasing, and the modifying tool for the center line comprises deleting, drawing and the like, and can be specifically set according to the use requirement, and is not specifically limited herein. The modification tool on the display interface can be in the same region with the information of the focus and can also be displayed in different regions.
In addition, the 'tool' bar of the display interface can also be provided with basic operation tools. Specifically, as shown in fig. 6, the operation tools in the "tools" column of the display interface are, from left to back and from top to bottom: the method comprises the following steps of displaying a display layout tool of an interface, globally displaying a certain region of a selected blood vessel, adjusting the brightness or contrast of a central line or the blood vessel, translating a selected target, amplifying, writing, line segment, measuring angle and refreshing a page. In other embodiments, a delete tool, a reset tool, etc. may also be included, and are not specifically limited herein.
In some embodiments, a thumbnail of the medical scan image may also be displayed on the display interface, as shown in fig. 6, which may be displayed in the display area 24.
Step S42: and determining the position information of the adjusted central line in the blood vessel in response to the adjustment operation of the central line by the user.
In this embodiment, the user can adjust the center line on the blood vessel displayed in the three-dimensional image of the blood vessel so that the position of the center line on the blood vessel is accurate and no loss occurs, and confirm the position of the center line after adjustment. For example, as shown in fig. 6, when the server calculates to generate the curved reconstructed image, the user may send the adjusted three-dimensional image of the blood vessel to the server through the "sending" port.
Step S43: and acquiring a curved surface reconstruction image generated based on the adjusted position information of the central line.
In the present embodiment, in response to a confirmation operation by the user, that is, after the user confirms that there is no problem with the position information of the adjusted center line, the curved surface reconstructed image is automatically generated based on the medical scan image and the position information of the adjusted center line. In another embodiment, the server calculates the generated curved surface reconstructed image, and after the user confirms the operation, the server transmits the position information of the adjusted center line to the server, and the server generates the curved surface reconstructed image based on the medical scanning image and the position information of the adjusted center line, and transmits the generated curved surface reconstructed image to the device so that the device acquires the curved surface reconstructed image generated based on the position information of the adjusted center line.
In order to facilitate the user to diagnose the lesion faster and more accurately, in an embodiment, the curved surface reconstructed image may be further generated based on a preset radiographing rule, that is, the radiographing rule of the user, for example, the preset radiographing rule may be that the curved surface reconstructed image is displayed on the display interface at a preset angle, or may also be that a blood vessel straightening graph of the curved surface reconstructed image is displayed on the display interface at a preset angle, and the like, which is not specifically limited herein.
Step S44: and displaying the curved surface reconstruction image.
In this embodiment, the curved surface reconstructed image is displayed to the user by presenting the acquired curved surface reconstructed image on the display interface.
Step S45: and responding to the preset operation of the user on the curved surface reconstruction image, determining the display angle matched with the preset operation, and displaying the curved surface reconstruction image matched with the display angle again.
In this embodiment, even if the curved surface reconstructed image can be displayed on the display interface based on the preset interpretation rule, the preset interpretation rule may be unfavorable for the diagnosis of the lesion, so that the user can change the display angle of the curved surface reconstructed image through the preset operation on the curved surface reconstructed image. Specifically, the user may perform a preset operation on the curved surface reconstructed image displayed on the display interface, where the preset operation may be an angle adjustment for displaying the curved surface reconstructed image, so that when the user performs the preset operation, the image processing device may automatically determine a display angle matched with the preset operation, and redisplay the curved surface reconstructed image matched with the display angle on the display interface. The user may adjust the display angle of the curved reconstructed image by using 30 ° as an adjustment amount, that is, the adjustment amount of the display angle of the curved reconstructed image is 30 ° each time. In an embodiment, the adjustment amount of the curved surface reconstructed image may be 20 °, 35 ° or other degrees, and is not particularly limited herein.
In other embodiments, step S45 may not be performed if the user confirms that the curved reconstructed image has no problem and does not need to be adjusted.
In addition, after the user confirms that the displayed curved surface reconstruction image, the blood vessel three-dimensional image or other medical images are correct, the method can also automatically generate structured text content according to the information of the focus by using a preset deep learning mode, wherein the structured text content can also be edited and modified, so that the user is assisted to complete the writing of a diagnosis report, and the time for writing the report is reduced; moreover, the user can send the confirmed medical image and related information to the medical image system for other users to check, or can print the content of the display interface through the function of film on the interface.
In other embodiments, the image processing apparatus or the server may directly generate the curved reconstructed image based on the medical scan image, and the display interface is displayed as shown in fig. 7, in which embodiments S41-S43 are not performed. At this time, after the user adjusts one of the display regions, the curved surface reconstructed image needs to be regenerated based on the adjusted display content, and the updated curved surface reconstructed image is displayed on the display interface again. For example, in several medical images shown in fig. 7, a user confirms that a center line of a blood vessel on a blood vessel three-dimensional image has a local fracture, and at this time, the user adjusts the center line of the blood vessel by using a center line modification tool, and generates a new curved surface reconstruction image based on the adjusted blood vessel three-dimensional image, and displays the image on a display interface.
Referring to fig. 9, fig. 9 is a schematic structural diagram of an embodiment of an image processing apparatus according to the present application. In this embodiment, the image processing apparatus 50 includes an acquisition module 51 and a presentation module 53. The obtaining module 51 is configured to obtain information about at least one type of lesion of a blood vessel in a medical scanning image, wherein the information about the at least one type of lesion is detected based on the medical scanning image. The prompting module 53 is configured to prompt information of at least one lesion in the medical scan image, wherein the at least one lesion includes an aneurysm.
Wherein said at least one lesion further comprises a plaque of said blood vessel; the information of the lesion includes at least one of: the type of the focus, the name of a blood vessel where the focus is located, the position of the focus in the blood vessel and morphological parameters of the focus, wherein the morphological parameters comprise at least one of the following parameters: major diameter, minor diameter, volume, cross-sectional area, and shape.
The information of the plaque also includes the degree of stenosis caused by the plaque to the blood vessel.
The above prompt module 53 prompts information of at least one lesion in the medical scanning image, and specifically includes: displaying the medical scanning image and first auxiliary information in response to a first display operation of a user, wherein the first auxiliary information comprises information of the aneurysm; and/or, in the case that the at least one lesion further includes a plaque of the blood vessel, displaying a reconstructed image and second auxiliary information in response to a second display operation of the user, wherein the second auxiliary information includes information of the plaque, and the reconstructed image includes at least one of: the curved surface reconstruction image is obtained by performing curved surface reconstruction on one or more blood vessels in the medical scanning image.
Before displaying the curved surface reconstructed image, the prompt module 53 specifically includes: displaying a blood vessel three-dimensional image corresponding to the medical scanning image, and displaying a central line of the blood vessel in the blood vessel three-dimensional image; determining position information of the adjusted central line in the blood vessel in response to the adjustment operation of the central line by the user; acquiring a curved surface reconstruction image generated based on the adjusted position information of the central line; and/or after the curved surface reconstructed image is displayed, the method specifically comprises the following steps: and responding to the preset operation of the user on the curved surface reconstruction image, determining the display angle matched with the preset operation, and displaying the curved surface reconstruction image matched with the display angle again.
The above-mentioned prompt module 53 displays a blood vessel three-dimensional image corresponding to the medical scanning image, and displays a center line of the blood vessel in the blood vessel three-dimensional image, and specifically includes: generating and displaying a blood vessel three-dimensional image based on a blood vessel segmentation result of the medical scanning image, wherein the blood vessel segmentation result is obtained by processing the medical scanning image in a first deep learning mode; displaying the center line of the blood vessel in the three-dimensional image of the blood vessel based on the result of extracting the center line of the blood vessel, wherein the result of extracting the center line is obtained by processing the three-dimensional image of the blood vessel by using a second deep learning mode; acquiring a curved surface reconstruction image generated based on the adjusted position information of the center line, specifically comprising: responding to the confirmation operation of a user, and generating a curved surface reconstruction image based on a preset film reading rule, the medical scanning image and the position information of the adjusted central line; or responding to the confirmation operation of the user, sending the position information of the adjusted central line to the server, and receiving the curved surface reconstruction image generated by the server based on the preset film reading rule, the medical scanning image and the position information of the adjusted central line.
Wherein, the first auxiliary information also comprises the name of the blood vessel in the medical scanning image; the second auxiliary information further comprises the name of the blood vessel in the curved surface reconstructed image and/or a blood vessel sectional view corresponding to the specified position of the blood vessel in the curved surface reconstructed image, wherein the plane of the blood vessel sectional view is perpendicular to the plane of the curved surface reconstructed image.
Wherein, the medical scanning image is obtained by scanning the head and neck; and/or the medical scan image is an electron computed tomography angiography image.
Referring to fig. 10, fig. 10 is a schematic structural diagram of an embodiment of an image processing apparatus provided in the present application. In this embodiment, the image processing apparatus 60 includes a processor 61 and a memory 63.
The processor 61 may also be referred to as a CPU (Central Processing Unit). The processor 61 may be an integrated circuit chip having signal processing capabilities. The processor 61 may also be a general purpose processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components. A general purpose processor may be a microprocessor or the processor 61 may be any conventional processor 61 or the like.
The memory 63 in the image processing device 60 is used to store program instructions required for the processor 61 to operate.
The processor 61 is configured to execute program instructions to implement the methods provided by any of the embodiments of the image processing method of the present application and any non-conflicting combinations thereof.
In other embodiments, the image processing device 60 may further include a prompt component (not shown) for performing a prompt in response to a control instruction of the processor 61, for example, performing a prompt for information of at least one lesion of a blood vessel. In some specific applications, the prompting component may be a display component and/or an audio playing component, and the like, and is not limited in particular.
Referring to fig. 11, fig. 11 is a schematic structural diagram of an embodiment of a computer-readable storage medium provided in the present application. The computer readable storage medium 70 of the embodiments of the present application stores program instructions 71, and the program instructions 71, when executed, implement the methods provided by any of the embodiments of the image processing method of the present application and any non-conflicting combinations. The program instructions 71 may form a program file stored in the computer readable storage medium 70 in the form of a software product, so as to enable a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the methods according to the embodiments of the present application. And the aforementioned computer-readable storage medium 70 includes: various media capable of storing program codes, such as a usb disk, a mobile hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, or terminal devices, such as a computer, a server, a mobile phone, and a tablet. The above description is only for the purpose of illustrating embodiments of the present application and is not intended to limit the scope of the present application, and all modifications of equivalent structures and equivalent processes, which are made by the contents of the specification and the drawings of the present application or are directly or indirectly applied to other related technical fields, are also included in the scope of the present application.

Claims (11)

1. An image processing method, characterized in that the method comprises:
acquiring information about at least one focus of a blood vessel in a medical scanning image, wherein the information about the at least one focus is detected based on the medical scanning image;
information indicative of the at least one lesion in the medical scan image, wherein the at least one lesion comprises an aneurysm.
2. The method of claim 1, wherein the at least one lesion further comprises a plaque of the blood vessel;
the information of the lesion includes at least one of: a type of the lesion, a name of a vessel in which the lesion is located, a location of the lesion in the vessel, and morphological parameters of the lesion, the morphological parameters including at least one of: major diameter, minor diameter, volume, cross-sectional area, and shape.
3. The method of claim 2, wherein the information of the plaque further comprises a degree of stenosis caused by the plaque to the blood vessel.
4. The method of claim 1, wherein the prompting for information of the at least one lesion in the medical scan image comprises:
displaying the medical scan image and first auxiliary information in response to a first display operation of a user, wherein the first auxiliary information includes information of the aneurysm; and/or the presence of a gas in the gas,
in a case where the at least one lesion further includes a plaque of the blood vessel, displaying a reconstructed image and second auxiliary information in response to a second display operation of a user, wherein the second auxiliary information includes information of the plaque, and the reconstructed image includes at least one of: a curved surface reconstruction image and a blood vessel straightening image of the curved surface reconstruction image.
5. The method of claim 4, wherein prior to said displaying said curved reconstructed image, said method further comprises:
displaying a blood vessel three-dimensional image corresponding to the medical scanning image, and displaying a central line of the blood vessel in the blood vessel three-dimensional image;
determining position information of the adjusted central line in the blood vessel in response to the adjustment operation of the central line by the user;
acquiring the curved surface reconstruction image generated based on the position information of the adjusted central line;
and/or, after the displaying the curved reconstructed image, the method further comprises:
and responding to the preset operation of the user on the curved surface reconstruction image, determining a display angle matched with the preset operation, and displaying the curved surface reconstruction image matched with the display angle again.
6. The method according to claim 5, wherein the displaying a three-dimensional image of a blood vessel corresponding to the medical scanning image and displaying a centerline of the blood vessel in the three-dimensional image of the blood vessel comprises:
generating and displaying a blood vessel three-dimensional image based on a blood vessel segmentation result of the medical scanning image, wherein the blood vessel segmentation result is obtained by processing the medical scanning image by using a first deep learning mode; and
displaying the center line of the blood vessel in the blood vessel three-dimensional image based on the center line extraction result of the blood vessel, wherein the center line extraction result is obtained by processing the blood vessel three-dimensional image by using a second deep learning mode;
the obtaining the curved surface reconstruction image generated based on the adjusted position information of the center line includes:
responding to the confirmation operation of a user, and generating the curved surface reconstruction image based on a preset film reading rule, the medical scanning image and the position information of the adjusted central line; alternatively, the first and second electrodes may be,
and responding to the confirmation operation of the user, sending the position information of the adjusted central line to a server, and receiving the curved surface reconstruction image generated by the server based on the preset film reading rule, the medical scanning image and the position information of the adjusted central line.
7. The method according to claim 4 or 5, characterized in that the first auxiliary information further comprises a name of the blood vessel in the medical scan image;
the second auxiliary information further includes a name of the blood vessel in the curved surface reconstructed image, and/or a blood vessel sectional view corresponding to the specified position of the blood vessel in the curved surface reconstructed image, wherein a plane where the blood vessel sectional view is located is perpendicular to a plane where the curved surface reconstructed image is located.
8. The method of claim 1, wherein the medical scan image is obtained by scanning a head and neck region;
and/or the medical scanning image is an electron computer tomography angiography image.
9. An image processing apparatus characterized by comprising:
an acquisition module, configured to acquire information about at least one lesion of a blood vessel in a medical scanning image, where the information about the at least one lesion is detected based on the medical scanning image;
a prompt module for prompting information of the at least one lesion in the medical scan image, wherein the at least one lesion comprises an aneurysm.
10. An image processing apparatus, characterized in that the image processing apparatus comprises a processor and a memory, the memory storing program instructions for execution by the processor to implement the method according to any one of claims 1-8.
11. A computer-readable storage medium, characterized in that the computer-readable storage medium stores program instructions that are executable to implement the method of any one of claims 1-8.
CN202110768694.3A 2021-07-07 2021-07-07 Image processing method, image processing device, related equipment and storage medium Withdrawn CN113506262A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110768694.3A CN113506262A (en) 2021-07-07 2021-07-07 Image processing method, image processing device, related equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110768694.3A CN113506262A (en) 2021-07-07 2021-07-07 Image processing method, image processing device, related equipment and storage medium

Publications (1)

Publication Number Publication Date
CN113506262A true CN113506262A (en) 2021-10-15

Family

ID=78011860

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110768694.3A Withdrawn CN113506262A (en) 2021-07-07 2021-07-07 Image processing method, image processing device, related equipment and storage medium

Country Status (1)

Country Link
CN (1) CN113506262A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114565582A (en) * 2022-03-01 2022-05-31 佛山读图科技有限公司 Medical image classification and lesion area positioning method, system and storage medium
CN117274502A (en) * 2023-11-17 2023-12-22 北京唯迈医疗设备有限公司 Image processing method and device for assisting interventional operation

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2013128705A (en) * 2011-12-22 2013-07-04 Aze Ltd Medical image forming apparatus, medical image forming program, and medical image forming method
US20150043774A1 (en) * 2013-08-09 2015-02-12 Siemens Aktiengesellschaft Automatic Planning For Medical Imaging
CN109584997A (en) * 2018-10-26 2019-04-05 首都医科大学宣武医院 A kind of measurement method and system of the Morphologic Parameters of intracranial aneurysm image
CN110717961A (en) * 2019-09-17 2020-01-21 上海联影医疗科技有限公司 Multi-modal image reconstruction method and device, computer equipment and storage medium
CN111968070A (en) * 2020-04-22 2020-11-20 深圳睿心智能医疗科技有限公司 Blood vessel detection method and device based on three-dimensional modeling
CN112397198A (en) * 2020-11-17 2021-02-23 上海商汤智能科技有限公司 Image processing method and device, electronic equipment and storage medium
CN112967291A (en) * 2021-03-01 2021-06-15 北京安德医智科技有限公司 Image processing method and device, electronic equipment and storage medium

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2013128705A (en) * 2011-12-22 2013-07-04 Aze Ltd Medical image forming apparatus, medical image forming program, and medical image forming method
US20150043774A1 (en) * 2013-08-09 2015-02-12 Siemens Aktiengesellschaft Automatic Planning For Medical Imaging
CN109584997A (en) * 2018-10-26 2019-04-05 首都医科大学宣武医院 A kind of measurement method and system of the Morphologic Parameters of intracranial aneurysm image
CN110717961A (en) * 2019-09-17 2020-01-21 上海联影医疗科技有限公司 Multi-modal image reconstruction method and device, computer equipment and storage medium
CN111968070A (en) * 2020-04-22 2020-11-20 深圳睿心智能医疗科技有限公司 Blood vessel detection method and device based on three-dimensional modeling
CN112397198A (en) * 2020-11-17 2021-02-23 上海商汤智能科技有限公司 Image processing method and device, electronic equipment and storage medium
CN112967291A (en) * 2021-03-01 2021-06-15 北京安德医智科技有限公司 Image processing method and device, electronic equipment and storage medium

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114565582A (en) * 2022-03-01 2022-05-31 佛山读图科技有限公司 Medical image classification and lesion area positioning method, system and storage medium
CN117274502A (en) * 2023-11-17 2023-12-22 北京唯迈医疗设备有限公司 Image processing method and device for assisting interventional operation
CN117274502B (en) * 2023-11-17 2024-03-01 北京唯迈医疗设备有限公司 Image processing method and device for assisting interventional operation

Similar Documents

Publication Publication Date Title
JP4832300B2 (en) Method of operating medical image diagnosis support apparatus, medical image diagnosis support apparatus, and image processing program
JP5583128B2 (en) Selecting a snapshot of a medical image sequence
US9311717B2 (en) Processing and displaying a breast image with overlaid glandular contour
US8270688B2 (en) Method for intelligent qualitative and quantitative analysis assisting digital or digitized radiography softcopy reading
US20100135562A1 (en) Computer-aided detection with enhanced workflow
US20070016016A1 (en) Interactive user assistant for imaging processes
US20100316277A1 (en) Method, system, apparatus, and computer program product for interactive hepatic vascular and biliary system assessment
US20030016850A1 (en) Systems and graphical user interface for analyzing body images
US20100034439A1 (en) Medical image processing apparatus and medical image processing method
US9443317B2 (en) Image display of a centerline of tubular structure
CN113506262A (en) Image processing method, image processing device, related equipment and storage medium
US20110144482A1 (en) Image display device and method, as well as program
JP2007044239A (en) Medical image diagnostic apparatus, medical image processing device and medical image processing program
JP2011086276A (en) Radiographic interpretation report preparation device, method, and program
JP2010148866A (en) Image processing apparatus and image processing method
US20100177177A1 (en) Inspection of tubular-shaped structures
US20100150418A1 (en) Image processing method, image processing apparatus, and image processing program
US11610667B2 (en) System and method for automated annotation of radiology findings
US11284855B2 (en) Ultrasound needle positioning system and ultrasound needle positioning method utilizing convolutional neural networks
CN113516700A (en) Image processing method, image processing device, related equipment and storage medium
KR20220155828A (en) Medical image analysis apparatus and method, medical image visualization apparatus and method
JP2005312937A (en) Medical image processing apparatus, and method for processing medical image
JP2016525426A (en) Matching findings between imaging datasets
CN113516701A (en) Image processing method, image processing device, related equipment and storage medium
JP6744175B2 (en) Medical image display device and interpretation report creation support device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WW01 Invention patent application withdrawn after publication

Application publication date: 20211015

WW01 Invention patent application withdrawn after publication