CN113516700A

CN113516700A - Image processing method, image processing device, related equipment and storage medium

Info

Publication number: CN113516700A
Application number: CN202110768350.2A
Authority: CN
Inventors: 宋涛; 徐韵成
Original assignee: Shanghai Sensetime Intelligent Technology Co Ltd
Current assignee: Shanghai Sensetime Intelligent Technology Co Ltd
Priority date: 2021-07-07
Filing date: 2021-07-07
Publication date: 2021-10-19

Abstract

The application discloses an image processing method, an image processing device, related equipment and a storage medium, wherein the method comprises the following steps: acquiring a first vessel medical image containing at least one vessel; determining a target vessel in a first vessel medical image; forming a central line of the target blood vessel in the first blood vessel medical image based on the central line detection result of the target blood vessel to obtain a second blood vessel medical image comprising the central line; displaying a target vessel-related medical image, wherein the target vessel-related medical image comprises a second vessel medical image. By means of the method, the center line of the blood vessel can be displayed, and therefore a user can quickly determine whether the detection of the center line of the blood vessel is accurate or not.

Description

Image processing method, image processing device, related equipment and storage medium

Technical Field

The present application relates to the field of medical image processing technologies, and in particular, to an image processing method and apparatus, and related devices and storage media.

Background

By imaging the blood vessel, the relevant vascular disease can be diagnosed by observing the morphology of the blood vessel. Currently, various blood vessel imaging techniques have been applied in clinical practice, such as Computed Tomography Angiography (CTA), Magnetic Resonance Angiography (MRA), and the like.

At present, the diagnosis of blood vessels requires post-processing reconstruction of original images obtained by scanning, for example, the diagnosis of plaque of blood vessels requires post-processing of original images to obtain curved surface reconstructed images. Usually, the generation of post-processed medical images such as surface reconstructed images needs to be dependent on the centerline of the blood vessel. Therefore, whether the vessel centerline is accurate has a large impact on the formation of post-processing medical images.

Disclosure of Invention

The application provides an image processing method and device, and related equipment and storage medium thereof.

In order to solve the technical problem, the application adopts a technical scheme that: there is provided an image processing method including: acquiring a first vessel medical image containing at least one vessel; determining a target vessel in a first vessel medical image; forming a central line of the target blood vessel in the first blood vessel medical image based on the central line detection result of the target blood vessel to obtain a second blood vessel medical image comprising the central line; displaying a target vessel-related medical image, wherein the target vessel-related medical image comprises a second vessel medical image.

The center line on the blood vessel can be automatically formed by using the detection result of the center line of the target blood vessel without manually determining the center line by a user, so that the center line forming efficiency is improved, and the waiting time of the user is reduced; moreover, after the center line of the target blood vessel is generated, the center line can be displayed on the target blood vessel, so that a user can evaluate the automatically formed center line to quickly determine whether the detection of the center line of the target blood vessel is accurate or whether other problems such as fracture exist, the accuracy of the center line can be ensured, and the accuracy of a medical image generated by using the center line can be further improved.

Wherein, after displaying the medical image related to the target blood vessel, the image processing method further comprises: responding to the adjustment operation of the user on the second blood vessel medical image, adjusting the second blood vessel medical image, and displaying the adjusted second blood vessel medical image; and/or, in response to the blood vessel selection operation of the user, taking the blood vessel selected by the user as a new target blood vessel, and re-executing the steps of forming the central line of the target blood vessel and subsequent steps thereof in the first blood vessel image medical image based on the central line detection result of the target blood vessel.

Therefore, the second blood vessel medical image is more accurate through adjustment of the second blood vessel medical image, and the accuracy of the medical image generated based on the second blood vessel medical image can be improved.

Wherein, the second vessel medical image is adjusted, and the second vessel medical image comprises any one of the following items: performing vessel adjustment on the second vessel medical image, wherein the vessel adjustment comprises adjusting the center line of the vessel and/or adjusting the region of the vessel; adding characters input by a user at a user-specified position in the second blood vessel medical image; deleting the content added by the user in the user selection area of the second blood vessel medical image; at least one of moving, scaling and rotating the second vessel medical image; and taking the blood vessel selected by the user in the second blood vessel medical image as the adjusted second blood vessel medical image.

Therefore, by setting a plurality of adjustment operations, the second blood vessel medical image can be adjusted based on the problems existing in the second blood vessel medical image, so that the second blood vessel medical image is more accurate.

Wherein, the adjustment of the center line of the blood vessel comprises any one of the following steps: performing first highlighting on a user-selected centerline in the second vessel medical image; performing moving operation on the central line selected by the user in the second blood vessel medical image; connecting the central line in the second blood vessel medical image with a line segment added by the user for the central line to form a new central line; performing angle adjustment on the central line in the second blood vessel medical image and/or the line segment added to the central line by the user; adjusting the region of the blood vessel, comprising any one of the following steps: adjusting the position and/or length of the blood vessel in the second blood vessel medical image; new blood vessels are generated in the second vascular medical image.

Therefore, the generated central line can be more accurate and has no other problems such as fracture and the like by adjusting the central line of the blood vessel; alternatively, by adjusting the blood vessel region, it is possible to avoid that the detection of the center line is affected by a blood vessel segmentation error.

Wherein the medical image related to the target blood vessel further comprises a curved surface reconstruction image of the target blood vessel; after the second blood vessel medical image is adjusted and the adjusted second blood vessel medical image is displayed, the image processing method further comprises: responding to the confirmation operation of the user, updating the center line of the target blood vessel by using the content of the blood vessel adjustment, and generating a new curved surface reconstruction image based on the updated center line, or sending the content of the blood vessel adjustment to a server and receiving the new curved surface reconstruction image fed back by the server; and updating the displayed curved surface reconstruction image by using the new curved surface reconstruction image.

Therefore, a new curved surface reconstruction image is generated based on the adjusted second blood vessel medical image and is updated and displayed, so that a user can check the updated medical image to confirm whether any place needs to be adjusted, and the accuracy of the curved surface reconstruction image is improved.

Wherein, responding to the adjustment operation of the user on the second vessel medical image, the adjusting the second vessel medical image comprises: responding to the selection operation of the user on the tool items in the functional area of the display interface, and adjusting the second blood vessel medical image to be matched with the selected tool items; in response to a user's blood vessel selection operation, regarding the blood vessel selected by the user as a new target blood vessel, including: and in response to the selection operation of the user on the blood vessel mark in the functional area of the display interface, taking the blood vessel corresponding to the blood vessel mark selected by the user as a new target blood vessel.

Therefore, by setting the display function area on the display interface, the user can conveniently adjust the second blood vessel medical image through the tool items in the function area.

Wherein the target vessel-related image further comprises at least one of: the method comprises the following steps of obtaining a curved surface reconstruction image of a target blood vessel, a blood vessel section image corresponding to the specified position of the target blood vessel in the curved surface reconstruction image, a blood vessel straightening image of the curved surface reconstruction image, a maximum density projection reconstruction image of the target blood vessel, a medical scanning image containing the target blood vessel, and thumbnails of a plurality of medical scanning images obtained by scanning the target part; wherein, the target blood vessel belongs to the target part, and the plane of the section diagram of the blood vessel is vertical to the plane of the curved surface reconstruction image; the blood vessel medical image, the curved surface reconstruction image, the blood vessel section image, the blood vessel straightening image, the maximum density projection reconstruction image, the medical scanning image and the thumbnail are displayed on the same display interface or different display interfaces.

Therefore, by displaying the medical image related to the lesion diagnosis on the display interface, the user can be assisted in quickly diagnosing the lesion.

Wherein, two or more of the blood vessel image, the curved surface reconstruction image, the blood vessel section image, the blood vessel straightening image and the maximum density projection reconstruction image are generated based on a preset slide reading rule in response to the same operation of a user; after the curved surface reconstructed image is displayed, the image processing method further comprises the following steps: responding to a first preset operation of a user on the curved surface reconstruction image, determining a display angle matched with the first preset operation, and displaying the curved surface reconstruction image matched with the display angle again; displaying a medical scan image, comprising: and displaying the medical scanning image, and performing second highlighting on the target blood vessel in the medical scanning image.

Therefore, the angle adjustment operation is carried out on the curved surface reconstructed image, so that the curved surface reconstructed image matched with the display angle is displayed on the display interface again, and the diagnosis of the focus of a user is assisted.

The first blood vessel medical image and the second blood vessel medical image are blood vessel three-dimensional images, the first blood vessel medical image is generated based on a blood vessel segmentation result of the medical scanning image, and the blood vessel segmentation result is obtained by processing the medical scanning image in a first deep learning mode; the central line detection result is obtained by processing the first blood vessel medical image in a second deep learning mode; displaying an image relating to a target vessel, comprising: displaying the second vessel medical image and displaying the name of the at least one vessel on the second vessel medical image.

Therefore, the first blood vessel medical image and the second blood vessel medical image are processed in a deep learning mode, the automatic detection of the central line and the blood vessel can be realized, and the detection of the central line and the blood vessel is more accurate.

The image processing method further comprises the following steps: displaying at least one lesion information on the blood vessel; and/or generating and displaying diagnosis auxiliary information based on the detection information of the blood vessel and the lesion information, and copying or modifying the diagnosis auxiliary information in response to a second preset operation of the user.

Therefore, by displaying at least one type of lesion information of the blood vessel, information about the lesion can be presented to the user, thereby assisting the user in diagnosing the lesion and avoiding misdiagnosis or missed diagnosis.

In order to solve the above technical problem, another technical solution adopted by the present application is: provided is an image processing apparatus including: an acquisition module for acquiring a first vessel medical image containing at least one vessel; a determination module for determining a target vessel in a first vessel medical image; a generation module, configured to form a centerline of a target blood vessel in the first blood vessel medical image based on a centerline detection result of the target blood vessel, and obtain a second blood vessel medical image including the centerline; a display module for displaying a medical image related to the target blood vessel, wherein the medical image related to the target blood vessel comprises a second blood vessel medical image.

In order to solve the above technical problem, another technical solution adopted by the present application is: there is provided an image processing apparatus comprising a processor and a memory, the memory storing program instructions, the processor being configured to perform the image processing method described above.

In order to solve the above technical problem, another technical solution adopted by the present application is: there is provided a computer-readable storage medium storing program instructions that can be executed to implement the image processing method described above.

According to the scheme, the center line of the target blood vessel can be automatically formed by using the detection result of the center line of the target blood vessel without manually determining the center line by a user, so that the center line forming efficiency is improved, and the waiting time of the user is reduced; and after the central line of the target blood vessel is generated, the central line can be displayed on the target blood vessel, so that a user can evaluate the automatically formed central line to quickly determine whether the detection of the central line of the target blood vessel is accurate or whether other problems such as fracture exist, and the accuracy of the central line can be ensured after the user confirms the automatically formed central line, and the accuracy of a medical image generated by using the central line can be improved.

Drawings

FIG. 1 is a schematic flowchart of an embodiment of an image processing method provided in the present application;

FIG. 2 is a schematic diagram of an embodiment of a vascular medical image provided by the present application;

FIG. 3 is a schematic view of an embodiment of a medical scan image provided herein;

FIG. 4 is a schematic diagram of an embodiment of a surface reconstructed image provided herein;

FIG. 5 is a schematic diagram of an embodiment of a vessel alignment map of a curved reconstructed image provided by the present application;

FIG. 6 is a schematic diagram of one embodiment of a display interface provided herein;

FIG. 7 is a schematic flowchart of another embodiment of an image processing method provided in the present application;

FIG. 8 is a schematic structural diagram of an embodiment of an image processing apparatus provided in the present application;

FIG. 9 is a schematic structural diagram of an embodiment of an image processing apparatus provided in the present application;

FIG. 10 is a schematic structural diagram of an embodiment of a computer-readable storage medium provided in the present application.

Detailed Description

In order to make the purpose, technical solution and effect of the present application clearer and clearer, the present application is further described in detail below with reference to the accompanying drawings and examples.

The term "and/or" herein is merely an association describing an associated object, meaning that three relationships may exist, e.g., a and/or B, may mean: a exists alone, A and B exist simultaneously, and B exists alone. In addition, the character "/" herein generally indicates that the former and latter related objects are in an "or" relationship. Further, the term "plurality" herein means two or more than two. In addition, the term "at least one" herein means any one of a plurality or any combination of at least two of a plurality, for example, including at least one of A, B, C, and may mean including any one or more elements selected from the group consisting of A, B and C.

The device for executing the image processing method of the present application is, for example, an electronic device including a display screen, such as a computer, a tablet, a mobile phone, or a device with a specific function (e.g., a device for medical information processing), and is not limited in particular herein.

Referring to fig. 1-6, fig. 1 is a schematic flowchart of an embodiment of an image processing method provided by the present application, fig. 2 is a schematic diagram of an embodiment of a vascular medical image provided by the present application, fig. 3 is a schematic diagram of an embodiment of a medical scanned image provided by the present application, fig. 4 is a schematic diagram of an embodiment of a curved reconstructed image provided by the present application, fig. 5 is a schematic diagram of an embodiment of a vessel straightening graph of a curved reconstructed image provided by the present application, and fig. 6 is a schematic diagram of an embodiment of a display interface provided by the present application. It should be noted that, if the result is substantially the same, the flow sequence shown in fig. 1 is not limited in this embodiment. As shown in fig. 1, the present embodiment includes:

step S11: a first vascular medical image containing at least one blood vessel is acquired.

The method of the embodiment is used for processing and displaying medical images related to blood vessels, such as a curved surface reconstruction image, a blood vessel straightening image of the curved surface reconstruction image and the like. The blood vessel medical image is an image obtained by imaging a blood vessel through an imaging technology in the medical technology field, some diseases related to the blood vessel can be checked based on the blood vessel medical image, and when the blood vessel of the head and the neck needs to be diagnosed, the blood vessel medical image is obtained by scanning the head and the neck. The blood vessel medical image may be an image obtained by post-processing a medical scanning image, and the medical scanning image may be an angiographic image obtained by a Computed Tomography (CT) technique, which may also be referred to as a CTA image; of course, the medical scan image may also be an angiographic image obtained by Magnetic Resonance Angiography (MRA) technique. It is understood that in other embodiments, the angiographic image may be obtained by other vessel imaging techniques, and is not limited in any way.

In an embodiment, as shown in fig. 2, the first blood vessel medical image is a blood vessel three-dimensional image, and the blood vessel three-dimensional image enables a user to observe a condition of a blood vessel, for example, a condition of a lesion in the blood vessel, from multiple angles and at multiple levels, and more information about the blood vessel can be obtained compared with the blood vessel two-dimensional image, so that the user can make an accurate diagnosis and avoid a misdiagnosis. The first blood vessel medical image is a three-dimensional image generated based on the result of the blood vessel segmentation of the medical scanning image, that is, the blood vessels in the first blood vessel medical image only include blood vessels needed for diagnosis or only include blood vessels of a certain part, in other words, the first blood vessel medical image may include only one blood vessel by the blood vessel segmentation, or the first blood vessel medical image may include only a few blood vessels needed for diagnosis by the blood vessel segmentation. Because blood vessels of various parts in a human body are connected or intertwined, for example, blood vessels of a neck of the human body need to be diagnosed, and a medical scanning image of blood vessels of a brain, a neck and the like of the human body needs to be actually acquired to ensure the integrity of the acquired blood vessels of the neck, and in the actual diagnosis process, blood vessels of other parts may affect the diagnosis of a user, so that the blood vessels on the medical scanning image need to be segmented first to avoid the influence of the presence of the blood vessels of other parts on the diagnosis. It is understood that in other embodiments, the first blood vessel medical image may also be a blood vessel three-dimensional image without blood vessel segmentation, or may also be a blood vessel two-dimensional image, and may be specifically set according to actual use needs, which is not specifically limited herein.

Wherein, the result of the blood vessel segmentation is obtained by processing the medical scanning image by using the first deep learning mode. In the traditional blood vessel segmentation, the image before the blood vessel enhancement is subtracted from the image after the blood vessel enhancement to obtain a blood vessel segmentation result, so that a patient needs to receive scanning radiation twice; compared with the traditional blood vessel segmentation, the method and the device have the advantages that the first deep learning mode can be directly utilized, the medical scanning image can be based on a CTA image, the automatic processing is carried out to obtain the result of the blood vessel segmentation, namely the blood vessel segmentation result is obtained in the method, the patient can reduce one-time radiation, the time required by subsequently constructing other blood vessel three-dimensional images is reduced, and the time required by subsequently constructing reconstructed images is reduced. The algorithm or the network model related to the first deep learning manner is not specifically limited herein, and may be specifically set according to actual use requirements.

Since the result of vessel segmentation affects the detection of the subsequent centerline, in order to avoid the inaccuracy of the result of vessel segmentation obtained by the first deep learning method, in an embodiment, the user may adjust the result of vessel segmentation by an adjustment operation, where the specific adjustment method is determined according to the problem of the result of vessel segmentation.

Further, in order to facilitate the user to more clearly and intuitively observe the condition of the blood vessel, for example, the segmentation condition of the blood vessel, in one embodiment, as shown in fig. 2, the first blood vessel medical image, i.e., the three-dimensional image of the blood vessel generated based on the blood vessel segmentation result, is displayed in a volume rendering manner. It will be appreciated that in other embodiments, the first vessel medical image may be displayed in other manners that are easily viewable by the user.

As shown in fig. 3, the medical scan image is an electron computed tomography angiography image obtained by CT technique, and the blood vessel three-dimensional image is an image obtained by three-dimensionally reconstructing a CTA image. The method comprises the steps that a server processes an acquired medical scanning image to obtain a first blood vessel medical image, and the server transmits the first blood vessel medical image to equipment to enable the equipment to acquire the first blood vessel medical image; or a first vessel medical image obtained by processing the medical scanning image by the equipment.

Step S12: a target vessel in the first vessel medical image is determined.

In the present embodiment, the first blood vessel medical image is generated based on the result of blood vessel segmentation, that is, the first blood vessel medical image includes only a blood vessel to be diagnosed, and the blood vessel to be diagnosed may be a certain blood vessel of a certain part. If only one blood vessel is included in the first blood vessel medical image, the blood vessel is determined as a target blood vessel; if the first blood vessel medical image includes a plurality of blood vessels, one of the blood vessels can be determined as a target blood vessel, and when the plurality of blood vessels need to be diagnosed, each of the plurality of blood vessels in the first blood vessel medical image can be the target blood vessel.

The target blood vessel can be determined by a user or determined by the device or the server. And is not particularly limited herein. For example, taking the target blood vessel determined by the user as an example, as shown in fig. 2, the user may determine the target blood vessel by clicking the blood vessel on the first blood vessel medical image through a pointer, where each blood vessel on the first blood vessel medical image may be identified and named in a preset deep learning manner when the first blood vessel medical image is generated, and a blood vessel name 21 is marked at a position of the corresponding blood vessel on the first blood vessel medical image, so that the user can conveniently select and determine the target blood vessel; alternatively, a list 22 containing vessel names is generated in a region adjacent to the first vessel medical image through a preset deep learning manner, and a user can perform a selection operation on the list 22 of vessel names through a pointer to determine a target vessel. The user selects a blood vessel in the list of blood vessel names 22, at which time the selected blood vessel in the first blood vessel medical image may be highlighted to enable the user to determine whether the target blood vessel selection is erroneous based on the displayed blood vessel; alternatively, the blood vessel name 21 may be marked at the position of the blood vessel corresponding to the first blood vessel medical image, and the list 22 including the blood vessel name may be generated in the adjacent region of the first blood vessel medical image, and the two may be combined to determine the target blood vessel.

In a specific embodiment, the first medical image includes four blood vessels, the four blood vessels are determined to be a Left Internal Carotid Artery (L-ICA), a Right Internal Carotid Artery (R-ICA), a Left vertebral Artery (L-VA), and a Right vertebral Artery (R-VA) in a preset deep learning manner, and the blood vessel names 21 are labeled at corresponding blood vessels in the first medical image, so that the user can distinguish the blood vessels in the first medical image, thereby assisting the user in determining the target blood vessel.

Step S13: and forming a central line of the target blood vessel in the first blood vessel medical image based on the central line detection result of the target blood vessel, and obtaining a second blood vessel medical image comprising the central line.

In the present embodiment, as shown in fig. 2, based on the detection result of the center line 23 of the target blood vessel, the center line 23 can be automatically formed on the target blood vessel in the first blood vessel medical image, so as to obtain the second blood vessel medical image including the center line 23, without the need for the user to manually determine the center line 23, thereby improving the efficiency of forming the center line 23, shortening the time for generating post-processing medical images such as a curved surface reconstructed image, and further reducing the waiting time of the user. That is, the second blood vessel medical image differs from the first blood vessel medical image only in whether or not the center line 23 is formed on the target blood vessel, so the second blood vessel medical image is also a blood vessel three-dimensional image. Since the second blood vessel medical image is displayed in a volume rendering manner as the first blood vessel medical image, in order to ensure that the user can observe the detection condition of the center line 23 from the second blood vessel medical image, the formed center line 23 can be clearly displayed on the target blood vessel by adjusting the brightness, contrast, and the like of the center line 23 relative to the target blood vessel.

In one embodiment, the centerline detection result of the target blood vessel is obtained by performing centerline detection on the target blood vessel of the first blood vessel medical image. For example, if the internal carotid artery and the vertebral artery need to be diagnosed, the internal carotid artery and the vertebral artery are determined to be the target blood vessels, then the starting point and the end point in the internal carotid artery and the vertebral artery are found on the medical image of the first blood vessel, the central line of the internal carotid artery is extracted and obtained based on the starting point and the end point of the internal carotid artery, and the central line of the vertebral artery is extracted and obtained based on the starting point and the end point of the vertebral artery, so that the central line detection results of the internal carotid artery and the vertebral artery are obtained.

And the detection result of the central line is obtained by processing the first blood vessel medical image by using a second deep learning mode. Traditional central line testing process all is that the user edits with semi-automatic mode in the workstation and obtains, compares in traditional central line testing mode, and this application can directly utilize the second degree of deep learning mode to detect based on first blood vessel medical image is automatic and obtain the central line, has improved the precision and the efficiency that the central line detected. The algorithm or the network model related to the second deep learning manner is not specifically limited herein, and may be specifically set according to actual use requirements.

Whether the above-mentioned detection result of the center line accurately affects the generation of the medical image related to the target blood vessel. For example, assuming that the target blood vessel is regarded as a special pipeline, the surface of the pipeline is formed by rolling and enveloping the spherical center along a certain curve (central axis), that is, the central axis of the pipeline directly affects the formed surface of the pipeline, and the central line of the blood vessel can be regarded as the central axis, so the detection result of the central line directly affects the construction of the curved surface reconstruction image or other medical images which need to be generated based on the central line. Based on this, in order to avoid the situation that the detection result of the center line obtained by the deep learning method is inaccurate, in an embodiment, the user may adjust the detection result of the center line of the target blood vessel through an adjustment operation, so that the accuracy of the center line is ensured, and the accuracy of the medical image generated by using the center line can be further improved.

Step S14: and displaying the medical image related to the target blood vessel.

In this embodiment, a medical image relating to the target blood vessel may be displayed on the display interface. The medical image related to the target blood vessel includes a second blood vessel medical image, that is, the second blood vessel medical image is displayed on the display interface, that is, the target blood vessel is displayed on the display interface and the corresponding center line of the target blood vessel is displayed on the target blood vessel, so that a user can evaluate the automatically formed center line, and the user can quickly determine whether the center line of the target blood vessel is accurately detected or whether the detected center line has other problems such as fracture and the like, thereby shortening the time of other medical images generated based on the second blood vessel medical image subsequently, and further reducing the waiting time of the user. The display interface may be a display screen of the device, or other interfaces capable of displaying content, and may be specifically set according to actual use, which is not specifically limited herein.

Further, in order to facilitate the user to determine the blood vessel on the second blood vessel medical image, in an embodiment, the name of at least one blood vessel is displayed on the second blood vessel medical image, the blood vessel displayed with the blood vessel name may be a target blood vessel, and by correspondingly displaying the blood vessel name on the target blood vessel in the second blood vessel medical image, the user can quickly and directly know the position of the target blood vessel and which blood vessels the target blood vessel is from the displayed second blood vessel medical image, thereby improving the image reading speed of the user. It is understood that, in other embodiments, the blood vessel displayed with the blood vessel name may be other blood vessels besides the target blood vessel, and is not limited in particular.

When a plurality of target blood vessels exist, the blood vessel names of the target blood vessels are directly and simultaneously displayed on the second blood vessel medical image without an operation instruction of a user. Of course, the vessel name of each target vessel may be displayed on the second vessel medical image based on the selection operation of the user. For example, as shown in fig. 2, taking the blood vessel name 21 of the target blood vessel as an example of single display on the second blood vessel medical image, the left display area of the second blood vessel medical image displays a list 22 of corresponding target blood vessel names, and the user can display the blood vessel name 21 on the corresponding target blood vessel in the second blood vessel medical image in response to the user's selection operation by selecting the name of the blood vessel in the list 22 of blood vessel names or selecting a certain target blood vessel on the second blood vessel medical image. The blood vessel names 21 mentioned above can identify and name each target blood vessel through a preset deep learning manner, and an algorithm or a network model related to the preset deep learning manner can be specifically set according to a use requirement, which is not specifically limited herein.

In the above embodiment, when there is one target blood vessel, the center line is displayed on the target blood vessel when the second blood vessel medical image is displayed. When the target blood vessels are multiple, the central lines of the multiple target blood vessels can be simultaneously displayed on the corresponding target blood vessels when the second blood vessel medical image is displayed; or, the center line may be displayed on the second blood vessel medical image based on a single selection operation of the user, and how to display the center line in the case of multiple target blood vessels may be specifically set according to actual use requirements, which is not specifically limited herein.

For example, the center lines of the target blood vessels are not displayed at the same time. As shown in fig. 2, the second blood vessel medical image is located in the right region of the display interface, the second blood vessel medical image includes four target blood vessels, and the four target blood vessels are correspondingly formed with center lines 23; the left area of the display interface displays a name list 22 'L-ICA', 'R-ICA', 'L-RA' and 'R-VA' of corresponding target blood vessels, and each target blood vessel in the second blood vessel medical image correspondingly displays a blood vessel name 21; the user may select a target vessel by clicking on the name of the target vessel in the list of vessel names 22 or by clicking on the target vessel on the second vessel medical image, at which time the centerline 23 of the selected target vessel is displayed in the second vessel medical image. As shown in FIG. 2, the currently selected target vessel is "L-ICA", and the target vessel "L-ICA" of the second blood vessel medical image has its corresponding centerline 23 displayed thereon.

In other embodiments, the medical image related to the target blood vessel may further include a curved reconstructed image 4a as shown in fig. 4, a blood vessel tangent plane view 4b corresponding to a specified position of the target blood vessel in the curved reconstructed image 4a as shown in fig. 4, a blood vessel straightening view 5b of the curved reconstructed image 4a as shown in fig. 5, a maximum density projection reconstructed image, a medical scanning image including the target blood vessel as shown in fig. 3, or a thumbnail image 2a of several medical scanning images obtained by scanning the target region as shown in fig. 2, which is not particularly limited herein. Wherein, for the medical scanning image containing the target blood vessel or the thumbnails 2a of a plurality of medical scanning images obtained by scanning the target part, the target blood vessel belongs to the target part; for the blood vessel tangent plane map 4b corresponding to the specified position of the target blood vessel in the curved reconstructed image 4a, the plane of the blood vessel tangent plane map 4b is perpendicular to the plane of the curved reconstructed image 4a, specifically, the blood vessel tangent plane is shown in the region 4b in fig. 4, wherein in the region 4b, the sub-region including the white outer frame is the blood vessel tangent plane at the specified position of the blood vessel, i.e., at the position corresponding to the white pointer in the region 4a, the sub-region located at the upper part of the sub-region including the white outer frame is the blood vessel tangent plane at the specified position of the blood vessel in the region 4a, and the sub-region located at the lower part of the sub-region including the white outer frame is the blood vessel tangent plane corresponding to the lower part of the specified position of the blood vessel in the region 4 a.

In one embodiment, the medical images related to the target blood vessel may be displayed on the same display interface at the same time or on different display interfaces. For example, as shown in fig. 6, medical images related to a target blood vessel are simultaneously displayed on the same display interface, and the medical images related to the target blood vessel include a medical scanning image, a curved surface reconstructed image, a blood vessel tangent plane image corresponding to a specified position of the target blood vessel in the curved surface reconstructed image, a second blood vessel medical image, and thumbnails of a plurality of medical scanning images obtained by scanning a target portion. The first area 61 of the display interface displays medical scanning images, the second area 62 displays curved surface reconstruction images, the third area 63 displays a blood vessel tangent plane image corresponding to the designated position of a target blood vessel in the blood curved surface reconstruction images, the fourth area 64 displays second blood vessel medical images, and the fifth area 65 displays thumbnails of a plurality of medical scanning images obtained by scanning the target part. The medical images related to the target blood vessel are displayed on the same interface, so that a user can observe the medical images related to the blood vessel at the same time, and the user can visually compare the medical images, thereby achieving the purpose of assisting a doctor in diagnosing and improving the diagnosis efficiency and accuracy; moreover, each medical image is displayed on the same interface in different areas, the display interface is clear, and the display content is prevented from being mixed. In addition, medical images displayed in different areas on the same interface can be exchanged according to the reading habits of users.

Two or more of the blood vessel image, the curved surface reconstruction image, the blood vessel section image, the blood vessel straightening image and the maximum density projection reconstruction image are generated based on a preset slide reading rule in response to the same operation of a user, namely, the user can generate and display two or more medical images which accord with the preset slide reading rule through the same operation. For example, taking the curved reconstructed image and the blood vessel straightening map as an example, the preset interpretation rule is to generate the medical image at the first angle, and the user can directly generate the curved reconstructed image and the blood vessel straightening map at the first angle through the same operation, so that the two medical images are simultaneously displayed on the display interface at the first angle.

In the embodiment of the present application, the medical image related to the target blood vessel is displayed so that the user can visually observe a plurality of medical images related to the blood vessel, so that the user can determine whether a lesion exists in the blood vessel from multiple angles, and the diagnosis efficiency and accuracy of the user are improved. Further, in order to assist the user in viewing the medical image, that is, assist the user in diagnosing a lesion in a blood vessel, in one embodiment, the device or the server may acquire information about at least one lesion of a blood vessel in the medical image and display the information about the at least one lesion of the blood vessel, so that the user can obtain information related to the lesion while viewing the lesion in the medical image, for example, morphological parameters of the lesion, a type of the lesion, and the like, thereby assisting the user in diagnosing the lesion and improving the diagnosis efficiency and accuracy of the user; in addition, the information of the focus displayed to the user can be diversified, rich diagnosis information can be provided, and the time for the user to make a focus treatment scheme is shortened. It is to be understood that, in other embodiments, information of at least one type of lesion in the medical image may also be prompted by voice broadcast or other methods, and may be specifically set according to actual use needs, which is not specifically limited herein.

The server or the device can detect the medical scanning image in a preset deep learning mode to obtain information of at least one focus. Compared with the method that a user directly judges whether a focus exists in a blood vessel through naked eyes based on a medical scanning image, the method and the device can automatically detect the focus when the medical image of the blood vessel is obtained, so that the speed and the accuracy of focus detection are improved, and misdiagnosis or missed diagnosis is avoided; in addition, the relevant information of the focus can be automatically acquired while the focus is detected, so that the risk of the focus can be evaluated by a user, and the user can be assisted to make a relevant treatment scheme.

In some embodiments, in displaying the information of the lesion, the information of the lesion may be displayed together with the medical image. In other embodiments, the information of the lesion may be displayed alone, that is, the information of the lesion is not displayed together with the medical image. How to display the information of the focus can be specifically set according to actual use needs, and is not specifically limited herein.

In some embodiments, the information of the lesion may be displayed together with the medical scanning image or a post-processing medical image generated based on the medical scanning image, wherein the post-processing medical image may be a three-dimensional image of a blood vessel, a curved surface reconstruction image, a blood vessel straightening map of a curved surface reconstruction image, or a maximum density projection reconstruction image, and the like, and is not limited in particular. In some embodiments, information of the lesion may be displayed together with a medical image corresponding to the lesion, so that a user may quickly diagnose the lesion based on the lesion information of the corresponding medical image. For example, since an aneurysm is detected based on a medical scan image, a plaque is detected based on a curved surface reconstructed image, that is, a medical image corresponding to the aneurysm is a medical scan image, and a medical image corresponding to the plaque is a curved surface reconstructed image, information on the aneurysm and information on the plaque can be displayed together with the medical scan image and the curved surface reconstructed image. Note that, the information on the lesion may not be displayed together with the medical image corresponding to the lesion, and for example, when a plurality of lesions are included, the information on the plurality of lesions may be displayed together with a certain medical image. Specifically, if the lesion includes plaque and aneurysm, information on the plaque and aneurysm is displayed together with the medical scan image.

It can be understood that, in the above embodiment, when the information of the lesion and the medical image are displayed on the display interface together, the information of the lesion and the medical image may be displayed in different regions on the same display interface, so that the display interface is clear and intuitive, and the user can diagnose the lesion conveniently. In other embodiments, the information of the lesion may also be displayed in the same region as the medical image, that is, the information of the lesion is displayed on the medical image, for example, the information of the lesion may be displayed at a position on a blood vessel of the medical image corresponding to the lesion, specifically, the region of the lesion may be highlighted, and/or the display of the relevant lesion may be displayed in text, and how to display the information may not be limited.

In one embodiment, after the user confirms that the displayed medical image and the focus information are correct, the method can also automatically generate and display diagnosis auxiliary information according to the detection information of the focus and the information of the focus by using a preset deep learning mode, namely, automatically generate structured text content capable of assisting the user in diagnosing, so that a doctor is assisted in completing the writing of a diagnosis report, the time consumed by the writing of the diagnosis report is reduced, the time of waiting for the diagnosis report by a patient is reduced, and styles and habits of different users in writing the report can be standardized. Wherein, the structured text content can also be copied or modified. Specifically, the device automatically copies or modifies the diagnosis assistance information in response to a second preset operation of the user and based on the structured report content, the reading and diagnosis efficiency of the doctor can be improved. In addition, the user can send the medical image and the related information which are confirmed to be correct to the medical image system for other users to check, or can print the content of the display interface through the function of film on the interface.

Referring to fig. 7, fig. 7 is a schematic flowchart illustrating an image processing method according to another embodiment of the present application. It should be noted that, if the result is substantially the same, the flow sequence shown in fig. 7 is not limited in this embodiment. As shown in fig. 7, the present embodiment includes:

step S71: a first vascular medical image containing at least one blood vessel is acquired.

Step S71 is similar to step S11 in the above embodiment, and is not repeated here.

Step S72: a target vessel in the first vessel medical image is determined.

Step S72 is similar to step S12 in the above embodiment, and is not repeated here.

Step S73: and forming a central line of the target blood vessel in the first blood vessel medical image based on the central line detection result of the target blood vessel, and obtaining a second blood vessel medical image comprising the central line.

Step S73 is similar to step S13 in the above embodiment, and is not repeated here.

Step S74: and displaying the medical image related to the target blood vessel.

Step S74 is similar to step S14 in the above embodiment, and is not repeated here.

Step S751: and adjusting the second vessel medical image in response to the adjustment operation of the user on the second vessel medical image.

In one embodiment, after the user views the second vessel medical image on the display interface, it is determined whether an adjustment of the second vessel medical image is needed based on the displayed content. For example, the user may confirm whether the vessel segmentation is correct through the second vessel medical image, and may also confirm whether the center line position on the target vessel is accurate or whether there is a lack or the like through the second vessel medical image, so as to determine whether to adjust the second vessel medical image.

Wherein the adjustment operation on the second vessel medical image can be determined according to a specific problem existing in the second vessel medical image. In a specific embodiment, the adjusting operation on the second blood vessel medical image may include any one of the following: performing a vessel adjustment on the second vessel medical image, for example, a region adjustment of a vessel or a centerline adjustment of the vessel; characters input by a user are added at a user-specified position in the second blood vessel medical image, namely, the labeling information and the like can be added on the second blood vessel medical image; deleting the content added by the user in the user selection area of the second blood vessel medical image, for example, deleting characters added by the user or line segments modified from the central line; at least one of moving, scaling and rotating the second vessel medical image; the blood vessel selected by the user in the second blood vessel medical image is taken as the adjusted second blood vessel medical image, that is, the second blood vessel medical image is adjusted to only display the selected blood vessel, that is, the selected blood vessel is displayed on the display interface in a full page, so that the second blood vessel medical image only displays the selected blood vessel on the display interface, and the second blood vessel medical image is not modified.

In an embodiment, the vessel adjustment of the second vessel medical image may be an adjustment of a center line of the vessel. For example, it may be that the user-selected centerline in the second vessel medical image is first highlighted, that is, the selected centerline is highlighted, for example, in a highlighted form, so that the user can visually observe the centerline more clearly, so that the user can evaluate the automatically formed centerline; or the moving operation is carried out on the central line selected by the user in the second blood vessel medical image; or connecting the central line in the second blood vessel medical image with a line segment added by the user for the central line to form a new central line; or the center line in the second blood vessel medical image and/or the line segment added by the user to the center line are/is subjected to angle adjustment so as to make the center line more conform to the morphological constitution of the blood vessel.

In other embodiments, the vessel adjustment performed on the second vessel medical image may also be an adjustment of a vessel region, that is, an adjustment of a result of vessel segmentation. For example, it is known from the blood vessel segmentation result that the blood vessel segmentation is not accurate enough, and if a certain segmented blood vessel is too long or too short, the length of the blood vessel in the second blood vessel medical image needs to be adjusted; if the blood vessel segmentation result shows that a certain blood vessel is missing, a new blood vessel needs to be generated in the second blood vessel medical image; alternatively, the position of the blood vessel on the second blood vessel medical image may be adjusted by moving, zooming, rotating, or the like.

In order to facilitate the adjustment of the second blood vessel medical image by the user, in one embodiment, a functional area is displayed on the display interface, and the tool items on the functional area can be used for adjusting the second blood vessel medical image. As shown in fig. 2, a region located on the left side of the second blood vessel medical image includes a functional region 2b, the functional region 2b includes a plurality of tool items, and the currently displayed tool items are basic tool items in the device. Wherein, the tool items are from left to right, and from top to bottom: the method comprises the following steps of displaying a display layout tool of an interface, globally displaying a selected blood vessel, adjusting the brightness or contrast of a central line or the blood vessel and the like, translating a selected target, amplifying the selected target, writing the selected target, measuring an angle of the selected target, and refreshing a page. In other embodiments, a delete tool, a reset tool, etc. may also be included, and are not specifically limited herein. Further, there are differences in the tool items involved in the adjustment of the blood vessel center line and the adjustment of the blood vessel region, and in one embodiment, the tool item corresponding to the adjustment of the blood vessel center line and the tool item corresponding to the adjustment of the blood vessel region may be displayed in separate regions simultaneously, or may be displayed in the functional region 2b when a corresponding adjustment is required.

In a specific embodiment, the user can select a tool item in the functional area of the display interface, and the device responds to the selection operation of the user to adjust the second blood vessel medical image to be matched with the selected tool item.

Step S752: and displaying the adjusted second blood vessel medical image.

In this embodiment, after the user adjusts the second blood vessel medical image, the display interface displays the adjusted second blood vessel medical image, so that the user can confirm whether there are other places to be adjusted in the adjusted second blood vessel medical image through the display interface.

Step S753: and acquiring a new curved surface reconstruction image generated based on the adjusted second blood vessel medical image.

However, since diagnosis of a lesion such as a plaque of a blood vessel requires a curved surface reconstructed image or the like, it is necessary to acquire a curved surface reconstructed image or the like generated based on the second blood vessel medical image when detecting a plaque of a blood vessel. The curved surface reconstructed image is obtained by performing curved surface reconstruction on one or more blood vessels in the medical scanning image, that is, the curved surface reconstructed image can be obtained by performing curved surface reconstruction on one blood vessel in the medical scanning image, and at this time, the curved surface reconstructed image only includes the blood vessel; the curved surface reconstructed image may also be a curved surface reconstruction of a plurality of blood vessels in the medical scanning image, and the curved surface reconstructed image includes the plurality of blood vessels. The blood vessel straightening graph of the curved surface reconstruction image is an image obtained by straightening a certain blood vessel on the curved surface reconstruction image, and the blood vessel straightening graph of the curved surface reconstruction image is beneficial to diagnosing and analyzing the stenosis degree of the plaque. When the curved surface reconstruction image of the target blood vessel is specifically constructed, the curved surface reconstruction image of the target blood vessel is based on the central line of the target blood vessel on the second blood vessel medical image and the target blood vessel on the medical scanning image, so that the target blood vessel is subjected to second highlighting when the medical scanning image is displayed, and the curved surface reconstruction image of the target blood vessel can be constructed more accurately.

In the present embodiment, in response to the confirmation operation of the user, that is, after the user confirms that the adjusted second blood vessel medical image has no problem, the center line of the target blood vessel is updated with the content of the adjusted blood vessel, and a new curved surface reconstructed image is automatically generated based on the updated center line. In other embodiments, for the curved reconstructed image generated by the server calculation, after the user confirms the operation, the contents of the blood vessel adjustment are sent to the server, the server generates a new curved reconstructed image based on the updated center line, and at the moment, the generated new curved reconstructed image is sent to the device, so that the device acquires a new curved reconstructed image generated based on the adjusted second blood vessel medical image.

For example, as shown in fig. 2, taking the server computing to generate the curved reconstructed image as an example, the user may send the adjusted second blood vessel medical image to the server through the "sending" port, so that the server can generate a new curved reconstructed image based on the adjusted second blood vessel medical image; and when the second blood vessel medical image and other medical images displayed on the display interface are correct, the steps related to adjustment in the embodiment do not need to be executed, and at this time, the second blood vessel medical image and other medical images can be sent to the medical imaging system through the sending port, so that other users except the user can view the second blood vessel medical image and other medical images, and meanwhile, the content of the display interface can be printed through the film port.

Step S754: and updating the displayed curved surface reconstruction image by using the new curved surface reconstruction image.

In this embodiment, the obtained new curved surface reconstructed image is displayed on the display interface to display the new curved surface reconstructed image to the user, so that the curved surface reconstructed image on the display interface is updated.

Further, in order to facilitate the user to diagnose the lesion faster and more accurately based on the curved surface reconstructed image or other medical images, in an embodiment, the curved surface reconstructed image may be further adjusted based on a preset radiographing rule, that is, a radiographing rule of the user, so that the curved surface reconstructed image is displayed on the display interface in a form conforming to the preset rule. For example, the preset slide reading rule may be to display the curved reconstructed image at a preset angle on the display interface, or may also be to display a blood vessel straightening graph of the curved reconstructed image at a preset angle on the display interface, and the like, which is not limited herein. In other embodiments, the curved surface reconstruction image can be directly generated based on the preset film reading rule, and subsequent further adjustment is avoided, so that the medical image conforming to the film reading habit of the user can be generated at one time. In addition, the user may further perform operations such as filtering, deleting, or transmitting the displayed medical image.

Step S755: and responding to a first preset operation of the user on the curved surface reconstructed image, determining a display angle matched with the first preset operation, and displaying the curved surface reconstructed image matched with the display angle again.

In this embodiment, even if the curved surface reconstructed image can be displayed on the display interface based on the preset rule, the preset rule may be unfavorable for the diagnosis of the current lesion, so that the user may change the display angle of the curved surface reconstructed image by performing the first preset operation on the curved surface reconstructed image. Specifically, a user may perform a first preset operation on the curved surface reconstructed image displayed on the display interface, where the first preset operation may be an angle adjustment for displaying the curved surface reconstructed image, so that when the user performs the first preset operation, the device may automatically determine a display angle matched with the first preset operation, and redisplay the curved surface reconstructed image matched with the display angle on the display interface. The user may adjust the display angle of the curved reconstructed image by using 30 ° as an adjustment amount, that is, the adjustment amount of the display angle of the curved reconstructed image is 30 ° each time. In an embodiment, the adjustment amount of the curved surface reconstructed image may be 20 °, 35 ° or other degrees, and is not particularly limited herein.

In other embodiments, if the user confirms that the curved surface reconstructed image meets the predetermined rule and has no influence on the determination of the lesion, i.e., does not need to adjust, step S755 may not be performed.

Step S761: and in response to the blood vessel selection operation of the user, taking the blood vessel selected by the user as a new target blood vessel.

In this case, the user may need to diagnose other blood vessels except the target blood vessel temporarily, and at this time, medical images related to the increased blood vessels need to be displayed correspondingly. In an embodiment, the user selects a blood vessel marker displayed in the functional area of the display interface to use a blood vessel corresponding to the selected blood vessel marker as a new target blood vessel, and performs the step of forming the center line of the target blood vessel and subsequent steps thereof in the first blood vessel medical image based on the center line detection result of the target blood vessel again, that is, returns to perform step S73 and subsequent steps thereof, so as to facilitate the subsequent construction and generation of other medical images of the target blood vessel, thereby assisting the user in diagnosing the target blood vessel.

Referring to fig. 8, fig. 8 is a schematic structural diagram of an embodiment of an image processing apparatus according to the present application. In this embodiment, the image processing apparatus 80 includes an acquisition module 81, a determination module 82, a generation module 83, and a display module 84. The acquisition module 81 is used for acquiring a first vessel medical image containing at least one vessel. The determination module 82 is used to determine a target vessel in the first vessel medical image. The generation module 83 is configured to form a centerline of the target blood vessel in the first blood vessel medical image based on the centerline detection result of the target blood vessel, and obtain a second blood vessel medical image including the centerline. The display module 84 is configured to display the medical image related to the target blood vessel, wherein the medical image related to the target blood vessel includes the second blood vessel medical image.

After displaying the medical image related to the target blood vessel, the generating module 83 specifically further includes: responding to the adjustment operation of the user on the second blood vessel medical image, adjusting the second blood vessel medical image, and displaying the adjusted second blood vessel medical image; and/or, in response to the blood vessel selection operation of the user, taking the blood vessel selected by the user as a new target blood vessel, and re-executing the step of forming the central line of the target blood vessel and subsequent steps thereof in the first blood vessel medical image based on the central line detection result of the target blood vessel.

Wherein, the adjusting the second blood vessel medical image includes any one of the following: performing vessel adjustment on the second vessel medical image, wherein the vessel adjustment comprises adjusting the center line of the vessel and/or adjusting the region of the vessel; adding characters input by a user at a user-specified position in the second blood vessel medical image; deleting the content added by the user in the user selection area of the second blood vessel medical image; at least one of moving, scaling and rotating the second vessel medical image; and taking the blood vessel selected by the user in the second blood vessel medical image as the adjusted second blood vessel medical image.

Wherein, the medical image related to the target blood vessel also comprises a curved surface reconstruction image of the target blood vessel; after the generating module 83 adjusts the second blood vessel medical image and displays the adjusted second blood vessel medical image, the generating module specifically further includes: responding to the confirmation operation of the user, updating the center line of the target blood vessel by using the content of the blood vessel adjustment, and generating a new curved surface reconstruction image based on the updated center line, or sending the content of the blood vessel adjustment to a server and receiving the new curved surface reconstruction image fed back by the server; and updating the displayed curved surface reconstruction image by using the new curved surface reconstruction image.

The generating module 83 adjusts the second blood vessel medical image in response to the adjustment operation of the user on the second blood vessel medical image, and specifically includes: responding to the selection operation of the user on the tool items in the functional area of the display interface, and adjusting the second blood vessel medical image to be matched with the selected tool items; in response to a user's blood vessel selection operation, regarding the blood vessel selected by the user as a new target blood vessel, including: and in response to the selection operation of the user on the blood vessel mark in the functional area of the display interface, taking the blood vessel corresponding to the blood vessel mark selected by the user as a new target blood vessel.

Wherein, the image related to the target blood vessel further comprises at least one of: the method comprises the following steps of obtaining a curved surface reconstruction image of a target blood vessel, a blood vessel section image corresponding to the specified position of the target blood vessel in the curved surface reconstruction image, a blood vessel straightening image of the curved surface reconstruction image, a maximum density projection reconstruction image of the target blood vessel, a medical scanning image containing the target blood vessel, and thumbnails of a plurality of medical scanning images obtained by scanning the target part; wherein, the target blood vessel belongs to the target part, and the plane of the section diagram of the blood vessel is vertical to the plane of the curved surface reconstruction image; the blood vessel medical image, the curved surface reconstruction image, the blood vessel section image, the blood vessel straightening image, the maximum density projection reconstruction image, the medical scanning image and the thumbnail are displayed on the same display interface or different display interfaces.

Wherein, more than two of the blood vessel image, the curved surface reconstruction image, the blood vessel section image, the blood vessel straightening image and the maximum density projection reconstruction image are generated based on a preset slide reading rule in response to the same operation of a user; after the generating module 83 displays the curved surface reconstructed image, the method specifically includes: responding to a first preset operation of a user on the curved surface reconstruction image, determining a display angle matched with the first preset operation, and displaying the curved surface reconstruction image matched with the display angle again; displaying a medical scan image, comprising: and displaying the medical scanning image, and performing second highlighting on the target blood vessel in the medical scanning image.

The first blood vessel medical image and the second blood vessel medical image are blood vessel three-dimensional images, the first blood vessel medical image is generated based on a blood vessel segmentation result of the medical scanning image, the blood vessel segmentation result is obtained by processing the medical scanning image by using a first deep learning mode, and the center line detection result is obtained by processing the first blood vessel medical image by using a second deep learning mode; the display module 84 displays the medical image related to the target blood vessel, and specifically includes: displaying the second vessel medical image and displaying the name of the at least one vessel on the second vessel medical image.

The display module 84 further includes: displaying at least one lesion information on the blood vessel; and/or, the generating module 83 generates and displays the diagnosis assistance information based on the detection information of the blood vessel and the lesion information, and copies or modifies the diagnosis assistance information in response to a second preset operation of the user.

Referring to fig. 9, fig. 9 is a schematic structural diagram of an embodiment of an image processing apparatus provided in the present application. In this embodiment, the image processing apparatus 90 includes a processor 91 and a memory 93.

The processor 91 may also be referred to as a CPU (Central Processing Unit). The processor 91 may be an integrated circuit chip having signal processing capabilities. The processor 91 may also be a general purpose processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components. A general purpose processor may be a microprocessor or the processor 91 may be any conventional processor 91 or the like.

A memory 93 in the electronic device 90 stores program instructions necessary for the processor 91 to operate.

The processor 91 is configured to execute program instructions to implement the methods provided by any of the embodiments of the image processing method of the present application and any non-conflicting combinations thereof.

Referring to fig. 10, fig. 10 is a schematic structural diagram of an embodiment of a computer-readable storage medium provided in the present application. The computer readable storage medium 100 of the embodiments of the present application stores program instructions 101, and the program instructions 101 when executed implement the method provided by any of the embodiments of the image processing method of the present application and any non-conflicting combinations. The program instructions 101 may form a program file stored in the computer-readable storage medium 100 in the form of a software product, so as to enable a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the methods according to the embodiments of the present application. And the aforementioned computer-readable storage medium 100 includes: various media capable of storing program codes, such as a usb disk, a mobile hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, or terminal devices, such as a computer, a server, a mobile phone, and a tablet.

The above description is only for the purpose of illustrating embodiments of the present application and is not intended to limit the scope of the present application, and all modifications of equivalent structures and equivalent processes, which are made by the contents of the specification and the drawings of the present application or are directly or indirectly applied to other related technical fields, are also included in the scope of the present application.

Claims

1. An image processing method, characterized in that the method comprises:

acquiring a first vessel medical image containing at least one vessel;

determining a target vessel in the first vessel medical image;

forming a center line of the target blood vessel in the first blood vessel medical image based on a center line detection result of the target blood vessel, and obtaining a second blood vessel medical image comprising the center line;

displaying the target vessel-related medical image, wherein the target vessel-related medical image comprises the second vessel medical image.

2. The method of claim 1, wherein after said displaying the medical image related to the target vessel, the method further comprises:

responding to the adjustment operation of the user on the second blood vessel medical image, adjusting the second blood vessel medical image, and displaying the adjusted second blood vessel medical image; and/or the presence of a gas in the gas,

and in response to the blood vessel selection operation of the user, taking the blood vessel selected by the user as a new target blood vessel, and re-executing the central line detection result based on the target blood vessel, forming the central line of the target blood vessel in the first blood vessel medical image and the subsequent steps.

3. The method according to claim 2, wherein the adjusting the second vessel medical image comprises any one of:

performing vessel adjustment on the second vessel medical image, wherein the vessel adjustment includes adjusting a center line of the vessel and/or adjusting a region of the vessel;

adding characters input by a user at a user-specified position in the second blood vessel medical image;

deleting the content added by the user in the user selection area of the second blood vessel medical image;

at least one of shift, zoom, and rotate the second vascular medical image;

and taking the blood vessel selected by the user in the second blood vessel medical image as the adjusted second blood vessel medical image.

4. The method of claim 3, wherein the adjusting the centerline of the vessel comprises any one of:

first highlighting the centerline of the second vessel medical image selected by the user;

performing a moving operation on the center line selected by a user in the second blood vessel medical image;

connecting the central line in the second blood vessel medical image with a line segment added by a user for the central line to form a new central line;

performing angle adjustment on the central line in the second blood vessel medical image and/or line segments added to the central line by a user;

the adjusting the region of the blood vessel comprises any one of the following steps:

adjusting the position and/or length of the blood vessel in the second blood vessel medical image;

generating a new said blood vessel in said second vessel medical image.

5. The method of claim 3, wherein the target vessel-related medical image further comprises a curved reconstructed image of the target vessel;

after the adjusting the second vessel medical image and displaying the adjusted second vessel medical image, the method further comprises:

in response to the confirmation operation of the user, updating the center line of the target blood vessel by using the blood vessel adjustment content, and generating a new curved surface reconstruction image based on the updated center line, or sending the blood vessel adjustment content to a server and receiving the new curved surface reconstruction image fed back by the server;

and updating the displayed curved surface reconstruction image by using the new curved surface reconstruction image.

6. The method of claim 2, wherein the adjusting the second vascular medical image in response to a user adjustment operation on the second vascular medical image comprises:

in response to the user's selection operation of a tool item in a functional area of a display interface, performing adjustment on the second blood vessel medical image, which is matched with the selected tool item;

the responding to the blood vessel selection operation of the user, and taking the blood vessel selected by the user as the new target blood vessel, comprises:

and in response to the selection operation of the user on the blood vessel mark in the functional area of the display interface, taking the blood vessel corresponding to the blood vessel mark selected by the user as the new target blood vessel.

7. The method of claim 1, wherein the target vessel-related image further comprises at least one of: the curved surface reconstruction image of the target blood vessel, a blood vessel section image corresponding to the specified position of the target blood vessel in the curved surface reconstruction image, a blood vessel straightening image of the curved surface reconstruction image, a maximum density projection reconstruction image of the target blood vessel, a medical scanning image containing the target blood vessel, and thumbnails of a plurality of medical scanning images obtained by scanning a target part; wherein, the target blood vessel belongs to the target part, and the plane of the section diagram of the blood vessel is vertical to the plane of the curved surface reconstruction image;

wherein the blood vessel medical image, the curved surface reconstructed image, the blood vessel section image, the blood vessel straightening image, the maximum density projection reconstructed image, the medical scanning image and the thumbnail are displayed on the same display interface or different display interfaces.

8. The method according to claim 7, wherein two or more of the blood vessel image, the curved surface reconstructed image, the blood vessel sectional image, the blood vessel straightening image and the maximum density projection reconstructed image are generated based on a preset scoring rule in response to a same operation of a user;

after the displaying the curved surface reconstruction image, the method further comprises:

responding to a first preset operation of a user on the curved surface reconstruction image, determining a display angle matched with the first preset operation, and displaying the curved surface reconstruction image matched with the display angle again;

the displaying the medical scan image comprises:

and displaying the medical scanning image, and performing second highlighting on the target blood vessel in the medical scanning image.

9. The method of claim 1,

the first blood vessel medical image and the second blood vessel medical image are blood vessel three-dimensional images, the first blood vessel medical image is generated based on a blood vessel segmentation result of a medical scanning image, the blood vessel segmentation result is obtained by processing the medical scanning image by using a first deep learning mode, and the central line detection result is obtained by processing the first blood vessel medical image by using a second deep learning mode;

the displaying the medical image related to the target blood vessel comprises:

displaying the second vessel medical image and displaying a name of the at least one vessel on the second vessel medical image.

10. The method of claim 1, further comprising:

displaying at least one lesion information about the blood vessel; and/or the presence of a gas in the gas,

and generating and displaying diagnosis auxiliary information based on the detection information and the focus information of the blood vessel, and copying or modifying the diagnosis auxiliary information in response to a second preset operation of a user.

11. An image processing apparatus is characterized in that,

an acquisition module for acquiring a first vessel medical image containing at least one vessel;

a determination module for determining a target vessel in the first vessel medical image;

a generation module, configured to form a centerline of the target blood vessel in the first blood vessel medical image based on a centerline detection result of the target blood vessel, resulting in a second blood vessel medical image including the centerline;

a display module for displaying the medical image related to the target blood vessel, wherein the medical image related to the target blood vessel comprises the second blood vessel medical image.

12. An image processing apparatus, characterized in that the electronic apparatus comprises a processor and a memory, the memory storing program instructions, the processor being configured to execute the program instructions to implement the method according to any of claims 1-10.

13. A computer-readable storage medium, characterized in that the computer-readable storage medium stores program instructions that are executable to implement the method of any one of claims 1-10.