CN110993066A

CN110993066A - Medical image display method and display equipment

Info

Publication number: CN110993066A
Application number: CN201911221270.4A
Authority: CN
Inventors: 石磊; 史晶; 程根
Original assignee: Hangzhou Yitu Medical Technology Co ltd
Current assignee: Hangzhou Yitu Medical Technology Co ltd
Priority date: 2019-12-03
Filing date: 2019-12-03
Publication date: 2020-04-10

Abstract

The present disclosure relates to a display method and a display device for medical images, the display method for medical images comprising: extracting an interested area in the medical image, and determining a fault where the interested area is located according to the maximum section of the interested area in the first dimension; and responding to interface interaction operation, acquiring an enlarged image of the region of interest on the fault, and displaying the enlarged image of the region of interest in an interactive window. The medical image display method and the medical image display device provided by the embodiment of the disclosure can intensively amplify and display different regions of interest in the medical image in an interactive window, are beneficial to visually and clearly comparing the different regions of interest, do not need to update the regions of interest layer by layer, and can improve the diagnosis efficiency and the use experience of doctors.

Description

Medical image display method and display equipment

Technical Field

The disclosure relates to the technical field of display of an interested area in a medical image, in particular to a display method and display equipment of the medical image.

Background

The existing AI detection focus software generally displays an image of a certain fault in a cross section mode. In the display interface, the physician can only observe nodules that belong to the current slice. Different nodules exist on different faults, in order to check the nodule conditions corresponding to the different faults, doctors need to switch the different faults to update and display the nodules in a mode of rolling a mouse wheel and the like, and the diagnosis efficiency and the use experience are poor for the doctors in the film reading mode.

Disclosure of Invention

In view of the above technical problems in the prior art, the present disclosure is directed to a display method and a display apparatus for medical images, so as to solve at least the above technical problems.

According to a first aspect of the present disclosure, there is provided a method for displaying a medical image, including:

extracting an interested area in the medical image, and determining a fault where the interested area is located according to the maximum section of the interested area in the first dimension;

and responding to interface interaction operation, acquiring an enlarged image of the region of interest on the fault, and displaying the enlarged image of the region of interest in an interactive window.

In some embodiments, the first dimension comprises one of three dimensions, a transverse, coronal, or sagittal dimension.

In some embodiments, acquiring a magnified view of the region of interest on the fault and displaying the magnified view of the region of interest in an interactable window includes:

and intercepting a segmentation image containing the region of interest on a fault where the maximum cross section of the region of interest is located, and amplifying and displaying the segmentation image on the interactive window, wherein the intercepted segmentation images of different regions of interest have the same size.

and intercepting a segmentation image containing the region of interest according to the size of the region of interest on a fault where the maximum cross section of the region of interest is located, and amplifying and displaying the intercepted segmentation image in each amplification window of the interactive windows in the same amplification scale, wherein the sizes of the amplification windows are the same.

According to a second aspect of the present disclosure, there is also provided a method for displaying a medical image, including:

extracting a region of interest in the medical image, and determining a fault where the region of interest is located according to the maximum cross section of the region of interest in at least two dimensions;

in response to interface interaction operation, acquiring magnified images of at least two dimensions of the region of interest on the fault, and displaying the magnified images of the at least two dimensions in an interactive window, wherein the region of interest of the at least two dimensions corresponds.

In some embodiments, magnifications of different dimensions of the same region of interest are displayed on the same page of the interactable window.

In some embodiments, a plurality of magnified images of the region of interest are displayed in an arrangement within the interactable window.

In some embodiments, a plurality of the regions of interest are displayed in a single page or in multiple pages in the interactive window, and the interactive window is provided with a page turning key for switching different pages.

In some embodiments, the medical image is displayed in a main window of a display interface, and the magnified image of the region of interest is displayed in an overlaid manner in the main window.

According to a third aspect of the present disclosure, there is also provided a display apparatus of medical images, comprising:

an extraction unit configured to: extracting an interested area in the medical image, and determining a fault where the interested area is located according to the maximum section of the interested area in the first dimension;

a display unit configured to: and responding to interface interaction operation, acquiring an enlarged image of the region of interest on the fault, and displaying the enlarged image of the region of interest in an interactive window.

According to a fourth aspect of the present disclosure, there is also provided a computer-readable storage medium having stored thereon computer-executable instructions, which when executed by a processor, implement the medical image display method described above.

According to the medical image display method and the medical image display device, different interesting regions in the medical image can be displayed in an interactive window in a concentrated and amplified manner, so that the different interesting regions can be visually and clearly compared, the interesting regions do not need to be updated layer by layer, and the diagnosis efficiency and the use experience of doctors can be improved.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure, as claimed.

Drawings

In the drawings, which are not necessarily drawn to scale, like reference numerals may designate like components in different views. Like numerals having letter suffixes or like numerals having different letter suffixes may represent different instances of like components. The drawings illustrate various embodiments generally, by way of example and not by way of limitation, and together with the description and claims, serve to explain the disclosed embodiments.

Fig. 1 shows a flow chart of a method of displaying medical images according to an embodiment of the present disclosure;

FIG. 2 shows a schematic diagram of a display interface of a medical image according to an embodiment of the present disclosure;

FIG. 3 shows a magnified schematic view of a region of interest of a medical image according to an embodiment of the present disclosure;

fig. 4(a) shows a layout diagram (page up and down) of an enlarged view of a region of interest in a display interface of a medical image according to an embodiment of the present disclosure;

fig. 4(b) shows a layout diagram (page left and right) of an enlarged view of a region of interest in a display interface of a medical image according to an embodiment of the present disclosure;

fig. 5 shows a schematic view of a display device for medical images according to an embodiment of the present disclosure;

fig. 6 shows a flow chart of another method of displaying medical images according to an embodiment of the present disclosure;

FIG. 7 shows a schematic diagram of another display interface of medical imagery according to an embodiment of the present disclosure;

FIG. 8 illustrates a layout diagram of an enlarged view of a region of interest in another display interface of a medical image according to an embodiment of the present disclosure;

fig. 9 shows a schematic view of a display device for medical images according to an embodiment of the present disclosure.

Detailed Description

In order to make the objects, technical solutions and advantages of the embodiments of the present disclosure more clear, the technical solutions of the embodiments of the present disclosure will be described below clearly and completely with reference to the accompanying drawings of the embodiments of the present disclosure. It is to be understood that the described embodiments are only a few embodiments of the present disclosure, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the described embodiments of the disclosure without any inventive step, are within the scope of protection of the disclosure.

Unless otherwise defined, technical or scientific terms used herein shall have the ordinary meaning as understood by one of ordinary skill in the art to which this disclosure belongs. The word "comprising" or "comprises", and the like, means that the element or item listed before the word covers the element or item listed after the word and its equivalents, but does not exclude other elements or items.

To maintain the following description of the embodiments of the present disclosure clear and concise, a detailed description of known functions and known components have been omitted from the present disclosure.

And drawing the identification of the nodule in the nodule image corresponding to each bit plane, wherein the identification can be a square frame, a circle, an ellipse or an irregular polygon and the like to outline the region where the nodule is located.

Fig. 1 is a flowchart illustrating a method for displaying a medical image according to an embodiment of the present disclosure, and as shown in fig. 1, the present disclosure provides a method for displaying a medical image, which includes the following steps:

step 101: extracting a region of interest in the medical image, and determining a fault where the region of interest is located according to the maximum section of the region of interest in the first dimension.

In the embodiment of the present disclosure, the medical image is a two-dimensional medical image, which may be a two-dimensional medical image of a human body and each part or organ of the body directly obtained by using various medical imaging devices, or a two-dimensional medical image obtained by performing two-dimensional slicing on a three-dimensional medical image acquired by using a medical imaging device. Medical images include, but are not limited to, chest lung CT, abdominal CT, cerebrovascular MRI, breast MRI, abdominal ultrasound, and the like.

The medical imaging apparatus may be a Magnetic Resonance imaging apparatus (MR), a Computed Tomography apparatus (CT), a positron emission Computed Tomography apparatus (PET), an Ultrasound apparatus (Ultrasound), and a multi-mode imaging apparatus combined by the above-mentioned various imaging apparatuses, such as a PET-CT apparatus, a PET-MR apparatus, an RT-MR apparatus, and the like.

The two-dimensional medical image generally includes three-dimensional images of a transverse position, a coronal position and a sagittal position, each dimensional image is composed of a set of slice images of different slices, and the slice images of different slices are usually continuously displayed in a main view window of a display interface. In an embodiment of the disclosure, the two-dimensional medical image is a two-dimensional slice image of a first dimension, the first dimension comprising one of three dimensions of a transverse position, a coronal position or a sagittal position. In one embodiment, as shown in fig. 2, a cross-sectional bitmap of a certain number of lungs may be obtained by scanning layer by layer using a Computed Tomography (CT) apparatus and displayed on a display interface, which displays the cross-sectional bitmap of the current cross-section.

A region of interest (ROI) is a region of interest or interest to a doctor in a medical image, which generally includes some interested objects with irregular contours, such as nodules, lesions, tumors, polyps, etc., and an image of the target region needs to be extracted for the doctor to view. A region of interest (ROI) is a region generated based on an object of interest for marking the object of interest.

In a set of continuous two-dimensional slice images, the two-dimensional slice images of different faults contain different interested areas, and the two-dimensional slice image of each fault also contains different interested areas. That is, when the medical image includes a plurality of regions of interest, the plurality of regions of interest may belong to the same two-dimensional tomographic image or may belong to different two-dimensional tomographic images. Fig. 2 shows a pulmonary transection bitmap including a slice of a lung nodule region, and other slices of the pulmonary transection bitmap may include a plurality of lung nodule regions or may not include a lung nodule region.

It should be understood that the different regions of interest refer to a set of consecutive two-dimensional slice images, each region of interest representing a different object of interest. Since regions of interest containing the same object of interest may exist in different slices of the two-dimensional slice image in the first dimension, for example, in the set of cross-sectional maps of the lung image of fig. 2, a lung nodule region containing a lung nodule a may exist in multiple slices, but the shape, size, etc. of the lung nodule a in each slice is not the same. In order to accurately determine the region of interest containing the object of interest, the region of interest with the largest cross-sectional area among the multiple faults is taken as the final region of interest, namely, the region of interest containing a certain object of interest is marked and displayed only on the fault determined by the largest cross section of the region of interest in the first dimension. Even if the object of interest can be seen in the cross-sectional bitmap of the other slice, the region of interest containing the object of interest is not marked in the other slice because the cross-section of the object of interest is not the largest cross-section.

It should be understood that the above-mentioned extraction process for determining the fault in which the region of interest is located by using the maximum cross section of the region of interest in the first dimension belongs to the region of interest.

After the final region of interest is determined, the region of interest can be marked on the fault through marks such as circles, ellipses, triangles, rectangles, irregular shapes and the like. For example, in fig. 2, a lung nodule a is displayed in a cross-sectional bitmap of a current slice of the display interface, and a lung nodule region including the lung nodule a is marked and displayed in the display interface in the form of a circle.

In some embodiments, the size of the marker used to mark the region of interest (the marking size of the region of interest) is determined based on the size of the object of interest. Specifically, a contour boundary containing the object of interest (e.g., lung nodule a) may be determined by expanding and extending a first preset distance to the periphery with the center coordinate of the object of interest as the center, and the region enclosed by the contour boundary is the determined region of interest. Wherein the first preset distance is a preset multiple of the radius of the object of interest.

As shown in fig. 2, in the lung transverse image, when the radius of the lung nodule a is r and the lung nodule region is marked with a circle as a mark, the center coordinate of the lung nodule a is taken as a center point, and the radius of the mark, which is 2 times the radius r of the lung nodule a, is extended outward to obtain the circle mark with the radius of 2 r.

Since the objects of interest contained in two-dimensional slice images of the same slice or different slices are different from each other. For example, lung images have different image features such as size, color depth, shape, etc. to distinguish different lung nodules. In order to facilitate the differentiation of the objects of interest of the same or different slices by the physician, the shape of the markers used for marking the different regions of interest in a set of consecutive two-dimensional slice images is the same.

In some embodiments, the shape of the identification of the region of interest is related to the shape of the object of interest. For example, since the shape of a lung nodule is generally circular, the indicia used to mark the lung nodule region are also circular. In other embodiments, the shape of the mark may also be an ellipse, a rectangle, an irregular shape, and the like, and the disclosure is not particularly limited.

In some embodiments, the size of the marker used to mark the region of interest may be the same, the size of the marker (the marked size of the region of interest) being determined based on the size of the largest object of interest in the two-dimensional slice image. For example, in a single-frame or multi-frame lung transverse position image containing different lung nodules, a lung nodule region with a preset mark radius can be obtained by taking 1.2 times of the largest lung nodule radius as the mark radius, so that the mark sizes of the lung nodule regions in the lung images of different sections can be ensured to be the same, and the different lung nodules can be conveniently subjected to comparative diagnosis; meanwhile, the mark size of the region of interest determined by the size of the largest interested target can contain all lung nodules in the lung image, and partial images of the lung nodules are prevented from being missed.

In other embodiments, the size of the markers used to mark the region of interest may be different, and the size of the markers (the size of the markers of the region of interest) may be determined based on the size of the corresponding object of interest. The size of the markers is proportional to the corresponding objects of interest, and when the objects of interest are small, the regions of interest are marked with the small markers; when the interested target is larger, the interested area is marked by larger identification, so that the situation that the interested target cannot be accurately determined due to the fact that the size of the mark of the interested area is too large because the interested target is too small can be prevented. Optionally, the proportion of the object of interest in the region of interest is at least greater than 50% so that the size of the object of interest and the region of interest do not differ too much.

In some embodiments, different regions of interest in the two-dimensional slice image may be distinguished using different colored markers, e.g., lung nodule a is identified in yellow and another lung nodule (if any) may be identified in red.

In some embodiments, the region of interest may be extracted by a deep learning method, for example, the medical image to be extracted may be identified and matched with a corresponding region of interest extraction model by using deep learning, so as to determine the region of interest. The method specifically comprises the following steps:

step 1011: acquiring a medical image to be extracted, wherein the medical image to be extracted comprises at least one region of interest;

step 1012: inputting the medical image to be extracted into a region-of-interest extraction model obtained through pre-training to obtain a region of interest, wherein the region-of-interest extraction model is obtained based on deep learning training.

The region of interest extraction model is obtained based on deep learning training and specifically comprises the following steps:

step one, acquiring a medical image as a training sample.

Specifically, a certain number of acquired medical images including the target of interest may be directly used as training samples, or a large number of generated images with high similarity to the medical images may be generated by using a generator as training samples, so as to expand the data set of the training samples.

And step two, manually marking the region of interest in the training sample.

The training samples can be manually marked by a professional such as a doctor. For example, when a lung nodule region in a lung image is marked, different doctors are used for manually marking the lung nodule region in a training sample respectively, the lung nodule regions of the same lung nodule marked by the different doctors are compared, and the final lung nodule region is determined by calculating the confidence coefficient of the marked lung nodule region.

The specific process of marking the region of interest is as follows: the two-dimensional coordinates of any lung image with the lung nodule identified are marked manually, then the two-dimensional coordinates of the lung nodule are used as the center, a preset distance is expanded to the periphery, and the boundary of the region of interest containing the lung nodule is determined, wherein the preset distance is a preset multiple of the radius of the lung nodule.

And step three, inputting the training sample marked with the region of interest into a deep learning network for training to obtain a region of interest extraction model.

Specifically, the medical image marked with the region of interest in the second step may be directly input into a deep learning network (e.g., a convolutional neural network) as a training sample for training, so as to obtain a region of interest extraction model and corresponding extraction parameters.

In some embodiments, a classifier-based approach may be employed to extract the region of interest. For example, image features of the object of interest may be extracted, the extracted image features may be analyzed by a classifier, and the object of interest and thus the region of interest may be determined. The image characteristics of the object of interest include the shape of the object of interest image, gray value gradients, etc.

Step 102: and responding to interface interaction operation, acquiring an enlarged image of the region of interest on the fault, and displaying the enlarged image of the region of interest in an interactive window.

After the fault in which the maximum cross section of the region of interest is located is determined and the corresponding region of interest is marked, in response to interface interaction operation, an enlarged image of the region of interest is obtained on the fault and displayed in an interactive window, so that a doctor can view the enlarged and clear image of the region of interest.

The interface interaction operation is amplification operation aiming at the display interface, the display interface is an interaction interface and can comprise a main window area for displaying medical images, an interactive window for displaying an amplified image and a toolbar area for operating, the toolbar area is provided with an amplification button for amplifying the region of interest, and the region of interest can be amplified and displayed by clicking the amplification button through a mouse. In other embodiments, the region of interest may also be enlarged by means of a shortcut key.

Displaying a magnified view of the region of interest in an interactable window includes: an enlarged view of the entire region of interest is displayed in the interactable window.

In particular, the magnified images of the region of interest acquired from the two-dimensional slice images of the different slices of the first dimension may all be displayed in an interactive window. The magnified images of the regions of interest include magnified images of all regions of interest in the same two-dimensional slice image and magnified images of different regions of interest in different two-dimensional slice images. As shown in fig. 3, when the zoom-in button on the toolbar is clicked, a zoom-in of 3 different lung nodule regions is displayed in the interactive window, and the 3 lung nodule regions displayed in the zoom-in mode can belong to the lung transverse bitmaps of the same fault or belong to the lung transverse bitmaps of different faults.

The medical image display method provided by the embodiment of the disclosure can be used for amplifying and displaying different regions of interest in a medical image in a centralized manner in an interactive window, so that the different regions of interest can be visually and clearly compared, the regions of interest do not need to be updated layer by layer, and the diagnosis efficiency and the use experience of doctors can be improved.

In some embodiments, the medical image is displayed in a main window and an enlarged view of the region of interest is displayed in the main window in an overlaid manner.

Specifically, the interactive window may include a plurality of zoom windows for displaying different zoom images, respectively, and as shown in fig. 3, the zoom images of 3 different lung nodule regions are displayed in 3 zoom windows of the display interface, respectively. The magnifying window can be displayed in a pop-up mode in a covering mode on the main window, and when a magnifying button on the toolbar is clicked, the magnifying window containing the magnifying image is displayed in a pop-up mode.

In other embodiments, the interactable window can also be a virtual window defining a boundary for displaying magnified images of regions of interest, with magnified images of different regions of interest all displayed in the virtual window. The virtual window may be the display interface itself, that is, when the zoom-in operation is performed on the region of interest, the enlarged view of the region of interest is directly displayed in the main window in an overlaid manner.

The enlarged image of the region of interest is an enlarged image of a local image including the region of interest in the medical image. In some embodiments, a contour boundary containing a region of interest (e.g., a lung nodule region) may be determined by expanding and extending the region of interest to a second predetermined distance around the center coordinate of the region of interest, and the region surrounded by the contour boundary is a determined local image containing the region of interest. Wherein the second preset distance is determined based on the size of the region of interest. The local image including the region of interest may be a regular shape such as a square, a rectangle, a circle, an ellipse, or an irregular shape, and the disclosure is not particularly limited.

Specifically, a segmented image containing the region of interest with a predetermined size is cut out from a cross section where the maximum cross section of the region of interest is located, and then the segmented image is displayed in an interactive window in an enlarged manner with a predetermined magnification.

When the segmentation image is intercepted, the boundary range of the segmentation image to be intercepted can be determined according to the marked interesting region, and the boundary range covers the range of the interesting region; and then, according to the boundary range of the segmented image to be intercepted, intercepting the segmented image containing the region of interest from the medical image. The cut segmented image is preferably an image of a regular shape such as a square or rectangle. As shown in fig. 2 and 3, the boundaries of the segmented image may be marked by rectangular borders, the segmented image including the lung nodule region may be cut, and when the zoom-in button on the toolbar is clicked, the segmented image including the region of interest may be displayed in the interactive window in an enlarged manner.

In this embodiment, the size of the segmented images of the different regions of interest is the same, and the size of the segmented images is determined based on the mark size of the region of interest. When the mark size (size of the mark) of the region of interest in the two-dimensional slice image is the same, the size of the segmented image may be determined based on the mark size, and for example, when the mark for marking the region of interest is a circle with a radius of r, a square segmented image with a side length of 1.5r may be cut out with the center of the region of interest as the center. When the mark sizes (sizes of the marks) of the regions of interest are different, the size of the segmented image to be intercepted can be determined by taking the mark size of the largest region of interest as a reference, so that the whole region of interest can be ensured to be intercepted completely.

In the embodiment, the segmentation images with the same size are intercepted and directly amplified and displayed, and the region of interest can be visually compared and checked in the main window and the interactive window according to the proportion of the region of interest in the segmentation images, so that the diagnosis efficiency of a doctor is improved.

In other embodiments, obtaining a magnified view of the region of interest on the fault and displaying the magnified view of the region of interest in an interactable window includes:

In particular, due to the different sizes of the different objects of interest, marking the region of interest containing the smaller object of interest with a mark size determined based on the largest object of interest may make it difficult for the physician to view the smaller object of interest if the region of interest is marked with the same mark size, for example, when the object of interest is smaller. Therefore, when the segmentation image containing the region of interest is intercepted, the size of the segmentation image can be correspondingly adjusted based on the mark size of the region of interest, and when the mark size of the region of interest is larger, the size of the segmentation image corresponding to the region of interest is larger; when the mark size of the region of interest is small, the size of the segmented image corresponding to the region of interest is small. Optionally, the proportion of the region of interest in the segmented image is at least greater than 50% to reduce redundant image truncation.

After the segmentation images with different sizes are captured, the segmentation images are magnified and displayed in the magnification windows of the interactive windows in the same magnification ratio, so that the region of interest can be magnified and displayed in the same magnification ratio. The sizes of the amplifying windows are the same, the proportion of the segmented image with smaller size in the amplifying window after being amplified is less, and the proportion of the segmented image with larger size in the amplifying window after being amplified is more, namely, partial blank can be left in the amplifying window. The enlargement of different interested areas is displayed by adopting the enlargement windows with the same size, so that the arrangement of the enlargement windows in the interactive window is more attractive.

The size of the enlargement window of the interactive window is determined based on the size of the largest divided image among the different divided images so that the enlarged images of all the divided images can be displayed in the respective enlargement windows completely.

The number of the enlarged images or the enlarged windows of the interactive windows displayed in the interactive windows is determined according to the size of the interactive windows, and the size of the interactive windows is limited by the size of the display interface, so that the number of the enlarged images or the enlarged windows of the interactive windows displayed in the interactive windows is limited in order to be capable of viewing the clear enlarged images.

In some embodiments, magnified images of multiple regions of interest are displayed in an arrangement within the interactable window.

Specifically, the enlarged images of different regions of interest are displayed in a centralized arrangement mode in the interactive window, so that the whole display interface is more reasonable and attractive. The enlarged images displayed in the array may be displayed in a single row or in a plurality of rows. For example, fig. 4(a) and 4(b) are enlarged views showing 6 (2 rows and 3 columns) regions of interest, respectively, for facilitating the viewing of different regions of interest. The enlarged images of the region of interest displayed in an arrangement in the interactive window are sorted in accordance with the two-dimensional slice images of the plurality of slices displayed in succession, so that the enlarged displayed region of interest can be quickly positioned to the corresponding slice.

In some embodiments, the magnified view of the multiple regions of interest is displayed in a single page or multiple pages in the interactable window.

Since the number of enlarged views of the region of interest displayed in the interactive window is limited to the size of the interactive window, when there are more regions of interest, enlarged views of a plurality of regions of interest may be paginated for display. For example, in fig. 4(a) and 4(b), enlarged views of 6 regions of interest are respectively displayed in the interactive window, and enlarged views of other regions of interest can be displayed on the hidden page of the interactive window.

In some embodiments, a page-turning key for turning pages is provided in the interactive window to update the page-turning magnification of different pages, for example, fig. 4(a) shows a page-up and page-down key for turning pages up and down, and fig. 4(b) shows a page-left and page-right key for turning pages left and right. In the embodiment of the disclosure, the page turning key is a virtual button, responds to the amplification operation of the region of interest, and is displayed in the interactive window together with the amplification image.

In other embodiments, the page turning key for turning pages may also be a scroll bar, and the page turning up and down or the page turning left and right may also be implemented by scrolling the scroll bar.

Fig. 5 illustrates a schematic diagram of a display apparatus of medical images according to an embodiment of the present disclosure, and as shown in fig. 5, an embodiment of the present disclosure further provides a display apparatus 500 of medical images, the display apparatus 500 including:

an extraction unit 501 configured to: extracting an interested area in the medical image, and determining a fault where the interested area is located according to the maximum section of the interested area in the first dimension;

a display unit 502 configured to: and responding to interface interaction operation, acquiring an enlarged image of the region of interest on the fault, and displaying the enlarged image of the region of interest in an interactive window.

The medical image display device 500 provided by the embodiment of the disclosure can intensively amplify and display different regions of interest in a medical image in an interactive window, is beneficial to visually and clearly comparing the different regions of interest, does not need to update the regions of interest layer by layer, and can improve the diagnosis efficiency and the use experience of doctors.

In some embodiments, the display device 500 may be integrated on an existing processing platform for images in various ways. For example, the program module can be written on the existing processing platform of the lung image by using a development interface, so that the compatibility with the existing processing platform and the update of the existing processing platform are realized, the hardware cost is reduced, and the popularization and the application of the display device are facilitated.

It should be noted that the display apparatus 500 for medical images provided in the foregoing embodiment and the above embodiment of the display method for medical images belong to the same concept, and specific implementation processes thereof are detailed in the method embodiment and are not described herein again.

In the above embodiment, the display method of the medical image is a method of displaying an enlarged region of interest in the two-dimensional slice image in the first dimension, and the display device 500 is configured to display an enlarged view of the region of interest in the first dimension.

Fig. 6 is a flowchart illustrating another display method of a medical image according to an embodiment of the present disclosure, and as shown in fig. 6, the present disclosure further provides a display method of a medical image, which specifically includes the following steps:

step 601: extracting a region of interest in the medical image, and determining a fault where the region of interest is located according to the maximum cross section of the region of interest in at least two dimensions.

The medical image may include at least two-dimensional slice images, and the display interface may display the at least two-dimensional slice images, for example, the main viewing window of the display interface of fig. 7 displays three-dimensional slice images of the transverse position, the coronal position, and the sagittal position of the lung image, respectively.

The extraction of the region of interest in the medical image is similar to the extraction of the region of interest in the two-dimensional slice image of the first dimension, and is not described herein again.

Step 602: in response to interface interaction operation, acquiring magnified images of at least two dimensions of the region of interest on the fault, and displaying the magnified images of the at least two dimensions in an interactive window, wherein the region of interest of the at least two dimensions corresponds.

The main window of the display interface may display a two-dimensional slice image containing at least two dimensions of the region of interest, and accordingly, in response to the interface interaction operation, an enlarged view of the at least two dimensions of the region of interest may be displayed in the interactable window. For example, as shown in fig. 7 and 8, when a zoom-in operation is performed with respect to the display interface of fig. 7, the lung nodule region of fig. 7, which includes three dimensions of the transverse, coronal, and sagittal dimensions of the lung nodule B, may be displayed in the interactive window of fig. 8 in a magnified manner.

In some embodiments, as shown in fig. 7, the shape and size of the markers used to mark the region of interest are the same in two-dimensional slice images of different dimensions containing the same region of interest. The same region of interest in images of different dimensions can be quickly determined by the same identification. Accordingly, the enlarged images of different dimensions are the same size, and the size of the enlarged images is determined based on the mark size (size of the mark) of the region of interest.

Similar to the display of the enlarged view of the region of interest with the first dimension, after the region of interest is extracted in step 601, and the fault where the region of interest is located is determined according to the maximum cross section of the region of interest in at least two dimensions, the segmented images with the predetermined size and different dimensions including the region of interest can be intercepted in the fault, and the segmented images with different dimensions are enlarged and displayed in the interactive window in a certain proportion in response to the enlarging operation for the display interface.

In the segmented images with different dimensions of the same region of interest, the size of each segmented image is the same, and the size of each segmented image is determined based on the mark size of the region of interest. The size of the segmented images of different regions of interest may be the same or different.

In particular, in some embodiments, the same size of the segmented image may be truncated for different regions of interest and the segmented image displayed in enlargement in the interactable window. The size of the segmented image is determined based on the marker size of the largest region of interest.

In another embodiment, the segmented images with different sizes can be intercepted aiming at different regions of interest, and the segmented images with different sizes are displayed in the magnifying windows of the interactive window in an enlarged mode with the same scale, and the magnifying windows are the same in size. The size of the segmented image is determined based on the marker size of the corresponding region of interest. When the mark size of the region of interest is larger, the size of the segmented image is larger; when the mark size of the region of interest is small, the size of the segmented image is small.

When the two-dimensional slice images with different dimensions are displayed in the main window of the display interface, the layout and arrangement display of the enlarged images of different regions of interest in the interactive window are similar to the display of the two-dimensional slice image with the first dimension, and the description is omitted here.

The main window of the display interface displays two-dimensional images of different dimensions of the same region of interest, and when the display interface is subjected to amplification operation, the amplified images of different dimensions of the same region of interest are displayed on the same page of the interactive window, so that a doctor can conveniently check the images. As shown in fig. 8, the current page of the interactable window displays a transverse magnified view, a coronal magnified view, and a sagittal magnified view of the lung nodule B. The doctor can accurately know the specific conditions of the nodule on different position surfaces by looking up the enlarged images of different dimensions of the region of interest, and the doctor can conveniently diagnose and treat the nodule.

FIG. 8 illustrates an enlarged view of a different dimension of the current page of the interactable window showing a region of interest. In other embodiments, a single page of the interactable window may also display different dimensional magnifications of the multiple regions of interest, for example, different dimensional magnifications of different regions of interest may be displayed in different rows of the single page. The number of magnified images of the region of interest in a single page is determined by the size of the interactable window.

When the area of interest is large, the enlarged view of the area of interest can be displayed on a different page. The interactive window is provided with a page turning key so that a user can conveniently turn pages to view different regions of interest.

The medical image display method provided by the embodiment of the disclosure can be used for amplifying and displaying different regions of interest in a medical image in a centralized manner in an interactive window, and amplifying and displaying different dimensions of the same region of interest on the same page, so that the different regions of interest can be visually and clearly compared, the regions of interest do not need to be updated layer by layer, and the diagnosis efficiency and the use experience of a doctor can be improved.

Fig. 9 shows a schematic diagram of another display apparatus for medical images according to an embodiment of the present disclosure, and as shown in fig. 9, an embodiment of the present disclosure further provides a display apparatus 900 for medical images, the display apparatus 900 including:

an extraction unit 901 configured to: extracting a region of interest in the medical image, and determining a fault where the region of interest is located according to the maximum cross section of the region of interest in at least two dimensions;

a display unit 902 configured to: in response to interface interaction operation, acquiring magnified images of at least two dimensions of the region of interest on the fault, and displaying the magnified images of the at least two dimensions in an interactive window, wherein the region of interest of the at least two dimensions corresponds.

The medical image display device 900 provided by the embodiment of the disclosure can amplify and display different regions of interest in a medical image in an interactive window in a centralized manner, and can amplify and display the different dimensions of the same region of interest on the same page, so that the different regions of interest can be visually and clearly compared without updating the regions of interest layer by layer, and the diagnosis efficiency and the use experience of a doctor can be improved.

It should be noted that the display apparatus 900 of the medical image provided in the foregoing embodiment and the above-mentioned embodiment of the method for displaying the region of interest in at least two dimensions in the medical image belong to the same concept, and specific implementation processes thereof are detailed in the method embodiment and are not described herein again.

Embodiments of the present disclosure also provide a computer-readable storage medium having stored thereon computer-executable instructions, which, when executed by a processor, implement the medical image display method described above.

In some embodiments, a processor executing computer-executable instructions may be a processing device including more than one general-purpose processing device, such as a microprocessor, Central Processing Unit (CPU), Graphics Processing Unit (GPU), or the like. More specifically, the processor may be a Complex Instruction Set Computing (CISC) microprocessor, Reduced Instruction Set Computing (RISC) microprocessor, Very Long Instruction Word (VLIW) microprocessor, processor running other instruction sets, or processors running a combination of instruction sets. The processor may also be one or more special-purpose processing devices such as an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA), a Digital Signal Processor (DSP), a system on a chip (SoC), or the like.

In some embodiments, the computer-readable storage medium may be a memory, such as a read-only memory (ROM), a random-access memory (RAM), a phase-change random-access memory (PRAM), a static random-access memory (SRAM), a dynamic random-access memory (DRAM), an electrically erasable programmable read-only memory (EEPROM), other types of random-access memory (RAM), a flash disk or other form of flash memory, a cache, a register, a static memory, a compact disc read-only memory (CD-ROM), a Digital Versatile Disc (DVD) or other optical storage, a tape cartridge or other magnetic storage device, or any other potentially non-transitory medium that may be used to store information or instructions that may be accessed by a computer device, and so forth.

In some embodiments, the computer-executable instructions may be implemented as a plurality of program modules that collectively implement the method for displaying medical images according to any one of the present disclosure.

The present disclosure describes various operations or functions that may be implemented as or defined as software code or instructions. The display unit may be implemented as software code or modules of instructions stored on a memory, which when executed by a processor may implement the respective steps and methods.

Such content may be source code or differential code ("delta" or "patch" code) that may be executed directly ("object" or "executable" form). A software implementation of the embodiments described herein may be provided through an article of manufacture having code or instructions stored thereon, or through a method of operating a communication interface to transmit data through the communication interface. A machine or computer-readable storage medium may cause a machine to perform the functions or operations described, and includes any mechanism for storing information in a form accessible by a machine (e.g., a computing display device, an electronic system, etc.), such as recordable/non-recordable media (e.g., Read Only Memory (ROM), Random Access Memory (RAM), magnetic disk storage media, optical storage media, flash memory display devices, etc.). The communication interface includes any mechanism for interfacing with any of a hardwired, wireless, optical, etc. medium to communicate with other display devices, such as a memory bus interface, a processor bus interface, an internet connection, a disk controller, etc. The communication interface may be configured by providing configuration parameters and/or transmitting signals to prepare the communication interface to provide data signals describing the software content. The communication interface may be accessed by sending one or more commands or signals to the communication interface.

The computer-executable instructions of embodiments of the present disclosure may be organized into one or more computer-executable components or modules. Aspects of the disclosure may be implemented with any number and combination of such components or modules. For example, aspects of the disclosure are not limited to the specific computer-executable instructions or the specific components or modules illustrated in the figures and described herein. Other embodiments may include different computer-executable instructions or components having more or less functionality than illustrated and described herein.

The above description is intended to be illustrative and not restrictive. For example, the above-described examples (or one or more versions thereof) may be used in combination with each other. For example, other embodiments may be used by those of ordinary skill in the art upon reading the above description. In addition, in the foregoing detailed description, various features may be grouped together to streamline the disclosure. This should not be interpreted as an intention that a disclosed feature not claimed is essential to any claim. Rather, the subject matter of the present disclosure may lie in less than all features of a particular disclosed embodiment. Thus, the following claims are hereby incorporated into the detailed description as examples or embodiments, with each claim standing on its own as a separate embodiment, and it is contemplated that these embodiments may be combined with each other in various combinations or permutations. The scope of the disclosure should be determined with reference to the appended claims, along with the full scope of equivalents to which such claims are entitled.

The above embodiments are merely exemplary embodiments of the present disclosure, which is not intended to limit the present disclosure, and the scope of the present disclosure is defined by the claims. Various modifications and equivalents of the disclosure may occur to those skilled in the art within the spirit and scope of the disclosure, and such modifications and equivalents are considered to be within the scope of the disclosure.

Claims

1. A method for displaying medical images, comprising:

2. The display method of claim 1, wherein the first dimension comprises one of three dimensions, a transverse, coronal, or sagittal dimension.

3. The display method according to claim 1, wherein acquiring an enlarged view of the region of interest on the tomographic image and displaying the enlarged view of the region of interest in an interactive window includes:

4. The display method according to claim 1, wherein acquiring an enlarged view of the region of interest on the tomographic image and displaying the enlarged view of the region of interest in an interactive window includes:

5. A method for displaying medical images, comprising:

6. The display method according to claim 5, wherein enlarged views of different dimensions of the same region of interest are displayed on the same page of the interactive window.

7. The display method according to any one of claims 1 or 5, wherein a plurality of enlarged views of the region of interest are displayed in an arrangement in the interactive window.

8. The display method according to any one of claims 1 or 5, wherein a plurality of the regions of interest are displayed in a single page or in a plurality of pages in the interactive window, and the interactive window is provided with a page turning key for switching different pages.

9. The display method according to any one of claims 1 or 5, wherein the medical image is displayed in a main window of a display interface, and the magnified image of the region of interest is displayed in an overlaid manner in the main window.

10. A display apparatus of medical images, comprising: