CN107885440B

CN107885440B - Medical image display method, device and computer readable storage medium

Info

Publication number: CN107885440B
Application number: CN201711257186.9A
Authority: CN
Inventors: 陈玺; 王洁
Original assignee: Shanghai United Imaging Healthcare Co Ltd
Current assignee: Shanghai United Imaging Healthcare Co Ltd
Priority date: 2017-12-04
Filing date: 2017-12-04
Publication date: 2021-04-30
Anticipated expiration: 2037-12-04
Also published as: CN107885440A

Abstract

The invention provides a medical image display method, a medical image display device and a computer-readable storage medium. Wherein the medical image display method is suitable for medical image registration, and comprises the following steps: displaying the first medical image and the second medical image which are overlapped on a medical image display interface, wherein the display interface comprises a first area, a second area and a third area which are not overlapped with each other; and performing one or more of at least two of the following steps: detecting a first event on the first area, rotating the first medical image or the second medical image according to the first event; detecting a second event on the second area, translating the first medical image or the second medical image according to the second event; detecting a third event on the third area, and performing translation, rotation or scaling on the first medical image and the second medical image according to the third event.

Description

Medical image display method, device and computer readable storage medium

Technical Field

The present invention relates generally to medical image display, and more particularly to medical image display suitable for medical image registration.

Background

Medical image registration is to spatially transform one of two medical images of the same object acquired under different conditions (e.g., different times, different acquisition devices, different viewing angles, etc.), so that the spatially transformed medical image corresponds to a point in the other medical image corresponding to the same spatial position one to one. For medical images acquired at different times, the registered medical images can clearly show changes of the focus and the like, which can well help doctors to know the changes of the focus of the patient so as to adjust the treatment scheme. For medical images acquired by different acquisition devices (e.g., one medical image is a CT image and the other medical image is an MR image), the medical images obtained after registration and fusion can help doctors to observe anatomical structures and organs more clearly.

The existing automatic registration methods based on image features can help a user to perform medical image registration to a certain extent, but because the postures of the patient cannot be completely the same when the medical images are obtained twice, such as neck curvature, breathing of the patient and the like, the registration images obtained by the automatic registration method have errors, and the user is required to perform manual registration on the part (such as a tumor and the like) of interest in the medical images according to the clinical experience of the user.

In the manual registration process, one of the medical images needs to be fixed, and the fixed medical image is called a reference image; the other medical image may be translated, rotated, etc. relative to the reference image, referred to as a floating image. In the existing software for medical image registration, special translation and rotation function selection keys are usually provided, and a manual registration method using the software is shown in fig. 1. In the manual registration method, when the floating image needs to be translated and rotated, the corresponding function key needs to be clicked in the key area, and then translation or rotation can be performed. For example, currently, the floating image is translated, if the angle is not appropriate and the floating image needs to be rotated, the rotating key needs to be clicked in the key area, and then the floating image can be rotated, and vice versa. Therefore, in the manual registration process of the existing software for medical image registration, the function key area and the adjustment area need to be continuously switched back and forth, the registration process is complicated, and the efficiency is low.

Disclosure of Invention

The invention aims to provide a medical image display method and a medical image display device, and a display interface displayed by the medical image display method and the medical image display device can be used for quickly and accurately carrying out manual medical image registration.

In order to solve the above technical problem, the present invention provides a medical image display method, which is suitable for medical image registration, and comprises: displaying the first medical image and the second medical image which are overlapped on a medical image display interface, wherein the display interface comprises a first area, a second area and a third area which are not overlapped with each other; and performing at least two of the following steps: detecting a first event on the first area, rotating the first medical image or the second medical image according to the first event; detecting a second event on the second region, translating the first medical image or the second medical image according to the second event; detecting a third event on the third region, performing a translation, a rotation or a scaling of the first and second medical images according to the third event.

In an embodiment of the invention, the first region is a closed loop, the second region is an inner region of the closed loop, and the third region is an outer region of the closed loop.

In an embodiment of the invention, the rotating the first medical image or the second medical image according to the first event is rotating the first medical image or the second medical image around a center of the closed loop according to the first event.

In an embodiment of the present invention, any one of the first event, the second event, and the third event includes a drag event, a click event, or a long press event.

In an embodiment of the invention, the drag event, the click event, or the long press event is triggered by one or more of a mouse, a touch component, and a trackball.

In an embodiment of the present invention, the first event includes a click event and/or a long press event, the first region includes a first sub-region and a second sub-region that do not overlap with each other, when the click event and/or the long press event occurs on the first sub-region, the first medical image or the second medical image is rotated in a first direction, and when the click event and/or the long press event occurs on the second sub-region, the first medical image or the second medical image is rotated in a second direction, the second direction being different from the first direction.

In an embodiment of the present invention, the second event includes a click event and/or a long press event, the second region includes a first sub-region and a second sub-region that do not overlap with each other, when the click event and/or the long press event occurs on the first sub-region, the first medical image or the second medical image is translated in a first direction, and when the click event and/or the long press event occurs on the second sub-region, the first medical image or the second medical image is translated in a second direction, the second direction is different from the first direction.

In an embodiment of the present invention, the third event includes a click event and/or a long press event, the third region includes a first sub-region and a second sub-region that do not overlap with each other, when the click event and/or the long press event occurs on the first sub-region, the first medical image or the second medical image is translated or rotated in a first direction, and when the click event and/or the long press event occurs on the second sub-region, the first medical image or the second medical image is translated or rotated in a second direction, the second direction being different from the first direction.

In an embodiment of the present invention, the third event includes a click event or a long-press event, the third region includes a first sub-region and a second sub-region that do not overlap with each other, the first medical image and the second medical image are zoomed in when the click event or the long-press event occurs on the first sub-region, and the first medical image and the second medical image are zoomed out when the click event or the long-press event occurs on the second sub-region.

In an embodiment of the invention, the first medical image and the second medical image are the same type of medical image.

In an embodiment of the invention, the first medical image and the second medical image are different types of medical images.

Another aspect of the present invention provides a medical image display apparatus including: a memory for storing instructions executable by the processor; a processor for executing the instructions to implement the method as described above.

Another aspect of the invention provides a computer readable storage medium having stored thereon computer instructions, which, when executed by a processor, perform the method as described above.

Compared with the prior art, the invention has the following advantages:

compared with the existing medical image display interface, when the medical image display interface is used for manual medical image registration, the function does not need to be switched back and forth, the image area does not need to be moved out, corresponding operations are only needed to be carried out in the first area, the second area and the third area, all the operations are carried out in a small range, the position of the image can be seen in real time, the adjustment can be carried out at any time, and the accuracy and the speed of the manual medical image registration are greatly improved.

Drawings

Fig. 1 is a flowchart of a method for manual registration using existing software for medical image registration.

Fig. 2 is a schematic structural diagram of a computer device according to an embodiment of the present invention.

Fig. 3 is a flowchart of a medical image display method according to an embodiment of the present invention.

FIG. 4 is a schematic diagram of a medical image display interface according to an embodiment of the invention.

Fig. 5 a-5 d are schematic diagrams of medical image display interfaces with a first event in a first region according to some embodiments of the invention.

FIG. 6 is a schematic illustration of a medical image display interface with a second event in a second region according to some embodiments of the inventions.

FIG. 7 is a diagram of a medical image display interface with a click event and/or a long press event in the second region according to an embodiment of the invention.

FIG. 8 is a schematic illustration of a medical image display interface with a third event in a third region of some embodiments of the inventions.

FIG. 9 is a schematic illustration of a medical image display interface with a third event in a third region according to further embodiments of the invention.

FIG. 10 is a diagram of a medical image display interface with a click event and/or a long press event in the third area according to an embodiment of the invention.

Detailed Description

In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in detail below.

In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present invention, but the present invention may be practiced in other ways than those specifically described herein, and thus the present invention is not limited to the specific embodiments disclosed below.

As used in this application and the appended claims, the terms "a," "an," "the," and/or "the" are not intended to be inclusive in the singular, but rather are intended to be inclusive in the plural unless the context clearly dictates otherwise. In general, the terms "comprises" and "comprising" merely indicate that steps and elements are included which are explicitly identified, that the steps and elements do not form an exclusive list, and that a method or apparatus may include other steps or elements.

Flow charts are used herein to illustrate operations performed by systems according to embodiments of the present application. It should be understood that the preceding or following operations are not necessarily performed in the exact order in which they are performed. Rather, various steps may be processed in reverse order or simultaneously. Meanwhile, other operations are added to or removed from these processes.

FIG. 2 is a schematic block diagram of a computer device according to some embodiments of the invention. Computer 100 may be used to implement particular methods and apparatus disclosed in some embodiments of the invention. The specific apparatus in this embodiment is illustrated by a functional block diagram of a hardware platform that includes a display module. In some embodiments, computer 100 may implement implementations of some embodiments of the invention by its hardware devices, software programs, firmware, and combinations thereof. In some embodiments, the computer 100 may be a general purpose computer, or a special purpose computer.

As shown in FIG. 2, computer 100 may include an internal communication bus 101, a processor (processor)102, Read Only Memory (ROM)103, Random Access Memory (RAM)104, communication ports 105, input/output components 106, a hard disk 107, and a user interface 108. The internal communication bus 101 may enable data communication among the components of the computer 100. The processor 102 may make the determination and issue the prompt. In some embodiments, the processor 102 may be comprised of one or more processors. The communication port 105 may enable the computer 100 to communicate with other components (not shown), such as: and the external equipment, the image acquisition equipment, the database, the external storage, the image processing workstation and the like are in data communication. In some embodiments, computer 100 may send and receive information and data from a network through communication port 105. Input/output component 106 supports the flow of input/output data between computer 100 and other components. The user interface 108 may enable interaction and information exchange between the computer 100 and a user. The computer 100 may also include various forms of program storage units and data storage units such as a hard disk 107, Read Only Memory (ROM)103 and Random Access Memory (RAM)104, capable of storing various data files used in computer processing and/or communications, as well as possible program instructions executed by the processor 102.

By way of example, the input/output components 106 may include one or more of the following components: a mouse, a trackball, a keyboard, a touch-sensitive component, a sound receiver, etc.

Fig. 3 is a flowchart of a medical image display method according to an embodiment of the present invention. Referring to fig. 3, the medical image display method 200 may include the steps of:

step 210: displaying the first medical image and the second medical image which are overlapped on a medical image display interface, wherein the display interface comprises a first area, a second area and a third area which are not overlapped with each other;

step 220: detecting a first event on the first area, rotating the first medical image or the second medical image according to the first event;

step 230: detecting a second event on the second area, translating the first medical image or the second medical image according to the second event;

step 240: detecting a third event on the third region, translating and/or rotating the first medical image and the second medical image in accordance with the third event.

It is understood that after step 210 is performed, one or more of step 220, step 230, and step 240 may be selectively performed, and that these performed steps may be performed simultaneously, sequentially, or out of order. Preferably, the medical image display method 200 may perform at least two of the

steps

220, 230 and 240. In addition, the medical image display method 200 may be executed in a computer 100 such as that shown in FIG. 2, and a display interface may be presented on the user interface 108, for example.

It is to be understood that the same medical image may be rotated and translated in

steps

220 and 230, e.g. both step 220 and step 230 rotate and translate a first medical image, or different medical images may be rotated and translated, e.g. step 220 may rotate a first medical image and step 230 may translate a second medical image.

In an embodiment, the first medical image and the second medical image may be the same type of medical image, e.g. both the first medical image and the second medical image are CT images or both are MR images. In another embodiment, the first medical image and the second medical image may be different types of medical images, for example the first medical image may be a CT image and the second medical image may be an MR image.

The first and second medical images may be, for example, medical images of the same scanning region obtained by Computed Tomography (CT), Digital Radiography (DR), Magnetic Resonance Imaging (MRI), Digital Subtraction Angiography (DSA), Magnetic Resonance Angiography (MRA), Computed Tomography Angiography (CTA), Ultrasound Scanning (US), CT-MR, CT-PET, PET-MR, X-ray CT, X-ray-MR, X-ray (X-ray), X-ray-US, etc., or any combination of the above techniques.

In some embodiments, the first region may be a closed loop, the second region may be an inner region of the closed loop, and the third region may be an outer region of the closed loop. The closed loop may be a circular loop, an elliptical loop, a rectangular loop, a semicircular loop, or other irregularly shaped closed loops, which is not limited by the present invention. In a preferred embodiment, the closed loop may encircle or substantially encircle the target region in the first medical image and the second medical image, as shown in fig. 5a, before the manual registration of the first medical image and the second medical image is not performed. The target area refers to an area which is of interest to a doctor and needs to be registered.

FIG. 4 is a schematic diagram of a medical image display interface according to an embodiment of the invention. Referring to fig. 4, the medical image display interface 300 has three non-overlapping first, second and

third regions

310, 320 and 330. The first region 310 is a closed circle, the second region 320 is an inner region of the closed circle, and the third region 330 is an outer region of the closed circle. In an embodiment of the present invention, the demarcations of the first, second and

third regions

310, 320, 330 may be presented in the medical image display interface 300 in a visually visible manner, which may be a fixed presentation or an event-triggered presentation (e.g., cursor hover, click, etc.). In another embodiment of the present invention, the boundaries of at least a portion of the first region 310, the second region 320, and the third region 330 may not be directly presented in the medical image display interface 300, but may be otherwise perceived by the user (e.g., with reference to instructions or in-use perception).

The first event on the first area may include: drag events, click events, long press events, etc. Wherein, the dragging event, the clicking event and the long-time pressing event can be triggered by a mouse, a touch control component, a track ball and the like.

When the first event is detected in the first area, different processes may be performed according to the first event. If the first event is a drag event, the first medical image or the second medical image may be rotated following the drag. If the first event is a click event, the first medical image or the second medical image may be rotated by a step angle. If the first event is a long press event, the first medical image or the second medical image may be continuously rotated by a step angle until the long press event is ended. In an embodiment where the first event is a click event and/or a long press event, the first region may be divided into a plurality of sub-regions that do not overlap with each other, and when the click event and/or the long press event occurs on a part of different sub-regions of the plurality of sub-regions, the first medical image or the second medical image is rotated in different directions. In some embodiments, the rotation of the first medical image and the second medical image may be around the center of the closed loop or other point on the closed loop (e.g., a certain vertex of the closed loop having a vertex). In still other embodiments, the rotation of the first medical image and the second medical image may be around other points (e.g., a point on the medical image, such as the upper left corner, the upper right corner of the medical image, etc.).

Fig. 5 a-5 d are schematic diagrams of medical image display interfaces with a first event in a first region according to some embodiments of the invention. Referring to fig. 5a, fig. 5a is a schematic diagram of the display interface 300 displaying the first medical image 10 and the second medical image 20, and the first event is a drag event, wherein the first medical image 10 is used as a reference image and the second medical image 20 is used as a floating image. In the embodiment shown in fig. 5a, the mouse cursor 30 is located on the first region 310 (closed circle), and pressing one or more of the mouse, such as the left button, the right button, and the wheel, and dragging along the a direction may rotate the second medical image 20 around the center of the closed circle following the dragging of the mouse. Although the mouse cursor 30 is located at the lower left corner of the first region 310 (closed circle) in fig. 5a, it is understood that the mouse cursor 30 can be located at any position of the first region 310 (closed circle) to perform a dragging operation to rotate the second medical image 20.

Referring to fig. 5b, fig. 5b is a schematic diagram of the display interface 300 displaying the first medical image 10 and the second medical image 20, and the first event is a click event or a long press event, wherein the first medical image 10 is used as a reference image and the second medical image 20 is used as a floating image. In the embodiment shown in fig. 5b, the first region 310 (closed circle) is divided by the dashed line 40 into a left half 310a and a right half 310 b. It is understood that the dashed line 40 may or may not be displayed in the actual displayed display interface 300 according to different settings. In one embodiment, when the mouse cursor 30 is positioned on the left half 310a, one or more of, for example, a left button, a right button, a scroll wheel, etc., in the mouse are clicked, the second medical image 20 may be rotated counterclockwise by a step angle. In another embodiment, when the mouse cursor 30 is positioned on the left half 310a, and one or more of the mouse, such as the left button, the right button, and the wheel, are pressed for a long time, the second medical image 20 may be continuously rotated counterclockwise by a step angle until the long-press of the mouse is stopped. In one embodiment, when the mouse cursor 30 is positioned on the right half portion 310b, one or more of, for example, a left button, a right button, a scroll wheel, and the like in the mouse are clicked, the second medical image 20 may be rotated clockwise by a step angle. In another embodiment, when the mouse cursor 30 is positioned on the right half portion 310b, and one or more of the mouse, such as the left button, the right button, and the wheel, are pressed for a long time, the second medical image 20 may be continuously rotated clockwise by a step angle until the long-pressing of the mouse is stopped. It is to be appreciated that in still other embodiments, a click event of the mouse on the left half 310a, a long press event, may cause the second medical image 20 to rotate in a clockwise direction, while a click event of the mouse on the right half 310b, a long press event, may cause the second medical image 20 to rotate in a counter-clockwise direction.

Referring to fig. 5c, fig. 5c is a schematic diagram of another display interface 300 displaying a first medical image 10 and a second medical image 20, and the first event is a click event or a long press event, wherein the first medical image 10 is used as a reference image and the second medical image 20 is used as a floating image. In the embodiment shown in fig. 5c, the first region 310 (closed circle) is divided by the dashed line 50 into an upper half 310c and a lower half 310 d. It is understood that the dashed line 50 may or may not be displayed in the actual displayed display interface 300 according to different settings. In one embodiment, when the mouse cursor 30 is positioned on the upper half portion 310c, one or more of the mouse buttons, such as the left button, the right button, and the wheel, etc., may be clicked, the second medical image 20 may be rotated clockwise by a step angle. In another embodiment, when the mouse cursor 30 is positioned on the upper half portion 310c, and one or more of the mouse, such as the left button, the right button, and the wheel, are pressed for a long time, the second medical image 20 may be continuously rotated clockwise by a step angle until the long-pressing of the mouse is stopped. In one embodiment, when the mouse cursor 30 is positioned on the lower portion 310d, one or more of the mouse buttons, such as the left button, the right button, and the scroll wheel, etc., the second medical image 20 may be rotated counterclockwise by a step angle. In another embodiment, when the mouse cursor 30 is located on the lower half portion 310d, and one or more of the mouse, such as the left button, the right button, and the wheel, are pressed for a long time, the second medical image 20 may be continuously rotated counterclockwise by a step angle until the long-pressing of the mouse is stopped. It is understood that in other embodiments, a click event of the mouse on the upper portion 310c, a long press event, may cause the second medical image 20 to rotate in a counterclockwise direction, while a click event of the mouse on the lower portion 310d, a long press event, may cause the second medical image 20 to rotate in a clockwise direction.

Referring to fig. 5d, fig. 5d is a schematic diagram of another display interface 300 displaying a first medical image 10 and a second medical image 20, and the first event is a click event or a long press event, wherein the first medical image 10 is used as a reference image and the second medical image 20 is used as a floating image. In the embodiment shown in fig. 5d, the first area 310 (closed circle) is divided by the dashed line 40 and the dashed line 50 into an upper left portion 310e, an upper right portion 310f, a lower right portion 310g, and a lower left portion 310 h. It is understood that the dashed line 40 and/or the dashed line 50 may or may not be displayed in the actual displayed display interface 300 according to different settings. In one embodiment, when the mouse cursor 30 is positioned on the upper left portion 310e or the lower right portion 310g, one or more of, for example, a left button, a right button, a scroll wheel, etc., in the mouse is clicked, the second medical image 20 may be rotated clockwise by a step angle. In another embodiment, when the mouse cursor 30 is positioned on the upper left portion 310e or the lower right portion 310g, and one or more of the mouse, such as the left button, the right button, and the wheel, is pressed for a long time, the second medical image 20 may be continuously rotated clockwise by a step angle until the long-pressing of the mouse is stopped. In one embodiment, when the mouse cursor 30 is positioned on the upper right portion 310f or the lower left portion 310h, one or more of, for example, a left button, a right button, a scroll wheel, etc., in the mouse is clicked, the second medical image 20 may be rotated counterclockwise by a step angle. In another embodiment, when the mouse cursor 30 is positioned on the upper right portion 310f or the lower left portion 310h, and one or more of the mouse, such as the left button, the right button, and the wheel, are pressed for a long time, the second medical image 20 may be continuously rotated counterclockwise by a step angle until the long-pressing of the mouse is stopped. It will be appreciated that in still other embodiments, a click event, a long press event of the mouse on the upper left portion 310e or the lower right portion 310g may cause the second medical image 20 to rotate in a counterclockwise direction, while a click event, a long press event of the mouse on the upper right portion 310f or the lower left portion 310h may cause the second medical image 20 to rotate in a clockwise direction.

When the first event is a dragging event, the second medical image 20 rotates along with the dragging, and generally speaking, the dragging amplitude of a mouse, touch control and the like is large, and the precision is low, so that the dragging event is suitable for rotating the second medical image 20 in a large amplitude.

When the first event is a long press event, the second medical image 20 is continuously rotated during the long press, and the control of the length of the long press is also generally inaccurate, so that the long press event is also applicable to a larger amplitude rotation of the second medical image 20.

When the first event is a click event, each click event can only rotate the second medical image 20 by a step angle, which can finely control the rotation of the second medical image 20, and thus the click event is typically used to rotate the second medical image 20 by a smaller magnitude.

It is understood that when the second medical image 20 has a large angular deviation from the first medical image 10, the second medical image 20 may be rotated by a large amount using a drag event and/or a long press event, and when the second medical image 20 has a small angular deviation from the first medical image 10, the second medical image 20 may be rotated by a small amount using a click event, so that the first medical image 10 and the second medical image 20 may be registered quickly and accurately.

Likewise, the second event on the second area may include: drag events, click events, long press events, etc. Wherein, the dragging event, the clicking event and the long-time pressing event can be triggered by a mouse, a touch control component, a track ball and the like.

When the second event is detected in the second area, different processing may be performed according to the second event. If the second event is a drag event, the first medical image or the second medical image may be translated following the drag. If the second event is a click event, the first medical image or the second medical image may be translated a further distance. If the second event is a long press event, the first medical image or the second medical image may be continuously translated a further distance until the long press event ends. In an embodiment where the second event is a click event and/or a long press event, the second region may be divided into a plurality of sub-regions that do not overlap with each other, and when the click event and/or the long press event occurs on a part of different sub-regions of the plurality of sub-regions, the first medical image or the second medical image is translated in different directions.

FIG. 6 is a schematic illustration of a medical image display interface with a second event in a second region according to some embodiments of the inventions. Referring to fig. 6, in fig. 6, the display interface 300 displays the first medical image 10 and the second medical image 20, and the mouse cursor 30 is located on the second region 320 (inner region of the closed circle), and when the mouse is pressed and dragged upwards, the second medical image 20 can be translated upwards along with the mouse cursor 30. It is understood that the dragging operation of the mouse can be in any direction, and is not limited to the upward direction shown in fig. 6.

Similar to the click event and/or the long press event on the first region 310, the second region 320 may also be divided into a plurality of sub-regions that do not overlap with each other, and the click event and/or the long press event on different sub-regions are processed differently. For example, the second region 320 may also be divided into a left half and a right half, and the second medical image 20 is translated to the left when a click event and/or a long press event occurs on the left half, and the second medical image 20 is translated to the right when a click event and/or a long press event occurs on the right half. For another example, the second region 320 may also be divided into an upper half and a lower half, and the second medical image 20 is translated upward when a click event and/or a long press event occurs on the upper half, and the second medical image 20 is translated downward when a click event and/or a long press event occurs on the lower half. For another example, the second region 320 may be divided into nine lattices, as shown in fig. 7, the second medical image 20 is translated upward to the left when a click event and/or a long press event occurs on the upper left region 320a, the second medical image 20 is translated upward to the right when a click event and/or a long press event occurs on the upper right region 320c, the second medical image 20 is translated upward to the right when a click event and/or a long press event occurs on the left region 320d, the second medical image 20 is translated leftward when a click event and/or a long press event occurs on the right region 320f, the second medical image 20 is translated rightward when a click event and/or a long press event occurs on the lower left region 320g, the second medical image 20 is translated downward to the left, the second medical image 20 is translated downward when a click event and/or a long press event occurs on the lower region 320h, and the second medical image 20 is translated downward to the right when a click event and/or a long press event occurs on the lower right region 320 i.

The third event on the third zone may also include: drag events, click events, long press events, etc. Wherein, the dragging event, the clicking event and the long-time pressing event can be triggered by a mouse, a touch control component, a track ball and the like.

When the third event is detected in the third area, different processing may be performed according to the third event. If the third event is a drag event, the first medical image and the second medical image may be translated, rotated, or scaled following the drag. If the third event is a click event, the first medical image and the second medical image may be translated a further distance, rotated a step angle, or scaled by a predetermined scale. If the third event is a long press event, the first medical image and the second medical image may be continuously translated by a further distance, continuously rotated by a step angle, or continuously zoomed until the long press event ends. In an embodiment where the third event is a click event and/or a long press event, the third region may be divided into a plurality of sub-regions that do not overlap with each other, and when the click event and/or the long press event occurs on a part of different sub-regions of the plurality of sub-regions, the first medical image and the second medical image are translated or rotated in different directions. In another embodiment, when the third event is a click event or a long press event, the third region may be divided into a plurality of sub-regions that do not overlap with each other, the first medical image and the second medical image may be zoomed in when the click event or the long press event occurs on a part of the sub-regions of the plurality of sub-regions, and the first medical image and the second medical image may be zoomed out when the click event or the long press event occurs on another part of the sub-regions of the plurality of sub-regions.

FIG. 8 is a schematic illustration of a medical image display interface with a third event in a third region of some embodiments of the inventions. Referring to fig. 8, in fig. 8, the display interface 300 displays the first medical image 10 and the second medical image 20, and the mouse cursor 30 is located on the third area 330 (the outer area of the closed circle), and the mouse is pressed and dragged to the right, so that the first medical image 10 and the second medical image 20 can be translated to the right along with the mouse cursor 30. It is understood that the dragging operation of the mouse can be in any direction, and is not limited to the right direction shown in fig. 8.

FIG. 9 is a schematic illustration of a medical image display interface with a third event in a third region according to further embodiments of the invention. Referring to fig. 9, in fig. 9, the display interface 300 displays the first medical image 10 and the second medical image 20, the mouse cursor 30 is located on the upper left corner of the third region 330 (the outer region of the closed circle), and the mouse is pressed and dragged in the direction B shown in the figure, so that the first medical image 10 and the second medical image 20 can rotate clockwise around a certain center following the mouse cursor 30. It is understood that the dragging operation of the mouse can be in any direction, and is not limited to the direction B shown in fig. 9, but different dragging directions can rotate the first medical image 10 and the second medical image 20 in different directions, for example, if the dragging direction of the mouse is the reverse direction of the direction B, the first medical image 10 and the second medical image 20 can be rotated counterclockwise around a certain center along with the mouse cursor 30. In addition, the rotation direction of the first medical image 10 and the second medical image 20 may also be determined according to the position and the dragging direction of the mouse cursor 30 in the third area 330, for example, the mouse cursor is positioned at the upper left corner of the third area 330 and dragged to the right, so that the first medical image 10 and the second medical image 20 rotate clockwise around a certain center along with the mouse cursor 30, and the mouse cursor is positioned at the lower left corner of the third area 330 and dragged to the right, so that the first medical image 10 and the second medical image 20 rotate counterclockwise around a certain center along with the mouse cursor 30.

In some embodiments, similar to the click event and/or the long press event on the second region 320, the third region 330 may also be divided into a plurality of sub-regions that do not overlap with each other, and the click event and/or the long press event on different sub-regions are processed differently. For example, the third region 330 may also be divided into a left half and a right half, and the first and second

medical images

10 and 20 are translated to the left when a click event and/or a long-press event occurs on the left half, and the first and second

medical images

10 and 20 are translated to the right when a click event and/or a long-press event occurs on the right half. For another example, the third area 330 may also be divided into an upper half and a lower half, and the first medical image 10 and the second medical image 20 are translated upward when a click event and/or a long-press event occurs on the upper half, and the first medical image 10 and the second medical image 20 are translated downward when a click event and/or a long-press event occurs on the lower half. For another example, the third region 330 may be divided into nine-squares, as shown in fig. 10, the first and second medical images 10 and 20 are translated upward to the left when a click event and/or a long press event occurs on the upper left region 330a, the first and second medical images 10 and 20 are translated upward when a click event and/or a long press event occurs on the upper right region 330b, the first and second medical images 10 and 20 are translated upward to the right when a click event and/or a long press event occurs on the upper right region 330c, the first and second medical images 10 and 20 are translated leftward when a click event and/or a long press event occurs on the left region 330d, the first and second medical images 10 and 20 are translated rightward when a click event and/or a long press event occurs on the right region 330e, the first and second medical images 10 and 20 are translated downward to the left when a click event and/or a long press event occurs on the lower left region 330f, the first and second medical images 10 and 20 are translated downward when a click event and/or a long press event occurs on the lower region 330g, and the first and second medical images 10 and 20 are translated downward to the right when a click event and/or a long press event occurs on the lower right region 330 h.

In other embodiments, similar to the click event and/or the long press event on the first region 310, the third region 330 may also be divided into a plurality of sub-regions that do not overlap with each other, and the click event and/or the long press event on different sub-regions are processed differently. For example, the third region 330 may also be divided into a left half and a right half, and the first medical image 10 and the second medical image 20 are rotated clockwise when a click event and/or a long press event occurs on the left half, and the first medical image 10 and the second medical image 20 are rotated counterclockwise when a click event and/or a long press event occurs on the right half. For another example, the third area 330 may also be divided into an upper half and a lower half, and the first medical image 10 and the second medical image 20 are rotated clockwise when a click event and/or a long press event occurs on the upper half, and the first medical image 10 and the second medical image 20 are rotated counterclockwise when a click event and/or a long press event occurs on the lower half.

In other embodiments, the third region 330 may also be divided into a plurality of sub-regions that do not overlap with each other, and a click event and/or a long-press event on a part of the sub-regions may cause the first medical image 10 and the second medical image 20 to translate, and a click event and/or a long-press event on another part of the sub-regions may cause the first medical image 10 and the second medical image 20 to rotate. In a more specific embodiment, the third region 330 may be divided into nine squares, as shown in fig. 10, the first and second medical images 10 and 20 may be rotated clockwise when a click event and/or a long press event occurs on the upper left region 330a, the first and second medical images 10 and 20 may be translated upward when a click event and/or a long press event occurs on the upper right region 330b, the first and second medical images 10 and 20 may be rotated counterclockwise when a click event and/or a long press event occurs on the upper right region 330c, the first and second medical images 10 and 20 may be translated leftward when a click event and/or a long press event occurs on the left region 330d, the first and second medical images 10 and 20 may be translated rightward when a click event and/or a long press event occurs on the right region 330e, the first and second medical images 10 and 20 are rotated counterclockwise when a click event and/or a long press event occurs on the lower left region 330f, the first and second medical images 10 and 20 are translated downward when a click event and/or a long press event occurs on the lower region 330g, and the first and second medical images 10 and 20 are rotated clockwise when a click event and/or a long press event occurs on the lower right region 330 h.

Similar to the first event, the second event and the third event are suitable for performing a larger movement on the first medical image and/or the second medical image when the second event and the third event are drag events and/or long-press events, and are suitable for performing a smaller movement on the first medical image and/or the second medical image when the second event and the third event are click events.

As can be seen from the above description, when the medical image display interface 300 of the present invention is used to perform manual medical image registration, it is not necessary to switch the function back and forth and move out the image region, and it is only necessary to perform corresponding operations in the first region 310, the second region 320 and the third region 330, all the operations are performed in a small range, and the position of the image can be seen in real time and adjusted at any time, so the accuracy and speed of manual medical image registration can be greatly improved.

Implementing the method described above in a computer device, a medical image display apparatus may be implemented, comprising a memory for storing instructions executable by a processor; a processor for executing the instructions to implement the methods as described in the embodiments above.

The methods described above may be implemented as a computer-readable storage medium having stored thereon computer instructions, which when executed by a processor, perform the methods as described in the embodiments above.

Having thus described the basic concept, it will be apparent to those skilled in the art that the foregoing disclosure is by way of example only, and is not intended to limit the present application. Various modifications, improvements and adaptations to the present application may occur to those skilled in the art, although not explicitly described herein. Such modifications, improvements and adaptations are proposed in the present application and thus fall within the spirit and scope of the exemplary embodiments of the present application.

Also, this application uses specific language to describe embodiments of the application. Reference throughout this specification to "one embodiment," "an embodiment," and/or "some embodiments" means that a particular feature, structure, or characteristic described in connection with at least one embodiment of the present application is included in at least one embodiment of the present application. Therefore, it is emphasized and should be appreciated that two or more references to "an embodiment" or "one embodiment" or "an alternative embodiment" in various places throughout this specification are not necessarily all referring to the same embodiment. Furthermore, some features, structures, or characteristics of one or more embodiments of the present application may be combined as appropriate.

Moreover, those skilled in the art will appreciate that aspects of the present application may be illustrated and described in terms of several patentable species or situations, including any new and useful combination of processes, machines, manufacture, or materials, or any new and useful improvement thereon. Accordingly, various aspects of the present application may be embodied entirely in hardware, entirely in software (including firmware, resident software, micro-code, etc.) or in a combination of hardware and software. The above hardware or software may be referred to as "data block," module, "" engine, "" unit, "" component, "or" system. Furthermore, aspects of the present application may be represented as a computer product, including computer readable program code, embodied in one or more computer readable media.

A computer readable signal medium may comprise a propagated data signal with computer program code embodied therein, for example, on a baseband or as part of a carrier wave. The propagated signal may take any of a variety of forms, including electromagnetic, optical, and the like, or any suitable combination. A computer readable signal medium may be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code on a computer readable signal medium may be propagated over any suitable medium, including radio, electrical cable, fiber optic cable, radio frequency signals, or the like, or any combination of the preceding.

Computer program code required for the operation of various portions of the present application may be written in any one or more programming languages, including an object oriented programming language such as Java, Scala, Smalltalk, Eiffel, JADE, Emerald, C + +, C #, VB.NET, Python, and the like, a conventional programming language such as C, Visual Basic, Fortran 2003, Perl, COBOL 2002, PHP, ABAP, a dynamic programming language such as Python, Ruby, and Groovy, or other programming languages, and the like. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer may be connected to the user's computer through any network format, such as a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet), or in a cloud computing environment, or as a service, such as a software as a service (SaaS).

Additionally, the order in which elements and sequences of the processes described herein are processed, the use of alphanumeric characters, or the use of other designations, is not intended to limit the order of the processes and methods described herein, unless explicitly claimed. While various presently contemplated embodiments of the invention have been discussed in the foregoing disclosure by way of example, it is to be understood that such detail is solely for that purpose and that the appended claims are not limited to the disclosed embodiments, but, on the contrary, are intended to cover all modifications and equivalent arrangements that are within the spirit and scope of the embodiments herein. For example, although the system components described above may be implemented by hardware devices, they may also be implemented by software-only solutions, such as installing the described system on an existing server or mobile device.

Similarly, it should be noted that in the preceding description of embodiments of the application, various features are sometimes grouped together in a single embodiment, figure, or description thereof for the purpose of streamlining the disclosure aiding in the understanding of one or more of the embodiments. This method of disclosure, however, is not intended to require more features than are expressly recited in the claims. Indeed, the embodiments may be characterized as having less than all of the features of a single embodiment disclosed above.

Numerals describing the number of components, attributes, etc. are used in some embodiments, it being understood that such numerals used in the description of the embodiments are modified in some instances by the use of the modifier "about", "approximately" or "substantially". Unless otherwise indicated, "about", "approximately" or "substantially" indicates that the number allows a variation of ± 20%. Accordingly, in some embodiments, the numerical parameters used in the specification and claims are approximations that may vary depending upon the desired properties of the individual embodiments. In some embodiments, the numerical parameter should take into account the specified significant digits and employ a general digit preserving approach. Notwithstanding that the numerical ranges and parameters setting forth the broad scope of the range are approximations, in the specific examples, such numerical values are set forth as precisely as possible within the scope of the application.

Although the present invention has been described with reference to the present specific embodiments, it will be appreciated by those skilled in the art that the above embodiments are merely illustrative of the present invention, and various equivalent changes and substitutions may be made without departing from the spirit of the invention, and therefore, it is intended that all changes and modifications to the above embodiments within the spirit and scope of the present invention be covered by the appended claims.

Claims

1. A medical image display method, adapted for medical image registration, comprising:

displaying the first medical image and the second medical image which are overlapped on a medical image display interface, wherein the display interface comprises a first area, a second area and a third area which are not overlapped with each other; and performing at least two of the following steps:

detecting a first event on the first area, rotating the first medical image or the second medical image according to the first event;

detecting a second event on the second region, translating the first medical image or the second medical image according to the second event;

detecting a third event on the third region, performing a translation, a rotation or a scaling of the first and second medical images according to the third event;

the first region is a closed ring, the second region is an inner region of the closed ring, the third region is an outer region of the closed ring, and the closed ring surrounds target regions of the first medical image and the second medical image.

2. The method of claim 1, wherein the rotating the first medical image or the second medical image according to the first event is rotating the first medical image or the second medical image around a center of the closed loop according to the first event.

3. The method of claim 1, wherein any of the first event, the second event, and the third event comprises a drag event, a click event, or a long press event.

4. The method of claim 3, wherein the drag event, the click event, or the long press event is triggered by one or more of a mouse, a touch component, and a trackball.

5. The method according to claim 1, wherein the first event comprises a click event and/or a long press event, the first region comprises a first sub-region and a second sub-region that do not overlap with each other, the first medical image or the second medical image is rotated in a first direction when the click event and/or the long press event occurs on the first sub-region, and the first medical image or the second medical image is rotated in a second direction when the click event and/or the long press event occurs on the second sub-region, the second direction being different from the first direction.

6. The method according to claim 1, wherein the second event comprises a click event and/or a long press event, the second region comprises a first sub-region and a second sub-region that do not overlap each other, when the click event and/or the long press event occurs on the first sub-region, the first medical image or the second medical image is translated in a first direction, and when the click event and/or the long press event occurs on the second sub-region, the first medical image or the second medical image is translated in a second direction, the second direction being different from the first direction.

7. The method according to claim 1, wherein the third event comprises a click event and/or a long press event, the third region comprises a first sub-region and a second sub-region that do not overlap each other, when the click event and/or the long press event occurs on the first sub-region, the first medical image and the second medical image are translated or rotated in a first direction, when the click event and/or the long press event occurs on the second sub-region, the first medical image and the second medical image are translated or rotated in a second direction, the second direction being different from the first direction.

8. The method according to claim 1, wherein the third event comprises a click event or a long press event, and the third region comprises a first sub-region and a second sub-region that do not overlap with each other, and wherein the first medical image and the second medical image are enlarged when the click event or the long press event occurs on the first sub-region, and the first medical image and the second medical image are reduced when the click event or the long press event occurs on the second sub-region.

9. The method of claim 1, wherein the first and second medical images are the same type of medical image.

10. The method of claim 1, wherein the first and second medical images are different types of medical images.

11. A medical image display apparatus comprising:

a memory for storing instructions executable by the processor;

a processor for executing the instructions to implement the method of any one of claims 1-10.

12. A computer readable storage medium having computer instructions stored thereon, wherein the computer instructions, when executed by a processor, perform the method of any of claims 1-10.