CN117369913A - Image display method, image display device, storage medium, and image display apparatus - Google Patents
Image display method, image display device, storage medium, and image display apparatus Download PDFInfo
- Publication number
- CN117369913A CN117369913A CN202210772426.3A CN202210772426A CN117369913A CN 117369913 A CN117369913 A CN 117369913A CN 202210772426 A CN202210772426 A CN 202210772426A CN 117369913 A CN117369913 A CN 117369913A
- Authority
- CN
- China
- Prior art keywords
- image
- window
- information
- identifier
- determining
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 55
- 238000003384 imaging method Methods 0.000 claims abstract description 75
- 230000008859 change Effects 0.000 claims description 50
- 238000004590 computer program Methods 0.000 claims description 9
- 230000009286 beneficial effect Effects 0.000 abstract description 2
- 238000010586 diagram Methods 0.000 description 18
- 230000008569 process Effects 0.000 description 15
- 238000002604 ultrasonography Methods 0.000 description 8
- 230000004048 modification Effects 0.000 description 7
- 238000012986 modification Methods 0.000 description 7
- 238000003745 diagnosis Methods 0.000 description 5
- 238000001514 detection method Methods 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 238000002595 magnetic resonance imaging Methods 0.000 description 3
- 238000002591 computed tomography Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000007689 inspection Methods 0.000 description 2
- 238000004891 communication Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04845—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Software Systems (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The present application provides a method for displaying an image, comprising the following steps: arranging and displaying the first window and the second window according to the set window layout; when the image display information of the first window is obtained, determining an image identifier corresponding to the image display information; the image identifier comprises an object identifier and an image playing time identifier; and acquiring the associated image information of the same imaging object in the time corresponding to the image playing time identifier from the image data association table according to the image identifier. The method and the device can realize image synchronization between the first window and the second window, facilitate graph reading of the user and improve graph reading efficiency of the user. The application also provides an image display device, a computer readable storage medium and an image display apparatus, which have the beneficial effects.
Description
Technical Field
The present disclosure relates to the field of display control technologies, and in particular, to a method and a system for displaying a medical image in a picture, and a related device.
Background
In clinic, it is often necessary to view and analyze the inspection images of different modalities simultaneously to provide the medical staff with inspection image information to help complete diagnosis and treatment. Of course, a dual-mode image is usually synthesized and then output to a display for display, so that the picture-in-picture position is fixed, the main screen and the sub-screen images are difficult to synchronize, the image reading is not facilitated, and the medical staff can use the images in serious condition.
Disclosure of Invention
The invention aims to provide a picture-in-picture display method, a system, a computer readable storage medium and image display equipment for medical images, which can facilitate the image reading of a user, help medical staff to quickly acquire key information in image information and improve the image reading efficiency of the user.
In order to solve the above technical problems, the present application provides an image display method, which specifically includes the following steps:
arranging and displaying the first window and the second window according to the set window layout;
when the image display information of the first window is obtained, determining an image identifier corresponding to the image display information; the image identifier comprises an object identifier and an image playing time identifier;
acquiring associated image information of the same imaging object in the time corresponding to the image playing time identifier from an image data association table according to the image identifier;
and displaying the corresponding associated image in the second window according to the associated image information.
Optionally, the image data association table includes association information between images in the first imaging mode and the second imaging mode;
the obtaining, from the image data association table, associated image information of the same imaging object under the time corresponding to the image playing time identifier according to the image identifier includes:
If the image under the first imaging mode is displayed in the first window, acquiring the imaging information of the same imaging object under the second imaging mode from an image data association table according to the image identification;
and determining associated image information under the time corresponding to the image playing time identifier in the image imaging information under the second imaging mode.
Optionally, when the image display information of the first window is obtained, determining an image identifier corresponding to the image display information includes:
when a playing instruction for playing the image is received, determining an object identifier corresponding to the playing instruction;
determining a first image corresponding to the object identifier, displaying the first image in the first window, and playing the first image;
and determining an image frame of the first image which is being played at the current moment, and determining the image playing time identifier according to the image frame which is being played.
Optionally, the method further comprises:
if a layout adjustment event is detected, determining a target window aimed at by the layout adjustment event; the target window is at least one of the first window and the second window;
And adjusting the target window according to the layout adjustment event.
Optionally, the layout adjustment event includes: at least one of a window movement event, a window zoom event, and an image zoom event;
the adjusting the target window according to the layout adjustment event includes:
if the layout adjustment event is a window movement event, determining a window movement instruction corresponding to the window movement event; the window moving instruction carries the position information and/or moving instruction information of the target window in the display screen; moving the target window according to the information carried by the window moving instruction;
if the layout adjustment event is a window scaling event, determining a window scaling instruction corresponding to the window scaling event; the window scaling instruction carries size information and a fixed point of a target window in a display interface; adjusting the size of the target window by taking the fixed point as the center according to the size information carried by the window scaling instruction;
if the layout adjustment event is an image scaling event, determining an image scaling instruction corresponding to the image scaling event; the image scaling instruction carries the size information of the image in the target window; and keeping the size of the target window unchanged, and scaling the image in the target window according to the size information carried in the image scaling instruction.
Optionally, the layout adjustment event includes a window scaling event;
after the target window is adjusted according to the layout adjustment event, the method further comprises:
when the target window is enlarged according to the window scaling event, the target window exceeds a display area of a display interface;
and reducing the enlarged target window according to the size of the display area so that the reduced target window is suitable for the display area.
Optionally, the method further comprises:
when an image closing instruction is detected, adding a current window layout into a window layout record, wherein the current window layout comprises the position information of the current first window and the second window and is used for being displayed when an image interface is subsequently entered;
correspondingly, the step of arranging and displaying the first window and the second window according to the set window layout comprises the following steps:
acquiring historical position information corresponding to window layout when the last image is closed from the window layout record;
and arranging and displaying the first window and the second window according to the historical position information.
Optionally, the method further comprises:
when an image change instruction is acquired through a control interface, determining a changed record corresponding to the image change instruction from an image record list;
Determining a first window image corresponding to the changed record and a second window image associated with the first window image respectively;
and respectively displaying the first window image and the second window image in the first window and the second window.
Optionally, when the image change instruction is obtained through the control interface, determining a record after change corresponding to the image change instruction from the image record list includes:
when an image change instruction is acquired through an icon control in a control interface, if the image change instruction contains an object change identifier, determining an image record list of an imaging object which is changed corresponding to the object change identifier from an image record list as a changed record; if the image change instruction comprises an image switching mark, determining an image record corresponding to the image switching mark in an image record list of the same imaging object from the image record list as a changed record;
when an image change instruction is obtained through a text control in a control interface, determining a changed record matched with a text in the text control from an image record list;
And when an image change instruction is acquired through a thumbnail control in a control interface, determining a changed record matched with the thumbnail index in the thumbnail control from an image record list.
The application also provides an image display device, comprising:
the window display module is used for arranging and displaying the first window and the second window according to the set window layout;
the image identification determining module is used for determining an image identification corresponding to the image display information when the image display information of the first window is acquired; the image identifier comprises an object identifier and an image playing time identifier;
the associated image determining module is used for acquiring associated image information of the same imaging object in the time corresponding to the image playing time identifier from an image data association table according to the image identifier;
and the associated image display module is used for displaying the corresponding associated image in the second window according to the associated image information.
The present application also provides a computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements the steps of the method as described above.
The application also provides an image display device comprising a memory and a processor, wherein the memory stores a computer program, and the processor realizes the steps of the method when calling the computer program in the memory.
According to the image display method, after the first window and the second window are displayed, when the image display information exists in the first window, the associated image information of the same imaging object under the time corresponding to the image playing time identifier can be obtained from the image data association table through the image identifier, and the image display information is displayed and played in the second window, so that the first window and the second window can display the image information corresponding to the image playing time of the same imaging object, the image reading of a user is facilitated, the medical staff can obtain key information in the image information quickly, and the image reading efficiency of the user is improved.
The medical image picture-in-picture display system, the computer readable storage medium and the image display device provided by the application have the beneficial effects and are not repeated here.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings that are required to be used in the embodiments or the description of the prior art will be briefly described below, and it is obvious that the drawings in the following description are only embodiments of the present application, and that other drawings may be obtained according to the provided drawings without inventive effort to a person skilled in the art.
FIG. 1 is a flowchart of an image display method according to an embodiment of the present disclosure;
FIG. 2 is a schematic diagram of a PIP window layout according to an embodiment of the present disclosure;
FIG. 3 is a schematic diagram of another PIP window layout provided in an embodiment of the present application;
FIG. 4 is a schematic diagram of a window movement event operation provided in an embodiment of the present application;
FIG. 5 is a schematic diagram of window movement event and window scaling event operations provided in an embodiment of the present application;
FIG. 6 is a schematic diagram of a PIP window layout according to an embodiment of the present disclosure;
FIG. 7 is a flowchart of an image data modification process according to an embodiment of the present disclosure;
FIG. 8 is a schematic diagram of a preferred icon control provided in an embodiment of the present application;
FIG. 9 is a schematic diagram of a preferred text control provided by embodiments of the present application;
FIG. 10 is a schematic diagram of a preferred thumbnail control provided in an embodiment of the present application;
FIG. 11 is a schematic diagram of an integrated control provided in an embodiment of the present application;
fig. 12 is a schematic structural diagram of an image display device according to an embodiment of the present application.
Detailed Description
For the purposes of making the objects, technical solutions and advantages of the embodiments of the present application more clear, the technical solutions of the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is apparent that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments, which can be made by one of ordinary skill in the art without undue burden from the present disclosure, are within the scope of the present disclosure.
The image display method provided by the embodiment of the application can be applied to an application scene comprising image display equipment and medical equipment. The image display device and the medical device are in network connection communication. Further, the medical device may be used to acquire medical images in different modes, for example, may be an ultrasound endoscope device, which is used to acquire ultrasound images in an ultrasound mode and endoscope images in an endoscope mode. Furthermore, the medical device can be one device or a plurality of devices, and can acquire medical images in different modes and communicate with the image display device. Specifically, the image display device arranges a first window and a second window in the display screen, acquires the associated images from the medical device, and displays the associated images under different modes in the first window and the second window respectively.
In some imaging scenarios, the imaging display device and the medical device may be integrated on one device, for example by an ultrasound endoscopic device with a display screen.
Referring to fig. 1, fig. 1 is a flowchart of an image display method according to an embodiment of the present application, and the method is described below as applied to an image display device, and includes:
S101: arranging and displaying the first window and the second window according to the set window layout;
the step aims at displaying the first window and the second window according to the set window layout. The window layout setting process is not limited herein, and may be a history window layout or a window layout customized by a user.
In a preferred implementation manner of this step, when the image closing instruction is detected in advance, the current window layout may be added to the window layout record, where the current window layout includes position information of the current first window and the second window, for displaying when the image interface is subsequently entered.
Optionally, when the image playing instruction is received, historical position information corresponding to the window layout when the last image is closed can be obtained from the window layout record, so that the first window and the second window are arranged and displayed according to the historical position information, and then the related images are played in the first window and the second window.
The first window in this step may refer to any one of two play windows existing in the same play interface. In particular, in the manner of displaying the picture-in-picture, the first window may be the main window or the sub window. That is, the first window and the second window may be windows of different window sizes, and of course, may be windows of the same size. Optionally, one of the windows may be displayed in association with an image displayed by the other window, for example, the second window is displayed in association with an image displayed by the first window, where the first window is referred to as a main window.
In addition, for window layout, there may or may not be a partial window overlap of the first window and the second window. If the picture-in-picture display mode is adopted and the second window is a smaller window, the second window may be partially or completely located above the first window at this time.
S102: when the image display information of the first window is obtained, determining an image identifier corresponding to the image display information;
the image display information is information related to image display of a window, and may include an image identifier of a displayed image, a start display time of the image, an end display time of the image, and the like.
The step aims at determining the image identification of the image display information when the image display information of the first window is detected. The image identifier is not specifically limited herein, and at least includes an object identifier and an image playing time identifier. The object identifier (may also be referred to as an imaging object identifier) refers to an identifier of a detected object in the image display information, that is, an identifier of the imaging object, for example, may be an identifier of a detected patient. The image playing time identifier is an associated identifier for indicating the playing progress of the image display information in the first window, and includes, but is not limited to, playing time, playing progress bar, playing frame number, and the like.
When a playing instruction for playing the image is received, determining an object identifier corresponding to the playing instruction, namely determining the object identifier of an imaging object in the playing instruction, determining a first image corresponding to the object identifier, displaying the first image in a first window, and playing. Meanwhile, in order to determine the image identifier corresponding to the image display information, the image frame of the first image being played at the current moment can be determined, and the image playing time identifier of the first image is determined according to the image frame being played. The first image in this step represents the image display information played in the first window. The implementation manner of determining the first image corresponding to the object identifier may be: and acquiring an image obtained by imaging and scanning the detected object corresponding to the object identifier as a first image. The medical image of the corresponding patient can be acquired as the first image.
One possible implementation manner may preset a default display channel, for example, determine the first window as the main window, and when receiving an image playing instruction for a certain image, display the image in the first window according to the display channel.
S103: acquiring associated image information of the same imaging object in the time corresponding to the image playing time identifier from an image data association table according to the image identifier;
in this step, the associated image information of the same imaging object needs to be determined in the image data association table, and the image display information in the first window corresponds to the image playing time identifier between the associated image information and the image display information.
The specific content of the image data association table is not limited herein, and it at least includes an object identifier and image data related to the object identifier. It should be noted that the same patient may include several image data. In addition, other relevant information, such as the acquired position, imaging mode, frame frequency, and other relevant information of the image, may be included in the image data association table. In addition, the storage location of the image data association table is not limited, and it may be stored in a cloud database or a local database. When the background image data association table is set in the cloud database, the device for displaying the image should have a direct connection or an indirect connection with the cloud database.
In a preferred implementation manner, the image data association table may include association information between images in at least two imaging modes, that is, the image data association table may include imaging information of images in different imaging modes of the same imaging object. Further, the image data association table includes association information between images in the first imaging mode and the second imaging mode. Such as endoscopic images (endoscopic images) and corresponding ultrasound images, i.e. image imaging information belonging to different imaging modalities.
When the step is executed, if the image under the first imaging mode is displayed in the first window, the image imaging information of the same imaging object under the second imaging mode can be acquired from the image data association table according to the image identifier, and then the associated image information under the time corresponding to the image playing time identifier is determined in the image imaging information under the second imaging mode. Optionally, when the image data association table includes association information between images in three or more imaging modes, after displaying a corresponding image (the image is an image in the first imaging mode) in the first window, an image in an imaging mode with a higher priority may be determined from the remaining imaging modes, and the image in the second imaging mode is further displayed in the second window. Further, when the first imaging modality is an ultrasound modality and the remaining imaging modalities are an endoscope modality, a CT (Computed Tomography, electronic computed tomography) modality, an MRI (Magnetic Resonance Imaging ) modality, and are prioritized as follows: the endoscope modality > CT modality > MRI modality, so the endoscope modality can be determined as the second imaging modality.
The step also needs to perform correspondence of image playing time identification on the image display information in the first window and the associated image in the second window. In the medical detection process, when the same part is detected in different modes, for example, an endoscope image and an ultrasonic image are synchronously displayed by utilizing the first window and the second window, so that diagnosis and treatment can be quickly performed.
It should be noted that, for the image display information and the associated image information that are synchronously detected, only the same or corresponding playing time is required to be maintained. For the patient image and the related image detected asynchronously, the time of playing the detected image of the same part may have a time difference, and the related image may be adjusted according to the image playing time identifier of the image display information played in the first window, so that the two images keep the same time difference.
In a preferred implementation manner, the related image information may be acquired first, and then the consistency of the image playing time identifier between the first window and the second window may be maintained through the synchronization time axis. The synchronization time axis may interact between the first window and the second window, i.e. the user may apply the same video playback time identification to either window by adjusting the synchronization time axis.
An exemplary image data association table may be shown in table 1 below, table 1 being an image data association table:
table 1 an image data association table
S104: and displaying the corresponding associated image in the second window according to the associated image information.
After the associated image information is determined, the associated image information may be directly displayed within the second window. The related images can be automatically displayed in the second window after the display of the first window is affected, namely, the display of the two windows is realized through one-time display control. At this time, the first window and the second window may correspond to the same display channel.
In an alternative embodiment, the first window and the second window may also correspond to different display channels, that is, the display playing of the first window and the second window are independently controlled, but the images displayed by the first window and the second window have an association relationship.
After the first window and the second window are displayed, when the first window has image display information, the image data association table can be used for acquiring the associated image information of the same imaging object under the time corresponding to the image playing time identifier through the image identifier of the first window, and the second window is displayed and played, so that the first window and the second window can display the image information corresponding to the image playing time of the same imaging object, the image reading of a user is facilitated, the medical staff can acquire key information in the image information quickly, and the image reading efficiency of the user is improved.
The method and the device can be applied to any display device, host, handheld display device or other image display devices capable of playing image data, and a user can play image display information on the first window through operation. Taking a host as an example, after entering an image interface, a user can select a certain part of image data of a certain object identifier to be in a main window, at this time, the step is executed to determine the associated image of the same patient in a background image data association table, and as the associated image may have multiple types of images, the user can select one of the images to play, or can automatically play the associated image with the same characteristic as the image of the patient, for example, the associated image with the same part or the same image time, and the user can flexibly select the associated image played by switching the sub-window.
Currently, in a special image display process, for example, a picture-in-picture co-screen display process, whether the first window or the second window is in a fixed state, the user cannot change the display position of the first window or the second window. As shown in fig. 2 and 3, fig. 2 is a schematic diagram of a window layout in a picture in picture, and fig. 3 is a schematic diagram of a window layout in a picture in picture, according to an embodiment of the present application. In both fig. 2 and fig. 3, the first window is used as a larger main window, and the second window is used as a smaller sub-window. Therefore, in both fig. 2 and fig. 3, the second window covers the image of the partial area of the first window, which is easy to interfere with the image reading of the medical staff, and at this time, the layout adjustment can be performed on the first window or the second window. If the layout adjustment event is detected, determining a target window aimed by the layout adjustment event, wherein the target window is at least one of the first window and the second window, and at this time, the target window can be adjusted according to the layout adjustment event. Further, the layout adjustment event may be an adjustment event automatically determined based on the sizes of the first window, the second window, and the display area, so that the shielding area of the first window and the second window is minimum or the shielding area of the key image content in the windows is minimum; the layout adjustment event may be an adjustment event corresponding to an input of the user. That is, the adjustment may be automatic or manual.
Several ways of adjusting the target window provided in the embodiments of the present application are described below:
1. if the layout adjustment event is a window movement event, determining a window movement instruction corresponding to the window movement event, and moving the target window according to information carried by the window movement instruction.
The target window is at least one of the first window and the second window, and generally, for simplifying the operation, the use requirement of medical staff can be met by only moving one of the first window and the second window at a time. And when confirming that the layout adjustment event is a window movement event, determining a corresponding window movement instruction. The window movement event is not limited herein as to how it is determined, and may be considered to occur, for example, if a related instruction or operation involving a change in window position is detected.
The window moving instruction carries the position information and/or moving instruction information of the target window in the display screen.
The window movement event may be a movement event that continues to be received externally. That is, the initial movement of the user can be regarded as the generation of the window movement event, and if the user continuously moves the first window or the second window, the continuous generation of the window movement event is maintained. If the window moving instruction carries the position information, for example, the information such as the position coordinates directly input by the user through the keyboard, the touch screen and other operable devices, the target window can be directly moved to the position where the position information is located. Of course, the process defaults to having established the corresponding positional coordinate correspondence in advance. If the window moving instruction carries moving instruction information, the moving instruction information can be sent by a user through any operable device such as a keyboard, a mouse, a touch screen and the like, and can also be generated by recognizing a voice operation instruction sent by the user through voice recognition equipment or a voice recognition system. The movement instruction information mainly includes a movement distance and a movement direction, and it is of course easy to understand that the movement distance cannot exceed the screen display range.
It should be further noted that, referring to fig. 4, fig. 4 is a schematic view of a window movement event operation provided in the embodiment of the present application, and the second window is typically overlaid on the first window, that is, the second window may be arbitrarily moved onto the page of the first window. Referring to fig. 5, fig. 5 is an operation schematic diagram of a window moving event and a window scaling event provided in the embodiment of the present application, where in a moving process of a second window, a first window frame size may be scaled, or the first window frame size may be kept unchanged, so that a frame display position is moved. For example, if the display screen is just full in the normal display state of the first window, if the user needs to enlarge and display a certain part, the translation of the display content of the first window can be performed after the enlargement. If the first window is not zoomed in or the display content is enlarged, the gray scale area can be set in the non-content display area when the first window is moved.
On the basis of the embodiment, the window position fixing can be set for the first window or the second window, so that the display of the other window is not influenced when any window moves. Or after the layout adjustment is performed on one window, the other window can be automatically adjusted according to the same adjustment mode.
The embodiment can move the first window or the second window when the window moving event is detected, can effectively avoid the picture display of the first window of the second window image, is convenient for the medical staff to read the pictures,
2. if the layout adjustment event is a window scaling event, determining a window scaling instruction corresponding to the window scaling event, and adjusting the size of the target window by taking the fixed point as the center according to the size information carried by the window scaling instruction. Optionally, after the window is scaled, the image size within the window may be adaptively adjusted.
Because the positions of the current first window and the second window are fixed, the sizes of the pictures are also fixed, and even moving in the display mode that part of the second window occupies a larger area of the first window, for example, the second window occupies a 1/4 screen, the display of the first window is influenced. For this reason, on the basis of the above-described embodiments, as a preferred embodiment, the present embodiment aims at scaling the window sizes, including scaling the sizes of the first window and the second window.
When the zoom instruction is a window zoom instruction, the window zoom instruction can carry size information and a fixed point of the target window in the display interface. It should be noted that the fixation point may be not just one, but a fixation line obtained by combining a plurality of fixation points may be formed.
Then a fixed point in the window scaling instruction may be determined when window scaling is performed, scaling the target window and the imagery in the target window centered around the fixed point. The fixed point can be any vertex of the window or the center point of the window, the fixed point can be kept unchanged, the window is scaled by taking the fixed point as the center, and meanwhile, the image in the window is scaled down according to the scaling of the window. When the zoom operation is specifically performed, the user can control to drag the target window to be zoomed. In a feasible operation mode, if the target window is a second window and the second window is located at the left upper corner of the page of the first window, the left upper corner vertex is overlapped with the left upper vertex of the first window, the fixed point can be set as the left upper vertex of the window, and at the moment, the right lower vertex of the second window can be dragged to zoom the second window. Referring to fig. 5, when the window is scaled, the fixed point of the first window is actually the left short side of the first window, and only the right short side moves, so that window scaling is formed.
The second window may be further enlarged on the basis of the present embodiment, and it is easy to understand that the process is the inverse operation of the scaling operation, and those skilled in the art have the ability to implement the relevant operation of window enlargement on the basis of the scaling operation already disclosed above, which is not described herein. However, it should be noted that, if the target window is enlarged according to the window scaling event and then the target window exceeds the display area of the display interface, the enlarged target window may be reduced according to the size of the display area, so that the reduced target window is adapted to the display area.
The embodiment can realize the zooming of the window, thereby effectively avoiding the oversized second window from influencing the image reading of the user, being capable of freely controlling the size of the first window or the second window, being convenient for the user to amplify the detection details and improving the image reading efficiency.
3. If the layout adjustment event is an image scaling event, determining an image scaling instruction corresponding to the image scaling event; keeping the size of the target window unchanged, and scaling the image in the target window according to the size information carried in the image scaling instruction. The window display channel and the image display channel are independent, so that the window and the image can be independently controlled, and further, the image can be independently scaled.
The image scaling instruction carries the size information of the image in the target window, namely, when the image is scaled, the size of the target window is unchanged, and only the image in the window is scaled, namely, the image is scaled according to the size information of the image carried in the image scaling instruction, and the size of the window is not changed.
Similarly, on the basis of the present embodiment, the image in the target window may be amplified, and the process is similar to the above process, and will not be described herein.
According to the embodiment, the size of the target window is unchanged, only the image size is scaled or amplified, the user can conveniently amplify the detection details or realize global detection on the premise that the image reading of other windows is not affected, and the image reading efficiency is further improved.
In an alternative embodiment, in the process of image reading, diagnosis and treatment are often required to be performed by combining different medical image data, that is, the image data in the first window or the second window is often required to be changed, so, based on the above embodiment, referring to fig. 6, fig. 6 is a flowchart of an image data changing process provided in the embodiment of the present application, and as a preferred embodiment, the method may further include the following steps:
s201: when an image change instruction is acquired through a control interface, determining a changed record corresponding to the image change instruction from an image record list;
s202: determining a first window image corresponding to the changed record and a second window image associated with the first window image respectively;
s203: and respectively displaying the first window image and the second window image in the first window and the second window.
The embodiment aims at realizing the image change of the first window and the second window.
From the point of view of the association of the first window and the second window, this step mainly comprises two types of modification:
if the object identifier is not changed, only the image in the first window or the second window is changed, but the images displayed in the first window and the second window are the same patient or contain the same object identifier regardless of the change.
If the object identification is changed, only one of the first window or the second window may be changed at this time, for example, if auxiliary diagnosis and treatment are needed by combining case data of other patients, image data of the target patient may be displayed at the first window at this time, and image data of the existing case may be displayed at the second window, so as to help medical staff to diagnose. It is also possible that both the first window and the second window are subject to a change in identification, e.g. a medical staff member making a diagnosis of the next patient.
From the aspect of the modification, the modification of one window and the modification of both windows may be included. For example, if both windows are changed, the display content of the first window and the second window may be exchanged. If only one window is changed, only one window may be changed, for example, to other image data of the same object to be measured. At this time, the second window is used to display the related information of the detected object, as shown in fig. 7.
In addition, the embodiment of the present application may further add an operation interface to the first window instead of displaying the image data in the second window, so that the user may directly perform the operations of any one of the embodiments on the main interface (the first window) at the operation interface, for example, adjusting the playing progress of the image data of the main interface, generating a thumbnail of the image data of the main interface, providing a screenshot function of the main interface, a storage function of the main interface picture, and so on. Patient-related information may also be displayed in the second window for medical staff to diagnose.
Then, based on the present embodiment, a specific implementation manner may be:
when an image change instruction is acquired through an icon control in a control interface, if the image change instruction contains an object change identifier, determining an image record list of an imaging object corresponding to the object change identifier after change from the image record list, and taking the image record list as a record after change, wherein an image to be displayed can be determined from the image record list according to a certain mode, for example, a first image in the image record list can be taken as an image to be displayed; if the image change instruction comprises an image switching mark, determining an image record corresponding to the image switching mark in the image record list of the same imaging object from the image record list as a changed record;
when an image change instruction is obtained through a text control in a control interface, determining a changed record matched with a text in the text control from an image record list;
when an image change instruction is acquired through a thumbnail control in the control interface, a changed record matched with a thumbnail index in the thumbnail control is determined from the image record list.
If the image change instruction contains an object change identifier, the image change instruction indicates that the image information of other objects to be tested needs to be changed currently. If the image change instruction contains the image switching identification, the image change instruction indicates that the measured object is not required to be changed at present, but is changed into other image information of the same measured object. The image record list in this step includes at least one image record, and if a plurality of image records are included, the plurality of image records may be displayed and played sequentially according to a default order or a user execution order. Referring to fig. 8-10, fig. 8 is a schematic diagram of a preferred icon control provided by an embodiment of the present application, fig. 9 is a schematic diagram of a preferred text control provided by an embodiment of the present application, and fig. 10 is a schematic diagram of a preferred thumbnail control provided by an embodiment of the present application. Those skilled in the art may also employ icon controls, text controls, and thumbnail controls in other forms of structures based thereon, without limitation.
Of course, the above controls may be combined to facilitate the user to control, for example, refer to fig. 11, fig. 11 is a schematic diagram of an integrated control provided in the embodiment of the present application, and the user may quickly implement image change and switch through the space as shown in fig. 11.
The following describes a picture-in-picture display system for medical images according to embodiments of the present application, and the image display device described below and the image display method described above may be referred to correspondingly.
Referring to fig. 12, fig. 12 is a schematic structural diagram of an image display device according to an embodiment of the present application, and the present application further provides an image display device, including:
the window display module is used for arranging and displaying the first window and the second window according to the set window layout;
the image identification determining module is used for determining an image identification corresponding to the image display information when the image display information of the first window is acquired; the image identifier comprises an object identifier and an image playing time identifier;
the associated image determining module is used for acquiring associated image information of the same imaging object in the time corresponding to the image playing time identifier from an image data association table according to the image identifier;
and the associated image display module is used for displaying the corresponding associated image in the second window according to the associated image information.
In an embodiment, the image data association table includes association information between images in a first imaging mode and a second imaging mode;
The associated image determining module includes:
the association table obtaining unit is used for obtaining image imaging information of the same imaging object in the second imaging mode from the image data association table according to the image identification if the image in the first imaging mode is displayed in the first window;
and the image determining unit is used for determining associated image information under the time corresponding to the image playing time mark in the image imaging information under the second imaging mode.
In one embodiment, the image identifier determining module includes:
the object identification determining unit is used for determining an object identification corresponding to a playing instruction when the playing instruction for playing the image is received;
the first display unit is used for determining a first image corresponding to the object identifier, displaying the first image in the first window and playing the first image;
and the time mark determining unit is used for determining an image frame of the first image which is being played at the current moment and determining the image playing time mark according to the image frame which is being played.
In an embodiment, the method further comprises:
the layout adjustment module is used for determining a target window aimed at by the layout adjustment event if the layout adjustment event is detected; the target window is at least one of the first window and the second window; and adjusting the target window according to the layout adjustment event.
In an embodiment, the layout adjustment event comprises: at least one of a window movement event, a window scaling event, and an image scaling event, the layout adjustment module comprises:
a window movement sub-module, configured to determine a window movement instruction corresponding to the window movement event if the layout adjustment event is a window movement event; the window moving instruction carries the position information and/or moving instruction information of the target window in the display screen; moving the target window according to the information carried by the window moving instruction;
a window scaling sub-module, configured to determine a window scaling instruction corresponding to the window scaling event if the layout adjustment event is the window scaling event; the window scaling instruction carries size information and a fixed point of a target window in a display interface; adjusting the size of the target window by taking the fixed point as the center according to the size information carried by the window scaling instruction;
the image scaling sub-module is used for determining an image scaling instruction corresponding to the image scaling event if the layout adjustment event is the image scaling event; the image scaling instruction carries the size information of the image in the target window; and keeping the size of the target window unchanged, and scaling the image in the target window according to the size information carried in the image scaling instruction.
In an embodiment, further comprising:
and the window adjusting unit is used for reducing the enlarged target window according to the size of the display area when the target window exceeds the display area of the display interface after the target window is enlarged according to the window scaling event, so that the reduced target window is adapted to the display area.
In an embodiment, further comprising:
the layout recording module is used for adding the current window layout into a window layout record when an image closing instruction is detected, wherein the current window layout comprises the position information of the current first window and the second window and is used for being displayed when an image interface is subsequently entered;
correspondingly, the window display module is a module for acquiring historical position information corresponding to window layout when the last image is closed from the window layout record, and displaying the first window and the second window in a distributed mode according to the historical position information.
In an embodiment, further comprising:
the image changing module is used for determining changed records corresponding to the image changing instructions from the image record list when the image changing instructions are acquired through the control interface; determining a first window image corresponding to the changed record and a second window image associated with the first window image respectively; and respectively displaying the first window image and the second window image in the first window and the second window.
In one embodiment, the image changing module includes:
the first changing unit is used for determining an image record list of an imaging object after corresponding to the object change mark from the image record list as a changed record if the image change instruction contains the object change mark when the image change instruction is acquired through an icon control in a control interface; if the image change instruction comprises an image switching mark, determining an image record corresponding to the image switching mark in an image record list of the same imaging object from the image record list as a changed record;
the second changing unit is used for determining a changed record matched with the text in the text control from the image record list when an image changing instruction is acquired through the text control in the control interface;
and the third changing unit is used for determining changed records matched with the thumbnail indexes in the thumbnail controls from the image record list when the image changing instruction is acquired through the thumbnail controls in the control interface.
The present application also provides a computer-readable storage medium having stored thereon a computer program which, when executed, implements the steps provided by the above embodiments. The storage medium may include: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), a magnetic disk, or an optical disk, or other various media capable of storing program codes.
The application also provides an image display device, which can comprise a memory and a processor, wherein the memory stores a computer program, and the processor can realize the steps provided by the embodiment when calling the computer program in the memory. Of course, the image display device may also include various display screens, network interfaces, power supplies, and other components. Alternatively, the image display device may be an ultrasound device, an ultrasound endoscope device, an endoscope device, or the like.
In the description, each embodiment is described in a progressive manner, and each embodiment is mainly described by the differences from other embodiments, so that the same similar parts among the embodiments are mutually referred. The system provided by the embodiment is relatively simple to describe as it corresponds to the method provided by the embodiment, and the relevant points are referred to in the description of the method section.
Specific examples are set forth herein to illustrate the principles and embodiments of the present application, and the description of the examples above is only intended to assist in understanding the methods of the present application and their core ideas. It should be noted that it would be obvious to those skilled in the art that various improvements and modifications can be made to the present application without departing from the principles of the present application, and such improvements and modifications fall within the scope of the claims of the present application.
It should also be noted that in this specification, relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
Claims (12)
1. An image display method, comprising:
arranging and displaying the first window and the second window according to the set window layout;
when the image display information of the first window is obtained, determining an image identifier corresponding to the image display information; the image identifier comprises an object identifier and an image playing time identifier;
Acquiring associated image information of the same imaging object in the time corresponding to the image playing time identifier from an image data association table according to the image identifier;
and displaying the corresponding associated image in the second window according to the associated image information.
2. The image display method according to claim 1, wherein the image data association table includes association information between images in a first imaging mode and a second imaging mode;
the obtaining, from the image data association table, associated image information of the same imaging object under the time corresponding to the image playing time identifier according to the image identifier includes:
if the image under the first imaging mode is displayed in the first window, acquiring the imaging information of the same imaging object under the second imaging mode from an image data association table according to the image identification;
and determining associated image information under the time corresponding to the image playing time identifier in the image imaging information under the second imaging mode.
3. The method for displaying images according to claim 1, wherein when the image display information of the first window is obtained, determining the image identifier corresponding to the image display information includes:
When a playing instruction for playing the image is received, determining an object identifier corresponding to the playing instruction;
determining a first image corresponding to the object identifier, displaying the first image in the first window, and playing the first image;
and determining an image frame of the first image which is being played at the current moment, and determining the image playing time identifier according to the image frame which is being played.
4. The image display method according to claim 1, further comprising:
if a layout adjustment event is detected, determining a target window aimed at by the layout adjustment event; the target window is at least one of the first window and the second window;
and adjusting the target window according to the layout adjustment event.
5. The image display method according to claim 4, wherein the layout adjustment event comprises: at least one of a window movement event, a window zoom event, and an image zoom event;
the adjusting the target window according to the layout adjustment event includes:
if the layout adjustment event is a window movement event, determining a window movement instruction corresponding to the window movement event; the window moving instruction carries the position information and/or moving instruction information of the target window in the display screen; moving the target window according to the information carried by the window moving instruction;
If the layout adjustment event is a window scaling event, determining a window scaling instruction corresponding to the window scaling event; the window scaling instruction carries size information and a fixed point of a target window in a display interface; adjusting the size of the target window by taking the fixed point as the center according to the size information carried by the window scaling instruction;
if the layout adjustment event is an image scaling event, determining an image scaling instruction corresponding to the image scaling event; the image scaling instruction carries the size information of the image in the target window; and keeping the size of the target window unchanged, and scaling the image in the target window according to the size information carried in the image scaling instruction.
6. The image display method according to claim 4, wherein the layout adjustment event comprises a window scaling event;
after the target window is adjusted according to the layout adjustment event, the method further comprises:
when the target window is enlarged according to the window scaling event, the target window exceeds a display area of a display interface;
and reducing the enlarged target window according to the size of the display area so that the reduced target window is suitable for the display area.
7. The image display method according to any one of claims 1 to 6, further comprising:
when an image closing instruction is detected, adding a current window layout into a window layout record, wherein the current window layout comprises the position information of the current first window and the second window and is used for being displayed when an image interface is subsequently entered;
correspondingly, the step of arranging and displaying the first window and the second window according to the set window layout comprises the following steps:
acquiring historical position information corresponding to window layout when the last image is closed from the window layout record;
and arranging and displaying the first window and the second window according to the historical position information.
8. The image display method according to any one of claims 1 to 6, further comprising:
when an image change instruction is acquired through a control interface, determining a changed record corresponding to the image change instruction from an image record list;
determining a first window image corresponding to the changed record and a second window image associated with the first window image respectively;
and respectively displaying the first window image and the second window image in the first window and the second window.
9. The method according to claim 8, wherein when the image change instruction is acquired through the control interface, determining a post-change record corresponding to the image change instruction from the image record list includes:
when an image change instruction is acquired through an icon control in a control interface, if the image change instruction contains an object change identifier, determining an image record list of an imaging object which is changed corresponding to the object change identifier from an image record list as a changed record; if the image change instruction comprises an image switching mark, determining an image record corresponding to the image switching mark in an image record list of the same imaging object from the image record list as a changed record;
when an image change instruction is obtained through a text control in a control interface, determining a changed record matched with a text in the text control from an image record list;
and when an image change instruction is acquired through a thumbnail control in a control interface, determining a changed record matched with the thumbnail index in the thumbnail control from an image record list.
10. An image display device, comprising:
the window display module is used for arranging and displaying the first window and the second window according to the set window layout;
the image identification determining module is used for determining an image identification corresponding to the image display information when the image display information of the first window is acquired; the image identifier comprises an object identifier and an image playing time identifier;
the associated image determining module is used for acquiring associated image information of the same imaging object in the time corresponding to the image playing time identifier from an image data association table according to the image identifier;
and the associated image display module is used for displaying the corresponding associated image in the second window according to the associated image information.
11. A computer readable storage medium having stored thereon a computer program, which when executed by a processor performs the steps of the image display method according to any of claims 1-9.
12. An image display device comprising a memory and a processor, wherein the memory has a computer program stored therein, and wherein the processor, when calling the computer program in the memory, implements the steps of the image display method according to any one of claims 1-9.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210772426.3A CN117369913A (en) | 2022-06-30 | 2022-06-30 | Image display method, image display device, storage medium, and image display apparatus |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210772426.3A CN117369913A (en) | 2022-06-30 | 2022-06-30 | Image display method, image display device, storage medium, and image display apparatus |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117369913A true CN117369913A (en) | 2024-01-09 |
Family
ID=89404643
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210772426.3A Pending CN117369913A (en) | 2022-06-30 | 2022-06-30 | Image display method, image display device, storage medium, and image display apparatus |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117369913A (en) |
-
2022
- 2022-06-30 CN CN202210772426.3A patent/CN117369913A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US7061484B2 (en) | User-interface and method for curved multi-planar reformatting of three-dimensional volume data sets | |
| CN106569673B (en) | Display method and display equipment for multimedia medical record report | |
| KR101474768B1 (en) | Medical device and image displaying method using the same | |
| US20090129644A1 (en) | System and method for efficient workflow in reading medical image data | |
| US20080118237A1 (en) | Auto-Zoom Mark-Up Display System and Method | |
| JP2007117739A (en) | Method and device for supporting image diagnosis | |
| CN102668556A (en) | Medical support apparatus, medical support method, and medical support system | |
| JPWO2014034294A1 (en) | Image display device and medical image pickup device | |
| JP2005130928A (en) | Image display device, image display method, and program therefor | |
| JP2011078527A (en) | Medical image management device and medical image display device | |
| JP2008510247A (en) | Display system for mammography evaluation | |
| CN112585692A (en) | Medical system, medical device and medical method | |
| JP2008217294A (en) | Medical communication device using mobile terminal | |
| CN111430012A (en) | System and method for semi-automatically segmenting 3D medical images using real-time edge-aware brushes | |
| CN1671325B (en) | Medical image diagnostic apparatus | |
| JP2007087285A (en) | Apparatus for creating diagnostic reading report and client terminal | |
| JP2020081280A (en) | Image display control system, image display system, and image analyzing device | |
| WO2013114817A1 (en) | Image processing apparatus, image processing system, image processing method, and program | |
| CN117369913A (en) | Image display method, image display device, storage medium, and image display apparatus | |
| US20090244006A1 (en) | Information processing apparatus, image display control method thereof, and image display control program thereof | |
| JP2012016488A (en) | Medical image display device | |
| JP5262649B2 (en) | Medical image display apparatus and program | |
| JP7099064B2 (en) | Display control device, medical image display system and program | |
| US20070016018A1 (en) | Review mode graphical user interface for an ultrasound imaging system | |
| JP2004305551A (en) | Medical image diagnostic reading system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |