JP2021137273A - Image display device, image display program, and image display method - Google Patents

Abstract

To improve an operability in causing a series of medical images taken continuously to be displayed in an order opposite to the order that the images are taken.SOLUTION: An image display device (20) includes a control part (21) for controlling the display of a series of continuously captured medical images (IM01-IM04) on a display screen, and an operation part (22) for receiving an operation instruction by a user. When an operation instruction is input according to a specific operation (e.g., double click) to a specific operation part (e.g., folder ES01) of the operation part, the control part controls the display by bringing the display order of the series of medical images into an order (IM04-IM01) reverse to the imaging order.SELECTED DRAWING: Figure 7

Description

The present invention relates to the display of medical images.

Conventionally, with the spread of PACS (Picture Archiving and Communication System), images were taken with modalities such as CR (Computed Radiography), CT (Computed Tomography), MR (Magnetic Resonance), and MG (Mammography). The medical image is stored in the image server as a digital image.
The viewer on the client terminal displays the medical image provided by the server.

JP-A-2015-84890 JP-A-2017-191466 JP-A-2018-175366

By the way, usually, the image is taken from the bottom of the stomach to the throat with an endoscope.
However, in actual endoscopic interpretation, image interpretation is performed by displaying images in the order from the throat to the fundus.
That is, the order of the medical images displayed by interpretation is the reverse of the order in which the images were taken. Therefore, the diagnostician had to bother to change the display order, which was complicated.
Further, in the conventional viewer, the setting and operation of the display order are complicated.

Therefore, it is an object of the present invention to improve the operability of displaying a series of medical images taken continuously in the reverse order of the pictures taken.

An image display device of one embodiment of the present invention for solving the above problems includes a control unit that controls the display of a series of continuously captured medical images on a display screen, and an operation that receives an operation instruction by a user. When an operation instruction is input according to a specific operation for a specific operation unit of the operation unit, the control unit sets the display order of the series of medical images as the reverse order of the imaging order. Control the display.

According to the present invention, when displaying a series of continuously photographed medical images, it is possible to improve the operability of displaying the images in the reverse order of the images.

It is a system block diagram of a medical image display system. It is a block diagram which shows the functional structure of an image server. It is a block diagram which shows the functional configuration of a client terminal. It is a schematic diagram of a human body which shows an endoscopic image | position. It is a figure which shows the example of the display screen displayed on the display part of a client terminal. It is a figure which shows the example of the display screen displayed on the display part of a client terminal. It is a figure which shows the example of the display screen displayed on the display part of a client terminal.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

[System overview]
FIG. 1 shows the system configuration of the medical image display system 100. As shown in FIG. 1, in the medical image display system 100, an image server 10, a client terminal 20 as an image display device, and a modality 30 communicate data via a communication network N such as a LAN (Local Area Network). It is configured to be connected as possible. The DICOM standard is applied to the communication network N.

The image server 10 is configured by PACS, stores image data files (hereinafter referred to as image files) of medical images generated by various modalities 30, and responds to a request from an external device such as a client terminal 20. Provide image files, etc. The image file is generated in a format conforming to the DICOM standard, and is composed of image data of a medical image and a header. Ancillary information about the medical image is stored in the header.

FIG. 2 shows the functional configuration of the image server 10. As shown in FIG. 2, the image server 10 includes a CPU (Central Processing Unit) 11, an operation unit 12, a display unit 13, a communication unit 14, a ROM (Read Only Memory) 15, a RAM (Random Access Memory) 16, and a storage unit. 17 is provided, and each part is connected by a bus 18.

The CPU 11 comprehensively controls the processing operation of each part of the image server 10. Specifically, the C PU 11 reads various processing programs stored in the ROM 15 in response to an operation signal input from the operation unit 12 or an instruction signal received by the communication unit 14, and is formed in the RAM 16. Deploy to the work area and perform various processes in collaboration with the program.

The operation unit 12 is configured to include a keyboard equipped with cursor keys, number input keys, various function keys, and a pointing device such as a mouse, and outputs an operation signal input by a key operation on the keyboard or a mouse operation to the CPU 11. do.

The display unit 13 is configured to include, for example, a monitor such as a CRT (Cathode Ray Tube) or an LCD (Liquid Crystal Display), and displays various screens based on display data input from the CPU 11.

The communication unit 14 is an interface for transmitting and receiving data to and from an external device such as a client terminal 20.
The ROM 15 is composed of a non-volatile semiconductor memory or the like, and stores a control program, parameters and files necessary for executing the program, and the like.

The RAM 16 forms a work area for temporarily storing various programs, input or output data, parameters, and the like read from the ROM 15 in various processes whose execution is controlled by the CPU 11.

The storage unit 17 is composed of a hard disk or the like and stores various data. Specifically, the storage unit 17 stores the image DB (Data Base) 171. The image DB 171 stores image files of a plurality of medical images. The image file is transmitted from various modality 30s. Examples of the image file include an image file of an image in the digestive organ obtained by taking an image with an endoscope.

When the client terminal 20 requests the acquisition of the image data of the medical image or the incidental information of the medical image, the CPU 11 reads the requested image data of the medical image or the incidental information of the medical image from the image DB 171 of the storage unit 17. , Sent to the client terminal 20.

The client terminal 20 is a device for displaying a medical image based on the image data of the medical image acquired from the image server 10 and interpreting the medical image, and is composed of a PC (Personal Computer) or the like.

FIG. 3 shows the functional configuration of the client terminal 20. As shown in FIG. 3, the client terminal 20 includes a CPU 21, an operation unit 22, a display unit 23, a communication unit 24, a ROM 25, a RAM 26, and a storage unit 27, and each unit is connected by a bus 28.

The CPU 21 comprehensively controls the processing operation of each part of the client terminal 20. Specifically, the CPU 21 reads out various processing programs stored in the ROM 25 in response to an operation signal input from the operation unit 22 or an instruction signal received by the communication unit 24, and the work formed in the RAM 26. Expand to the area and perform various processes in collaboration with the program.

The operation unit 22 is a functional unit that receives an operation instruction by the user. The operation unit 22 is configured to include a keyboard equipped with cursor keys, number input keys, various function keys, and a pointing device such as a mouse, and outputs an operation signal input by key operation on the keyboard or mouse operation to the CPU 21. do. The operation unit 22 is realized in cooperation with the display unit 23 for operations such as arranging the pointer on the display screen at a specific position and performing one-click or double-click.

The display unit 23 is a monitor device composed of an LCD, and displays various screens based on display data input from the CPU 21. For example, the display unit 23 displays a medical image to be read.

The communication unit 24 is an interface for transmitting and receiving data to and from an external device such as an image server 10.

The ROM 25 is composed of a non-volatile semiconductor memory or the like, and stores a control program (including an image display program), parameters and files necessary for executing the program, and the like.

The RAM 26 forms a work area for temporarily storing various programs, input or output data, parameters, and the like read from the ROM 25 in various processes whose execution is controlled by the CPU 21.

The storage unit 27 is composed of a hard disk or the like and stores various data.

The CPU 21 transmits a request for acquiring the image data of the medical image or the incidental information of the medical image stored in the storage unit 17 to the image server 10 via the communication unit 24, and the image server 10 transmits the medical image. Acquire image data or incidental information of medical images.

The modality 30 takes an image of a patient's diagnosis target site as a subject, and digitally converts the photographed image to generate a medical image. The modality 30 is composed of, for example, an endoscope, a CR (Computed Radiography), an FPD (Flat Panel Detector), a CT (Computed Tomography), an MR (Magnetic Resonance), and the like. The modality 30 includes patient information (patient ID, patient name, gender, date of birth, age, etc.), image attribute information (UID, imaging date and time, examination ID, examination site, modality LUT, VOI LUT, etc.) in accordance with the DICOM standard. ) Etc. are written in the header of the image file of the medical image to attach the incidental information to the medical image.

[Control of display order]
Next, control of the display order of medical images on the client terminal 20 will be described.
Here, it is assumed that the modality 30 is used as an endoscope and medical images IM01, IM02, IM03, and IM04 are taken (examined) from the fundus toward the throat as shown in FIG. 4 (examination ID is "ES01"). do).
The modality 30 generates an image file of a medical image and stores it in the image server 10.
Log in to the PACS on the image server 10 from the client terminal 20 with the user ID.
The CPU 21 of the client terminal 20 transmits a request for acquiring an image file of a medical image stored in the storage unit 17 to the image server 10 via the communication unit 24, and the image file of the medical image is transmitted from the image server 10. To get.

5 to 7 show an example of a display screen of the viewer displayed on the display unit 23 of the client terminal 20. The display screen D includes a folder tree structure D1, a thumbnail image display area D2, a thumbnail image arrangement order change button D3, and a selected medical image display area D4. Thumbnail images D21 and D22 are displayed in the display area D2. In FIG. 5, one image display format is applied to the display area D4, and the selected medical image IM04 is displayed. In FIG. 6, a two-image display format is applied to the display area D4, and the selected medical images IM04 and IM03 are displayed. In FIG. 7, a 2 × 2 image display format is applied to the display area D4, and the selected medical images IM04, IM03, IM02, and IM01 are displayed.

The CPU 21 displays the tree structure D1 of the folder stored in the image server 10 on the display unit 23. The tree structure D1 is for display purposes and does not necessarily indicate the storage structure in the image server 10. As shown in FIG. 4, the tree structure D1 displays a storage folder ES01 for a series of medical images taken continuously.
It is assumed that the pointer P is placed on the folder ES01 and double-clicked by the operation using the user's pointing device.
In response to this, the CPU 21 controls the display of a series of medical images in the storage folder ES01 as an order opposite to the order in which the images were taken. That is, in the case of FIG. 5, the last photographed medical image IM04 is displayed in the display area D4, and the medical image IM03, the medical image IM02, and the medical image IM01 are sequentially displayed according to the next page feed operation. Examples of the next page feed operation include a one-click operation in the display area D4, a scroll operation, and an arrow key operation on the keyboard.

In the case of FIG. 6, the arrangement order with the left first is applied, the medical image IM04 is displayed on the left and the medical image IM03 is displayed on the right in the display area D4, and the medical image is displayed according to the next page feed operation. IM02 (displayed on the left) and medical image IM01 (displayed on the right) are displayed in sequence.
In the case of FIG. 7, the arrangement order in which the upper row is first and the left is first in the same row is applied and displayed. The same applies when there is a next page.

As described above, the CPU 21 sets the display order of the series of medical images in the predetermined arrangement order in one page when displaying a plurality of medical images in one page. As the predetermined arrangement order, it is preferable to apply an order that is easy for the user to understand from first to second.
Further, the CPU 21 sets the display order of the series of medical images in the page order when the series of medical images is displayed over a plurality of pages. For example, in FIG. 5, the first page is the medical image IM04, the second page is the medical image IM03, the third page is the medical image IM02, and so on.
When displaying a plurality of medical images on one page and displaying them over a plurality of pages, both of the above rules are applied. For example, in FIG. 6, the medical images IM04 (left) and IM03 are applied to the first page. (Right) The second page is the medical image IM02 (left), IM01 (right), and so on.

In the above display control, double-clicking on the storage folder ES01 corresponds to a specific operation for the specific operation unit. Specifically, it corresponds to double-clicking after arranging the pointer P on the display screen D on the specific area (storage folder ES01). The storage folder ES01 corresponds to the specific operation unit, and double-clicking corresponds to the specific operation. This operation is assigned to an operation instruction instructing that the display order of the series of medical images in the storage folder ES01 should be controlled in the reverse order of the shooting order.

Further, in order to improve operability, it is preferable that the specific operation is a one-step operation. The operation of one click first and then one click to select another area is a two-step operation, which complicates the operation.
As shown in FIGS. 5 to 7, the specific operation unit is preferably displayed in a window (display screen D) including the display area D4 of the medical image. This is because the operation becomes complicated when it is displayed for the first time by some operation.

When the storage folder ES01 is selected with one click, the CPU 21 sets the display order of the series of medical images to the same as the display order of the thumbnail images displayed in the display area D2. The display order of the thumbnail images displayed in the display area D2 is the shooting order or the reverse order of the shooting order.
In addition, the display order of a series of medical images is the order in which they were taken when the images were received / captured, the order in which they were captured, and the order in which they were selected by the operation of selecting thumbnail images. It may not be in the reverse order.
If there is a double-click operation on the storage folder ES01 when the order is not the reverse of the shooting order, the CPU 21 sets the display order of the series of medical images in the reverse order of the shooting order.

The following operations may be assigned instead of the above "double-click on the storage folder ES01".
The CPU 21 displays the operation button D5 on the display screen D, and when the pointer P is placed on the operation button D5 and one click is performed, the display order of the series of medical images is set to the reverse order of the shooting order. Control the display. The target folder is selected by clicking the storage folder ES01 once.
Therefore, when the storage folder ES01 is selected with one click, the CPU 21 displays a series of medical images in the order in which they were taken. Therefore, the medical image IM01 is displayed in the display area D4.
After that, if there is a double-click operation on the operation button D5, the CPU 21 sets the display order of the series of medical images in the reverse order of the shooting order.
Further, if there is a double-click operation on the operation button D5, the CPU 21 sets the display order of the series of medical images to the shooting order.

The above "one-click operation on the operation button D5" can be replaced with a touch to a specific area (operation button) on the touch screen, or a specific one hardware key can be pressed or a plurality of specific hardware can be pressed. It may be replaced with pressing the keys at the same time.
If the operation is as described above, the operability is good.

The operation unit 22 is capable of accepting an operation instruction for changing the display order of a series of medical images to a different order from the order in which the images are taken. As a specific example, in the display format of the plurality of images shown in FIG. 6 or 7, the order can be changed by dragging and dropping the medical images.

By this change operation, when the display order of the series of medical images is different from the order opposite to the shooting order, the CPU 21 receives a series of operation instructions for the specific operation unit described above when the operation instruction by the specific operation is input. The display order of the medical images is controlled as the reverse order of the images taken. That is, the CPU 21 rearranges the display order in the reverse order of the shooting order.
When the specific operation for the specific operation unit is "double-click on the storage folder ES01", it is as follows.
When the display order of a series of medical images is different from the order in which they were taken, if there is a double-click operation on the storage folder ES01, the CPU 21 takes a picture of the display order of the series of medical images. The order is the reverse of the order in which they were created.
The same applies to "one-click operation on the operation button D5" and the like.

The CPU 21 controls to display thumbnail images D21 and D22 of a series of medical images on the display screen D in a predetermined arrangement order. For example, the thumbnail images D21, D22 ... Are displayed in the display area D2 in the order in which they were photographed.
On the other hand, the CPU 21 controls the display order of the series of medical images IM01, IM02 ... Corresponding to the original images for the thumbnail images D21, D22 ... Independently and non-interlockingly from the arrangement order of the thumbnail images.
That is, when the CPU 21 controls the display order of the medical images in the display area D4, the CPU 21 does not control the display order of the thumbnail images D21, D22 ... In the display area D2 in conjunction with this. The display order of the medical images in the display area D4 is not reflected in the display order of the thumbnail images in the display area D2.
Therefore, the operation of selecting from the thumbnail images is not complicated.

The operation unit 22 can accept an operation instruction for changing the arrangement order of the thumbnail images. Specifically, each time the pointer P is placed on the button D3 for changing the arrangement order of the thumbnail images and one click is made, the ascending order to the descending order and the descending order to the ascending order can be switched.
Also in this case, the display order in the display area D4 is not linked. The display order of the thumbnail images in the display area D2 is not reflected in the display order of the medical images in the display area D4.
Therefore, the interpretation of the medical image through the display area D4 is not complicated.

It is possible to set whether or not to assign the operation instruction of "display in the reverse order of shooting" to a specific operation for a specific operation unit such as "double-click on the storage folder ES01". This setting is possible on the image server 10. Therefore, the CPU 11 provides a setting selection means (such as a radio button on a dialog box) to the system administrator via the operation unit 12, and controls according to the setting selection via the operation unit 12. For example, when assigning "Display in the reverse order of shooting" to "Double-click on the storage folder ES01", it is as described above, but when not assigning this (do not check the radio box), , Even if you double-click on the storage folder ES01, the display order is not controlled at all.
When setting in the image server 10, the setting may be enabled uniformly regardless of the user ID, or one or a plurality of user IDs may be specified and set.

Further, the above setting may be possible at the client terminal 20. Therefore, the CPU 21 provides a setting selection means (such as a radio button on a dialog box) to the user via the operation unit 22, and controls according to the setting selection via the operation unit 22 from the user. In this case, the settings may be uploaded from the client terminal 20 to the image server 10 as information corresponding to the user ID of the logged-in user. By logging in based on the user ID, the image server 10 transmits the information related to the setting to the client terminal 20, and the setting becomes valid on the client terminal 20. Even if the terminal changes, the settings for each user ID are reflected and convenience is improved.

As described above, according to the present embodiment, when displaying a series of continuously photographed medical images, it is possible to improve the operability of displaying the images in the reverse order of the images.

The control of the display order in which the order is reversed from the order in which the images are taken may be applied only to the display of a specific type of medical image. For example, it may be applied only to endoscopic images and not to other types of images.
In this case, the CPU 21 displays the series of medical images only when the series of medical images is a specific type of medical image when an operation instruction is input in response to a specific operation on the specific operation unit of the operation unit 22. The display is controlled so that the order is the reverse of the shooting order.

The description in the above embodiment is an example of the image display device according to the present invention, and is not limited thereto. The detailed configuration and detailed operation of each part constituting the device can be appropriately changed without departing from the spirit of the present invention.

Some of the functions of the CPU 21 in the above embodiment may be realized in collaboration with the CPU of the image server 10.

Further, in the above embodiment, the case where the endoscopic image of the upper digestive organ is used as the medical image has been described, but the imaging site is not limited to the upper digestive organ and the imaging means is not limited to the endoscope. , Other parts, or other imaging means.

In the above description, an example in which the ROM is used as a computer-readable medium in which a program for executing each process is stored has been disclosed, but the present invention is not limited to this example. As other computer-readable media, non-volatile memory such as flash memory and portable recording media such as CD-ROM can be applied. Further, a carrier wave may be applied as a medium for providing program data via a communication line.

10 image server 11 CPU
12 Operation unit 13 Display unit 14 Communication unit 17 Storage unit 20 Client terminal 21 CPU
22 Operation unit 23 Display unit 24 Communication unit 27 Storage unit 30 Modality 100 Medical image display system D Display screen D1 Tree structure D2 Thumbnail image display area D21, D22 ... Thumbnail image D3 Change button D4 Medical image display area D5 Operation Button (specific area)
ES01 Medical image storage folder (specific area)
IM01 Medical image IM02 Medical image IM03 Medical image IM04 Medical image N Communication network P pointer

Claims (10)

A control unit that controls the display of a series of medical images taken continuously on the display screen,
It is equipped with an operation unit that receives operation instructions from the user.
When an operation instruction is input to the specific operation unit of the operation unit, the control unit controls the display of the series of medical images in the reverse order of the imaging order. Device. The operation unit
The specific operation for the specific operation unit is one-click or double-click after arranging the pointer on the display screen on the specific area, or touching the specific area on the touch screen, or a specific one. The image display device according to claim 1, wherein one hardware key is pressed or a plurality of specific hardware keys are pressed at the same time. The image display device according to claim 1 or 2, wherein the control unit sets the display order to a predetermined arrangement order within one page when displaying a plurality of medical images on one page. The image display device according to claim 1, claim 2 or claim 3, wherein the control unit uses the display order as the page order when the series of medical images are displayed over a plurality of pages. The operation unit can accept an operation instruction to change the display order to a different order from the shooting order.
When the display order is different from the order in which the images are taken, the control unit receives the operation instruction by the specific operation for the specific operation unit by the operation unit, and the control unit receives the series of medical images. The image display device according to any one of claims 1 to 4, wherein the display order of the above is controlled as the reverse order of the shooting order. The control unit controls to display thumbnail images of the series of medical images on a display screen in a predetermined arrangement order.
The image according to any one of claims 1 to 5, wherein the display order of the series of medical images corresponding to the original image with respect to the thumbnail image is controlled independently of the arrangement order of the thumbnail images in a non-linked manner. Display device. The image display device according to claim 6, wherein the operation unit is capable of receiving an operation instruction for changing the arrangement order of the thumbnail images. When an operation instruction is input to the specific operation unit of the operation unit, the control unit displays the series of medical images only when the series of medical images is a specific type of medical image. The image display device according to any one of claims 1 to 7, wherein the display is controlled in the reverse order of the shooting order. A program for operating a computer as a control unit that controls the display of a series of medical images taken continuously on a display screen and an operation unit that receives an operation instruction by a user.
When an operation instruction is input to the specific operation unit of the operation unit, the control unit controls the display of the series of medical images in the reverse order of the imaging order. program. It is an image display method that accepts operation instructions from the user and controls the display of a series of medical images taken continuously on the display screen.
An image display method in which, when an operation instruction by a specific operation is input to a specific operation unit, the display order of the series of medical images is controlled as the reverse order of the shooting order.

Images